OpenRaiser/Intern-Atlas huggingface dataset:
Hybrid Deep Reinforcement Learning and Planning for Safe and Comfortable Automated Driving
Venue: arXiv cs.RO 2022
Year: 2022

We present a novel hybrid learning method, HyLEAR, for solving the collision-free navigation problem for self-driving cars in POMDPs. HyLEAR leverages interposed learning to embed knowledge of a hybrid planner into a deep reinforcement learner to faster determine safe and comfortable driving policies. In particular, the hybrid planner combines pedestrian path prediction and risk-aware path planning with driving-behavior rule-based reasoning such that the driving policies also take into account, whenever possible, the ride comfort and a given set of driving-behavior rules. Our experimental performance analysis over the CARLA-CTS1 benchmark of critical traffic scenarios revealed that HyLEAR can significantly outperform the selected baselines in terms of safety and ride comfort.
Targeted Phishing Campaigns using Large Scale Language Models
Venue: arXiv cs.CL 2022
Year: 2022

In this research, we aim to explore the potential of natural language models (NLMs) such as GPT-3 and GPT-2 to generate effective phishing emails. Phishing emails are fraudulent messages that aim to trick individuals into revealing sensitive information or taking actions that benefit the attackers. We propose a framework for evaluating the performance of NLMs in generating these types of emails based on various criteria, including the quality of the generated text, the ability to bypass spam filters, and the success rate of tricking individuals. Our evaluations show that NLMs are capable of generating phishing emails that are difficult to detect and that have a high success rate in tricking individuals, but their effectiveness varies based on the specific NLM and training data used. Our research indicates that NLMs could have a significant impact on the prevalence of phishing attacks and emphasizes the need for further study on the ethical and security implications of using NLMs for malicious purposes.
Active Learning for Neural Machine Translation
Venue: arXiv cs.CL 2022
Year: 2022

The machine translation mechanism translates texts automatically between different natural languages, and Neural Machine Translation (NMT) has gained attention for its rational context analysis and fluent translation accuracy. However, processing low-resource languages that lack relevant training attributes like supervised data is a current challenge for Natural Language Processing (NLP). We incorporated a technique known Active Learning with the NMT toolkit Joey NMT to reach sufficient accuracy and robust predictions of low-resource language translation. With active learning, a semi-supervised machine learning strategy, the training algorithm determines which unlabeled data would be the most beneficial for obtaining labels using selected query techniques. We implemented two model-driven acquisition functions for selecting the samples to be validated. This work uses transformer-based NMT systems; baseline model (BM), fully trained model (FTM) , active learning least confidence based model (ALLCM), and active learning margin sampling based model (ALMSM) when translating English to Hindi. The Bilingual Evaluation Understudy (BLEU) metric has been used to evaluate system results. The BLEU scores of BM, FTM, ALLCM and ALMSM systems are 16.26, 22.56 , 24.54, and 24.20, respectively. The findings in this paper demonstrate that active learning techniques helps the model to converge early and improve the overall quality of the translation system.
Interaction design for socially assistive robots for people with developmental disabilities
Venue: arXiv cs.HC 2022
Year: 2022

Social robots, also known as service or assistant robots, have been developed to improve the quality of human life in recent years. Socially assistive robots (SAR) are a special type of social robots that focus on providing support through social interaction. The design of socially capable and intelligent robots can vary, depending on the target user groups. In this work, I assess the effect of socially assistive robots' roles, functions, and communication approaches in the context of a social agent providing service or companionship to users with developmental disabilities. In this thesis, I describe an exploratory study of interaction design for a socially assistive robot that supports people suffering from developmental disabilities. While exploring the impacts of visual elements to robot's visual interface and different aspects of robot's social dimension, I developed a series of prototypes and tested them through three user studies that included three residents with various function levels at a local group home for people with developmental disabilities. All user studies had been recorded for the following qualitative data analysis. Results show that each design factor played a different role in delivering information and in increasing engagement, and there are more aspects of HRI to consider besides robot's graphical user interface and speech, such as proxemics and robot's physical appearance and dimensions. I also note that some fundamental design principles that would work for ordinary users did not apply to our target user group. I conclude that socially assistive robots could benefit our target users and acknowledge that these robots were not suitable for certain scenarios based on the feedback from our users.
MERLIN: Multi-agent offline and transfer learning for occupant-centric energy flexible operation of grid-interactive communities using smart meter data and CityLearn
Venue: arXiv cs.LG 2022
Year: 2022

The decarbonization of buildings presents new challenges for the reliability of the electrical grid as a result of the intermittency of renewable energy sources and increase in grid load brought about by end-use electrification. To restore reliability, grid-interactive efficient buildings can provide flexibility services to the grid through demand response. Residential demand response programs are hindered by the need for manual intervention by customers. To maximize the energy flexibility potential of residential buildings, an advanced control architecture is needed. Reinforcement learning is well-suited for the control of flexible resources as it is able to adapt to unique building characteristics compared to expert systems. Yet, factors hindering the adoption of RL in real-world applications include its large data requirements for training, control security and generalizability. Here we address these challenges by proposing the MERLIN framework and using a digital twin of a real-world 17-building grid-interactive residential community in CityLearn. We show that 1) independent RL-controllers for batteries improve building and district level KPIs compared to a reference RBC by tailoring their policies to individual buildings, 2) despite unique occupant behaviours, transferring the RL policy of any one of the buildings to other buildings provides comparable performance while reducing the cost of training, 3) training RL-controllers on limited temporal data that does not capture full seasonality in occupant behaviour has little effect on performance. Although, the zero-net-energy (ZNE) condition of the buildings could be maintained or worsened as a result of controlled batteries, KPIs that are typically improved by ZNE condition (electricity price and carbon emissions) are further improved when the batteries are managed by an advanced controller.
Task-Guided IRL in POMDPs that Scales
Venue: arXiv cs.LG 2022
Year: 2022

In inverse reinforcement learning (IRL), a learning agent infers a reward function encoding the underlying task using demonstrations from experts. However, many existing IRL techniques make the often unrealistic assumption that the agent has access to full information about the environment. We remove this assumption by developing an algorithm for IRL in partially observable Markov decision processes (POMDPs). We address two limitations of existing IRL techniques. First, they require an excessive amount of data due to the information asymmetry between the expert and the learner. Second, most of these IRL techniques require solving the computationally intractable forward problem -- computing an optimal policy given a reward function -- in POMDPs. The developed algorithm reduces the information asymmetry while increasing the data efficiency by incorporating task specifications expressed in temporal logic into IRL. Such specifications may be interpreted as side information available to the learner a priori in addition to the demonstrations. Further, the algorithm avoids a common source of algorithmic complexity by building on causal entropy as the measure of the likelihood of the demonstrations as opposed to entropy. Nevertheless, the resulting problem is nonconvex due to the so-called forward problem. We solve the intrinsic nonconvexity of the forward problem in a scalable manner through a sequential linear programming scheme that guarantees to converge to a locally optimal policy. In a series of examples, including experiments in a high-fidelity Unity simulator, we demonstrate that even with a limited amount of data and POMDPs with tens of thousands of states, our algorithm learns reward functions and policies that satisfy the task while inducing similar behavior to the expert by leveraging the provided side information.
Decentralized cooperative perception for autonomous vehicles: Learning to value the unknown
Venue: arXiv cs.LG 2022
Year: 2022

Recently, we have been witnesses of accidents involving autonomous vehicles and their lack of sufficient information. One way to tackle this issue is to benefit from the perception of different view points, namely cooperative perception. We propose here a decentralized collaboration, i.e. peer-to-peer, in which the agents are active in their quest for full perception by asking for specific areas in their surroundings on which they would like to know more. Ultimately, we want to optimize a trade-off between the maximization of knowledge about moving objects and the minimization of the total volume of information received from others, to limit communication costs and message processing time. For this, we propose a way to learn a communication policy that reverses the usual communication paradigm by only requesting from other vehicles what is unknown to the ego-vehicle, instead of filtering on the sender side. We tested three different generative models to be taken as base for a Deep Reinforcement Learning (DRL) algorithm, and compared them to a broadcasting policy and a policy randomly selecting areas. In particular, we propose Locally Predictable VAE (LP-VAE), which appears to be producing better belief states for predictions than state-of-the-art models, both as a standalone model and in the context of DRL. Experiments were conducted in the driving simulator CARLA. Our best models reached on average a gain of 25% of the total complementary information, while only requesting about 5% of the ego-vehicle's perceptual field. This trade-off is adjustable through the interpretable hyperparameters of our reward function.
5G on the Farm: Evaluating Wireless Network Capabilities for Agricultural Robotics
Venue: arXiv cs.NI 2022
Year: 2022

Global food security is an issue that is fast becoming a critical matter in the world today. Global warming, climate change and a range of other impacts caused by humans, such as carbon emissions, sociopolitical and economical challenges (e.g. war), traditional workforce/labour decline and population growth are straining global food security. The need for high-speed and reliable wireless communication in agriculture is becoming more of a necessity rather than a technological demonstration or showing superiority in the field. Governments and industries around the world are seeing more urgency in establishing communication infrastructure to scale up agricultural activities and improve sustainability, by employing autonomous agri-robotics and agri-technologies. The work presented here evaluates the physical performance of 5G in an agri-robotics application, and the results are compared against 4G and WiFi6 (a newly emerging wireless communication standard), which are typically used in agricultural environments. In addition, a series of simulation experiments were performed to assess the ``real-time'' operational delay in critical tasks that may require a human-in-the-loop to support decision making. The results lead to the conclusion that 4G cannot be used in the agricultural domain for applications that require high throughput and reliable communication between robot and user. Moreover, a single wireless solution does not exist for the agricultural domain, but instead multiple solutions can be combined to meet the necessary telecommunications requirements. Finally, the results show that 5G greatly outperforms 4G in all performance metrics, and on average only 18.2ms slower than WiFi6 making it very reliable.
Deep leakage from gradients
Venue: arXiv cs.CR 2022
Year: 2022

With the development of artificial intelligence technology, Federated Learning (FL) model has been widely used in many industries for its high efficiency and confidentiality. Some researchers have explored its confidentiality and designed some algorithms to attack training data sets, but these algorithms all have their own limitations. Therefore, most people still believe that local machine learning gradient information is safe and reliable. In this paper, an algorithm based on gradient features is designed to attack the federated learning model in order to attract more attention to the security of federated learning systems. In federated learning system, gradient contains little information compared with the original training data set, but this project intends to restore the original training image data through gradient information. Convolutional Neural Network (CNN) has excellent performance in image processing. Therefore, the federated learning model of this project is equipped with Convolutional Neural Network structure, and the model is trained by using image data sets. The algorithm calculates the virtual gradient by generating virtual image labels. Then the virtual gradient is matched with the real gradient to restore the original image. This attack algorithm is written in Python language, uses cat and dog classification Kaggle data sets, and gradually extends from the full connection layer to the convolution layer, thus improving the universality. At present, the average squared error between the data recovered by this algorithm and the original image information is approximately 5, and the vast majority of images can be completely restored according to the gradient information given, indicating that the gradient of federated learning system is not absolutely safe and reliable.
A Low-Cost ISM-Band Multi-Transceiver Cognitive Radio
Venue: arXiv cs.NI 2022
Year: 2022

A Cognitive Radio is a type of Software-Defined Radio (SDR) that automatically detects available wireless spectrum and adjusts its physical hardware, modulation, or protocol parameters to obtain optimal throughput, latency, and range. Much of prior Cognitive Radio research and design has required expensive transceivers using licensed bands that are not openly available for use by unlicensed users. This thesis presents a low-cost hardware platform built from off-the-shelf components that utilizes free to use Industrial, Scientific, and Medical (ISM) bands, and implements a concurrent multi-spectrum point-to-point wireless protocol optimized for non-stationary devices. Performance metrics such as cost, latency, throughput, and range are measured and analyzed. Applications of such a wireless implementation are proposed and implemented, such as smart-city infrastructure that allows internet connectivity to inner-city users by providing Wi-Fi Access Points through mobile On-Board Unit (OBU) devices with uplinks delivered from stationary Roadside Unit (RSU) devices.
Deep learning approach for interruption attacks detection in LEO satellite networks
Venue: arXiv cs.CR 2022
Year: 2022

The developments of satellite communication in network systems require strong and effective security plans. Attacks such as denial of service (DoS) can be detected through the use of machine learning techniques, especially under normal operational conditions. This work aims to provide an interruption detection strategy for Low Earth Orbit (\textsf{LEO}) satellite networks using deep learning algorithms. Both the training, and the testing of the proposed models are carried out with our own communication datasets, created by utilizing a satellite traffic (benign and malicious) that was generated using satellite networks simulation platforms, Omnet++ and Inet. We test different deep learning algorithms including Multi Layer Perceptron (MLP), Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), Gated Recurrent Units (GRU), and Long Short-term Memory (LSTM). Followed by a full analysis and investigation of detection rate in both binary classification, and multi-classes classification that includes different interruption categories such as Distributed DoS (DDoS), Network Jamming, and meteorological disturbances. Simulation results for both classification types surpassed 99.33% in terms of detection rate in scenarios of full network surveillance. However, in more realistic scenarios, the best-recorded performance was 96.12% for the detection of binary traffic and 94.35% for the detection of multi-class traffic with a false positive rate of 3.72%, using a hybrid model that combines MLP and GRU. This Deep Learning approach efficiency calls for the necessity of using machine learning methods to improve security and to give more awareness to search for solutions that facilitate data collection in LEO satellite networks.
Sparse Coding in a Dual Memory System for Lifelong Learning
Venue: arXiv cs.NE 2022
Year: 2022

Efficient continual learning in humans is enabled by a rich set of neurophysiological mechanisms and interactions between multiple memory systems. The brain efficiently encodes information in non-overlapping sparse codes, which facilitates the learning of new associations faster with controlled interference with previous associations. To mimic sparse coding in DNNs, we enforce activation sparsity along with a dropout mechanism which encourages the model to activate similar units for semantically similar inputs and have less overlap with activation patterns of semantically dissimilar inputs. This provides us with an efficient mechanism for balancing the reusability and interference of features, depending on the similarity of classes across tasks. Furthermore, we employ sparse coding in a multiple-memory replay mechanism. Our method maintains an additional long-term semantic memory that aggregates and consolidates information encoded in the synaptic weights of the working model. Our extensive evaluation and characteristics analysis show that equipped with these biologically inspired mechanisms, the model can further mitigate forgetting.
The problem with AI consciousness: A neurogenetic case against synthetic sentience
Venue: arXiv cs.AI 2022
Year: 2022

Ever since the creation of the first artificial intelligence (AI) machinery built on machine learning (ML), public society has entertained the idea that eventually computers could become sentient and develop a consciousness of their own. As these models now get increasingly better and convincingly more anthropomorphic, even some engineers have started to believe that AI might become conscious, which would result in serious social consequences. The present paper argues against the plausibility of sentient AI primarily based on the theory of neurogenetic structuralism, which claims that the physiology of biological neurons and their structural organization into complex brains are necessary prerequisites for true consciousness to emerge.
TA-DA: Topic-Aware Domain Adaptation for Scientific Keyphrase Identification and Classification (Student Abstract)
Venue: arXiv cs.CL 2022
Year: 2022

Keyphrase identification and classification is a Natural Language Processing and Information Retrieval task that involves extracting relevant groups of words from a given text related to the main topic. In this work, we focus on extracting keyphrases from scientific documents. We introduce TA-DA, a Topic-Aware Domain Adaptation framework for keyphrase extraction that integrates Multi-Task Learning with Adversarial Training and Domain Adaptation. Our approach improves performance over baseline models by up to 5% in the exact match of the F1-score.
Super forecasting the technological singularity risks from artificial intelligence
Venue: arXiv cs.CY 2022
Year: 2022

The article forecasts emerging cyber-risks from the integration of AI in cybersecurity.
Introducing Political Ecology of Creative-Ai
Venue: arXiv cs.CY 2022
Year: 2022

This chapter introduces the perspective of political ecology to the application of artificial intelligence to artistic processes (Creative-Ai). Hence, the environmental and social impact of the development and employment of Creative-Ai are the focus of this text, when we consider them as part of an economic system that transforms artistic creation to a commodity. I first analyse specific Creative-Ai cases, and then conduct a speculation that takes Jacques Attali's writing on the role of music in society as a vantage point, and investigates the environmental and social consequences of an automatic composition network controlled by a large music streaming platform. Whereas the possibilities that emerge from Creative-Ai may be promising from an artistic perspective, its entanglement with corporate interest raises severe concerns. These concerns can only be addressed by a wide cross-sectoral alliance between research and arts that develops a critical perspective on the future directions of Creative-Ai.
Reduced order modelling using parameterized non-uniform boundary conditions in room acoustic simulations
Venue: arXiv cs.CE 2022
Year: 2022

Quick simulations for iterative evaluations of multi-design variables and boundary conditions are essential to find the optimal acoustic conditions in building design. We propose to use the reduced basis method (RBM) for realistic room acoustic scenarios where the surfaces have inhomogeneous acoustic properties, which enables quick evaluations of changing absorption materials for different surfaces in room acoustic simulations. The RBM has shown its benefit to speed up room acoustic simulations by three orders of magnitude for uniform boundary conditions. This study investigates the RBM with two main focuses, 1) various source positions in diverse geometries, e.g., square, rectangular, L-shaped, and disproportionate room. 2) Inhomogeneous surface absorption in 2D and 3D by parameterizing numerous acoustic parameters of surfaces, e.g., the thickness of a porous material, cavity depth, switching between a frequency independent (e.g., hard surface) and frequency dependent boundary condition. Results of numerical experiments show speedups of more than two orders of magnitude compared to a high fidelity numerical solver in a 3D case where reverberation time varies within one just noticeable difference in all the frequency octave bands.
Stroke-based Rendering: From Heuristics to Deep Learning
Venue: arXiv cs.CV 2022
Year: 2022

In the last few years, artistic image-making with deep learning models has gained a considerable amount of traction. A large number of these models operate directly in the pixel space and generate raster images. This is however not how most humans would produce artworks, for example, by planning a sequence of shapes and strokes to draw. Recent developments in deep learning methods help to bridge the gap between stroke-based paintings and pixel photo generation. With this survey, we aim to provide a structured introduction and understanding of common challenges and approaches in stroke-based rendering algorithms. These algorithms range from simple rule-based heuristics to stroke optimization and deep reinforcement agents, trained to paint images with differentiable vector graphics and neural rendering.