Reviewerly/exHarmony huggingface dataset:
A two-stage scheduler based on New Caledonian Crow Learning Algorithm and reinforcement learning strategy for cloud environment

Most studies on task scheduling in the cloud consider at most two or three objectives and hence the main motivation of this paper is to design the task scheduling problem by considering conflicting objectives (i.e., makespan, energy consumption, resources utilization, and security). The proposed algorithm consists of two stages (i.e., meta-scheduler and local-scheduler). In the meta-scheduler stage, the tasks are assigned to hosts based on their priorities, deadlines, and the power of hosts. In the local-scheduler stage, the optimal mapping between tasks and virtual machines is obtained with the proposed Parallel Reinforcement Learning Caledonian Crow (PRLCC). The proposed PRLCC is a combination of the New Caledonian Crow Learning Algorithm (NCCLA), Reinforcement Learning (RL), and parallel strategy. The RE is utilized to guide the agent's activity and provide a balance between intensification and diversification activities, whereas parallel strategy is employed to help agents for searching different directions of problems in the shortest time. The first experiment tries to evaluate the proposed PRLCC as a global optimizer by 20 test functions (i.e., 8 unimodal and 12 multimodal). The results demonstrate the PRLCC's robustness, efficiency, and stability. The second experiment compares the performance of the proposed scheduler with four scheduling algorithms. In a heavily (lightly) loaded system, it improves waiting time by 32.5% (1.4%), energy consumption by 81% (75%), and resource utilization by 7.5% (3.5%) on average compared to other methods, also guaranteed security by 65.5% (84%).
Decentralized Multi-UAV Path Planning Based on Two-Layer Coordinative Framework for Formation Rendezvous

Unmanned aerial vehicle (UAV) formation rendezvous path planning problem is one of the important research topics in multiple UAV (multi-UAV) coordinated path planning. Aiming at solving low computational efficiency and poor scalability of the traditional multi-UAV path planning method, the decentralized multi-UAV path planning method suitable for obstacle environments is proposed. Firstly, the UAV rendezvous path planning problem with constraints such as the kinematics of UAVs and collision-free constraints is modeled as a non-convex optimal control problem. To minimize formation rendezvous time and energy consumption, a two-layer coordinative framework is developed to solve this problem. In the coordination layer, relying only on the information of neighboring UAVs, each UAV in the decentralized communication graph negotiates the desired flight time using a consensus protocol to achieve coordination among UAVs. In the planning layer, the initial non-convex formation rendezvous path planning problem is decoupled into several sub-problems, which can be solved in parallel by path planners distributed on each UAV using sequential convex programming. Finally, numerical simulations are carried out to verify the effectiveness and scalability of the proposed method. The results show that this decentralized multi-UAV path planning method can handle the minimum-time rendezvous path planning problem and optimize the energy consumption in flight, and the computing time does not increase significantly with the enlargement of the UAV swarm. This decentralized framework scales well with the number of UAVs and can be applied for future urban flight and supplies delivery tasks.
KerGNNs: Interpretable Graph Neural Networks with Graph Kernels

Graph kernels are historically the most widely-used technique for graph classification tasks. However, these methods suffer from limited performance because of the hand-crafted combinatorial features of graphs. In recent years, graph neural networks (GNNs) have become the state-of-the-art method in downstream graph-related tasks due to their superior performance. Most GNNs are based on Message Passing Neural Network (MPNN) frameworks. However, recent studies show that MPNNs can not exceed the power of the Weisfeiler-Lehman (WL) algorithm in graph isomorphism test. To address the limitations of existing graph kernel and GNN methods, in this paper, we propose a novel GNN framework, termed Kernel Graph Neural Networks (KerGNNs), which integrates graph kernels into the message passing process of GNNs. Inspired by convolution filters in convolutional neural networks (CNNs), KerGNNs adopt trainable hidden graphs as graph filters which are combined with subgraphs to update node embeddings using graph kernels. In addition, we show that MPNNs can be viewed as special cases of KerGNNs. We apply KerGNNs to multiple graph-related tasks and use cross-validation to make fair comparisons with benchmarks. We show that our method achieves competitive performance compared with existing state-of-the-art methods, demonstrating the potential to increase the representation ability of GNNs. We also show that the trained graph filters in KerGNNs can reveal the local graph structures of the dataset, which significantly improves the model interpretability compared with conventional GNN models.
Live Free-Viewpoint Video in Immersive Media Production Over 5G Networks

5G is a key tool for the cloud-based wireless production of audio-visual contents. By providing higher throughput and lower latency than previous mobile network technologies, as well as flexible allocation of network resources, it enables that some content production pipelines, which are currently implemented using wired connectivity, are provided on top of a 5G network. This brings down production costs, reduces environmental impact and increases operational efficiency. In particular, live immersive production services, such as free-viewpoint video (FVV), can be provided in a much more efficient way. In this paper, we address the challenge of producing and streaming FVV services in real time through 5G networks. We have adapted a state-of-the-art FVV system to integrate it within a 5G architecture, using three key technological enablers: mmWave radio access network to support the uplink traffic requirements from FVV cameras, multi-access edge computing to run video processing algorithms with minimum latency, and end-to-end slicing to guarantee a sufficient quality of service (QoS) within the production pipeline. We have built a field trial over the production network of a telecommunication operator, including a mmWave pilot deployment, edge cloud processing, and remote content production, involving three different locations across Spain. We have measured the key performance indicators at the relevant parts of our trial deployment, showing that, with existing 5G technology, it is possible to achieve live FVV production, although with some limitations. We have also analyzed such limitations, obtaining some insights on how the next generation of 5G networks can overcome them to achieve higher quality of experience (QoE).
Research on Microvideo Character Perception and Recognition Based on Target Detection Technology

With the rapid development of the Internet short-video platform, microvideo is increasingly attracting users because of its small traffic and time period. However, the content of microvideo on the Internet is complex, with illegal information. This research is an improved algorithm based on target detection technology, aiming at the characteristics of difficult character recognition in microvideo. The algorithm combines Gabor wavelet transform algorithm and 2D principal component analysis (PCA) algorithm and makes full use of video perception technology to realize character recognition in microvideo. Through MATLAB simulation analysis, it can be seen that the accuracy of the optimization algorithm proposed in this paper is 86.34% and the recognition time is 34.28s. Compared with the traditional PCA algorithm and artificial neural network (ANN) algorithm, the optimization algorithm proposed in this paper has better recognition rate and recognition efficiency.
A Machine Learning based Approach to Detect the Ethereum Fraud Transactions with Limited Attributes

Ethereum smart contracts have recently received new commercial applications and a lot of attention from the scientific community.Ethereum eliminates the requirement for a trusted third party by allowing untrusted parties to expose contract details in computer code.Nonetheless, as online commerce grows, plenty of fraudulent activities, such as money laundering, bribery, and phishing, emerge as major threats to trade security.For correctly recognizing fraudulent transactions, this paper developed a Light Gradient Boosting Machine (LGBM) technique-based model.The modified LGBM model optimized the parameters of Light GBM using the Euclidean distant structured estimation approach.This paper also examines the performance of different popular models such as Random Forest (RF), Multi-Layer Perceptron (MLP), Logistic Regression, k-Nearest Neighbors (KNN), XGBoost, Support Vector Classification (SVC), and ADAboost with limited features and compares their performance metrics with the proposed model for Ethereum fraudulent activity classification.A comparative performance evaluation matrices scores of different popular models along with the proposed model demonstrated the applicability of the proposed approach.The modified LGBM algorithms and RF models demonstrate the best performance compared to other models with the highest accuracies, while the modified LGBM algorithm has a slightly superior performance of 99.17 percent compared to the RF model's 98.26 percent.
Optical Flow Based Object Movement Tracking

Object detection and tracking is one of the key tasks performed in video surveillance. The objects present in the area under surveillance is studied and analyzed with reference to the context. This plays a pivotal role in detecting and predicting anomalies based on the behavioral traits of objects observed under the surveillance region. Optical flow is one of the computer vision based approaches that is used for tracking the precise movement of objects. Several optical flow algorithms have been used to track and study the movement of objects. This work is motivated towards carrying out a thorough study different optical flow techniques and comparing the features of different optical flow approaches and implementing them for real time detection and tracking of objects in real time environment.
An Research to Enhance the Old Manuscript Resolution using Deep Learning Mechanism

In this paper we address the problem of enhancing the resolution of old manuscripts as these will deteriorate over time. The manuscripts are of at most importance as they may contain sensitive and important imformation.Hence digital processing techniques play a crucial role to improve the quality of the manuscripts. We propose a standard deep learning mechanism that is conventional neural network (CNN) to enhance image resolution which will help to increase resolution of old manuscript .It not only increases the resolution but also tries to identify missing content using digit recognizer. We also compare the efficiency of our approach with the existing image enhancing techniques.
Multilingual training for software engineering

Well-trained machine-learning models, which leverage large amounts of open-source software data, have now become an interesting approach to automating many software engineering tasks. Several SE tasks have all been subject to this approach, with performance gradually improving over the past several years with better models and training methods. More, and more diverse, clean, labeled data is better for training; but constructing good-quality datasets is time-consuming and challenging. Ways of augmenting the volume and diversity of clean, labeled data generally have wide applicability. For some languages (e.g., Ruby) labeled data is less abundant; in others (e.g., JavaScript) the available data maybe more focused on some application domains, and thus less diverse. As a way around such data bottlenecks, we present evidence suggesting that human-written code in different languages (which performs the same function), is rather similar, and particularly preserving of identifier naming patterns; we further present evidence suggesting that identifiers are a very important element of training data for software engineering tasks. We leverage this rather fortuitous phenomenon to find evidence that available multilingual training data (across different languages) can be used to amplify performance. We study this for 3 different tasks: code summarization, code retrieval, and function naming. We note that this data-augmenting approach is broadly compatible with different tasks, languages, and machine-learning models.
TAU: A framework for video-based traffic analytics leveraging artificial intelligence and unmanned aerial systems

Smart traffic engineering and intelligent transportation services are in increasing demand from governmental authorities to optimize traffic performance and thus reduce energy costs, increase the drivers’ safety and comfort, ensure traffic laws enforcement, and detect traffic violations. In this paper, we address this challenge, and we leverage the use of Artificial Intelligence (AI) and Unmanned Aerial Vehicles (UAVs) to develop an AI-integrated video analytics framework, called TAU (Traffic Analysis from UAVs), for automated traffic analytics and understanding. Unlike previous works on traffic video analytics, we propose an automated object detection and tracking pipeline from video processing to advanced traffic understanding using high-resolution UAV images. TAU combines six main contributions. First, it proposes a pre-processing algorithm to adapt the high-resolution UAV image as input to the object detector without lowering the resolution. This ensures an excellent detection accuracy from high-quality features, particularly the small size of detected objects from UAV images. Second, it introduces an algorithm for recalibrating the vehicle coordinates to ensure that vehicles are uniquely identified and tracked across the multiple crops of the same frame. Third, it presents a speed calculation algorithm based on accumulating information from successive frames. Fourth, TAU counts the number of vehicles per traffic zone based on the Ray Tracing algorithm. Fifth, TAU has a fully independent algorithm for crossroad arbitration based on the data gathered from the different zones surrounding it. Sixth, TAU introduces a set of algorithms for extracting twenty-four types of insights from the raw data collected. These insights facilitate the traffic understanding using curves, histograms, heatmaps, and animations. The present work presents a valuable added value for academic researchers and transportation engineers to automate the traffic video analytics process and extract useful insights to optimize traffic performance. TAU is a ready-to-use framework for any Transportation Engineer to better understand and manage daily road traffic (video demonstrations are provided here: https://youtu.be/wXJV0H7LviU and here: https://youtu.be/kGv0gmtVEbI). The source code is available at: https://github.com/bilel-bj/TAU.
Autotelic Agents with Intrinsically Motivated Goal-Conditioned Reinforcement Learning: A Short Survey

Building autonomous machines that can explore open-ended environments, discover possible interactions and build repertoires of skills is a general objective of artificial intelligence. Developmental approaches argue that this can only be achieved by autotelic agents: intrinsically motivated learning agents that can learn to represent, generate, select and solve their own problems. In recent years, the convergence of developmental approaches with deep reinforcement learning (RL) methods has been leading to the emergence of a new field: developmental reinforcement learning. Developmental RL is concerned with the use of deep RL algorithms to tackle a developmental problem— the intrinsically motivated acquisition of open-ended repertoires of skills. The self-generation of goals requires the learning of compact goal encodings as well as their associated goal-achievement functions. This raises new challenges compared to standard RL algorithms originally designed to tackle pre-defined sets of goals using external reward signals. The present paper introduces developmental RL and proposes a computational framework based on goal-conditioned RL to tackle the intrinsically motivated skills acquisition problem. It proceeds to present a typology of the various goal representations used in the literature, before reviewing existing methods to learn to represent and prioritize goals in autonomous systems. We finally close the paper by discussing some open challenges in the quest of intrinsically motivated skills acquisition.
An Energy and Carbon Footprint Analysis of Distributed and Federated Learning

Classical and centralized Artificial Intelligence (AI) methods require moving data from producers (sensors, machines) to energy hungry data centers, raising environmental concerns due to computational and communication resource demands, while violating privacy. Emerging alternatives to mitigate such high energy costs propose to efficiently distribute, or federate, the learning tasks across devices, which are typically low-power. This paper proposes a novel framework for the analysis of energy and carbon footprints in distributed and federated learning (FL). The proposed framework quantifies both the energy footprints and the carbon equivalent emissions for vanilla FL methods and consensus-based fully decentralized approaches. We discuss optimal bounds and operational points that support green FL designs and underpin their sustainability assessment. Two case studies from emerging 5G industry verticals are analyzed: these quantify the environmental footprints of continual and reinforcement learning setups, where the training process is repeated periodically for continuous improvements. For all cases, sustainability of distributed learning relies on the fulfillment of specific requirements on communication efficiency and learner population size. Energy and test accuracy should be also traded off considering the model and the data footprints for the targeted industrial applications.
Universal quantum circuits for quantum chemistry

Universal gate sets for quantum computing have been known for decades, yet no universal gate set has been proposed for particle-conserving unitaries, which are the operations of interest in quantum chemistry. In this work, we show that controlled single-excitation gates in the form of Givens rotations are universal for particle-conserving unitaries. Single-excitation gates describe an arbitrary $U(2)$ rotation on the two-qubit subspace spanned by the states $|01\rangle, |10\rangle$, while leaving other states unchanged -- a transformation that is analogous to a single-qubit rotation on a dual-rail qubit. The proof is constructive, so our result also provides an explicit method for compiling arbitrary particle-conserving unitaries. Additionally, we describe a method for using controlled single-excitation gates to prepare an arbitrary state of a fixed number of particles. We derive analytical gradient formulas for Givens rotations as well as decompositions into single-qubit and CNOT gates. Our results offer a unifying framework for quantum computational chemistry where every algorithm is a unique recipe built from the same universal ingredients: Givens rotations.
Multi-Task Fusion via Reinforcement Learning for Long-Term User Satisfaction in Recommender Systems

Recommender System (RS) is an important online application that affects billions of users every day. The mainstream RS ranking framework is composed of two parts: a Multi-Task Learning model (MTL) that predicts various user feedback, i.e., clicks, likes, sharings, and a Multi-Task Fusion model (MTF) that combines the multi-task outputs into one final ranking score with respect to user satisfaction. There has not been much research on the fusion model while it has great impact on the final recommendation as the last crucial process of the ranking. To optimize long-term user satisfaction rather than obtain instant returns greedily, we formulate MTF task as Markov Decision Process (MDP) within a recommendation session and propose a Batch Reinforcement Learning (RL) based Multi-Task Fusion framework (BatchRL-MTF) that includes a Batch RL framework and an online exploration. The former exploits Batch RL to learn an optimal recommendation policy from the fixed batch data offline for long-term user satisfaction, while the latter explores potential high-value actions online to break through the local optimal dilemma. With a comprehensive investigation on user behaviors, we model the user satisfaction reward with subtle heuristics from two aspects of user stickiness and user activeness. Finally, we conduct extensive experiments on a billion-sample level real-world dataset to show the effectiveness of our model. We propose a conservative offline policy estimator (Conservative-OPEstimator) to test our model offline. Furthermore, we take online experiments in a real recommendation environment to compare performance of different models. As one of few Batch RL researches applied in MTF task successfully, our model has also been deployed on a large-scale industrial short video platform, serving hundreds of millions of users.
The effect of digital marketing on value creation and customer satisfaction

The current research main purpose is to examine the effect of digital marketing on both value creation and customer satisfaction. The literature was reviewed for the relevant existing studies to address the knowledge gap that has not been fulfilled before by a proposed integrative model. A quantitative research approach was used in this study to investigate the hypothesized proposed model with a survey questionnaire to collect data from the sample of customers of telecommunication firms operating in Jordan. The instrument was developed and customized to achieve the research objectives. With a total of 315 valid and complete returned questionnaires, the research has analyzed the data collected by using the PLS-SEM approach to run the essential analysis procedures and test the hypothesized statements. The results showed a significant and positive effect of digital marketing on both value creation and customer satisfaction. The research would contribute to providing more understanding of the issues related to this topic and filling research gaps and provide some new knowledgeable and theoretical research implications.