Reviewerly/exHarmony huggingface dataset:
DoRO: Disambiguation of Referred Object for Embodied Agents

Robotic task instructions often involve a referred object that the robot must locate (ground) within the environment. While task intent understanding is an essential part of natural language understanding, less effort is made to resolve ambiguity that may arise while grounding the task. Existing works use vision-based task grounding and ambiguity detection, suitable for a fixed view and a static robot. However, the problem magnifies for a mobile robot, where the ideal view is not known beforehand. Moreover, a single view may not be sufficient to locate all the object instances in the given area, which leads to inaccurate ambiguity detection. Human intervention is helpful only if the robot can convey the kind of ambiguity it is facing. In this article, we present DoRO ( <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><u>D</u>isambiguation <u>o</u>f <u>R</u>eferred <u>O</u>bject</i> ), a system that can help an embodied agent to disambiguate the referred object by raising a suitable query whenever required. Given an area where the intended object is, DoRO finds all the instances of the object by aggregating observations from multiple views while exploring & scanning the area. It then raises a suitable query using the information from the grounded object instances. Experiments conducted with the AI2Thor simulator show that DoRO not only detects the ambiguity more accurately but also raises verbose queries with more accurate information from the visual-language grounding.
URPI-GRU: An approach of next POI recommendation based on user relationship and preference information

Next POI (Point of Interest) recommendation aims to recommend next POI for users at specific time given users' historical check-ins. User relationship and preference information are important factors that can affect the user's decision-making behavior on the next POI. To this end, we propose an approach for the next POI recommendation based on user relationship and preference information, called URPI-GRU (User relationship and Preference information Gated Recurrent Unit). URPI-GRU contains two modules, short-term module and long-term module. First, we construct a user relationship graph and learn user relationship vectors. And then we divide the check-ins into current preference, periodic preference and long-term preference according to the user's check-in time. In the short-term module, the user's periodic preference and current preference are learned through the GRU model, and they are concatenated with the user relationship vector to learn the short-term scores of POIs. In the long-term module, the user's long-term preference is mined through the K-nearest neighbor sequences to obtain the long-term scores of the POIs. Last, we recommend the POIs based on the total score of short-term and long-term scores. Extensive experiments on two representative real-world datasets demonstrated that our model yields significant improvements over the state-of-the-art methods.
MiShape

We propose MiShape, a millimeter-wave (mmWave) wireless signal based imaging system that generates high-resolution human silhouettes and predicts 3D locations of body joints. The system can capture human motions in real-time under low light and low-visibility conditions. Unlike existing vision-based motion capture systems, MiShape is privacy non-invasive and can generalize to a wide range of motion tracking applications at-home. To overcome the challenges with low-resolution, specularity, and aliasing in images from Commercial-Off-The-Shelf (COTS) mmWave systems, MiShape designs deep learning models based on conditional Generative Adversarial Networks and incorporates the rules of human biomechanics. We have customized MiShape for gait monitoring, but the model is well adaptive to any tracking applications with limited fine-tuning samples. We experimentally evaluate MiShape with real data collected from a COTS mmWave system for 10 volunteers, with diverse ages, gender, height, and somatotype, performing different poses. Our experimental results demonstrate that MiShape delivers high-resolution silhouettes and accurate body poses on par with an existing vision-based system, and unlocks the potential of mmWave systems, such as 5G home wireless routers, for privacy-noninvasive healthcare applications.
YeSQL

The diversity and complexity of modern data management applications have led to the extension of the relational paradigm with syntactic and semantic support for User-Defined Functions (UDFs). Although well-established in traditional DBMS settings, UDFs have become central in many application contexts as well, such as data science, data analytics, and edge computing. Still, a critical limitation of UDFs is the impedance mismatch between their evaluation and relational processing. In this paper, we present YeSQL, an SQL extension with rich UDF support along with a pluggable architecture to easily integrate it with either server-based or embedded database engines. YeSQL currently supports Python UDFs fully integrated with relational queries as scalar, aggregator, or table functions. Key novel characteristics of YeSQL include easy implementation of complex algorithms and several performance enhancements, including tracing JIT compilation of Python UDFs, parallelism and fusion of UDFs, stateful UDFs, and seamless integration with a database engine. Our experimental analysis showcases the usability and expressiveness of YeSQL and demonstrates that our techniques of minimizing context switching between the relational engine and the Python VM are very effective and achieve significant speedups up to 68x in common, practical use cases compared to earlier approaches and alternative implementation choices.
Airlines’ Sustainability Study Based on Search Engine Optimization Techniques and Technologies

Digital marketing, especially search engine optimization (SEO), is an integral part of websites today. Airlines in the COVID-19 era have to use every possible means to survive despite the adverse conditions for both entrepreneurship and travel. Many of them have allocated resources and money to develop SEO strategies by applying SEO techniques to their websites to gain more visitors and bookings. Thus, this research is focused on analyzing airlines’ website presence as regards the implemented SEO techniques and their effect on airlines’ website traffic. In the first phase of the research, we gathered web data from 243 airline firms during a one-year observation period (December 2020–December 2021) using our own-developed tool. Furthermore, we proceeded to create an exploratory model using fuzzy cognitive mapping. From the technical SEO point of view and the descriptive analysis, we conclude that the traffic on airlines’ websites and, consequently, their sustainability are inseparably linked to the corresponding SEO techniques and technologies used.
Assessment on the source of geochemical anomalies in the sediments of the Changjiang river (China), using a modified enrichment factor based on multivariate statistical analyses

Rivers can be sinks for potential toxic elements (PTEs) inputted in their systems by both natural and anthropic processes. Many indices have been proposed to assess the contamination degree of sediments and the environmental conditions of surficial water bodies. Above all, enrichment factor (EF) is the most used tool, but also it is the most debated for its limitations. The need for a reference element and for a background/baseline composition makes the EF method dependent on the researcher's expertise, implying that its repeatability may not be granted. Starting from the awareness that geochemical processes, bringing to compositional changes in the environmental matrices, involve multiple elements rather than individual variables, we developed a modified EF (mEF) based on the use of elemental associations. Different multivariate statistical methods (i.e. Robust Principal Component Analysis and Fuzzy Clustering), in a compositional data analysis (CoDA) perspective, were used to set all the terms of the mEF. The mEF was applied to 101 sediment samples collected from a 2 m-long core, covering a sedimentation period of about 150 years (1850-2007), located in the lower Changjiang River (China). The method resulted effective in recognizing most of the signals proceeding from the main natural and anthropogenic events which affected the lower river basin in the considered timespan. The largest geochemical variations recorded fit well the flooding events occurred; besides, the effects produced on the system by the recent socio-economic development (following the end of the civil war in 1949 and the beginning of economic reforms in 1978) and the start-up of the Three Gorges Dam (the world's largest power station since 2012) were also intercepted. The proposed method represents a step forward to enhance the effectiveness of the EF in discriminating geochemical anomalies that may be significant to assess the human historical impact on the environment.
Instance difficulty-based noise correction for crowdsourcing

Crowdsourcing offers an efficient way to obtain a multiple noisy label set of each instance from different crowd workers and then label integration algorithms are used to infer its integrated label. In spite of the effectiveness of label integration algorithms, there always exists a certain degree of noise in the integrated labels, and thus noise correction algorithms have been proposed to reduce the effect of noise. However, existing noise correction algorithms seldom consider the effect of instance difficulty on noise correction. In this paper, we argue that the greater the difficulty of an instance, the fewer crowd workers can label it correctly, and the more likely the instance is a noise instance. Based on this premise, we propose a simple but very effective noise correction algorithm called instance difficulty-based noise correction (IDNC). In IDNC, we at first propose two methods to measure the difficulty of each instance. Then, we use the proposed two methods to filter the noise instances to obtain a clean set and a noise set. Finally, we build two different classifiers on the clean set to correct the noise instances in the noise set via the consensus voting. The extensive experiments on both simulated and real-world crowdsourced datasets validated the effectiveness and efficiency of our proposed IDNC.
A route network planning method for urban air delivery

High-tech giants and start-ups are investing in drone technologies to provide urban air delivery service, which is expected to solve the last-mile problem and mitigate road traffic congestion. However, air delivery service will not scale up without proper traffic management for drones in dense urban environment. Currently, a range of Concepts of Operations (ConOps) for unmanned aircraft system traffic management (UTM) are being proposed and evaluated by researchers, operators, and regulators. Among these, the tube-based (or corridor-based) ConOps has emerged in operations in some regions of the world for drone deliveries and is expected to continue serving certain scenarios that with dense and complex airspace and requires centralized control in the future. Towards the tube-based ConOps, we develop a route network planning method to design routes (tubes) in a complex urban environment in this paper. In this method, we propose a priority structure to decouple the network planning problem, which is NP-hard, into single-path planning problems. We also introduce a novel space cost function to enable the design of dense and aligned routes in a network. The proposed method is tested on various scenarios and compared with other state-of-the-art methods. Results show that our method can generate near-optimal route networks with significant computational time-savings.
Research on UAV cloud control system based on ant colony algorithm

In the cloud era, the control objects are becoming larger and the information processing is more complex, and it is difficult for traditional control systems to process massive data in a timely manner.In view of the difficulty of data processing in the cloud era, it is extremely important to perform massive data operations through cloud servers.Unmanned aeriel vehicle (UAV) control is the representative of the intelligent field.Based on the ant colony algorithm and incorporating the potential field method, an improved potential field ant colony algorithm is designed.To deal with the path planning problem of UAVs, the potential field ant colony algorithm shortens the optimal path distance by 6.7%, increases the algorithm running time by 39.3%, and increases the maximum distance by 24.1% compared with the previous improvement.The cloud server is used to process the path problem of the UAV and feedback the calculation results in real time.Simulation experiments verify the effectiveness of the new algorithm in the cloud environment.
Interpretable Machine Learning with Brain Image and Survival Data

Recent developments in research on artificial intelligence (AI) in medicine deal with the analysis of image data such as Magnetic Resonance Imaging (MRI) scans to support the of decision-making of medical personnel. For this purpose, machine learning (ML) algorithms are often used, which do not explain the internal decision-making process at all. Thus, it is often difficult to validate or interpret the results of the applied AI methods. This manuscript aims to overcome this problem by using methods of explainable AI (XAI) to interpret the decision-making of an ML algorithm in the use case of predicting the survival rate of patients with brain tumors based on MRI scans. Therefore, we explore the analysis of brain images together with survival data to predict survival in gliomas with a focus on improving the interpretability of the results. Using the Brain Tumor Segmentation dataset BraTS 2020, we used a well-validated dataset for evaluation and relied on a convolutional neural network structure to improve the explainability of important features by adding Shapley overlays. The trained network models were used to evaluate SHapley Additive exPlanations (SHAP) directly and were not optimized for accuracy. The resulting overfitting of some network structures is therefore seen as a use case of the presented interpretation method. It is shown that the network structure can be validated by experts using visualizations, thus making the decision-making of the method interpretable. Our study highlights the feasibility of combining explainers with 3D voxels and also the fact that the interpretation of prediction results significantly supports the evaluation of results. The implementation in python is available on gitlab as “XAIforBrainImgSurv”.
Enhanced Arabic Sentiment Analysis Using a Novel Stacking Ensemble of Hybrid and Deep Learning Models

Sentiment analysis (SA) is a machine learning application that drives people’s opinions from text using natural language processing (NLP) techniques. Implementing Arabic SA is challenging for many reasons, including equivocation, numerous dialects, lack of resources, morphological diversity, lack of contextual information, and hiding of sentiment terms in the implicit text. Deep learning models such as convolutional neural networks (CNN) and long short-term memory (LSTM) have significantly improved in the Arabic SA domain. Hybrid models based on CNN combined with long short-term memory (LSTM) or gated recurrent unit (GRU) have further improved the performance of single DL models. In addition, the ensemble of deep learning models, especially stacking ensembles, is expected to increase the robustness and accuracy of the previous DL models. In this paper, we proposed a stacking ensemble model that combined the prediction power of CNN and hybrid deep learning models to predict Arabic sentiment accurately. The stacking ensemble algorithm has two main phases. Three DL models were optimized in the first phase, including deep CNN, hybrid CNN-LSTM, and hybrid CNN-GRU. In the second phase, these three separate pre-trained models’ outputs were integrated with a support vector machine (SVM) meta-learner. To extract features for DL models, the continuous bag of words (CBOW) and the skip-gram models with 300 dimensions of the word embedding were used. Arabic health services datasets (Main-AHS and Sub-AHS) and the Arabic sentiment tweets dataset were used to train and test the models (ASTD). A number of well-known deep learning models, including DeepCNN, hybrid CNN-LSTM, hybrid CNN-GRU, and conventional ML algorithms, have been used to compare the performance of the proposed ensemble model. We discovered that the proposed deep stacking model achieved the best performance compared to the previous models. Based on the CBOW word embedding, the proposed model achieved the highest accuracy of 92.12%, 95.81%, and 81.4% for Main-AHS, Sub-AHS, and ASTD datasets, respectively.
Construction and Application of Piano to Intelligent Teaching System Based on Multi-Source Data Fusion

With the rapid development of modern information technology represented by the Internet, cloud computing and big data, education and teaching have gradually realized the deep integration of the Internet, which has changed people’s way of life, study and work to a certain extent. Intelligence [Formula: see text] education provides a new information-based teaching method for the development of education. From the perspective of improving the accuracy of data fusion results, this paper proposes a new multi-source data fusion method based on a set pair analysis connection degree for the situation that multiple sensors with unknown prior knowledge detect the same target feature parameters multiple times. By using the advantages of the set pair analysis feature function, the degree of opposition, the identity and difference between the measurement data are mined to adjust the degree of connection between the data. According to the existing signal-to-noise ratio weighting method in the fusion process, the weight of the measurement data is reasonably allocated to realize the weighted fusion of multi-source data, and the effectiveness and reliability of the algorithm are verified through simulation experiments. Through the summary of the questions, it can be seen that the learners are very satisfied with the mobile piano learning mode based on the intelligent teaching system, and they believe that this learning mode is conducive to the learner’s mastery of the basic knowledge of piano, and effectively improves the learners’ learning ability. It also improves the individual’s self-directed learning ability and academic performance. Through the research, it is concluded that the students’ piano mobile learning mode based on the intelligent teaching system is more conducive to the learner’s mastery of knowledge, and improves the learning interest and academic performance.
Pyramid Geometric Consistency Learning For Semantic Segmentation

Semantic segmentation is a critical in vision fields. Randomly transforms each image into different augmented samples and supervise the views with transformed semantics labels. However, even if the views are expanded from the same sample, the prediction results obtained by the same network will be very different. Therefore, we argue that between the augmented samples, the transformation-equivariance and the representational consistency also need to be supervised. Motivated by this, we propose a simple cross-data augmentation for semantic segmentation, in which we also leverage the pixel-level consistency constraint learning between pairs of augmented samples. As a result, our scheme significantly can improve the performances of existing semantic segmentation models without additional computation overhead. We verified the effectiveness of this method on Deeplab V3 Plus. Experiments show that our method can achieve stable performance improvement on mainstream data sets such as Pascal VOC 2012, Camvid, Cityscapes, etc.
DPNet: Detail-preserving image deraining via learning frequency domain knowledge

The quality of images captured in rainy days is severely degraded, which affects the accuracy of subsequent computer vision tasks. Recently, many deep learning-based methods have demonstrated superior performance for single image deraining. However, there are still many issues left. Since real-world rain images and their corresponding ground truths are difficult to collect, models trained on limited data may lead to overfitting. Meanwhile, although many methods can remove part of the rain streaks, most of them cannot reconstruct precise edges and textures. For the first issue, we use the transfer learning approach. Loading pre-trained parameters trained on the ImageNet enables the network to have robust feature representation, which improves the generalization of the network. For the second issue, we restore clear details by making full use of the frequency domain information of the image. Specifically, we design a novel frequency domain residual block (FRDB) and use an efficient fusion strategy in FRDB to fuse spatial and frequency domain features. Then, we propose a frequency domain reconstruction loss function (FDR loss) to restore details by reducing the differences in high-frequency space. Finally, a simple detail enhancement attention module (DEAM) is used to further enhance the image details. Extensive experimental results demonstrate that our DPNet has superior performance on both synthetic and real data. Furthermore, we verify the effectiveness of our method on downstream computer vision tasks. The source codes will be open at https://github.com/noxsine/DPNet.
Learning to localize image forgery using end-to-end attention network

Recent advancements have increased the prevalence of digital image tampering. Anyone can manipulate multimedia content using editing software to alter the semantic meaning of images to deceive viewers. Since manipulations appear realistic, both humans and machines face challenges detecting forgeries. We propose a novel algorithm for authenticating visual content by localizing forged regions in this work. Our proposed algorithm employs channel attention convolutional blocks in an end-to-end learning framework. The channel attention infers forged regions in an image by extracting attention-aware multi-resolution features in the spatial domain and features in the frequency domain. Therefore, the proposed network is divided into two subnetworks, for extracting attention-aware multi-resolution features in the spatial and frequency domain. To predict the resulting mask, we concatenate the features of both networks. The proposed channel attention network exclusively focuses on the forged region and increases network generalization capabilities on unseen manipulations. Rigorous experiments demonstrate that the proposed algorithm outperforms state-of-the-art methods on five benchmark datasets for localizing a wide range of manipulations.
Vehicle detection and classification with spatio-temporal information obtained from CNN

Vehicle detection and classification with convolutional neural networks (CNN) is encouraging and fascinating for intelligent transportation applications. In general, CNN is trained with huge labeled vehicle images, which are rare to find in developing country scenarios. This work proposes a vehicle detection technique with CNN that does not require any labeled vehicle dataset. A CNN is trained with road marks and these act as the background. When a vehicle occupies a road mark a logic 1 is recorded else 0 is saved in the database. This accumulated occupancy data is spatio-temporal information from which vehicle width and length are approximated and classified. This method does not require any GPU for training as well as for implementation in real-time. The detection accuracy of the proposed method on real-time videos is about 98.5%. The runtime performance of CNN model on NVIDIA Jetson Tx2 is 0.01 s, whereas on RaspberryPi4 is 0.03 s. The given method even works in shadow and low-light conditions.