Reviewerly/exHarmony huggingface dataset:
Multi-objective reinforcement learning for autonomous drone navigation in urban areas with wind zones

Authors:
raw_author_name: Jiahao Wu
raw_affiliation_string: Informatics, Cobots and Intelligent Construction (ICIC) Lab, Department of Civil and Coastal Engineering, University of Florida, Gainesville, FL 32611, United States of America
raw_author_name: Yang Ye
raw_affiliation_string: Informatics, Cobots and Intelligent Construction (ICIC) Lab, Department of Civil and Coastal Engineering, University of Florida, Gainesville, FL 32611, United States of America
raw_author_name: Jing Du
raw_affiliation_string: Informatics, Cobots and Intelligent Construction (ICIC) Lab, Department of Civil and Coastal Engineering, University of Florida, Gainesville, FL 32611, United States of America

Abstract: Drones can be used for tasks such as data collection and logistics in civil engineering. Current research on autonomous drones mainly focuses on planning a safe path and avoiding obstacles in a static environment. However, navigating a drone in complex environments like urban areas involves many dynamic constraints, such as building layout, winds, and signal coverage, which are interdependent. The wind factor is the most important among these environmental factors, which may cause a drone to lose control or even crash. This paper presents a multi-objective navigation reinforcement learning algorithm (MONRL) for the drone to navigate and avoid obstacles in an unknown environment when dynamic wind zones present, with only imagery data about the building layouts. Based on a deep reinforcement learning and memory architecture, the drone develops policies to prioritize navigation decisions, optimizing the path while minimizing negative impact of winds with only sparse sensor data, in our case, camera inputs. By leveraging the advantages of the proposed method in estimating the environmental factors from previous trials, no aerodynamic force sensors are needed for the drone to develop effective strategies to navigate to target while counteracting to milder winds and dodging aways from stronger winds. The proposed method was tested in a virtual environment, and a real model of New York City. The method is expected to contribute to new automation algorithms for urban aerial logistics and future automated civil infrastructure inspection.
Personalized Federated Learning with Layer-Wise Feature Transformation via Meta-Learning

Authors:
raw_author_name: Jiaming Huang
raw_affiliation_string: South China University of Technology, CHINA
raw_author_name: Lei Yang
raw_affiliation_string: South China University of Technology, CHINA
raw_author_name: Wanyu Lin
raw_affiliation_string: The Hong Kong Polytechnic University, CHINA

Abstract: Federated learning enables multiple clients to collaboratively learn machine learning models in a privacy-preserving manner. However, in real-world scenarios, a key challenge encountered in federated learning is the statistical heterogeneity among clients. Existing work mainly focused on a single global model shared across the clients, making it hard to generalize well to all clients due to the large discrepancy in the data distributions. To address this challenge, we propose pFedLT , a novel approach that can adapt the single global model to different data distributions. Specifically, we propose to perform a pluggable layer-wise transformation during the local update phase based on scaling and shifting operations. In particular, these operations are learned with a meta-learning strategy. By doing so, pFedLT can capture the diversity of data distribution among clients, therefore, can generalize well even when the data distributions among clients exhibit high statistical heterogeneity. We conduct extensive experiments on synthetic and real-world datasets (MNIST, Fashion_MNIST, CIFAR-10, and Office+Caltech10) under different Non-IID settings. Experimental results demonstrate that pFedLT significantly improves the model accuracy by up to 11.67% and reduces the communication costs compared with state-of-the-art approaches.
A Novel Neural Ensemble Architecture for On-the-fly Classification of Evolving Text Streams

Authors:
raw_author_name: Pouya Ghahramanian
raw_affiliation_string: Bilkent University, Turkey
raw_author_name: Sepehr Bakhshi
raw_affiliation_string: Bilkent University, Turkey
raw_author_name: Hamed Bonab
raw_affiliation_string: Amazon Inc., USA
raw_author_name: Fazli Can
raw_affiliation_string: Bilkent University, Turkey

Abstract: We study on-the-fly classification of evolving text streams in which the relation between the input data and target labels changes over time—i.e., “concept drift.” These variations decrease the model’s performance, as predictions become less accurate over time and they necessitate a more adaptable system. While most studies focus on concept drift detection and handling with ensemble approaches, the application of neural models in this area is relatively less studied. We introduce Adaptive Neural Ensemble Network ( AdaNEN ), a novel ensemble-based neural approach, capable of handling concept drift in data streams. With our novel architecture, we address some of the problems neural models face when exploited for online adaptive learning environments. Most current studies address concept drift detection and handling in numerical streams, and the evolving text stream classification remains relatively unexplored. We hypothesize that the lack of public and large-scale experimental data could be one reason. To this end, we propose a method based on an existing approach for generating evolving text streams by introducing various types of concept drifts to real-world text datasets. We provide an extensive evaluation of our proposed approach using 12 state-of-the-art baselines and 13 datasets. We first evaluate concept drift handling capability of AdaNEN and the baseline models on evolving numerical streams; this aims to demonstrate the concept drift handling capabilities of our method on a general spectrum and motivate its use in evolving text streams. The models are then evaluated in evolving text stream classification. Our experimental results show that AdaNEN consistently outperforms the existing approaches in terms of predictive performance with conservative efficiency.
Leveraging Dual Gloss Encoders in Chinese Biomedical Entity Linking

Authors:
raw_author_name: Tzu-Mi Lin
raw_affiliation_string: National Yang Ming Chiao Tung University and National Central University, Taiwan
raw_author_name: Man-Chen Hung
raw_affiliation_string: National Central University, Taiwan
raw_author_name: Lung-Hao Lee
raw_affiliation_string: National Yang Ming Chiao Tung University and National Central University, Taiwan

Abstract: Entity linking is the task of assigning a unique identity to named entities mentioned in a text, a sort of word sense disambiguation that focuses on automatically determining a pre-defined sense for a target entity to be disambiguated. This study proposes the DGE (Dual Gloss Encoders) model for Chinese entity linking in the biomedical domain. We separately model a dual encoder architecture, comprising a context-aware gloss encoder and a lexical gloss encoder, for contextualized embedding representations. DGE are then jointly optimized to assign the nearest gloss with the highest score for target entity disambiguation. The experimental datasets consist of a total of 10,218 sentences that were manually annotated with glosses defined in the BabelNet 5.0 across 40 distinct biomedical entities. Experimental results show that the DGE model achieved an F1-score of 97.81, outperforming other existing methods. A series of model analyses indicate that the proposed approach is effective for Chinese biomedical entity linking.
Improving the Detection of Multilingual South African Abusive Language via Skip-gram Using Joint Multilevel Domain Adaptation

Authors:
raw_author_name: Oluwafemi Oriola
raw_affiliation_string: Department of Computer Science and Informatics, University of the Free State
raw_author_name: Eduan Kotzé
raw_affiliation_string: Department of Computer Science and Informatics, University of the Free State

Abstract: The distinctiveness and sparsity of low-resource multilingual South African abusive language necessitate the development of a novel solution to automatically detect different classes of abusive language instances using machine learning. Skip-gram has been used to address sparsity in machine learning classification problems but is inadequate in detecting South African abusive language due to the considerable amount of rare features and class imbalance. Joint Domain Adaptation has been used to enlarge features of a low-resource target domain for improved classification outcomes by jointly learning from the target domain and large-resource source domain. This article, therefore, builds a Skip-gram model based on Joint Domain Adaptation to improve the detection of multilingual South African abusive language. Contrary to the existing Joint Domain Adaptation approaches, a Joint Multilevel Domain Adaptation model involving adaptation of monolingual source domain instances and multilingual target domain instances with high frequency of rare features was executed at the first level and adaptation of target-domain features and first-level features at the next level. Both surface-level and embedding word features were used to evaluate the proposed model. In the evaluation of surface-level features, the Joint Multilevel Domain Adaptation model outperformed the state-of-the-art models with accuracy of 0.92 and F1-score of 0.68. In the evaluation of embedding features, the proposed model outperformed the state-of-the-art models with accuracy of 0.88 and F1-score of 0.64. The Joint Multilevel Domain Adaptation model significantly improved the average information gain of the rare features in different language categories and reduced class imbalance.
Optimal Hadamard Gate Count for Clifford+ <i>T</i> Synthesis of Pauli Rotations Sequences

Authors:
raw_author_name: Simon Martiel
raw_affiliation_string: Atos Quantum Lab, Les Clayes-sous-Bois, France
raw_author_name: Simon Perdrix
raw_affiliation_string: Université de Lorraine, CNRS, Inria, LORIA, Nancy, France
raw_author_name: Christophe Vuillot
raw_affiliation_string: Université de Lorraine, CNRS, Inria, LORIA, Nancy, France

Abstract: The Clifford+ T gate set is commonly used to perform universal quantum computation. In such setup the T gate is typically much more expensive to implement in a fault-tolerant way than Clifford gates. To improve the feasibility of fault-tolerant quantum computing it is then crucial to minimize the number of T gates. Many algorithms, yielding effective results, have been designed to address this problem. It has been demonstrated that performing a pre-processing step consisting of reducing the number of Hadamard gates in the circuit can help to exploit the full potential of these algorithms and thereby lead to a substantial T -count reduction. Moreover, minimizing the number of Hadamard gates also restrains the number of additional qubits and operations resulting from the gadgetization of Hadamard gates, a procedure used by some compilers to further reduce the number of T gates. In this work we tackle the Hadamard gate reduction problem, and propose an algorithm for synthesizing a sequence of π /4 Pauli rotations with a minimal number of Hadamard gates. Based on this result, we present an algorithm which optimally minimizes the number of Hadamard gates lying between the first and the last T gate of the circuit.
NNC-GCN: Neighbours-to-Neighbours Contrastive Graph Convolutional Network for Semi-Supervised Classification

Authors:
raw_author_name: Feng Xiao
raw_affiliation_string: School of Computer Science, Wuhan University, China; College of Informatics, Huazhong Agricultural University, China
raw_author_name: Youfa Liu
raw_affiliation_string: School of Computer Science, Wuhan University, China; College of Informatics, Huazhong Agricultural University, China
raw_author_name: Jia Shao
raw_affiliation_string: College of Informatics, Huazhong Agricultural University, China

Abstract: Contrastive learning (CL) is a popular learning paradigm in deep learning, which uses contrastive principle to learn low-dimensional embeddings, and has been applied in Graph Neural Networks (GNNs) successfully. Existing works of contrastive multi-view GNNs usually focus on point-to-point contrastive learning strategies. However, they neglect the local information in neighbors, which brings isolated positive samples. The quality of selected positive samples is hard to evaluate, and these samples may lead to invalid contrastiveness. Therefore, we propose a simple and efficient neighbors-to-neighbors contrastive graph neural network (NNC-GCN), which constructs a consistent multi-view by using the topologies of original input graphs. Moreover, we raise a new learning problem of unlabeled data base on these constructed multi-view topologies and propose a loss function NNC-InfoNCE to guide its learning process. The NNC-InfoNCE is an improved version of InfoNCE, which can be adapted to neighborhood-level contrast learning. Specifically, the neighborhoods and the remaining nodes of the selected anchor are weighted and treated as positive and negative sample sets. The experimental results show that our method is effective on public benchmark datasets.
Ibn-Ginni: An Improved Morphological Analyzer for Arabic

Authors:
raw_author_name: Waleed Nazih
raw_affiliation_string: Department of Computer Science, College of Computer Engineering and Sciences, Prince Sattam bin Abdulaziz University, Saudi Arabia
raw_author_name: Amany Fashwan
raw_affiliation_string: Faculty of Arts, Linguistics and Phonetics Department, Alexandria University, Egypt
raw_author_name: Yasser Hifny
raw_affiliation_string: Faculty of Computers and Artificial Intelligence, Helwan University, Egypt

Abstract: Arabic is a morphologically rich language, which means that the Arabic language has a complicated system of word formation and structure. The affixes in the Arabic language (i.e., prefixes and suffixes) can be added to root words to generate different meanings and grammatical functions. These affixes can indicate aspects such as tense, gender, number, case, person, and more. In addition, the meaning and function of words can be modified in Arabic using an internal structure known as morphological patterns. Computational morphological analyzers of Arabic are vital to developing Arabic language processing toolkits. In this article, we introduce a new morphological analyzer (Ibn-Ginni) that inherits the speed and quality of the Buckwalter Arabic Morphological Analyzer (BAMA). The BAMA has poor coverage of the classical Arabic language. Hence, the coverage of classical Arabic is improved by using the Alkhalil analyzer. Although it is slow, it was used to generate a huge number of solutions for 3 million unique Arabic words collected from different resources. These word form-based solutions were converted to stem-based solutions, refined manually, and added to the database of BAMA, resulting in substantial improvements in the quality of the analysis. Hence, Ibn-Ginni is a hybrid system between BAMA and Alkhalil analyzers and may be considered an efficient large-scale analyzer. The Ibn-Ginni analyzer analyzed 0.6 million more words than the BAMA analyzer. Therefore, our analyzer significantly improves the coverage of the Arabic language. Besides, the Ibn-Ginni analyzer is high speed at providing solutions, the average time to analyze a word is 0.3 ms. Using a corpus designed for benchmarking Arabic morphological analyzers, our analyzer was able to find all solutions for 72.72% of the words. Moreover, the analyzer did not provide all possible morphological solutions for 24.24% of the words. The analyzer and its morphological database are publicly available on GitHub. 1
Bridging Formal Methods and Machine Learning with Model Checking and Global Optimisation

Authors:
raw_author_name: Saddek Bensalem
raw_affiliation_string: University Grenoble Alpes, VERIMAG, Grenoble, France
raw_author_name: Xiaowei Huang
raw_affiliation_string: Department of Computer Science, University of Liverpool, Liverpool, L69 3BX, UK
raw_author_name: Wenjie Ruan
raw_affiliation_string: Department of Computer Science, University of Liverpool, Liverpool, L69 3BX, UK
raw_author_name: Qiyi Tang
raw_affiliation_string: Department of Computer Science, University of Liverpool, Liverpool, L69 3BX, UK
raw_author_name: Changshun Wu
raw_affiliation_string: University Grenoble Alpes, VERIMAG, Grenoble, France
raw_author_name: Xingyu Zhao
raw_affiliation_string: Department of Computer Science, University of Liverpool, Liverpool, L69 3BX, UK

Abstract: Formal methods and machine learning are two research fields with drastically different foundations and philosophies. Formal methods utilise mathematically rigorous techniques for software and hardware systems' specification, development and verification. Machine learning focuses on pragmatic approaches to gradually improve a parameterised model by observing a training data set. While historically, the two fields lack communication, this trend has changed in the past few years with an outburst of research interest in the robustness verification of neural networks. This paper will briefly review these works, and focus on the urgent need for broader and more in-depth communication between the two fields, with the ultimate goal of developing learning-enabled systems with excellent performance and acceptable safety and security. We present a specification language, MLS2, and show that it can express a set of known safety and security properties, including generalisation, uncertainty, robustness, data poisoning, backdoor, model stealing, membership inference, model inversion, interpretability, and fairness. To verify MLS2 properties, we promote the global optimisation-based methods, which have provable guarantees on the convergence to the optimal solution. Many of them have theoretical bounds on the gap between current solutions and the optimal solution.
CLUE: Contrastive language-guided learning for referring video object segmentation

Authors:
raw_author_name: Wanjun Zhong
raw_affiliation_string: Sun Yat-sen University, 135 XinGangxi Road, Guangzhou, 510275, Guangdong, China
raw_author_name: Jie Li
raw_affiliation_string: Harbin Institute of Technology, 92 Xida St, Harbin, 150001, Heilongjiang, China
raw_author_name: Tiejun Zhao
raw_affiliation_string: Harbin Institute of Technology, 92 Xida St, Harbin, 150001, Heilongjiang, China

Abstract: Referring video object segmentation (R-VOS), the task of separating the object described by a natural language query from the video frames, has become increasingly critical with recent advances in multi-modal understanding. Existing approaches are mainly visual-dominant in both representation-learning and decision-making process, and are less sensitive to fine-grained clues in text description. To address this, we propose a language-guided contrastive learning and data augmentation framework to enhance the model sensitivity to the fine-grained textual clues (i.e., color, location, subject) in the text that relate heavily to the video information. By substituting key information of the original sentences and paraphrasing them with a text-based generation model, our approach conducts contrastive learning through automatically building diverse and fluent contrastive samples. We further enhance the multi-modal alignment with a sparse attention mechanism, which can find the most relevant video information by optimal transport. Experiments on a large-scale R-VOS benchmark show that our method significantly improves strong Transformer-based baselines, and further analysis demonstrates the better ability of our model in identifying textual semantics.
Multi-supervision transformer combining bounding box and mask for data-limited pose estimation

Authors:
raw_author_name: Xinyang Yuan
raw_affiliation_string: Sichuan University, School of Aeronautics and Astronautics, Chengdu, 610207, Sichuan, China
raw_author_name: Peng Cheng
raw_affiliation_string: Sichuan University, School of Aeronautics and Astronautics, Chengdu, 610207, Sichuan, China
raw_author_name: Songchen Han
raw_affiliation_string: Sichuan University, School of Aeronautics and Astronautics, Chengdu, 610207, Sichuan, China

Abstract: In scenarios where acquiring accurate annotated pose data is difficult, obtaining sufficient training samples becomes a challenge. Given these data constraints, it is challenging to provide optimal end-to-end supervision with limited pose information. To address this limitation, we propose a novel approach, named MSPose, which combines diverse data sources from human instances to provide multi-level supervision in human pose estimation. This approach mitigates the impact of scarce training data and enhances pose estimation precision by synergistically incorporating human bounding box and mask information. Our proposed method achieves multi-level model activation for the human body region, structure, and joints. This hierarchical pixel activation is facilitated by integrating human bounding box and mask signals as supplementary supervision during training. Importantly, we exclude auxiliary branches to ensure complete freedom during inference. Our experimental validation on a quarter of the COCO and MPII datasets demonstrates the competitiveness of our method compared to state-of-the-art methods. Compared to TokenPose-T, our MSPose-T achieves a 6.1 points improvement in average precision and a corresponding 3.1 points increase on the full COCO validation set. On the MPII dataset, MSPose achieves the highest Mean score of 1.9 points. Our approach achieves these improvements while maintaining consistent parameters and GFLOPs, highlighting the advantage of our approach.
FAUC-S: Deep AUC maximization by focusing on hard samples

Authors:
raw_author_name: Shoukun Xu
raw_affiliation_string: Department of Computer Science and Technology, Changzhou University, Changzhou, Jiangsu 213164, China
raw_author_name: Yanrui Ding
raw_affiliation_string: Department of Computer Science and Technology, Changzhou University, Changzhou, Jiangsu 213164, China
raw_author_name: Yanhao Wang
raw_affiliation_string: Columbia University, NY, USA
raw_author_name: Junru Luo
raw_affiliation_string: Department of Computer Science and Technology, Changzhou University, Changzhou, Jiangsu 213164, China

Abstract: Deep AUC maximization (DAM) is a popular method to deal with complex imbalanced classification problems. It learns a deep neural network by minimizing a surrogate AUC loss. The mostly used surrogates are the pairwise square loss and its variants. However, they are usually used in regression problems and are sensitive to noise samples. The easy samples suffer larger losses than those without correct classification, which is unreasonable in optimization problems. In this paper, we propose a focus AUC loss based on samples (FAUC-S) by constructing a differentiable weight function that identifies hard and easy samples, which makes easy samples have small losses, and hard samples have large losses. It is more reasonable than the traditional AUC loss while having the same advantages on large-scale datasets. In experiments, we use an end-to-end compositional DAM to investigate the effect of different weight functions on the AUC loss and compare it with other methods. Experimental results on several benchmark datasets demonstrate that FAUC-S achieves superior performance in terms of AUC compared to existing state-of-the-art methods.