Reviewerly/exHarmony huggingface dataset:
Graph Convolution Based Efficient Re-Ranking for Visual Retrieval

Visual retrieval tasks such as image retrieval and person re-identification (Re-ID) aim at effectively and thoroughly searching images with similar content or the same identity. After obtaining retrieved examples, re-ranking is a widely adopted post-processing step to reorder and improve the initial retrieval results by making use of the contextual information from semantically neighboring samples. Prevailing re-ranking approaches update distance metrics and mostly rely on inefficient crosscheck set comparison operations while computing expanded neighbors based distances. In this work, we present an efficient re-ranking method which refines initial retrieval results by updating features. Specifically, we reformulate re-ranking based on Graph Convolution Networks (GCN) and propose a novel Graph Convolution based Re-ranking (GCR) for visual retrieval tasks via feature propagation. To accelerate computation for large-scale retrieval, a decentralized and synchronous feature propagation algorithm which supports parallel or distributed computing is introduced. In particular, the plain GCR is extended for cross-camera retrieval and an improved feature propagation formulation is presented to leverage affinity relationships across different cameras. It is also extended for video-based retrieval, and Graph Convolution based Re-ranking for Video (GCRV) is proposed by mathematically deriving a novel profile vector generation method for the tracklet. Without bells and whistles, the proposed approaches achieve state-of-the-art performances on seven benchmark datasets from three different tasks, i.e., image retrieval, person Re-ID and video-based person Re-ID. Code is publicly available: <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">github.com/WesleyZhang1991/GCN rerank</uri> .
Baseband Control of Superconducting Qubits with Shared Microwave Drives

Accurate control of qubits is the central requirement for building functional quantum processors. For the current superconducting quantum processor, high-fidelity control of qubits is mainly based on independently calibrated microwave pulses, which could differ from each other in frequencies, amplitudes, and phases. With this control strategy, the needed physical resource could be challenging, especially when scaling up to large-scale quantum processors is considered. Inspired by Kane's proposal for spin-based quantum computing, here, we explore theoretically the possibility of baseband flux control of superconducting qubits with only shared and always-on microwave drives. In our strategy, qubits are by default far detuned from the drive during system idle periods, qubit readout and baseband flux-controlled two-qubit gates can thus be realized with minimal impacts from the always-on drive. By contrast, during working periods, qubits are tuned on resonance with the drive and single-qubit gates can be realized. Therefore, universal qubit control can be achieved with only baseband flux pulses and always-on shared microwave drives. We apply this strategy to the qubit architecture where tunable qubits are coupled via a tunable coupler, and the analysis shows that high-fidelity qubit control is possible. Besides, the baseband control strategy needs fewer physical resources, such as control electronics and cooling power in cryogenic systems, than that of microwave control. Of note, the flexibility of baseband flux control could be employed for addressing the nonuniformity issue of superconducting qubits, potentially allowing the realization of multiplexing and cross-bar technologies and thus controlling large numbers of qubits with fewer control lines. We thus expect that baseband control with shared microwave drives can help build large-scale superconducting quantum processors.
Fringe-pattern analysis with ensemble deep learning

In recent years, there has been tremendous progress in the development of deep-learning-based approaches for optical metrology, which introduce various deep neural networks (DNNs) for many optical metrology tasks, such as fringe analysis, phase unwrapping, and digital image correlation. However, since different DNN models have their own strengths and limitations, it is difficult for a single DNN to make reliable predictions under all possible scenarios. In this work, we introduce ensemble learning into optical metrology, which combines the predictions of multiple DNNs to significantly enhance the accuracy and reduce the generalization error for the task of fringe-pattern analysis. First, several state-of-the-art base models of different architectures are selected. A K-fold average ensemble strategy is developed to train each base model multiple times with different data and calculate the mean prediction within each base model. Next, an adaptive ensemble strategy is presented to further combine the base models by building an extra DNN to fuse the features extracted from these mean predictions in an adaptive and fully automatic way. Experimental results demonstrate that ensemble learning could attain superior performance over state-of-the-art solutions, including both classic and conventional single-DNN-based methods. Our work suggests that by resorting to collective wisdom, ensemble learning offers a simple and effective solution for overcoming generalization challenges and boosts the performance of data-driven optical metrology methods.
Asymmetrical Attention Networks Fused Autoencoder for Debiased Recommendation

Popularity bias is a massive challenge for autoencoder-based models, which decreases the level of personalization and hurts the fairness of recommendations. User reviews reflect their preferences and help mitigate bias or unfairness in the recommendation. However, most existing works typically incorporate user (item) reviews into a long document and then use the same module to process the document in parallel. Actually, the set of user reviews is completely different from the set of item reviews. User reviews are heterogeneous in that they reflect a variety of items purchased by users, while item reviews are only related to the item itself and are thus typically homogeneous. In this article, a novel asymmetric attention network fused with autoencoders is proposed, which jointly learns representations from the user and item reviews and implicit feedback to perform recommendations. Specifically, we design an asymmetric attentive module to capture rich representations from user and item reviews, respectively, which solves data sparsity and explainable problems. Furthermore, to further address popularity bias, we apply a noise-contrastive estimation objective to learn high-quality “de-popularity” embedding via the decoder structure. A series of extensive experiments are conducted on four benchmark datasets to show that leveraging user review information can eliminate popularity bias and improve performance compared to various state-of-the-art recommendation techniques.
Personal Healthcare Data Records Analysis and Monitoring using The Internet of Things and Cloud Computing

This paper presents a proposed system for cloud-based and Internet o Things (IoT)-based electronic health records (EHRs) that utilize wearable body biosensors to collect biometric data in real time and analyze it to provide personalized therapy recommendations. The study aims to ensure the confidentiality and integrity of patient data through security authorizations, device authentication, and encrypted communication channels. The research method involves describing the proposed system’s communication environment and trust boundary and illustrating the communication mechanisms, including the “starting” and “authentication” procedures. The proposed communication protocols are also explained in detail, and a complete illustration of the symbols and abbreviations used throughout the work is provided. The initialization process involves contacting a body sensor network (BSN) server to register, generating a secret key, and assigning a track sequence number. The proposed systematic verification involves a dependable authentication solution to maintain secure communication between the biosensors, local processing unit (LPU), and BSN server. The verification process involves figuring out the values and generating a random integer, establishing communication with the receiver, and validating the data by searching for a corresponding tuple in the required database. The study emphasizes the importance of a robust IoT communication architecture to ensure secure data transfer between devices, networks, and individuals.
Disaster management ontology- an ontological approach to disaster management automation

The geographical location of any region, as well as large-scale environmental changes caused by a variety of factors, invite a wide range of disasters. Floods, droughts, earthquakes, cyclones, landslides, tornadoes, and cloudbursts are all common natural disasters that destroy property and kill people. On average, 0.1% of the total deaths globally in the past decade have been due to natural disasters. The National Disaster Management Authority (NDMA), a branch of the Ministry of Home Affairs, plays an important role in disaster management in India by taking responsibility for risk mitigation, response, and recovery from all natural and man-made disasters. This article presents an ontology-based disaster management framework based on the NDMA's responsibility matrix. This ontological base framework is named as Disaster Management Ontology (DMO). It aids in task distribution among necessary authorities at various stages of a disaster, as well as a knowledge-driven decision support system for financial assistance to victims. In the proposed DMO, ontology has been used to integrate knowledge as well as a working platform for reasoners, and the Decision Support System (DSS) ruleset is written in Semantic Web Rule Language (SWRL), which is based on the First Order Logic (FOL) concept. In addition, OntoGraph, a class view of taxonomy, is used to make taxonomy more interactive for users.
Towards Student Behaviour Simulation: A Decision Transformer Based Approach

With the rapid development of Artificial Intelligence (AI), an increasing number of Machine Learning (ML) technologies have been widely applied in many aspects of life. In the field of education, Intelligence Tutoring Systems (ITS) have also made significant advancements using these technologies. Developing different teaching strategies automatically, according to mined student characteristics and learning styles, could significantly enhance students’ learning efficiency and performance. This requires the ITS to recommend different learning strategies and trajectories for different individual students. However, one of the greatest challenges is the scarcity of data sets providing interactions between students and ITS, for training such ITS. One promising solution to this challenge is to train “sim students”, which imitate real students’ behaviour while using the ITS. The simulated interactions between these sim students and the ITS can then be generated and used to train the ITS to provide personalised learning strategies and trajectories to real students. In this paper, we thus propose SimStu, built upon a Decision Transformer, to generate learning behavioural data to improve the performance of the trained ITS models. The experimental results suggest that our SimStu could model real students well in terms of action frequency distribution. Moreover, we evaluate SimStu in an emerging ITS technology, Knowledge Tracing. The results indicate that SimStu could improve the efficiency of ITS training.
Artificial intelligence-assisted ultrasound image analysis to discriminate early breast cancer in Chinese population: a retrospective, multicentre, cohort study

Early diagnosis of breast cancer has always been a difficult clinical challenge. We developed a deep-learning model EDL-BC to discriminate early breast cancer with ultrasound (US) benign findings. This study aimed to investigate how the EDL-BC model could help radiologists improve the detection rate of early breast cancer while reducing misdiagnosis.In this retrospective, multicentre cohort study, we developed an ensemble deep learning model called EDL-BC based on deep convolutional neural networks. The EDL-BC model was trained and internally validated on B-mode and color Doppler US image of 7955 lesions from 6795 patients between January 1, 2015 and December 31, 2021 in the First Affiliated Hospital of Army Medical University (SW), Chongqing, China. The model was assessed by internal and external validations, and outperformed radiologists. The model performance was validated in two independent external validation cohorts included 448 lesions from 391 patients between January 1 to December 31, 2021 in the Tangshan People's Hospital (TS), Chongqing, China, and 245 lesions from 235 patients between January 1 to December 31, 2021 in the Dazu People's Hospital (DZ), Chongqing, China. All lesions in the training and total validation cohort were US benign findings during screening and biopsy-confirmed malignant, benign, and benign with 3-year follow-up records. Six radiologists performed the clinical diagnostic performance of EDL-BC, and six radiologists independently reviewed the retrospective datasets on a web-based rating platform.The area under the receiver operating characteristic curve (AUC) of the internal validation cohort and two independent external validation cohorts for EDL-BC was 0.950 (95% confidence interval [CI]: 0.909-0.969), 0.956 (95% [CI]: 0.939-0.971), and 0.907 (95% [CI]: 0.877-0.938), respectively. The sensitivity values were 94.4% (95% [CI]: 72.7%-99.9%), 100% (95% [CI]: 69.2%-100%), and 80% (95% [CI]: 28.4%-99.5%), respectively, at 0.76. The AUC for accurate diagnosis of EDL-BC (0.945 [95% [CI]: 0.933-0.965]) and radiologists with artificial intelligence (AI) assistance (0.899 [95% [CI]: 0.883-0.913]) was significantly higher than that of the radiologists without AI assistance (0.716 [95% [CI]: 0.693-0.738]; p < 0.0001). Furthermore, there were no significant differences between the EDL-BC model and radiologists with AI assistance (p = 0.099).EDL-BC can identify subtle but informative elements on US images of breast lesions and can significantly improve radiologists' diagnostic performance for identifying patients with early breast cancer and benefiting the clinical practice.The National Key R&D Program of China.
Is Your Machine Better Than You? You May Never Know

Artificial intelligence systems are increasingly demonstrating their capacity to make better predictions than human experts. Yet recent studies suggest that professionals sometimes doubt the quality of these systems and overrule machine-based prescriptions. This paper explores the extent to which a decision maker (DM) supervising a machine to make high-stakes decisions can properly assess whether the machine produces better recommendations. To that end, we study a setup in which a machine performs repeated decision tasks (e.g., whether to perform a biopsy) under the DM’s supervision. Because stakes are high, the DM primarily focuses on making the best choice for the task at hand. Nonetheless, as the DM observes the correctness of the machine’s prescriptions across tasks, the DM updates the DM’s belief about the machine. However, the DM is subject to a so-called verification bias such that the DM verifies the machine’s correctness and updates the DM’s belief accordingly only if the DM ultimately decides to act on the task. In this setup, we characterize the evolution of the DM’s belief and overruling decisions over time. We identify situations under which the DM hesitates forever whether the machine is better; that is, the DM never fully ignores but regularly overrules it. Moreover, the DM sometimes wrongly believes with positive probability that the machine is better. We fully characterize the conditions under which these learning failures occur and explore how mistrusting the machine affects them. These findings provide a novel explanation for human–machine complementarity and suggest guidelines on the decision to fully adopt or reject a machine. This paper was accepted by Elena Katok, special issue on the human–algorithm connection. Supplemental Material: The online appendix is available at https://doi.org/10.1287/mnsc.2023.4791 .
Towards a Metaverse of Knowledge

The academic success of students can be improved by an understanding of the academic domain they are navigating. As such, they may benefit from gaining valuable perspective into the shape of their chosen field via an enhanced visual aid. We discuss K-Cube VR, a work-in-progress academic domain browser, which provides visualization of such information through knowledge graphs in virtual reality. We then present the theoretical motivations of such a project, proposing in the process new principles for learning in the metaverse. These principles are an attempt to integrate current educational trends, immersive learning, and visual literacy, within a constructivist pedagogical framework. It is hoped that the proposed principles and our implementation via K-Cube VR can inspire future metaverse learning environments.
A Hybrid Excitation Model Based Lightweight Siamese Network for Underwater Vehicle Object Tracking Missions

Performing object tracking tasks and efficiently perceiving the underwater environment in real time for underwater vehicles is a challenging task due to the complex nature of the underwater environment. A hybrid excitation model based lightweight Siamese network is proposed to solve the mismatch between underwater objects with limited characteristics and complex deep learning models. The lightweight neural network is applied to the residual network in the Siamese network to reduce the computational complexity and cost of the model while constructing a deeper network. In addition, to deal with the changeable complex underwater environment and consider the timing of video tracking, the global excitation model (HE module) is introduced. The model adopts the excitation methods of space, channel, and motion to improve the accuracy of the algorithm. Based on the designed underwater vehicle, the underwater target tracking and target grabbing experiments are carried out, and the experimental results show that the proposed tracking algorithm has a high tracking success rate.
PPA-Net: Pyramid Pooling Attention Network for Multi-Scale Ship Detection in SAR Images

In light of recent advances in deep learning and Synthetic Aperture Radar (SAR) technology, there has been a growing adoption of ship detection models that are based on deep learning methodologies. However, the efficiency of SAR ship detection models is significantly impacted by complex backgrounds, noise, and multi-scale ships (the number of pixels occupied by ships in SAR images varies significantly). To address the aforementioned issues, this research proposes a Pyramid Pooling Attention Network (PPA-Net) for SAR multi-scale ship detection. Firstly, a Pyramid Pooled Attention Module (PPAM) is designed to alleviate the influence of background noise on ship detection while its parallel component favors the processing of multiple ship sizes. Different from the previous attention module, the PPAM module can better suppress the background noise in SAR images because it considers the saliency of ships in SAR images. Secondly, an Adaptive Feature Balancing Module (AFBM) is developed, which can automatically balance the conflict between ship semantic information and location information. Finally, the detection capabilities of the ship detection model for multi-scale ships are further improved by introducing the Atrous Spatial Pyramid Pooling (ASPP) module. This innovative module enhances the detection model’s ability to detect ships of varying scales by extracting features from multiple scales using atrous convolutions and spatial pyramid pooling. PPA-Net achieved detection accuracies of 95.19% and 89.27% on the High-Resolution SAR Images Dataset (HRSID) and the SAR Ship Detection Dataset (SSDD), respectively. The experimental results demonstrate that PPA-Net outperforms other ship detection models.
Distributed Learning Over Networks With Graph-Attention-Based Personalization

In conventional distributed learning over a network, multiple agents collaboratively build a common machine learning model. However, due to the underlying non-i.i.d. data distribution among agents, the unified learning model becomes inefficient for each agent to process its locally accessible data. To address this problem, we propose a graph-attention-based personalized training algorithm (GATTA) for distributed deep learning. The GATTA enables each agent to train its local personalized model while exploiting its correlation with neighboring nodes and utilizing their useful information for aggregation. In particular, the personalized model in each agent is composed of a global part and a node-specific part. By treating each agent as one node in a graph and the node-specific parameters as its features, the benefits of the graph attention mechanism can be inherited. Namely, instead of aggregation based on averaging, it learns the specific weights for different neighboring nodes without requiring prior knowledge about the graph structure or the neighboring nodes' data distribution. Furthermore, relying on the weight-learning procedure, we develop a communication-efficient GATTA by skipping the transmission of information with small aggregation weights. Additionally, we theoretically analyze the convergence properties of GATTA for non-convex loss functions. Numerical results validate the excellent performances of the proposed algorithms in terms of convergence and communication cost.
A Multi-Source Fusion Navigation System to Overcome GPS Interruption of Unmanned Ground Vehicles

The Inertial Navigation System/Global Positioning System (INS/GPS) fusion navigation technology commonly used by unmanned ground vehicles is prone to GPS interruption in complex environments, resulting in the inability of the system to locate accurately.This paper designs an INS/GPS/Odometer/Vision/Magnetometer fusion navigation scheme in response to this problem.Add odometer, vision, and magnetometer to the INS/GPS integrated navigation system, use odometer dead reckoning to suppress the position offset caused by GPS interruption, reduce the cumulative error of the system through visual positioning, and correct the course of INS with the help of magnetometer orientation Angle, improve the positioning ability of the system in the GPS interruption environment.In order to further enhance the positioning accuracy of the system, the Federal Filter algorithm (FKF) was improved, and the Federal Robust Cubature Kalman Filter algorithm (FRCKF) was proposed.A Robust Cubature Kalman Filter algorithm is introduced into the framework of the federated filter algorithm, which improves the processing ability of the FKF algorithm for nonlinear systems and reduces the positioning error of the system.Finally, an experimental platform for unmanned ground vehicle navigation was developed, and the effectiveness of the multi-source fusion navigation system was verified through vehicle navigation experiments.The experiment results show that the multi-source fusion navigation system designed in this paper can effectively reduce the negative impact of GPS interruption on the INS/GPS integrated navigation system and improve the positioning accuracy of unmanned ground vehicles.