Reviewerly/exHarmony huggingface dataset:
Boosting knowledge diversity, accuracy, and stability via tri-enhanced distillation for domain continual medical image segmentation

Authors:
raw_author_name: Wei Wang
raw_affiliation_string: Faculty of Computing, Harbin Institute of Technology, Shenzhen, China. Electronic address: wangwei2019@hit.edu.cn.
raw_author_name: Suyu Dong
raw_affiliation_string: College of Computer and Control Engineering, Northeast Forestry University, Harbin, China.
raw_author_name: Kuanquan Wang
raw_affiliation_string: Faculty of Computing, Harbin Institute of Technology, Harbin, China. Electronic address: wangkq@hit.edu.cn.
raw_author_name: Gongning Luo
raw_affiliation_string: Faculty of Computing, Harbin Institute of Technology, Harbin, China. Electronic address: luogongning@hit.edu.cn.
raw_author_name: Guohua Wang
raw_affiliation_string: College of Computer and Control Engineering, Northeast Forestry University, Harbin, China.
raw_author_name: Shuo Li
raw_affiliation_string: Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH 44106, USA.

Abstract: Domain continual medical image segmentation plays a crucial role in clinical settings. This approach enables segmentation models to continually learn from a sequential data stream across multiple domains. However, it faces the challenge of catastrophic forgetting. Existing methods based on knowledge distillation show potential to address this challenge via a three-stage process: distillation, transfer, and fusion. Yet, each stage presents its unique issues that, collectively, amplify the problem of catastrophic forgetting. To address these issues at each stage, we propose a tri-enhanced distillation framework. (1) Stochastic Knowledge Augmentation reduces redundancy in knowledge, thereby increasing both the diversity and volume of knowledge derived from the old network. (2) Adaptive Knowledge Transfer selectively captures critical information from the old knowledge, facilitating a more accurate knowledge transfer. (3) Global Uncertainty-Guided Fusion introduces a global uncertainty view of the dataset to fuse the old and new knowledge with reduced bias, promoting a more stable knowledge fusion. Our experimental results not only validate the feasibility of our approach, but also demonstrate its superior performance compared to state-of-the-art methods. We suggest that our innovative tri-enhanced distillation framework may establish a robust benchmark for domain continual medical image segmentation.
A bidirectional workflow scheduling approach with feedback mechanism in clouds

Authors:
raw_author_name: Mingjie Fan
raw_affiliation_string: Key Laboratory of Mathematics and Information Networks, Ministry of Education, Beijing, 100876, China; School of Science, Beijing University of Posts and Telecommunications, Beijing, 100876, China
raw_author_name: Lingjuan Ye
raw_affiliation_string: Key Laboratory of Mathematics and Information Networks, Ministry of Education, Beijing, 100876, China; School of Science, Beijing University of Posts and Telecommunications, Beijing, 100876, China
raw_author_name: Xingquan Zuo
raw_affiliation_string: Key Laboratory of Trustworthy Distributed Computing and Service, Ministry of Education, Beijing, 100876, China; School of Computer Science, Beijing University of Posts and Telecommunications, Beijing, 100876, China
raw_author_name: Xinchao Zhao
raw_affiliation_string: Key Laboratory of Mathematics and Information Networks, Ministry of Education, Beijing, 100876, China; School of Science, Beijing University of Posts and Telecommunications, Beijing, 100876, China

Abstract: Workflow scheduling poses a significant challenge in cloud computing environments, offering the potential to optimize execution time and reduce economic costs. In this paper, we present BFWS, a bidirectional workflow scheduling approach with a feedback mechanism, designed to address the deadline-constrained cost-aware workflow scheduling problem. BFWS is built upon a bidirectional scheduling framework that facilitates resource allocation from both the forward and the backward directions of the workflow. This framework incorporates a dynamic sub-deadline prediction method, leveraging prior knowledge and real-time scheduling progress to enhance the accuracy of task sub-deadline predictions. Additionally, a cost-aware resource selection operator is integrated into the framework, enabling the selection of appropriate virtual machines based on considerations of cost and time constraints. To further enhance decision-making and optimize performance, we introduce a feedback mechanism that enables BFWS to adapt and improve over time. Through extensive experiments using real-world workflows, the superior performance of BFWS is validated compared to the state-of-the-art algorithms. Moreover, the effectiveness of the bidirectional scheduling approach and the feedback mechanism is demonstrated individually through rigorous validation experiments. These findings highlight the potential of BFWS in achieving efficient and effective workflow scheduling in cloud computing environments.
YOLO-DCNet

Authors:
raw_author_name: YiHeng Wu
raw_affiliation_string: China University of Mining and Technology, China
raw_author_name: Jiaqiang Dong
raw_affiliation_string: Xichang University, China

Abstract: Enhanced processors empower edge devices like smartphones for human detection, yet their application is constrained by algorithmic efficiency and precision. This paper introduces YOLO-DCNet, a lightweight neural network detector built upon YOLOv7-tiny. Incorporating a dynamic multi-head structural re-parameterization (DMSR) module within its backbone network enables effective processing of the features utilized in the model. To improve multi-scale feature aggregation, the model integrates a channel information compression and linear mapping (CLM) module into its feature pyramid architecture. Moreover, the optimization of training and inference performance is achieved by employing RepVGG blocks between the main computational modules of the model. Experimental data reveal that the enhanced YOLOv7-tiny model achieves a 31.7% faster inference speed and marginal gains of 0.7% in mAP@0.5 and 0.5% in mAP@0.5:0.95 over the original. This underscores the model's improved performance and applicability for real-time human detection on edge devices across diverse applications.
Face De-Identification Using Convolutional Neural Network (CNN) Models for Visual-Copy Detection

Authors:
raw_author_name: Juntae Kim
raw_affiliation_string: Department of Computer Science and Engineering, Sogang University, Seoul 04107, Republic of Korea
raw_author_name: Jongho Nang
raw_affiliation_string: Department of Computer Science and Engineering, Sogang University, Seoul 04107, Republic of Korea

Abstract: The proliferation of media-sharing platforms has led to issues with illegally edited content and the distribution of pornography. To protect personal information, de-identification technologies are being developed to prevent facial identification. Existing de-identification methods directly alter the pixel values in the face region, leading to reduced feature representation and identification accuracy. This study aims to develop a method that minimizes the possibility of personal identification while effectively preserving important features for image- and video-copy-detection tasks, proposing a new deep-learning-based de-identification approach that surpasses traditional pixel-based alteration methods. We introduce two de-identification models using different approaches: one emphasizing the contours of the original face through feature inversion and the other generating a blurred version of the face using D2GAN (Dual Discriminator Generative Adversarial Network). Both models were evaluated on their performance in image- and video-copy-detection tasks before and after de-identification, demonstrating effective feature preservation. This research presents new possibilities for personal-information protection and digital-content security, contributing to digital-rights management and law enforcement.
Robust noise-aware algorithm for randomized neural network and its convergence properties

Authors:
raw_author_name: Yuqi Xiao
raw_affiliation_string: Department of Electrical Engineering, City University of Hong Kong, Tat Chee Avenue, Kowloon, Hong Kong, HKSAR, China; Shenzhen Key Laboratory of Millimeter Wave and Wideband Wireless Communications, CityU Shenzhen Research Institute, Shenzhen, 518057, China
raw_author_name: Chi-Sing Leung
raw_affiliation_string: Department of Electrical Engineering, City University of Hong Kong, Tat Chee Avenue, Kowloon, Hong Kong, HKSAR, China
raw_author_name: Kwok Wa Leung
raw_affiliation_string: Department of Electrical Engineering, City University of Hong Kong, Tat Chee Avenue, Kowloon, Hong Kong, HKSAR, China; Shenzhen Key Laboratory of Millimeter Wave and Wideband Wireless Communications, CityU Shenzhen Research Institute, Shenzhen, 518057, China

Abstract: The concept of randomized neural networks (RNNs), such as the random vector functional link network (RVFL) and extreme learning machine (ELM), is a widely accepted and efficient network method for constructing single-hidden layer feedforward networks (SLFNs). Due to its exceptional approximation capabilities, RNN is being extensively used in various fields. While the RNN concept has shown great promise, its performance can be unpredictable in imperfect conditions, such as weight noises and outliers. Thus, there is a need to develop more reliable and robust RNN algorithms. To address this issue, this paper proposes a new objective function that addresses the combined effect of weight noise and training data outliers for RVFL networks. Based on the half-quadratic optimization method, we then propose a novel algorithm, named noise-aware RNN (NARNN), to optimize the proposed objective function. The convergence of the NARNN is also theoretically validated. We also discuss the way to use the NARNN for ensemble deep RVFL (edRVFL) networks. Finally, we present an extension of the NARNN to concurrently address weight noise, stuck-at-fault, and outliers. The experimental results demonstrate that the proposed algorithm outperforms a number of state-of-the-art robust RNN algorithms.
Balanced self-distillation for long-tailed recognition

Authors:
raw_author_name: Ning Ren
raw_affiliation_string: College of Computer Science and Technology, Harbin Engineering University, Nantong, Harbin, 150001, Heilongjiang, China
raw_author_name: Xiaosong Li
raw_affiliation_string: College of Computer Science and Technology, Harbin Engineering University, Nantong, Harbin, 150001, Heilongjiang, China
raw_author_name: Yanxia Wu
raw_affiliation_string: College of Computer Science and Technology, Harbin Engineering University, Nantong, Harbin, 150001, Heilongjiang, China
raw_author_name: Yan Fu
raw_affiliation_string: College of Computer Science and Technology, Harbin Engineering University, Nantong, Harbin, 150001, Heilongjiang, China

Abstract: In long-tailed recognition tasks, the knowledge distillation technology is widely adopted for improving performance of deep neural networks. These methods distill the knowledge from the pretrained teacher model to the student model, which enables higher long-tailed recognition accuracy. However, the dependence on accompanying assistive models complicates the single network’s training process in the need for large memory and time costs. In this work, we present Balanced Self-Distillation (BSD) to distill tail knowledge by a single network without the assistive models. Specifically, BSD distills knowledge between different distortions of the same samples to stimulate the representation learning potential of the single network and adopts a balanced class weight for shifting the distillation focus from head- to-tail classes. Comprehensive experimentation across diverse datasets, including CIFAR-10-LT, CIFAR-100-LT and TinyImageNet-LT, consistently outperforms robust baseline methods. Specifically, BSD achieves improvements of 8.13% on CIFAR-100-LT with an mbalance ratio of 100 compared to the baseline (cross entropy). Furthermore, the proposed method enables seamless integration with contemporary techniques like re-sampling, meta-learning, and cost-sensitive learning. It emerges as a versatile tool capable of effectively addressing the challenges of long-tailed scenarios.
Mesh-clustered Gaussian process emulator for partial differential equation boundary value problems

Authors:
raw_author_name: Chih-Li Sung
raw_affiliation_string: Michigan State University
raw_author_name: Liang Ding
raw_affiliation_string: Fudan University
raw_author_name: Xingjian Wang
raw_affiliation_string: Tsinghua University

Abstract: Partial differential equations (PDEs) have become an essential tool for modeling complex physical systems. Such equations are typically solved numerically via mesh-based methods, such as finite element methods, with solutions over the spatial domain. However, obtaining these solutions are often prohibitively costly, limiting the feasibility of exploring parameters in PDEs. In this paper, we propose an efficient emulator that simultaneously predicts the solutions over the spatial domain, with theoretical justification of its uncertainty quantification. The novelty of the proposed method lies in the incorporation of the mesh node coordinates into the statistical model. In particular, the proposed method segments the mesh nodes into multiple clusters via a Dirichlet process prior and fits Gaussian process models with the same hyperparameters in each of them. Most importantly, by revealing the underlying clustering structures, the proposed method can provide valuable insights into qualitative features of the resulting dynamics that can be used to guide further investigations. Real examples are demonstrated to show that our proposed method has smaller prediction errors than its main competitors, with competitive computation time, and identifies interesting clusters of mesh nodes that possess physical significance, such as satisfying boundary conditions. An R package for the proposed methodology is provided in an open repository.
Exploratory Analysis of Distributional Data Using the Quantile Method

Authors:
raw_author_name: Manabu Ichino
raw_affiliation_string: School of Science and Engineering, Tokyo Denki University, Hatoyama, Saitama 350-0394, Japan

Abstract: The quantile method transforms each complex object described by different histogram values to a common number of quantile vectors. This paper retraces the authors’ research, including a principal component analysis, unsupervised feature selection using hierarchical conceptual clustering, and lookup table regression model. The purpose is to show that this research is essentially based on the monotone property of quantile vectors and works cooperatively in the exploratory analysis of the given distributional data.
Universal quantum computing with qubits embedded in trapped-ion qudits

Authors:
raw_author_name: Anastasiia S. Nikolaeva
raw_affiliation_string: Russian Quantum Center, Skolkovo, Moscow 121205, Russia and National University of Science and Technology “MISIS,” Moscow 119049, Russia
raw_author_name: Evgeniy O. Kiktenko
raw_affiliation_string: Russian Quantum Center, Skolkovo, Moscow 121205, Russia and National University of Science and Technology “MISIS,” Moscow 119049, Russia
raw_author_name: Aleksey K. Fedorov
raw_affiliation_string: Russian Quantum Center, Skolkovo, Moscow 121205, Russia and National University of Science and Technology “MISIS,” Moscow 119049, Russia

Abstract: Recent developments in qudit-based quantum computing, in particular with trapped ions, open interesting possibilities for scaling quantum processors without increasing the number of physical information carriers. Here, we propose a method for compiling quantum circuits in the case, where qubits are embedded into qudits of experimentally relevant dimensionalities, $d=3,...,8$, for the trapped-ion platform. In particular, we demonstrate how single-qubit, two-qubit, and multiqubit gates can be realized using single-qudit operations and the $\text{M}\o{}\text{lmer-S}\o{}\text{rensen}$ (MS) gate as a basic two-particle operation. We expect that our findings are directly applicable to the current generation of trapped-ion-based qudit processors.
Unleashing the benefits of smart grids by overcoming the challenges associated with low-resolution data

Authors:
raw_author_name: S. Ali Pourmousavi
raw_affiliation_string: The University of Adelaide, School of Electrical and Mechanical Engineering, Adelaide, SA, Australia
raw_author_name: Andrew J. Black
raw_affiliation_string: The University of Adelaide, School of Computer and Mathematical Sciences, Adelaide, SA, Australia

Abstract: Smart meters have been widely deployed worldwide, but there is an often-overlooked problem that remains unresolved: the data collected from these meters is of relatively low time resolution, hindering the realization of smart grid benefits. This perspective unfolds the roadblocks to achieving high-resolution data from a smart metering infrastructure. We highlight the loss of critical information, essential for many smart grid applications, due to low-resolution readings of residential consumer data. We then outline the main reasons behind the lack of high-resolution data, the tetralemma on balancing data collection, transmission, warehousing, and privacy concerns. Finally, we hypothesize a framework for data collection, maintenance, communication, and storage of smart utility meters data to obtain high-resolution records by tackling the challenges using a dictionary-based compression method and separately maintaining the compressed products at the user ends and data center.
Fast and reliable entanglement distribution with quantum repeaters: Principles for improving protocols using reinforcement learning

Authors:
raw_author_name: Stav Haldar
raw_affiliation_string: Hearne Institute for Theoretical Physics, Department of Physics and Astronomy, Louisiana State University, Baton Rouge, Louisiana 70803, USA
raw_author_name: Pratik J. Barge
raw_affiliation_string: Hearne Institute for Theoretical Physics, Department of Physics and Astronomy, Louisiana State University, Baton Rouge, Louisiana 70803, USA
raw_author_name: Sumeet Khatri
raw_affiliation_string: Dahlem Center for Complex Quantum Systems, Freie Universität Berlin, 14195 Berlin, Germany
raw_author_name: Hwang Lee
raw_affiliation_string: Hearne Institute for Theoretical Physics, Department of Physics and Astronomy, Louisiana State University, Baton Rouge, Louisiana 70803, USA

Abstract: Future quantum technologies such as quantum communication, quantum sensing, and distributed quantum computation, will rely on networks of shared entanglement between spatially separated nodes.In this work, we provide improved protocols/policies for entanglement distribution along a linear chain of nodes, both homogeneous and inhomogeneous, that take practical limitations into account.For a wide range of parameters, our policies improve upon previously known policies, such as the "swap-as-soon-as-possible" policy, with respect to both the waiting time and the fidelity of the end-to-end entanglement.This improvement is greatest for the most practically relevant cases, namely, for short coherence times, high link losses, and highly asymmetric links.To obtain our results, we model entanglement distribution using a Markov decision process, and then we use the Q-learning reinforcement learning (RL) algorithm to discover new policies.These new policies are characterized by dynamic, state-dependent memory cutoffs and collaboration between the nodes.In particular, we quantify this collaboration between the nodes.Our quantifiers tell us how much "global" knowledge of the network every node has, specifically, how much knowledge two distant nodes have of each other's states.In addition to the usual figures of merit, these quantifiers add an extra important dimension to the performance analysis and practical implementation of quantum repeaters.Finally, our understanding of the performance of large quantum networks is currently limited by the computational inefficiency of simulating them using RL or other optimization methods.The other main contribution of our work is to address this limitation.We present a method for nesting policies in order to obtain policies for large repeater chains.By nesting our RL-based policies for small repeater chains, we obtain policies for large repeater chains that improve upon the swap-as-soon-as-possible policy, and thus we pave the way for a scalable method for obtaining policies for long-distance entanglement distribution under practical constraints.
Towards Efficient Risky Driving Detection: A Benchmark and a Semi-Supervised Model

Authors:
raw_author_name: Qimin Cheng
raw_affiliation_string: School of Electronic Information and Communications, Huazhong University of Science and Technology, Wuhan 430074, China
raw_author_name: Huanying Li
raw_affiliation_string: School of Electronic Information and Communications, Huazhong University of Science and Technology, Wuhan 430074, China
raw_author_name: Yunfei Yang
raw_affiliation_string: Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China
raw_author_name: Xiao Huang
raw_affiliation_string: Department of Environmental Sciences, Emory University, Atlanta, GA 30322, USA

Abstract: Risky driving is a major factor in traffic incidents, necessitating constant monitoring and prevention through Intelligent Transportation Systems (ITS). Despite recent progress, a lack of suitable data for detecting risky driving in traffic surveillance settings remains a significant challenge. To address this issue, Bayonet-Drivers, a pioneering benchmark for risky driving detection, is proposed. The unique challenge posed by Bayonet-Drivers arises from the nature of the original data obtained from intelligent monitoring and recording systems, rather than in-vehicle cameras. Bayonet-Drivers encompasses a broad spectrum of challenging scenarios, thereby enhancing the resilience and generalizability of algorithms for detecting risky driving. Further, to address the scarcity of labeled data without compromising detection accuracy, a novel semi-supervised network architecture, named DGMB-Net, is proposed. Within DGMB-Net, an enhanced semi-supervised method founded on a teacher–student model is introduced, aiming at bypassing the time-consuming and labor-intensive tasks associated with data labeling. Additionally, DGMB-Net has engineered an Adaptive Perceptual Learning (APL) Module and a Hierarchical Feature Pyramid Network (HFPN) to amplify spatial perception capabilities and amalgamate features at varying scales and levels, thus boosting detection precision. Extensive experiments on widely utilized datasets, including the State Farm dataset and Bayonet-Drivers, demonstrated the remarkable performance of the proposed DGMB-Net.
Research on data security in industry 4.0 manufacturing industry against the background of privacy protection challenges

Authors:
raw_author_name: Chang Zeng
raw_affiliation_string: Law School, Hunan University, Changsha, China

Abstract: As the manufacturing industry advances into the era of Industry 4.0, data security has emerged as a critical concern in the face of growing privacy protection challenges. This research paper explores data security challenges in the Industry 4.0 manufacturing industry and the associated privacy protection concerns. It highlights the risks of interconnected systems and data-driven processes while emphasizing the need for a comprehensive framework. The proposed framework encompasses technological, organizational, and regulatory measures to safeguard data at all stages. The study also examines legal and ethical considerations and suggests strategies to enhance privacy protection. The research aims to provide insights for stakeholders in the manufacturing industry, policymakers, and researchers to strengthen data security practices and uphold privacy rights in the Industry 4.0 landscape.