Reviewerly/exHarmony huggingface dataset:
Unsupervised Multi-View K-Means Clustering Algorithm

Since advanced technologies via social media, internet, virtual communities and networks and internet of things (IoT), there are more multi-view data to be collected. Multi-view clustering is a substantial tool as a natural design for clustering multi-view data. K-means (KM) clustering for (single-view) data had been extended for handling multi-view data, called multi-view KM (MV-KM). In the literature, most MV-KM clustering algorithms are reported to be influenced by initializations and also need a given number of clusters. In this paper, we propose an unsupervised type of MV-KM clustering algorithm so that it can automatically find an optimal number of clusters without any initialization. We call it unsupervised MV-KM (U-MV-KM). Moreover, we also propose three multi-view cluster validity indices, called multi-view Dunn index (MV-Dunn), multi-view generalized Dunn index (MV-G-Dunn) and multi-view modified Dunn (MV-M-Dunn) indices for MV-KM clustering algorithms. We make experiments on some synthetic and real data sets and also make comparisons with some existing algorithms. Based on the experimental results and comparisons, the proposed U-MV-KM clustering algorithm actually shows good results. We also apply U-MV-KM to real data sets, the results demonstrate the superiority and usefulness of the U-MV-KM algorithm for clustering multi-view data.
A Survey on Optical Phase-Change Memory: The Promise and Challenges

Silicon photonics (SiPh) technology has facilitated the deployment of integrated photonics across different application domains, from ultra-fast communication in Datacom applications to energy-efficient optical computation in emerging hardware accelerators for machine learning. More recently, the integration of SiPh and phase change materials has created a unique opportunity to realize adaptable, reconfigurable, and programmable photonic platforms. In particular, the nonvolatile programmability in phase change materials has made them a promising candidate for implementing photonic memory cells and architectures. Accordingly, photonic memory systems and even in-memory photonic computing paradigms are on the rise, especially given their potential for improving data access in electronic and photonic processors. However, there are still many challenges in the design and fabrication of phase-change photonic integrated circuits, which need to be addressed. This article presents a comprehensive survey on the recent advances and challenges for the integration of phase change materials with contemporary photonic devices while focusing on the photonic memory application. In particular, we explore phase-change photonic memory from the material level to the architecture level by presenting an overview of different material-level characteristics of phase change materials with their optical, electrical, and thermal properties as well as their integration into SiPh devices and photonic memory architectures and their application for in-memory photonic computing. We also present a comparison with electronic memory and discuss open research challenges that must be addressed to further advance phase-change photonic memory towards successful integration into emerging computing systems.
Multi-objective path planning for mobile robot in nuclear accident environment based on improved ant colony optimization with modified A∗

This paper presents a hybrid algorithm to solve the multi-objective path planning (MOPP) problem for mobile robots in a static nuclear accident environment. The proposed algorithm mimics a real nuclear accident site by modeling the environment with a two-layer cost grid map based on geometric modeling and Monte Carlo calculations. The proposed algorithm consists of two steps. The first step optimizes a path by the hybridization of improved ant colony optimization algorithm-modified A∗ (IACO-A∗) that minimizes path length, cumulative radiation dose and energy consumption. The second module is the high radiation dose rate avoidance strategy integrated with the IACO-A∗ algorithm, which will work when the mobile robots sense the lethal radiation dose rate, avoiding radioactive sources with high dose levels. Simulations have been performed under environments of different complexity to evaluate the efficiency of the proposed algorithm, and the results show that IACO-A∗ has better path quality than ACO and IACO. In addition, a study comparing the proposed IACO-A∗ algorithm and recent path planning (PP) methods in three scenarios has been performed. The simulation results show that the proposed IACO-A∗ algorithm is obviously superior in terms of stability and minimization the total cost of MOPP.
A Comprehensive Empirical Study of Bias Mitigation Methods for Machine Learning Classifiers

Software bias is an increasingly important operational concern for software engineers. We present a large-scale, comprehensive empirical study of 17 representative bias mitigation methods for Machine Learning (ML) classifiers, evaluated with 11 ML performance metrics (e.g., accuracy), 4 fairness metrics, and 20 types of fairness-performance tradeoff assessment, applied to 8 widely-adopted software decision tasks. The empirical coverage is much more comprehensive, covering the largest numbers of bias mitigation methods, evaluation metrics, and fairness-performance tradeoff measures compared to previous work on this important software property. We find that (1) the bias mitigation methods significantly decrease ML performance in 53% of the studied scenarios (ranging between 42%∼66% according to different ML performance metrics); (2) the bias mitigation methods significantly improve fairness measured by the 4 used metrics in 46% of all the scenarios (ranging between 24%∼59% according to different fairness metrics); (3) the bias mitigation methods even lead to decrease in both fairness and ML performance in 25% of the scenarios; (4) the effectiveness of the bias mitigation methods depends on tasks, models, the choice of protected attributes, and the set of metrics used to assess fairness and ML performance; (5) there is no bias mitigation method that can achieve the best tradeoff in all the scenarios. The best method that we find outperforms other methods in 30% of the scenarios. Researchers and practitioners need to choose the bias mitigation method best suited to their intended application scenario(s).
Hybrid Quantum Annealing for Larger-than-QPU Lattice-structured Problems

Quantum processing units (QPUs) executing annealing algorithms have shown promise in optimization and simulation applications. Hybrid algorithms are a natural bridge to larger applications. We present a simple greedy method for solving larger-than-QPU lattice-structured Ising optimization problems. The method, implemented in the open source D-Wave Hybrid framework, uses a QPU coprocessor operating with generic parameters. Performance is evaluated for standard spin-glass problems on two lattice types with up to 11,616 spin variables, double the size that is directly programmable on any available QPU. The proposed method is shown to converge to low-energy solutions faster than an open source simulated annealing method that is either directly employed or substituted as a coprocessor in the hybrid method. Using newer Advantage QPUs in place of D-Wave 2000Q QPUs is shown to enhance convergence of the hybrid method to low energies and to achieve a lower final energy.
A Multi-Scale Traffic Object Detection Algorithm for Road Scenes Based on Improved YOLOv5

Object detection in road scenes is a task that has recently become popular and it is also an important part of intelligent transportation systems. Due to the different locations of cameras in the road scenes, the size of the traffic objects captured varies greatly, which imposes a burden on the network optimization. In addition, in some dense traffic scenes, the size of the traffic objects captured is extremely small and it is easy to miss detection and to encounter false detection. In this paper, we propose an improved multi-scale YOLOv5s algorithm based on the YOLOv5s algorithm. In detail, we add a detection head for extremely small objects to the original YOLOv5s model, which significantly improves the accuracy in detecting extremely small traffic objects. A content-aware reassembly of features (CARAFE) module is introduced in the feature fusion part to enhance the feature fusion. A new SPD-Conv CNN Module is introduced instead of the original convolutional structure to enhance the overall computational efficiency of the model. Finally, the normalization-based attention module (NAM) is introduced, allowing the model to focus on more useful information during training and significantly improving detection accuracy. The experimental results demonstrate that compared with the original YOLOv5s algorithm, the detection accuracy of the multi-scale YOLOv5s model proposed in this paper is improved by 7.1% on the constructed diverse traffic scene datasets. The improved multi-scale YOLOv5s algorithm also maintains the highest detection accuracy among the current mainstream object detection algorithms and is superior in accomplishing the task of detecting traffic objects in complex road scenes.
Smart algorithm in wireless networks for video streaming based on adaptive quantization

Summary Nowadays, smart multimedia network services have become crucial in the healthcare system. The network parameters of Quality of Service (QoS) are widely affecting the efficiency and accuracy of multimedia streaming in wireless environments. This paper proposes an adaptation framework model, which makes a relation between the QP (quantization parameter) in H.264 and H.265 codecs and the QoS of 5G wireless technology. Besides, the effect of QP and packet loss have been studied because of their impact on video streaming. Packet loss of 5G wireless network characteristic is emulated to determine the impact of QP on the received video quality using objective and subjective quality metrics such as PSNR (peak signal to noise ratio), SSIM (structure similarity), and DMOS (differential mean opinion score). In this research, a Testbed is implemented to stream the encoded video from the server to the end users. The application model framework has automatically evaluated the QoE (Quality of Experience). Accordingly, the model detects the defect of network packet loss and selects the optimum QP value to enhance the QoE by the end‐users. The application has been tested on low and high video motions with full high definition (HD) resolution (1920 × 1080) which were taken from ( https://www.xiph.org/downloads/ ). Test results based on the objective and subjective quality measurements indicate that an optimal QP = 35 and QP = 30 have been chosen for low and high motion respectively to satisfy user QoE requirements.
Sparse online Gaussian process adaptation for incremental backstepping flight control

Presence of uncertainties caused by unforeseen malfunctions in actuation or measurement systems or changes in aircraft behaviour could lead to aircraft loss-of-control during flight. This paper considers sparse online Gaussian Processes (GP) adaptive augmentation for Incremental Backstepping (IBKS) flight control. IBKS uses angular accelerations and control deflections to reduce the dependency on the aircraft model. However, it requires knowledge of the relationship between inner and outer loops and control effectiveness. Proposed indirect adaptation significantly reduces model dependency. Global uniform ultimate boundness is proved for the resultant GP adaptive IBKS. Conducted research shows that if the input-affine property is violated, e.g., in severe conditions with a combination of multiple failures, the IBKS can lose stability. Meanwhile, the proposed sparse GP-based estimator provides fast online identification and the resultant controller demonstrates improved stability and tracking performance.
Trustworthy Artificial Intelligence Requirements in the Autonomous Driving Domain

We identify the maturity level of the different requirements for artificial intelligence (AI) in autonomous driving and outline the main challenges to be addressed in the future to ensure that automotive AI systems are developed in a trustworthy way.
Relationship-aware contrastive learning for social recommendations

The popularity bias is an outstanding challenge in recommendation systems. Prevalent work based on contrastive learning (CL) alleviates this issue but neglects the relationship among data, which limits the ability of CL and leads to a loss of personalized features of users/items, and thus degrades the performance of the recommendation systems. In this paper, we propose a model-agnostic contrastive learning framework, called Relationship-aware Contrastive Learning (ReACL), to make recommendations to users. ReACL framework utilizes the relationship homophily among data to achieve a uniform distribution for node and align the relevant features to preserve personalized features and avoids the problem of popularity bias. We first combine a graph of user-item interaction with that of a social network to mine views on the relationships of users on social networks as well as those of item commonality. We then apply these two views to construct contrastive learning pairs on the user and item sides, respectively. We design two sample selectors and an augmented contrastive loss function to preserve personalized features. Furthermore, we jointly optimize the tasks of supervised learning and contrastive learning. Finally, we conduct extensive experiments on four public datasets, and the results show that the proposed ReACL framework outperforms state-of-the-art algorithms.
HiFlash: Communication-Efficient Hierarchical Federated Learning With Adaptive Staleness Control and Heterogeneity-Aware Client-Edge Association

Federated learning (FL) is a promising paradigm that enables collaboratively learning a shared model across massive clients while keeping the training data locally. However, for many existing FL systems, clients need to frequently exchange model parameters of large data size with the remote cloud server directly via wide-area networks (WAN), leading to significant communication overhead and long transmission time. To mitigate the communication bottleneck, we resort to the hierarchical federated learning paradigm of HiFL, which reaps the benefits of mobile edge computing and combines synchronous client-edge model aggregation and asynchronous edge-cloud model aggregation together to greatly reduce the traffic volumes of WAN transmissions. Specifically, we first analyze the convergence bound of HiFL theoretically and identify the key controllable factors for model performance improvement. We then advocate an enhanced design of HiFlash by innovatively integrating deep reinforcement learning based adaptive staleness control and heterogeneity-aware client-edge association strategy to boost the system efficiency and mitigate the staleness effect without compromising model accuracy. Extensive experiments corroborate the superior performance of HiFlash in model accuracy, communication reduction, and system efficiency.
Exploring Optical-Flow-Guided Motion and Detection-Based Appearance for Temporal Sentence Grounding

Temporal sentence grounding aims to localize a target segment in an untrimmed video semantically according to a given sentence query. Most previous works focus on learning frame-level features of each whole frame <xref ref-type="fn" rid="fn1" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><sup>1</sup></xref> <fn id="fn1" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><label><sup>1</sup></label> In this paper, the frame is a general concept for an actual video frame or a video clip which consists of a few consecutive frames. </fn> in the entire video, and directly match them with the textual information. Such frame-level feature extraction leads to the obstacles of these methods in distinguishing ambiguous video frames with complicated contents and subtle appearance differences, thus limiting their performance. In order to differentiate fine-grained appearance similarities among consecutive frames, some state-of-the-art methods additionally employ a detection model like Faster R-CNN to obtain detailed object-level features in each frame for filtering out the redundant background contents. However, these methods suffer from missing motion analysis since the object detection module in Faster R-CNN lacks temporal modeling. To alleviate the above limitations, in this paper, we propose a novel <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">M</b> otion- and <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">A</b> ppearance-guided <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">3</b> D <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">S</b> emantic <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">R</b> easoning <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">N</b> etwork (MA3SRN), which incorporates optical-flow-guided motion-aware, detection-based appearance-aware, and 3D-aware object-level features to better reason the spatial-temporal object relations for accurately modelling the activity among consecutive frames. Specifically, we first develop three individual branches for motion, appearance, and 3D encoding separately to learn fine-grained motion-guided, appearance-guided, and 3D-aware object features, respectively. Then, both motion and appearance information from corresponding branches are associated to enhance the 3D-aware features for the final precise grounding. Extensive experiments on three challenging datasets (ActivityNet Caption, Charades-STA and TACoS) demonstrate that the proposed MA3SRN model achieves a new state-of-the-art.
Secure Medical Image Communication Using Fragile Data Hiding Based on Discrete Wavelet Transform and A₅ Lattice Vector Quantization

Secure communication of medical images is essential to telemedicine. Message Authentication Codes (MAC) can be embedded inside medical images to protect their integrity. Fragile watermarking algorithms are suitable options since they can be used to detect any tampering attempt. In this paper, a novel fragile data-hiding algorithm based on Integer-to-Integer Discrete Wavelet Transforms (IIDWT) and <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$A_{5}$ </tex-math></inline-formula> Lattice Vector Quantization (LVQ) is proposed. In the proposed data-hiding algorithm, a combination of the medical image Metadata and a MAC is embedded into the medical image. The Metadata includes information about the patient such as name, family, birthday, the place where it is created such as the name of the hospital, and the physician’s name. To preserve the privacy of the patients and the physician/hospital, the Metadata is then replaced with fake information. The receiver can extract the Metadata and the MAC. If the extracted MAC is the same as the expected MAC, the integrity of the medical image is guaranteed. Otherwise, a tampering attempt is detected. The proposed algorithm can embed 50% more data than similar algorithms in medical images while keeping the Peak Signal to Noise Ratio (PSNR) in acceptable ranges. Furthermore, the proposed algorithm is applied to a dataset of medical images and high PSNR values above 53.88 dB are experienced.
Hybrid Architecture using CNN and LSTM for Image Captioning in Hindi Language

With the advent of deep learning in recent years, the integration of computer vision with natural language processing has garnered a lot of attention. Generating descriptions from images is one of the most intriguing and focused areas of Machine Learning that faces a number of obstacles, particularly when describing images in languages other than English. In image captioning, a computer is trained to understand the visual information of an image and then generate a description based on the image features and reference sentences. Having an application that automatically describes events in their environment and then translates them into a caption or message can make a significant contribution to society. This paper presents a multi-layered CNN-LSTM neural network model that is utilized to recognize and generate Hindi captions for the objects in images. In addition, a variety of models were trained by adjusting hyperparameters and the number of hidden layers to find the optimum model and maximize the likelihood of the resultant Hindi description. Moreover, after testing the effectiveness of our models, it was observed that our model has shown an increase of 34.64% and 29.13% in terms of BLEU score (Unigram) and BLEU score (Bigram) respectively when compared to the existing work done in this field. Image captioning in Hindi can have a multitude of applications in today's society, and it can also provide a user-friendly interface for Hindi speakers.
Toward Next-Generation Signal Intelligence: A Hybrid Knowledge and Data-Driven Deep Learning Framework for Radio Signal Classification

Automatic modulation classification (AMC) can generally be divided into knowledge-based methods and data-driven methods. In this paper, we explore combining the knowledge-based method and data-driven technology to take full advantage of both and propose a hybrid knowledge and data-driven deep learning framework (HKDD) for AMC. To make the handcrafted features more discriminative, various traditional features are adopted, including instantaneous features, statistical features, and spectral features. In the HKDD framework, a feature fusion mechanism is proposed to integrate the features learned from the original signal with those processed by a fully connected network from the handcrafted features. Besides, an attention mechanism is implemented on the fused features to neglect immature features and highlight important features. To evaluate the performance of the proposed method, we construct two modulation classification datasets containing both traditional features and raw IQ data. The bigger one contains 36 modulation categories, which is greater than the number of categories of any AMC dataset currently available. Simulation results show that our proposed method has significant performance gain in both adequate-sample classification scenario and few-shot classification scenario.