Reviewerly/exHarmony huggingface dataset:
Unleashing the Potential of Blockchain and Machine Learning: Insights and Emerging Trends From Bibliometric Analysis

Blockchain and machine learning (ML) has garnered growing interest as cutting-edge technologies that have witnessed tremendous strides in their respective domains. Blockchain technology provides a decentralized and immutable ledger, enabling secure and transparent transactions without intermediaries. Alternatively, ML is a sub-field of artificial intelligence (AI) that empowers systems to enhance their performance by learning from data. The integration of these data-driven paradigms holds the potential to reinforce data privacy and security, improve data analysis accuracy, and automate complex processes. The confluence of blockchain and ML has sparked increasing interest among scholars and researchers. Therefore, a bibliometric analysis is carried out to investigate the key focus areas, hotspots, potential prospects, and dynamical aspects of the field. This paper evaluates 700 manuscripts drawn from the Web of Science (WoS) core collection database, spanning from 2017 to 2022. The analysis is conducted using advanced bibliometric tools (e.g., Bibliometrix R, VOSviewer, and CiteSpace) to assess various aspects of the research area regarding publication productivity, influential articles, prolific authors, the productivity of academic countries and institutions, as well as the intellectual structure in terms of hot topics and emerging trends. The findings suggest that upcoming research should focus on blockchain technology, AI-powered 5G networks, industrial cyber-physical systems, IoT environments, and autonomous vehicles. This paper provides a valuable foundation for both academic scholars and practitioners as they contemplate future projects on the integration of blockchain and ML.
Global Path Planning of Unmanned Surface Vehicle Based on Improved A-Star Algorithm

To make unmanned surface vehicles that are better applied to the field of environmental monitoring in inland rivers, reservoirs, or coasts, we propose a global path-planning algorithm based on the improved A-star algorithm. The path search is carried out using the raster method for environment modeling and the 8-neighborhood search method: a bidirectional search strategy and an evaluation function improvement method are used to reduce the total number of traversing nodes; the planned path is smoothed to remove the inflection points and solve the path folding problem. The simulation results reveal that the improved A-star algorithm is more efficient in path planning, with fewer inflection points and traversing nodes, and the smoothed paths are more to meet the actual navigation demands of unmanned surface vehicles than the conventional A-star algorithm.
How to develop, test, and extend multinomial processing tree models: A tutorial.

Many psychological theories assume that observable responses are determined by multiple latent processes. Multinomial processing tree (MPT) models are a class of cognitive models for discrete responses that allow researchers to disentangle and measure such processes. Before applying MPT models to specific psychological theories, it is necessary to tailor a model to specific experimental designs. In this tutorial, we explain how to develop, fit, and test MPT models using the classical pair-clustering model as a running example. The first part covers the required data structures, model equations, identifiability, model validation, maximum-likelihood estimation, hypothesis tests, and power analyses using the software multiTree. The second part introduces hierarchical MPT modeling which allows researchers to account for individual differences and to estimate the correlations of latent processes among each other and with additional covariates using the TreeBUGS package in R. All examples including data and annotated analysis scripts are provided at the Open Science Framework (https://osf.io/24pbm/). (PsycInfo Database Record (c) 2023 APA, all rights reserved).
Client Selection in Federated Learning: Principles, Challenges, and Opportunities

As a privacy-preserving paradigm for training machine learning (ML) models, federated learning (FL) has received tremendous attention from both industry and academia. In a typical FL scenario, clients exhibit significant heterogeneity in terms of data distribution and hardware configurations. Thus, randomly sampling clients in each training round may not fully exploit the local updates from heterogeneous clients, resulting in lower model accuracy, slower convergence rate, degraded fairness, etc. To tackle the FL client heterogeneity problem, various client selection algorithms have been developed, showing promising performance improvement. In this article, we systematically present recent advances in the emerging field of FL client selection and its challenges and research opportunities. We hope to facilitate practitioners in choosing the most suitable client selection mechanisms for their applications, as well as inspire researchers and newcomers to better understand this exciting research topic.
Intelligent System for ATM Fraud Detection System using C-LSTM Approach

ATMs are vulnerable to a wide variety of assaults and fraud because of the money and personal information available on it. In response, today’s ATMs feature enhanced hardware security systems are capable of identifying specific forms of fraud and manipulation. However, there is no defense in place for future attacks that can’t be anticipated during design. It shows how automated teller machines (ATMs) can be secured against theft without the need for extra hardware. The goal is to employ automatic techniques of model generation to learn normal behavior patterns from the status information of the standard de vices that make up an ATM, with a significant divergence from the taught behavior indicating a fraud attempt. Preprocessing, feature selection, and model training are all parts of the proposed method. Cleaning, integrating, and deduplicating data are all parts of data preprocessing. BOA is employed in feature selection and C-LSTM is used for model training. In C-LSTM, a LSTM recurrent neural network is used to obtain the sentence representation after CNN is used to extract a sequence of higher-level phrase representations. C-LSTM can learn the global and temporal sentence semantics in addition to the local aspects of phrases. When compared to LSTM and CNN, the proposed method fares very well.
Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE

This paper describes the CAVE (CAVE Automatic Virtual Environment) virtual reality/scientific visualization system in detail and demonstrates that projection technology applied to virtual-reality goals achieves a system that matches the quality of workstation screens in terms of resolution, color, and flicker-free stereo. In addition, this format helps reduce the effect of common tracking and system latency errors. The off-axis perspective projection techniques we use are shown to be simple and straightforward. Our techniques for doing multi-screen stereo vision are enumerated, and design barriers, past and current, are described. Advantages and disadvantages of the projection paradigm are discussed, with an analysis of the effect of tracking noise and delay on the user. Successive refinement, a necessary tool for scientific visualization, is developed in the virtual reality context. The use of the CAVE as a one-to-many presentation device at SIGGRAPH '92 and Supercomputing '92 for computational science data is also mentioned.
Enhancing the engineering supervision process in China: A solution enabled by integrating hybrid blockchain system

This paper analyzes the current status of the engineering supervision process in construction and infrastructure projects in China. It discusses the existing problems, such as low efficiency of supervision, distorted monitoring data, resource waste, and environmental damage. Based on extensive literature research and combining the consensus mechanism, ECDSA encryption algorithm and so on, the paper proposes the idea of integrating blockchain technology with the engineering supervision process. This includes the decision of blockchain type, the use of digital signature technology to implement responsibility, and the construction of a hybrid blockchain system using the blockchain's consensus mechanism. The paper presents the general design, the design of the system structures, and the design of modules of the system. Through this system, project participants can verify their identities and share sensitive information confidentially, thereby improving the efficiency of supervision work and preventing data forgery, reducing resource waste, decreasing carbon emissions, and minimizing environmental damage.
MM-BSN: Self-Supervised Image Denoising for Real-World with Multi-Mask based on Blind-Spot Network

Recent advances in deep learning have been pushing image denoising techniques to a new level. In self-supervised image denoising, blind-spot network (BSN) is one of the most common methods. However, most of the existing BSN algorithms use a dot-based central mask, which is recognized as inefficient for images with large-scale spatially correlated noise. In this paper, we give the definition of large-noise and propose a multi-mask strategy using multiple convolutional kernels masked in different shapes to further break the noise spatial correlation. Furthermore, we propose a novel self-supervised image denoising method that combines the multi-mask strategy with BSN (MM-BSN). We show that different masks can cause significant performance differences, and the proposed MM-BSN can efficiently fuse the features extracted by multi-masked layers, while recovering the texture structures destroyed by multi-masking and information transmission. Our MM-BSN can be used to address the problem of large-noise denoising, which cannot be efficiently handled by other BSN methods. Extensive experiments on public real-world datasets demonstrate that the proposed MM-BSN achieves state-of-the-art performance among self-supervised and even unpaired image denoising methods for sRGB images denoising, without any labelling effort or prior knowledge. Code can be found in https://github.com/dannie125/MM-BSN.
A Hybrid Dependable Deep Feature Extraction and Ensemble-Based Machine Learning Approach for Breast Cancer Detection

Breast cancer is a prevalent and life-threatening disease that requires effective detection and diagnosis methods to improve patient outcomes. Deep learning (DL) and machine learning (ML) techniques have emerged as powerful tools in breast cancer detection, offering benefits such as improved accuracy and efficiency. However, existing methods have scalability and performance limitations, emphasizing the need for further research. In this paper, we propose a hybrid dependable breast cancer detection approach that combines the power of DL using a pre-trained ResNet50V2 model and ensemble-based ML methods. The integration of DL enables the approach to learn and extract hidden patterns from complex breast cancer images, while ML algorithms contribute interpretability and generalization capabilities. We conducted extensive experiments using a breast histopathology image-based publicly available Invasive Ductal Carcinoma (IDC) dataset comprising samples of different sizes. The results obtained from our rigorous experiments provide compelling evidence for our hybrid model’s robustness and high performance. We achieved a higher accuracy rate of 95%, precision of 94.86%, recall of 94.32%, and F1 score of 94.57% compared to state-of-the-art models. We also identified Light Boosting Classifier (LGB) as the most suitable ML model in conjunction with the ResNet50V2 architecture. The results of this research offer significant contributions to breast cancer detection through an innovative approach, comprehensive performance analysis, and dependable assessment. Moreover, it has the potential to assist medical professionals in making informed decisions, improving patient care, and enhancing outcomes for breast cancer patients.
A Yolo-Based Model for Breast Cancer Detection in Mammograms

Abstract This work aims to implement an automated data-driven model for breast cancer detection in mammograms to support physicians’ decision process within a breast cancer screening or detection program. The public available CBIS-DDSM and the INbreast datasets were used as sources to implement the transfer learning technique on full-field digital mammography proprietary dataset. The proprietary dataset reflects a real heterogeneous case study, consisting of 190 masses, 46 asymmetries, and 71 distortions. Several Yolo architectures were compared, including YoloV3, YoloV5, and YoloV5-Transformer. In addition, Eigen-CAM was implemented for model introspection and outputs explanation by highlighting all the suspicious regions of interest within the mammogram. The small YoloV5 model resulted in the best developed solution obtaining an mAP of 0.621 on proprietary dataset. The saliency maps computed via Eigen-CAM have proven capable solution reporting all regions of interest also on incorrect prediction scenarios. In particular, Eigen-CAM produces a substantial reduction in the incidence of false negatives, although accompanied by an increase in false positives. Despite the presence of hard-to-recognize anomalies such as asymmetries and distortions on the proprietary dataset, the trained model showed encouraging detection capabilities. The combination of Yolo predictions and the generated saliency maps represent two complementary outputs for the reduction of false negatives. Nevertheless, it is imperative to regard these outputs as qualitative tools that invariably necessitate clinical radiologic evaluation. In this view, the model represents a trusted predictive system to support cognitive and decision-making, encouraging its integration into real clinical practice.
Revealing the Dark Secrets of Masked Image Modeling

Masked image modeling (MIM) as pre-training is shown to be effective for numerous vision downstream tasks, but how and where MIM works remain unclear. In this paper, we compare MIM with the long-dominant supervised pretrained models from two perspectives, the visualizations and the experiments, to uncover their key representational differences. From the visualizations, we find that MIM brings locality inductive bias to all layers of the trained models, but supervised models tend to focus locally at lower layers but more globally at higher layers. That may be the reason why MIM helps Vision Transformers that have a very large receptive field to optimize. Using MIM, the model can maintain a large diversity on attention heads in all layers. But for supervised models, the diversity on attention heads almost disappears from the last three layers and less diversity harms the fine-tuning performance. From the experiments, we find that MIM models can perform significantly better on geometric and motion tasks with weak semantics or fine-grained classification tasks, than their supervised counterparts. Without bells and whistles, a standard MIM pre-trained SwinV2-L could achieve state-of-the-art performance on pose estimation (78.9 AP on COCO test-dev and 78.0 AP on CrowdPose), depth estimation (0.287 RMSE on NYUv2 and 1.966 RMSE on KITTI), and video object tracking (70.7 SUC on LaSOT). For the semantic understanding datasets where the categories are sufficiently covered by the supervised pre-training, MIM models can still achieve highly competitive transfer performance. With a deeper understanding of MIM, we hope that our work can inspire new and solid research in this direction. Code will be available at https://github.com/zdaxie/MIM-DarkSecrets.
Turning a CLIP Model into a Scene Text Detector

The recent large-scale Contrastive Language-Image Pretraining (CLIP) model has shown great potential in various downstream tasks via leveraging the pretrained vision and language knowledge. Scene text, which contains rich textual and visual information, has an inherent connection with a model like CLIP. Recently, pretraining approaches based on vision language models have made effective progresses in the field of text detection. In contrast to these works, this paper proposes a new method, termed TCM, focusing on Turning the CLIP Model directly for text detection without pretraining process. We demonstrate the advantages of the proposed TCM as follows: (1) The underlying principle of our framework can be applied to improve existing scene text detector. (2) It facilitates the few-shot training capability of existing methods, e.g., by using 10% of labeled data, we significantly improve the performance of the baseline method with an average of 22% in terms of the F-measure on 4 benchmarks. (3) By turning the CLIP model into existing scene text detection methods, we further achieve promising domain adaptation ability. The code will be publicly released at https://github.com/wenwenyu/TCM.
Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person Retrieval

Text-to-image person retrieval aims to identify the target person based on a given textual description query. The primary challenge is to learn the mapping of visual and textual modalities into a common latent space. Prior works have attempted to address this challenge by leveraging separately pre-trained unimodal models to extract visual and textual features. However, these approaches lack the necessary underlying alignment capabilities required to match multimodal data effectively. Besides, these works use prior information to explore explicit part alignments, which may lead to the distortion of intra-modality information. To alleviate these issues, we present IRRA: a cross-modal Implicit Relation Reasoning and Aligning framework that learns relations between local visual-textual tokens and enhances global image-text matching without requiring additional prior supervision. Specifically, we first design an Implicit Relation Reasoning module in a masked language modeling paradigm. This achieves cross-modal interaction by integrating the visual cues into the textual tokens with a cross-modal multimodal interaction encoder. Secondly, to globally align the visual and textual embeddings, Similarity Distribution Matching is proposed to minimize the KL divergence between image-text similarity distributions and the normalized label matching distributions. The proposed method achieves new state-of-the-art results on all three public datasets, with a notable margin of about 3%-9% for Rank-1 accuracy compared to prior methods.
Explicit Visual Prompting for Low-Level Structure Segmentations

We consider the generic problem of detecting low-level structures in images, which includes segmenting the manipulated parts, identifying out-of-focus pixels, separating shadow regions, and detecting concealed objects. Whereas each such topic has been typically addressed with a domain-specific solution, we show that a unified approach performs well across all of them. We take inspiration from the widely-used pre-training and then prompt tuning protocols in NLP and propose a new visual prompting model, named Explicit Visual Prompting (EVP). Different from the previous visual prompting which is typically a dataset-level implicit embedding, our key insight is to enforce the tunable parameters focusing on the explicit visual content from each individual image, i.e., the features from frozen patch embeddings and the input's high-frequency components. The proposed EVP significantly outperforms other parameter-efficient tuning protocols under the same amount of tunable parameters (5.7% extra trainable parameters of each task). EVP also achieves state-of-the-art performances on diverse low-level structure segmentation tasks compared to task-specific solutions. Our code is available at: https://github.com/NiFangBaAGe/Explicit-Visual-Prompt.
SDC-UDA: Volumetric Unsupervised Domain Adaptation Framework for Slice-Direction Continuous Cross-Modality Medical Image Segmentation

Recent advances in deep learning-based medical image segmentation studies achieve nearly human-level performance in fully supervised manner. However, acquiring pixel-level expert annotations is extremely expensive and laborious in medical imaging fields. Unsupervised domain adaptation (UDA) can alleviate this problem, which makes it possible to use annotated data in one imaging modality to train a network that can successfully perform segmentation on target imaging modality with no labels. In this work, we propose SDC-UDA, a simple yet effective volumetric UDA framework for Slice-Direction Continuous cross-modality medical image segmentation which combines intra- and inter-slice self-attentive image translation, uncertainty-constrained pseudo-label refinement, and volumetric self-training. Our method is distinguished from previous methods on UDA for medical image segmentation in that it can obtain continuous segmentation in the slice direction, thereby ensuring higher accuracy and potential in clinical practice. We validate SDC-UDA with multiple publicly available cross-modality medical image segmentation datasets and achieve state-of-the-art segmentation performance, not to mention the superior slice-direction continuity of prediction compared to previous studies.
Generalized Decoding for Pixel, Image, and Language

We present X-Decoder, a generalized decoding model that can predict pixel-level segmentation and language tokens seamlessly. X-Decoder takes as input two types of queries: (i) generic non-semantic queries and (ii) semantic queries induced from text inputs, to decode different pixel-level and token-level outputs in the same semantic space. With such a novel design, X-Decoder is the first work that provides a unified way to support all types of image segmentation and a variety of vision-language (VL) tasks. Without any pseudo-labeling, our design enables seamless interactions across tasks at different granularities and brings mutual benefits by learning a common and rich pixel-level understanding. After pretraining on a mixed set of a limited amount of segmentation data and millions of image-text pairs, X-Decoder exhibits strong transferability to a wide range of downstream tasks in both zero-shot and finetuning settings. Notably, it achieves (1) state-of-the-art results on open-vocabulary segmentation and referring segmentation on seven datasets; (2) better or competitive finetuned performance to other generalist and specialist models on segmentation and VL tasks; and (3) flexibility for efficient fine-tuning and novel task composition (e.g., referring captioning and image editing shown in Fig. 1). Code, demo, video and visualization are available at: https://x-decoder-vl.github.io.
Learning a Simple Low-Light Image Enhancer from Paired Low-Light Instances

Low-light Image Enhancement (LIE) aims at improving contrast and restoring details for images captured in lowlight conditions. Most of the previous LIE algorithms adjust illumination using a single input image with several handcrafted priors. Those solutions, however, often fail in revealing image details due to the limited information in a single image and the poor adaptability of handcrafted priors. To this end, we propose PairLIE, an unsupervised approach that learns adaptive priors from low-light image pairs. First, the network is expected to generate the same clean images as the two inputs share the same image content. To achieve this, we impose the network with the Retinex theory and make the two reflectance components consistent. Second, to assist the Retinex decomposition, we propose to remove inappropriate features in the raw image with a simple self-supervised mechanism. Extensive experiments on public datasets show that the proposed PairLIE achieves comparable performance against the state-of-the-art approaches with a simpler network and fewer handcrafted priors. Code is available at: https://github.com/zhenqifu/PairLIE.