Reviewerly/exHarmony huggingface dataset:
Bidirectional Self-Training with Multiple Anisotropic Prototypes for Domain Adaptive Semantic Segmentation

A thriving trend for domain adaptive segmentation endeavors to generate the high-quality pseudo labels for target domain and retrain the segmentor on them. Under this self-training paradigm, some competitive methods have sought to the latent-space information, which establishes the feature centroids (a.k.a prototypes) of the semantic classes and determines the pseudo label candidates by their distances from these centroids. In this paper, we argue that the latent space contains more information to be exploited thus taking one step further to capitalize on it. Firstly, instead of merely using the source-domain prototypes to determine the target pseudo labels as most of the traditional methods do, we bidirectionally produce the target-domain prototypes to degrade those source features which might be too hard or disturbed for the adaptation. Secondly, existing attempts simply model each category as a single and isotropic prototype while ignoring the variance of the feature distribution, which could lead to the confusion of similar categories. To cope with this issue, we propose to represent each category with multiple and anisotropic prototypes via Gaussian Mixture Model, in order to fit the de facto distribution of source domain and estimate the likelihood of target samples based on the probability density. We apply our method on GTA5->Cityscapes and Synthia->Cityscapes tasks and achieve 61.2% and 62.8% respectively in terms of mean IoU, substantially outperforming other competitive self-training methods. Noticeably, in some categories which severely suffer from the categorical confusion such as "truck" and "bus", our method achieves 56.4% and 68.8% respectively, which further demonstrates the effectiveness of our design. The code and model are available at https://github.com/luyvlei/BiSMAPs.
Prompting for Multi-Modal Tracking

Multi-modal tracking gains attention due to its ability to be more accurate and robust in complex scenarios compared to traditional RGB-based tracking. Its key lies in how to fuse multi-modal data and reduce the gap between modalities. However, multi-modal tracking still severely suffers from data deficiency, thus resulting in the insufficient learning of fusion modules. Instead of building such a fusion module, in this paper, we provide a new perspective on multi-modal tracking by attaching importance to the multi-modal visual prompts. We design a novel multi-modal prompt tracker (ProTrack), which can transfer the multi-modal inputs to a single modality by the prompt paradigm. By best employing the tracking ability of pre-trained RGB trackers learning at scale, our ProTrack can achieve high-performance multi-modal tracking by only altering the inputs, even without any extra training on multi-modal data. Extensive experiments on 5 benchmark datasets demonstrate the effectiveness of the proposed ProTrack.
DEAU-Net: Attention networks based on dual encoder for Medical Image Segmentation

In recent years, variant networks derived from U-Net networks have achieved better results in the field of medical image segmentation. However, we found during our experiments that the current mainstream networks still have certain shortcomings in the learning and extraction of detailed features. Therefore, in this paper, we propose a feature attention network based on dual encoder. In the encoder stage, a dual encoder is used to implement macro feature extraction and micro feature extraction respectively. Feature attention fusion is then performed, resulting in the network that not only performs well in the recognition of macro features, but also in the processing of micro features, which is significantly improved. The network is divided into three stages: (1) learning and capture of macro features and detail features with dual encoders; (2) completing the mutual complementation of macro features and detail features through the residual attention module; (3) complete the fusion of the two features and output the final prediction result. We conducted experiments on two datasets on DEAU-Net and from the results of the comparison experiments, we showed better results in terms of edge detail features and macro features processing.
Fast detection method for prostate cancer cells based on an integrated ResNet50 and YoloV5 framework

To propose a fast detection method for prostate cancer abnormal cells based on deep learning. The purpose of this method is to quickly and accurately locate and identify abnormal cells, so as to improve the efficiency of prostate precancerous screening and promote the application and popularization of prostate cancer cell assisted screening technology.The method includes two stages: preliminary screening of abnormal cell images and accurate identification of abnormal cells. In the preliminary screening stage of abnormal cell images, ResNet50 model is used as the image classification network to judge whether the local area contains cell clusters. In the another stage, YoloV5 model is used as the target detection network to locate and recognize abnormal cells in the image containing cell clusters.This detection method aims at the pathological cell images obtained by the membrane method. And the double stage models proposed in this paper are compared with the single stage model method using only the target detection model. The results show that through the image classification network based on deep learning, we can first judge whether there are abnormal cells in the local area. If there are abnormal cells, we can further use the target detection method based on candidate box for analysis, which can reduce the reasoning time by 50% and improve the efficiency of abnormal cell detection under the condition of losing a small amount of accuracy and slightly increasing the complexity of the model.This study proposes a fast detection method for prostate cancer abnormal cells based on deep learning, which can greatly shorten the reasoning time and improve the detection speed. It is able to improve the efficiency of prostate precancerous screening.
Prototype-Guided Feature Learning for Unsupervised Domain Adaptation

Unsupervised Domain Adaptation transfers knowledge from the source domain to the target domain. It makes remarkable progress in alleviating the label-shortage problem in machine learning. Existing methods focus on aligning the two domain distributions directly. However, due to domain discrepancy, there may be some samples in the source domain being unnecessary or even harmful to the target tasks. Avoiding transferring knowledge from these samples is crucial. Existing researches are limited in this area. To this end, we propose a new unsupervised domain adaptation approach named the prototype-guided feature learning. The proposed method contains three main innovations. Firstly, we propose to utilize the more representative source-domain samples, class prototypes, to learn a domain-invariant subspace with the target samples. Secondly, the modified nearest class prototype method is proposed to predict the target samples by exploiting the structural information of the target domain efficiently. Thirdly, a multi-stage label filtering method is proposed to alleviate the mislabeling problem during training. Extensive experiments manifest that our method is competitive compared to the current mainstream unsupervised domain adaptive methods.
Photovoltaic Power Generation Forecasting for Regional Assessment Using Machine Learning

Solar energy currently plays a significant role in supplying clean and renewable electric energy worldwide. Harnessing solar energy through PV plants requires problems such as site selection to be solved, for which long-term solar resource assessment and photovoltaic energy forecasting are fundamental issues. This paper proposes a fast-track methodology to address these two critical requirements when exploring a vast area to locate, in a first approximation, potential sites to build PV plants. This methodology retrieves solar radiation and temperature data from free access databases for the arbitrary division of the region of interest into land cells. Data clustering and probability techniques were then used to obtain the mean daily solar radiation per month per cell, and cells are clustered by radiation level into regions with similar solar resources, mapped monthly. Simultaneously, temperature probabilities are determined per cell and mapped. Then, PV energy is calculated, including heat losses. Finally, PV energy forecasting is accomplished by constructing the P50 and P95 estimations of the mean yearly PV energy. A case study in Mexico fully demonstrates the methodology using hourly data from 2000 to 2020 from NSRDB. The proposed methodology is validated by comparison with actual PV plant generation throughout the country.
Curriculum Reinforcement Learning Based on K-Fold Cross Validation

With the continuous development of deep reinforcement learning in intelligent control, combining automatic curriculum learning and deep reinforcement learning can improve the training performance and efficiency of algorithms from easy to difficult. Most existing automatic curriculum learning algorithms perform curriculum ranking through expert experience and a single network, which has the problems of difficult curriculum task ranking and slow convergence speed. In this paper, we propose a curriculum reinforcement learning method based on K-Fold Cross Validation that can estimate the relativity score of task curriculum difficulty. Drawing lessons from the human concept of curriculum learning from easy to difficult, this method divides automatic curriculum learning into a curriculum difficulty assessment stage and a curriculum sorting stage. Through parallel training of the teacher model and cross-evaluation of task sample difficulty, the method can better sequence curriculum learning tasks. Finally, simulation comparison experiments were carried out in two types of multi-agent experimental environments. The experimental results show that the automatic curriculum learning method based on K-Fold cross-validation can improve the training speed of the MADDPG algorithm, and at the same time has a certain generality for multi-agent deep reinforcement learning algorithm based on the replay buffer mechanism.
Dual-Population Adaptive Differential Evolution Algorithm L-NTADE

This study proposes a dual-population algorithmic scheme for differential evolution and specific mutation strategy. The first population contains the newest individuals, and is continuously updated, whereas the other keeps the top individuals throughout the whole search process. The proposed mutation strategy combines information from both populations. The proposed L-NTADE algorithm (Linear population size reduction Newest and Top Adaptive Differential Evolution) follows the L-SHADE approach by utilizing its parameter adaptation scheme and linear population size reduction. The L-NTADE is tested on two benchmark sets, namely CEC 2017 and CEC 2022, and demonstrates highly competitive results compared to the state-of-the-art methods. The deeper analysis of the results shows that it displays different properties compared to known DE schemes. The simplicity of L-NTADE coupled with its high efficiency make it a promising approach.
NFTs in Smart Cities: Vision, Applications, and Challenges

Non-Fungible Tokens (NFTs) have recently received widespread attention as their market has experienced massive growth since early 2021. NFTs are blockchain-based tokens used to represent ownership of digital and physical assets in a manner that is transparent, traceable, tamper-proof, secure, and trustworthy. Although NFTs have enabled new applications in the gaming and art industries, their full extent and potential are yet to be explored. In this paper, we outline the vision of using NFTs in smart cities. We describe the main components of NFTs and how smart city applications, such as smart governance, smart services, smart economy, smart industry, smart environment, and smart mobility and transportation, can benefit from them. In addition, we show how leveraging NFTs can add value to the metaverse. Finally, we discuss research challenges that hinderthe adoption of NFTs in smart cities
The JPS Pathfinding System

We describe a pathfinding system based on Jump Point Search (JPS): a recent and very successful search strategy that performs symmetry breaking to speed up optimal pathfinding on grid maps. We first modify JPS for grid maps where corner-cutting moves are not allowed. We then describe JPS+: a new derivative search strategy that reformulates an input graph into an equivalent symmetry-reduced form that can be searched more efficiently. JPS and JPS+ were both submitted to the 2012 Grid-based Path Planning Competition.
An Impartial Take to the CNN vs Transformer Robustness Contest

Following the surge of popularity of Transformers in Computer Vision, several studies have attempted to determine whether they could be more robust to distribution shifts and provide better uncertainty estimates than Convolutional Neural Networks (CNNs). The almost unanimous conclusion is that they are, and it is often conjectured more or less explicitly that the reason of this supposed superiority is to be attributed to the self-attention mechanism. In this paper we perform extensive empirical analyses showing that recent state-of-the-art CNNs (particularly, ConvNeXt [20]) can be as robust and reliable or even sometimes more than the current state-of-the-art Transformers. However, there is no clear winner. Therefore, although it is tempting to state the definitive superiority of one family of architectures over another, they seem to enjoy similar extraordinary performances on a variety of tasks while also suffering from similar vulnerabilities such as texture, background, and simplicity biases.
Evolution of Software Testing Strategies and Trends: Semantic Content Analysis of Software Research Corpus of the Last 40 Years

From the early days of computer systems to the present, software testing has been considered as a crucial process that directly affects the quality and reliability of software-oriented products and services. Accordingly, there is a huge amount of literature regarding the improvement of software testing approaches. However, there are limited reviews that show the whole picture of the software testing studies covering the topics and trends of the field. This study aims to provide a general figure reflecting topics and trends of software testing by analyzing the majority of software testing articles published in the last 40 years. A semi-automated methodology is developed for the analysis of software testing corpus created from core publication sources. The methodology of the study is based on the implementation of probabilistic topic modeling approach to discover hidden semantic patterns in the 14,684 published articles addressing software testing issues between 1980 and 2019. The results revealed 42 topics of the field, highlighting five software development ages, namely specification, detection, generation, evaluation, and prediction. The recent accelerations of the topics also showed a trend toward prediction-based software testing actions. Additionally, a higher trend on the topics concerning “Security Vulnerability”, “Open Source” and “Mobile Application” was identified. This study showed that the current trend of software testing is towards prediction-based testing strategies. Therefore, the findings of this study may provide valuable insights for the industry and software communities to be prepared for the possible changes in the software testing procedures using prediction-based approaches.
Training-free Transformer Architecture Search

Recently, Vision Transformer (ViT) has achieved remarkable success in several computer vision tasks. The progresses are highly relevant to the architecture design, then it is worthwhile to propose Transformer Architecture Search (TAS) to search for better ViTs automatically. However, current TAS methods are time-consuming and existing zero-cost proxies in CNN do not generalize well to the ViT search space according to our experimental observations. In this paper, for the first time, we investigate how to conduct TAS in a training-free manner and devise an effective training-free TAS (TF-TAS) scheme. Firstly, we observe that the properties of multi-head self-attention (MSA) and multi-layer perceptron (MLP) in ViTs are quite different and that the synaptic diversity of MSA affects the performance notably. Secondly, based on the observation, we devise a modular strategy in TF-TAS that evaluates and ranks ViT architectures from two theoretical perspectives: synaptic diversity and synaptic saliency, termed as DSS-indicator. With DSS-indicator, evaluation results are strongly corre-lated with the test accuracies of ViT models. Experimental results demonstrate that our TF- TAS achieves a competitive performance against the state-of-the-art manually or automatically design ViT architectures, and it promotes the searching efficiency in ViT search space greatly: from about 24 GPU days to less than 0.5 GPU days. Moreover, the proposed DSS-indicator outperforms the existing cutting-edge zero-cost approaches (e.g., TE-score and NASWOT).
Securing the Socio-Cyber World: Multiorder Attribute Node Association Classification for Manipulated Media

With the rapid development of information technology, social network has become an indispensable part of daily life. People have been able to get news from all over the world through social networks for a long time. People spend more time online than they do in real life. However, the information we get in the world of social network is not purely benign. Due to the development of artificial intelligence technology, more and more tampered media information appears in social networks, some for entertainment, while others become the dark side of social networks, of which the most harmful is to people in the media tamper. For fake news and misinformation caused by media tampering, we need to trace the source and clearly distinguish the truth from the manipulated. This article proposes an image media forgery classification method of multiorder attribute nodes. First, we use different methods to extract the edge, texture, grayscale, and color attributes of the image. Second, according to the characteristics of different attributes, we calculate the first-order entropy of edge attributes, the second-order entropy of texture attributes, local entropy of grayscale, and color properties. Finally, we represent each image with some nodes and build a graph convolutional network (GCN) to classify real and fake images. Experimental results on mainstream media manipulation datasets show that our method is the state-of-the-art compared with similar methods.
Certain Types of Function Via Alpha -Open Sets

In this effort, some new types of (alpha-open, alpha-star-open, alpha-star star-open) function. And addition to the previous study, there are some concepts associated with what we have taken to be ready relationships, semi (alpha-open, alpha-star-open, alpha-star star-open) function. All of these ideas introduce the topological space, we prove that this class (alpha-open and alpha-star[open) function. Also we find some basic properties and application of alpha-star star-open function, we as well lead and study a new class of space between concepts, and learning a new class of space, that is to say ( semi-alpha-open, semi-alpha-star-open and semi-alpha-star-star-open ) by function. We will need some theorems and observations to achieve the results between these mathematical concepts, while taking the test by renting the presentations necessary to solve mathematical problems.
Medical Augmented Reality: Definition, Principle Components, Domain Modeling, and Design-Development-Validation Process

Three decades after the first set of work on Medical Augmented Reality (MAR) was presented to the international community, and ten years after the deployment of the first MAR solutions into operating rooms, its exact definition, basic components, systematic design, and validation still lack a detailed discussion. This paper defines the basic components of any Augmented Reality (AR) solution and extends them to exemplary Medical Augmented Reality Systems (MARS). We use some of the original MARS applications developed at the Chair for Computer Aided Medical Procedures and deployed into medical schools for teaching anatomy and into operating rooms for telemedicine and surgical guidance throughout the last decades to identify the corresponding basic components. In this regard, the paper is not discussing all past or existing solutions but only aims at defining the principle components and discussing the particular domain modeling for MAR and its design-development-validation process, and providing exemplary cases through the past in-house developments of such solutions.
Image and Model Transformation with Secret Key for Vision Transformer

In this paper, we propose a combined use of transformed images and vision transformer (ViT) models transformed with a secret key. We show for the first time that models trained with plain images can be directly transformed to models trained with encrypted images on the basis of the ViT architecture, and the performance of the transformed models is the same as models trained with plain images when using test images encrypted with the key. In addition, the proposed scheme does not require any specially prepared data for training models or network modification, so it also allows us to easily update the secret key. In an experiment, the effectiveness of the proposed scheme is evaluated in terms of performance degradation and model protection performance in an image classification task on the CIFAR-10 dataset.
Smartphones and Threshold-Based Monitoring Methods Effectively Detect Falls Remotely: A Systematic Review

In the US, at least one fall occurs in at least 28.7% of community-dwelling seniors 65 and older each year. Falls had medical costs of USD 51 billion in 2015 and are projected to reach USD 100 billion by 2030. This review aims to discuss the extent of smartphone (SP) usage in fall detection and prevention across a range of care settings. A computerized search was conducted on six electronic databases to investigate the use of remote sensing technology, wireless technology, and other related MeSH terms for detecting and preventing falls. After applying inclusion and exclusion criteria, 44 studies were included. Most of the studies targeted detecting falls, two focused on detecting and preventing falls, and one only looked at preventing falls. Accelerometers were employed in all the experiments for the detection and/or prevention of falls. The most frequent course of action following a fall event was an alarm to the guardian. Numerous studies investigated in this research used accelerometer data analysis, machine learning, and data from previous falls to devise a boundary and increase detection accuracy. SP was found to have potential as a fall detection system but is not widely implemented. Technology-based applications are being developed to protect at-risk individuals from falls, with the objective of providing more effective and efficient interventions than traditional means. Successful healthcare technology implementation requires cooperation between engineers, clinicians, and administrators.