Reviewerly/exHarmony huggingface dataset:
ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and Beyond

Vision transformers have shown great potential in various computer vision tasks owing to their strong capability to model long-range dependency using the self-attention mechanism. Nevertheless, they treat an image as a 1D sequence of visual tokens, lacking an intrinsic inductive bias (IB) in modeling local visual structures and dealing with scale variance, which is instead learned implicitly from large-scale training data with longer training schedules. In this paper, we leverage the two IBs and propose the ViTAE transformer, which utilizes a reduction cell for multi-scale feature and a normal cell for locality. The two kinds of cells are stacked in both isotropic and multi-stage manners to formulate two families of ViTAE models, i.e., the vanilla ViTAE and ViTAEv2. Experiments on the ImageNet dataset as well as downstream tasks on the MS COCO, ADE20K, and AP10K datasets validate the superiority of our models over the baseline and representative models. Besides, we scale up our ViTAE model to 644 M parameters and obtain the state-of-the-art classification performance, i.e., 88.5% Top-1 classification accuracy on ImageNet validation set and the best 91.2% Top-1 classification accuracy on ImageNet Real validation set, without using extra private data. It demonstrates that the introduced inductive bias still helps when the model size becomes large. The source code and pretrained models are publicly available atcode.
Hybrid-YOLO for classification of insulators defects in transmission lines based on UAV

Transmission power lines are essential to supply electrical energy to consumption centers. Keeping a reliable transmission system requires the early identification of faults. Image-based inspection of transmission lines makes fault identification faster and more accessible since it can be carried out using unmanned aerial vehicles (UAVs) in hard-to-reach places. In this paper, it is proposed to use a hybrid version of the You Only Look Once (YOLO) using ResNet-18 classifier, for power system inspection based on real images of failed components recorded by UAVs. This work assumed a dataset including 1,593 power grid inspection pictures for a supervised training. Based on YOLOv5x, with an mAP of 0.99262, the proposed method was superior to YOLOv5n, YOLOv5s, YOLOv5m, and YOLOv5l for object detection. For the multiclassification task, with an F1_score result of 0.96216, the proposed Hybrid-YOLO was superior to distinct architectures as the VGG-11, VGG-13, VGG-16, VGG-19, ResNet-34, ResNet-50, ResNet-152, DenseNet-121, DenseNet-161, DenseNet-169, DenseNet-201, YOLOv5, YOLOv6, and YOLOv7 versions.
Theoretical Understanding of Convolutional Neural Network: Concepts, Architectures, Applications, Future Directions

Convolutional neural networks (CNNs) are one of the main types of neural networks used for image recognition and classification. CNNs have several uses, some of which are object recognition, image processing, computer vision, and face recognition. Input for convolutional neural networks is provided through images. Convolutional neural networks are used to automatically learn a hierarchy of features that can then be utilized for classification, as opposed to manually creating features. In achieving this, a hierarchy of feature maps is constructed by iteratively convolving the input image with learned filters. Because of the hierarchical method, higher layers can learn more intricate features that are also distortion and translation invariant. The main goals of this study are to help academics understand where there are research gaps and to talk in-depth about CNN’s building blocks, their roles, and other vital issues.
Path planning techniques for mobile robots: Review and prospect

Mobile robot path planning refers to the design of the safely collision-free path with shortest distance and least time-consuming from the starting point to the end point by a mobile robot autonomously. In this paper, a systematic review of mobile robot path planning techniques is presented. Firstly, path planning is classified into global path planning and local path planning according to the mastery of environmental information. In the global path planning, environment modeling methods and path evaluation method are introduced. The methods of environment modeling include grid method, topology method, geometric feature method and mixed representation method. In the local path planning, we introduce the sensors commonly used in the detection environment, including laser radar and visual sensor. Next, according to the characteristics of algorithms, mobile robot path planning algorithms are divided into three categories: classical algorithms, bionic algorithms and artificial intelligence algorithms. Among the classical algorithms, we introduce the cell decomposition method, sampling based method, graph search algorithm, artificial potential field method and dynamic window method. In the algorithm based on bionics, we introduce genetic algorithm, ant colony algorithm, gray wolf algorithm, etc. in detail. In artificial intelligence algorithm, we introduce neural network algorithm and fuzzy logic. Finally, we compare the key technologies of mobile robot path planning in the form of graphs and charts based on the classification statistics of the collected literature to provide references for future research.
Predicting Economic Development using Geolocated Wikipedia Articles

Progress on the UN Sustainable Development Goals (SDGs) is hampered by a persistent lack of data regarding key social, environmental, and economic indicators, particularly in developing countries. For example, data on poverty - the first of seventeen SDGs - is both spatially sparse and infrequently collected in Sub-Saharan Africa due to the high cost of surveys. Here we propose a novel method for estimating socioeconomic indicators using open-source, geolocated textual information from Wikipedia articles. We demonstrate that modern NLP techniques can be used to predict community-level asset wealth and education outcomes using nearby geolocated Wikipedia articles. When paired with nightlights satellite imagery, our method outperforms all previously published benchmarks for this prediction task, indicating the potential of Wikipedia to inform both research in the social sciences and future policy decisions.
Exergaming Executive Functions: An Immersive Virtual Reality-Based Cognitive Training for Adults Aged 50 and Older

Prior research suggests that both exergaming and virtual reality (VR)-based training programs could improve executive functions in older adults. However, few studies investigated whether combining exergaming with VR would be more effective. This study seeks to (a) investigate whether playing exergames in an immersive virtual environment (IVE) would yield differential outcomes in selected executive functions, including inhibition, task switching, and working, and (b) examine the role of feeling of presence as a potential mediator between immersive exergaming and cognitive improvement in specific domains. Thirty-three participants over 50 years of age (mean age = 62) participated in a 4-week training program and were randomly assigned into an IVE and non-IVE to play an exergame (Fruit Ninja) for eight sessions within 4 weeks. The results revealed a significant effect of the IVE on the Stroop Test and Trail Making Test after the 4-week training. Furthermore, the impacts of the IVE exergaming on these two tasks were mediated by the feeling of presence. These findings suggested that the immersive experience of exergaming would elicit the feeling of presence, which later contributes to improved cognitive performances in inhibition and task switching. For the theoretical implications, this study extends previous research by showing that (a) feeling of presence could contribute to older adults' cognitive improvement, and (b) the impacts of immersive exergame training on executive functions vary across individual domains. Additionally, this study provides practical implications such that the design of exergames could emphasize the game features requiring mental simulation, which can serve as a novel strategy for preventing cognitive decline in midlife and old age.
Early-Learning Regularization Prevents Memorization of Noisy Labels

We propose a novel framework to perform classification via deep in the presence of noisy annotations. When trained on noisy labels, deep neural networks have been observed to first fit the training data with clean labels during an learning phase, before eventually memorizing the examples with false labels. We prove that early and memorization are fundamental phenomena in high-dimensional classification tasks, even in simple linear models, and give a theoretical explanation in this setting. Motivated by these findings, we develop a new technique for noisy classification tasks, which exploits the progress of the early phase. In contrast with existing approaches, which use the model output during early to detect the examples with clean labels, and either ignore or attempt to correct the false labels, we take a different route and instead capitalize on early via regularization. There are two key elements to our approach. First, we leverage semi-supervised techniques to produce target probabilities based on the model outputs. Second, we design a regularization term that steers the model towards these targets, implicitly preventing memorization of the false labels. The resulting framework is shown to provide robustness to noisy annotations on several standard benchmarks and real-world datasets, where it achieves results comparable to the state of the art.
Comparison of Deep Learning Models and Various Text Pre-Processing Techniques for the Toxic Comments Classification

The emergence of anti-social behaviour in online environments presents a serious issue in today’s society. Automatic detection and identification of such behaviour are becoming increasingly important. Modern machine learning and natural language processing methods can provide effective tools to detect different types of anti-social behaviour from the pieces of text. In this work, we present a comparison of various deep learning models used to identify the toxic comments in the Internet discussions. Our main goal was to explore the effect of the data preparation on the model performance. As we worked with the assumption that the use of traditional pre-processing methods may lead to the loss of characteristic traits, specific for toxic content, we compared several popular deep learning and transformer language models. We aimed to analyze the influence of different pre-processing techniques and text representations including standard TF-IDF, pre-trained word embeddings and also explored currently popular transformer models. Experiments were performed on the dataset from the Kaggle Toxic Comment Classification competition, and the best performing model was compared with the similar approaches using standard metrics used in data analysis.
A Survey of Speaker Recognition: Fundamental Theories, Recognition Methods and Opportunities

Humans can identify a speaker by listening to their voice, over the telephone, or on any digital devices. Acquiring this congenital human competency, authentication technologies based on voice biometrics, such as automatic speaker recognition (ASR), have been introduced. An ASR recognizes speakers by analyzing speech signals and characteristics extracted from speaker's voices. ASR has recently become an effective research area as an essential aspect of voice biometrics. Specifically, this literature survey gives a concise introduction to ASR and provides an overview of the general architectures dealing with speaker recognition technologies, and upholds the past, present, and future research trends in this area. This paper briefly describes all the main aspects of ASR, such as speaker identification, verification, diarization etc. Further, the performance of current speaker recognition systems are investigated in this survey with the limitations and possible ways of improvement. Finally, a few unsolved challenges of speaker recognition are presented at the closure of this survey.
Digital technologies and financial inclusion in Sub-Saharan Africa

The study investigates the digital technology-financial inclusion nexus in 43 Sub-Saharan African countries between 2004 and 2019. The methodologies are the Generalized Method of Moment (GMM) to take care of double causality and country heterogeneity and IV-Tobit to take into account the limited range in the dependent variables. At all levels, digital technology measured by ICT indicators of the subscription rate of fixed and mobile telephone users, fixed broadband, internet users and a composite indicator of digitalization have positive significant effects on financial inclusion. A further robustness check is conducted by computing a composite indicator of financial inclusion to determine how it is affected by digital technology. The findings indicate that the rate of financial inclusion in Sub Saharan Africa rises with increasing digital technologies. There should be more investments in terms of promoting financial and technological infrastructures and also in the human capital sector since financial literacy can play an important part in promoting financial stability and inclusive finance in Africa.
Asleep at the Keyboard? Assessing the Security of GitHub Copilot’s Code Contributions

There is burgeoning interest in designing AI-based systems to assist humans in designing computing systems, including tools that automatically generate computer code. The most notable of these comes in the form of the first self-described ‘AI pair programmer’, GitHub Copilot, which is a language model trained over open-source GitHub code. However, code often contains bugs—and so, given the vast quantity of unvetted code that Copilot has processed, it is certain that the language model will have learned from exploitable, buggy code. This raises concerns on the security of Copilot’s code contributions. In this work, we systematically investigate the prevalence and conditions that can cause GitHub Copilot to recommend insecure code. To perform this analysis we prompt Copilot to generate code in scenarios relevant to high-risk cybersecurity weaknesses, e.g. those from MITRE’s “Top 25” Common Weakness Enumeration (CWE) list. We explore Copilot’s performance on three distinct code generation axes—examining how it performs given diversity of weaknesses, diversity of prompts, and diversity of domains. In total, we produce 89 different scenarios for Copilot to complete, producing 1,689 programs. Of these, we found approximately 40% to be vulnerable.
A Systematic Review on Blockchain Adoption

Blockchain technologies have received considerable attention from academia and industry due to their distinctive characteristics, such as data integrity, security, decentralization, and reliability. However, their adoption rate is still scarce, which is one of the primary reasons behind conducting studies related to users’ satisfaction and adoption. Determining what impacts the use and adoption of Blockchain technologies can efficiently address their adoption challenges. Hence, this systematic review aimed to review studies published on Blockchain technologies to offer a thorough understanding of what impacts their adoption and discuss the main challenges and opportunities across various sectors. From 902 studies collected, 30 empirical studies met the eligibility criteria and were thoroughly analyzed. The results confirmed that the technology acceptance model (TAM) and technology–organization–environment (TOE) were the most common models for studying Blockchain adoption. Apart from the core variables of these two models, the results indicated that trust, perceived cost, social influence, and facilitating conditions were the significant determinants influencing several Blockchain applications. The results also revealed that supply chain management is the main domain in which Blockchain applications were adopted. Further, the results indicated inadequate exposure to studying the actual use of Blockchain technologies and their continued use. It is also essential to report that existing studies have examined the adoption of Blockchain technologies from the lens of the organizational level, with little attention paid to the individual level. This review is believed to improve our understanding by revealing the full potential of Blockchain adoption and opening the door for further research opportunities.
Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt &amp; Predict Paradigm (P5)

For a long time, different recommendation tasks require designing task-specific architectures and training objectives. As a result, it is hard to transfer the knowledge and representations from one task to another, thus restricting the generalization ability of existing recommendation approaches. To deal with such issues, considering that language can describe almost anything and language grounding is a powerful medium to represent various problems or tasks, we present a flexible and unified text-to-text paradigm called “Pretrain, Personalized Prompt, and Predict Paradigm” (P5) for recommendation, which unifies various recommendation tasks in a shared framework. In P5, all data such as user-item interactions, user descriptions, item metadata, and user reviews are converted to a common format — natural language sequences. The rich information from natural language assists P5 to capture deeper semantics for personalization and recommendation. Specifically, P5 learns different tasks with the same language modeling objective during pretraining. Thus, it serves as the foundation model for various downstream recommendation tasks, allows easy integration with other modalities, and enables instruction-based recommendation. P5 advances recommender systems from shallow model to deep model to big model, and will revolutionize the technical form of recommender systems towards universal recommendation engine. With adaptive personalized prompt for different users, P5 is able to make predictions in a zero-shot or few-shot manner and largely reduces the necessity for extensive fine-tuning. On several benchmarks, we conduct experiments to show the effectiveness of P5. To help advance future research on Recommendation as Language Processing (RLP), Personalized Foundation Models (PFM), and Universal Recommendation Engine (URE), we release the source code, dataset, prompts, and pretrained P5 model at https://github.com/jeykigung/P5.
LineVul

Software vulnerabilities are prevalent in software systems, causing a variety of problems including deadlock, information loss, or system failures. Thus, early predictions of software vulnerabilities are critically important in safety-critical software systems. Various ML/DL-based approaches have been proposed to predict vulnerabilities at the file/function/method level. Recently, IVDetect (a graph-based neural network) is proposed to predict vulnerabilities at the function level. Yet, the IVDetect approach is still inaccurate and coarse-grained. In this paper, we propose LineVul, a Transformer-based line-level vulnerability prediction approach in order to address several limitations of the state-of-the-art IVDetect approach. Through an empirical evaluation of a large-scale real-world dataset with 188k+ C/C++ functions, we show that LineVul achieves (1) 160%-379% higher F1-measure for function-level predictions; (2) 12%-25% higher Top-10 Accuracy for line-level predictions; and (3) 29%-53% less [email protected]%Recall than the baseline approaches, highlighting the significant advancement of LineVul towards more accurate and more cost-effective line-level vulnerability predictions. Our additional analysis also shows that our LineVul is also very accurate (75%-100%) for predicting vulnerable functions affected by the Top-25 most dangerous CWEs, highlighting the potential impact of our LineVul in real-world usage scenarios.
Transformer Tracking with Cyclic Shifting Window Attention

Transformer architecture has been showing its great strength in visual object tracking, for its effective attention mechanism. Existing transformer-based approaches adopt the pixel-to-pixel attention strategy on flattened image features and unavoidably ignore the integrity of ob-jects. In this paper, we propose a new transformer ar-chitecture with multi-scale cyclic shifting window attention for visual object tracking, elevating the attention from pixel to window level. The cross-window multi-scale at-tention has the advantage of aggregating attention at dif-ferent scales and generates the best fine-scale match for the target object. Furthermore, the cyclic shifting strat-egy brings greater accuracy by expanding the window sam-ples with positional information, and at the same time saves huge amounts of computational power by removing redun-dant calculations. Extensive experiments demonstrate the superior performance of our method, which also sets the new state-of-the-art records on five challenging datasets, along with the VOT2020, UAV123, LaSOT, TrackingNet, and GOT-lOk benchmarks. Our project is available at https://github.com/SkyeSong38/CSWinTT.
PointCLIP: Point Cloud Understanding by CLIP

Recently, zero-shot and few-shot learning via Contrastive Vision-Language Pre-training (CLIP) have shown inspirational performance on 2D visual recognition, which learns to match images with their corresponding texts in open-vocabulary settings. However, it remains under explored that whether CLIP, pre-trained by large-scale image-text pairs in 2D, can be generalized to 3D recognition. In this paper, we identify such a setting is feasible by proposing PointCLIP, which conducts alignment between CLIP-encoded point clouds and 3D category texts. Specifically, we encode a point cloud by projecting it onto multi-view depth maps and aggregate the view-wise zero-shot prediction in an end-to-end manner, which achieves efficient knowledge transfer from 2D to 3D. We further design an inter-view adapter to better extract the global feature and adaptively fuse the 3D few-shot knowledge into CLIP pre-trained in 2D. By just fine-tuning the adapter under few-shot settings, the performance of PointCLIP could be largely improved. In addition, we observe the knowledge complementary property between PointCLIP and classical 3D-supervised networks. Via simple ensemble during inference, PointCLIP contributes to favorable performance enhancement over state-of-the-art 3D networks. Therefore, PointCLIP is a promising alternative for effective 3D point cloud understanding under low data regime with marginal resource cost. We conduct thorough experiments on Model-NetlO, ModelNet40 and ScanObjectNN to demonstrate the effectiveness of PointCLIP. Code is available at https://github.com/ZrrSkywalker/PointCLIP.