Reviewerly/exHarmony huggingface dataset:
Inpainting Transformer for Anomaly Detection

Anomaly detection in computer vision is the task of identifying images which deviate from a set of normal images. A common approach is to train deep convolutional autoencoders to inpaint covered parts of an image and compare the output with the original image. By training on anomaly-free samples only, the model is assumed to not being able to reconstruct anomalous regions properly. For anomaly detection by inpainting we suggest it to be beneficial to incorporate information from potentially distant regions. In particular we pose anomaly detection as a patch-inpainting problem and propose to solve it with a purely self-attention based approach discarding convolutions. The proposed Inpainting Transformer (InTra) is trained to inpaint covered patches in a large sequence of image patches, thereby integrating information across large regions of the input image. When training from scratch, in comparison to other methods not using extra training data, InTra achieves results on par with the current state-of-the-art on the MVTec AD dataset for detection and segmentation.
“It’s Complicated”: Negotiating Accessibility and (Mis)Representation in Image Descriptions of Race, Gender, and Disability

Content creators are instructed to write textual descriptions of visual content to make it accessible; yet existing guidelines lack specifics on how to write about people’s appearance, particularly while remaining mindful of consequences of (mis)representation. In this paper, we report on interviews with screen reader users who were also Black, Indigenous, People of Color, Non-binary, and/or Transgender on their current image description practices and preferences, and experiences negotiating theirs and others’ appearances non-visually. We discuss these perspectives, and the ethics of humans and AI describing appearance characteristics that may convey the race, gender, and disabilities of those photographed. In turn, we share considerations for more carefully describing appearance, and contexts in which such information is perceived salient. Finally, we offer tensions and questions for accessibility research to equitably consider politics and ecosystems in which technologies will embed, such as potential risks of human and AI biases amplifying through image descriptions.
Weapon Detection Using YOLO V3 for Smart Surveillance System

Every year, a large amount of population reconciles gun-related violence all over the world. In this work, we develop a computer-based fully automated system to identify basic armaments, particularly handguns and rifles. Recent work in the field of deep learning and transfer learning has demonstrated significant progress in the areas of object detection and recognition. We have implemented YOLO V3 “You Only Look Once” object detection model by training it on our customized dataset. The training results confirm that YOLO V3 outperforms YOLO V2 and traditional convolutional neural network (CNN). Additionally, intensive GPUs or high computation resources were not required in our approach as we used transfer learning for training our model. Applying this model in our surveillance system, we can attempt to save human life and accomplish reduction in the rate of manslaughter or mass killing. Additionally, our proposed system can also be implemented in high-end surveillance and security robots to detect a weapon or unsafe assets to avoid any kind of assault or risk to human life.
Human Fall Detection in Surveillance Videos Using Fall Motion Vector Modeling

Representation of spatio-temporal properties of human body silhouette and human-to-ground relationship, significantly contribute to the fall detection process. So, we propose an approach to efficiently model the spatio-temporal features using fall motion vector. First, we construct a Gaussian mixture model (GMM) called fall motion mixture model (FMMM) using histogram of optical flow and motion boundary histogram features to implicitly capture motion attributes in both the fall and non-fall videos. The FMMM contains both fall and non-fall attributes resulting in a high-dimensional representation. In order to extract only the relevant attributes for a particular fall or non-fall videos, we perform factor analysis on FMMM to get a low dimensional representation known as fall motion vector. Using fall motion vector, we are able to efficiently identify fall events in varieties of scenarios, such as the narrow angle camera (Le2i dataset), wide angle camera (URFall dataset), and multiple cameras (Montreal dataset). In all these scenarios, we show that the proposed fall motion vector achieves better performance than the existing methods.
Deep Convolutional Dictionary Learning for Image Denoising

Inspired by the great success of deep neural networks (DNNs), many unfolding methods have been proposed to integrate traditional image modeling techniques, such as dictionary learning (DicL) and sparse coding, into DNNs for image restoration. However, the performance of such methods remains limited for several reasons. First, the unfolded architectures do not strictly follow the image representation model of DicL and lose the desired physical meaning. Second, handcrafted priors are still used in most unfolding methods without effectively utilizing the learning capability of DNNs. Third, a universal dictionary is learned to represent all images, reducing the model representation flexibility. We propose a novel framework of deep convolutional dictionary learning (DCDicL), which follows the representation model of DicL strictly, learns the priors for both representation coefficients and the dictionaries, and can adaptively adjust the dictionary for each input image based on its content. The effectiveness of our DCDicL method is validated on the image denoising problem. DCDicL demonstrates leading denoising performance in terms of both quantitative metrics (e.g., PSNR, SSIM) and visual quality. In particular, it can reproduce the subtle image structures and textures, which are hard to recover by many existing denoising DNNs. The code is available at: https://github.com/natezhenghy/DCDicL_denoising.
Knowledge distillation: A good teacher is patient and consistent

There is a growing discrepancy in computer vision between large-scale models that achieve state-of-the-art performance and models that are affordable in practical applications. In this paper we address this issue and significantly bridge the gap between these two types of models. Throughout our empirical investigation we do not aim to necessarily propose a new method, but strive to identify a robust and effective recipe for making state-of-the-art large scale models affordable in practice. We demonstrate that, when performed correctly, knowledge distillation can be a powerful tool for reducing the size of large models without compromising their performance. In particular, we uncover that there are certain implicit design choices, which may drastically affect the effectiveness of distillation. Our key contribution is the explicit identification of these design choices, which were not previously articulated in the literature. We back up our findings by a comprehensive empirical study, demonstrate compelling results on a wide range of vision datasets and, in particular, obtain a state-of-the-art ResNet-50 model for ImageNet, which achieves 82.8% top-1 accuracy.
Data analysis methods for prospectivity modelling as applied to mineral exploration targeting: State-of-the-art and outlook

Mineral exploration targeting is a highly complex decision-making task. Two key risk factors, the quality of exploration data and robustness of the underlying conceptual targeting model, have a strong impact on the effectiveness of this decision-making. Geographic information systems (GIS) can be used not only for compiling, integrating, interrogating and interpreting diverse exploration data, but also for targeting by employing powerful mathematical algorithms, an approach that is commonly referred to as mineral potential modelling or mineral prospectivity mapping (MPM). Here, we pose and examine key aspects around the question of “how can we get better at mineral exploration targeting using GIS?” We do this by (1) reviewing the fundamental aspects of MPM, (2) identifying significant deficiencies of MPM, and (3) discussing possible solutions to alleviating or eliminating these deficiencies. In particular, we discuss how these deficiencies can be overcome by adopting an intelligence amplification system, such as the recently proposed exploration information system (EIS) for translating critical ore-forming processes into spatially predictive criteria (i.e., predictor maps and spatial proxies) and improving decision-making in mineral exploration targeting.
Malignant and Benign Breast Cancer Classification using Machine Learning Algorithms

At the moment, the most prevalent form of cancer diagnosed in women across the globe is breast cancer. It develops in the breast tissue and is one of the most frequent causes of women's death. This cancer can be cured if it is diagnosed at preliminary stage. Malignant and benign are two types of tumor found in case of breast cancer. Malignant tumors are deadly as their rate of growth is much higher than benign tumors. So, early identification of tumor type is pivotal for the appropriate treatment of a patient having breast cancer. In this work, Wisconsin Breast Cancer Dataset has been used which was collected from UCI repository. Our goal is to analyze the dataset and evaluate the performance of various machine learning algorithms for predicting breast cancer. Here, Support Vector Machine, Logistic Regression, K-Nearest Neighbors, Decision Tree, Naive Bayes and Random Forest classifiers have been implemented for classifying tumors into benign and malignant. The accuracy of each algorithm is calculated and compared to find the most suitable one. Based on the analysis, Random Forest and Support Vector Machine outperform other classifiers with accuracy of 96.5%. These classifiers can be used to build an automatic diagnostic system for preliminary diagnosis of breast cancer.
VLN↻BERT: A Recurrent Vision-and-Language BERT for Navigation

Accuracy of many visiolinguistic tasks has benefited significantly from the application of vision-and-language (V&L) BERT. However, its application for the task of vision-and-language navigation (VLN) remains limited. One reason for this is the difficulty adapting the BERT architecture to the partially observable Markov decision process present in VLN, requiring history-dependent attention and decision making. In this paper we propose a recurrent BERT model that is time-aware for use in VLN. Specifically, we equip the BERT model with a recurrent function that maintains cross-modal state information for the agent. Through extensive experiments on R2R and REVERIE we demonstrate that our model can replace more complex encoder-decoder models to achieve state-of-the-art results. Moreover, our approach can be generalised to other transformer-based architectures, supports pre-training, and is capable of solving navigation and referring expression tasks simultaneously.
How to measure uncertainty in uncertainty sampling for active learning

Abstract Various strategies for active learning have been proposed in the machine learning literature. In uncertainty sampling, which is among the most popular approaches, the active learner sequentially queries the label of those instances for which its current prediction is maximally uncertain. The predictions as well as the measures used to quantify the degree of uncertainty, such as entropy, are traditionally of a probabilistic nature. Yet, alternative approaches to capturing uncertainty in machine learning, alongside with corresponding uncertainty measures, have been proposed in recent years. In particular, some of these measures seek to distinguish different sources and to separate different types of uncertainty, such as the reducible (epistemic) and the irreducible (aleatoric) part of the total uncertainty in a prediction. The goal of this paper is to elaborate on the usefulness of such measures for uncertainty sampling, and to compare their performance in active learning. To this end, we instantiate uncertainty sampling with different measures, analyze the properties of the sampling strategies thus obtained, and compare them in an experimental study.
Reconsidering Representation Alignment for Multi-view Clustering

Aligning distributions of view representations is a core component of today’s state of the art models for deep multi-view clustering. However, we identify several drawbacks with naïvely aligning representation distributions. We demonstrate that these drawbacks both lead to less separable clusters in the representation space, and inhibit the model’s ability to prioritize views. Based on these observations, we develop a simple baseline model for deep multi-view clustering. Our baseline model avoids representation alignment altogether, while performing similar to, or better than, the current state of the art. We also expand our baseline model by adding a contrastive learning component. This introduces a selective alignment procedure that preserves the model’s ability to prioritize views. Our experiments show that the contrastive learning component enhances the baseline model, improving on the current state of the art by a large margin on several datasets <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> .
Supervised Contrastive Replay: Revisiting the Nearest Class Mean Classifier in Online Class-Incremental Continual Learning

Online class-incremental continual learning (CL) studies the problem of learning new classes continually from an online non-stationary data stream, intending to adapt to new data while mitigating catastrophic forgetting. While memory replay has shown promising results, the recency bias in online learning caused by the commonly used Softmax classifier remains an unsolved challenge. Although the Nearest-Class-Mean (NCM) classifier is significantly undervalued in the CL community, we demonstrate that it is a simple yet effective substitute for the Softmax classifier. It addresses the recency bias and avoids structural changes in the fully-connected layer for new classes. Moreover, we observe considerable and consistent performance gains when replacing the Softmax classifier with the NCM classifier for several state-of-the-art replay methods.To leverage the NCM classifier more effectively, data embeddings belonging to the same class should be clustered and well-separated from those with a different class label. To this end, we contribute Supervised Contrastive Replay (SCR), which explicitly encourages samples from the same class to cluster tightly in embedding space while pushing those of different classes further apart during replay-based training. Overall, we observe that our proposed SCR substantially reduces catastrophic forgetting and outperforms state-of-the-art CL methods by a significant margin on a variety of datasets.
Detection, Tracking, and Counting Meets Drones in Crowds: A Benchmark

To promote the developments of object detection, tracking and counting algorithms in drone-captured videos, we construct a benchmark with a new drone-captured large-scale dataset, named as DroneCrowd, formed by 112 video clips with 33, 600 HD frames in various scenarios. Notably, we annotate 20, 800 people trajectories with 4.8 million heads and several video-level attributes. Meanwhile, we design the Space-Time Neighbor-Aware Network (STNNet) as a strong baseline to solve object detection, tracking and counting jointly in dense crowds. STNNet is formed by the feature extraction module, followed by the density map estimation heads, and localization and association subnets. To exploit the context information of neighboring objects, we design the neighboring context loss to guide the association subnet training, which enforces consistent relative position of nearby objects in temporal domain. Extensive experiments on our DroneCrowd dataset demonstrate that STNNet performs favorably against the state-of-the-arts.
Changes in habits of electronic news usage on mobile devices in university students: a comparative survey

Purpose A rising trend has been observed to minimize extraneous cognitive load when reading by enhancing secondary knowledge through technology. For the readers to comprehend information more efficiently in their cognitive architecture, instructional procedures, which are secondary knowledge, should be aligned with the modern technology environment. With continual, rapid technological advances in modern society, people have changed their news reading habits after using mobile devices such as smartphones, tablets and e-readers. Design/methodology/approach This research employed a quantitative survey to compare the changes in the news reading habits of the undergraduate (UG) and postgraduate (PG) students in the Library and Information Management program of a university in Hong Kong after using mobile devices to read electronic news. A total of 102 responses were collected, which comprised 51 UGs and 51 PGs, respectively (the student population for the program was around 100 UGs and 100 PGs). Findings Survey results showed that mobile devices had changed the respondents’ habit of reading news to read more content on phones, with a variation on news categories. Such changes included the duration and location of news discussion among the respondents that shorter periods were used to read and that more people read while traveling and in restaurants. Notably, reading the news helped respondents in their learning. Most respondents preferred to read electronic news by using mobile devices. The convenience of reading and discussing news may also cause a potential threat that intensifies disputes, arguments or even bullying on controversial issues. Originality/value This study confirmed that the usage of the mobile devices changed the respondents’ habit of reading news. This user group constitutes the future generation of information specialists in various disciplines. This study fills the research gap of finding students’ reading habits when using mobile devices, especially in East Asia. Educators are encouraged to recommend relevant news content to students to improve their general knowledge base and arouse their interest in reading and discussing related news topics.
Multitask-Learning-Based Deep Neural Network for Automatic Modulation Classification

Automatic modulation classification (AMC) is to identify the modulation type of a received signal, which plays a vital role to ensure the physical-layer security for Internet of Things (IoT) networks. Inspired by the great success of deep learning in pattern recognition, the convolutional neural network (CNN) and recurrent neural network (RNN) are introduced into the AMC. In general, there are two popular data formats used by AMC, which are the in-phase/quadrature (I/Q) representation and amplitude/phase (A/P) representation, respectively. However, most of AMC algorithms aim at structure innovations, while the differences and characteristics of I/Q and A/P are ignored to analyze. In this article, lots of popular AMC algorithms are reproduced and evaluated on the same data set, where the I/Q and A/P are used, respectively, for comparison. Based on the experimental results, it is found that: 1) CNN-RNN-like algorithms using A/P as input data are superior to those using I/Q at high signal-to-noise ratio (SNR), while it has an opposite result in low SNR and 2) the features extracted from I/Q and A/P are complementary to each other. Motivated by the aforementioned findings, a multitask learning-based deep neural network (MLDNN) is proposed, which effectively fuses I/Q and A/P. In addition, the MLDNN also has a novel backbone, which is made up of three blocks to extract discriminative features, and they are CNN block, bidirectional gated recurrent unit (BiGRU) block, and a step attention fusion network (SAFN) block. Different from most of CNN-RNN-like algorithms (i.e., they only use the last step outputs of RNN), all step outputs of BiGRU can be effectively utilized by MLDNN with the help of SAFN. Extensive simulations are conducted to verify that the proposed MLDNN achieves superior performance in the public benchmark.
Breast cancer diagnosis using multiple activation deep neural network

Deep Neural Network (DNN) stands for multilayered Neural Network (NN) that is capable of progressively learn the more abstract and composite representations of the raw features of the input data received, with no need for any feature engineering. They are advanced NNs having repetitious hidden layers between the initial input and the final layer. The working principle of such a standard deep classifier is based on a hierarchy formed by the composition of linear functions and a defined nonlinear Activation Function (AF). It remains uncertain (not clear) how the DNN classifier can function so well. But it is clear from many studies that within DNN, the AF choice has a notable impact on the kinetics of training and the success of tasks. In the past few years, different AFs have been formulated. The choice of AF is still an area of active study. Hence, in this study, a novel deep Feed forward NN model with four AFs has been proposed for breast cancer classification: hidden layer 1: Swish, hidden layer, 2:-LeakyReLU, hidden layer 3: ReLU, and final output layer: naturally Sigmoidal. The purpose of the study is twofold. Firstly, this study is a step toward a more profound understanding of DNN with layer-wise different AFs. Secondly, research is also aimed to explore better DNN-based systems to build predictive models for breast cancer data with improved accuracy. Therefore, the benchmark UCI dataset WDBC was used for the validation of the framework and evaluated using a ten-fold CV method and various performance indicators. Multiple simulations and outcomes of the experimentations have shown that the proposed solution performs in a better way than the Sigmoid, ReLU, and LeakyReLU and Swish activation DNN in terms of different parameters. This analysis contributes to producing an expert and precise clinical dataset classification method for breast cancer. Furthermore, the model also achieved improved performance compared to many established state-of-the-art algorithms/models.
From Bitcoin to Central Bank Digital Currencies: Making Sense of the Digital Money Revolution

We analyze the path from cryptocurrencies to official Central Bank Digital Currencies (CBDCs), to shed some light on the ultimate dematerialization of money. To that end, we made an extensive search that resulted in a review of more than 100 academic and grey literature references, including official positions from central banks. We present and discuss the characteristics of the different CBDC variants being considered—namely, wholesale, retail, and, for the latter, the account-based, and token-based—as well as ongoing pilots, scenarios of interoperability, and open issues. Our contribution enables decision-makers and society at large to understand the potential advantages and risks of introducing CBDCs, and how these vary according to many technical and economic design choices. The practical implication is that a debate becomes possible about the trade-offs that the stakeholders are willing to accept.