Reviewerly/exHarmony huggingface dataset:
Challenges in benchmarking stream learning algorithms with real-world data

Streaming data are increasingly present in real-world applications such as sensor measurements, satellite data feed, stock market, and financial data. The main characteristics of these applications are the online arrival of data observations at high speed and the susceptibility to changes in the data distributions due to the dynamic nature of real environments. The data stream mining community still faces some primary challenges and difficulties related to the comparison and evaluation of new proposals, mainly due to the lack of publicly available high quality non-stationary real-world datasets. The comparison of stream algorithms proposed in the literature is not an easy task, as authors do not always follow the same recommendations, experimental evaluation procedures, datasets, and assumptions. In this paper, we mitigate problems related to the choice of datasets in the experimental evaluation of stream classifiers and drift detectors. To that end, we propose a new public data repository for benchmarking stream algorithms with real-world data. This repository contains the most popular datasets from literature and new datasets related to a highly relevant public health problem that involves the recognition of disease vector insects using optical sensors. The main advantage of these new datasets is the prior knowledge of their characteristics and patterns of changes to adequately evaluate new adaptive algorithms. We also present an in-depth discussion about the characteristics, reasons, and issues that lead to different types of changes in data distribution, as well as a critical review of common problems concerning the current benchmark datasets available in the literature.
FluSense

We developed a contactless syndromic surveillance platform FluSense that aims to expand the current paradigm of influenza-like illness (ILI) surveillance by capturing crowd-level bio-clinical signals directly related to physical symptoms of ILI from hospital waiting areas in an unobtrusive and privacy-sensitive manner. FluSense consists of a novel edge-computing sensor system, models and data processing pipelines to track crowd behaviors and influenza-related indicators, such as coughs, and to predict daily ILI and laboratory-confirmed influenza caseloads. FluSense uses a microphone array and a thermal camera along with a neural computing engine to passively and continuously characterize speech and cough sounds along with changes in crowd density on the edge in a real-time manner. We conducted an IRB-approved 7 month-long study from December 10, 2018 to July 12, 2019 where we deployed FluSense in four public waiting areas within the hospital of a large university. During this period, the FluSense platform collected and analyzed more than 350,000 waiting room thermal images and 21 million non-speech audio samples from the hospital waiting areas. FluSense can accurately predict daily patient counts with a Pearson correlation coefficient of 0.95. We also compared signals from FluSense with the gold standard laboratory-confirmed influenza case data obtained in the same facility and found that our sensor-based features are strongly correlated with laboratory-confirmed influenza trends.
Poisoning Attacks on Federated Learning-based IoT Intrusion Detection System

Federated Learning (FL) is an appealing method for applying machine learning to large scale systems due to the privacy and efficiency advantages that its training mechanism provides.One important field for FL deployment is emerging IoT applications.In particular, FL has been recently used for IoT intrusion detection systems where clients, e.g., a home security gateway, monitors traffic data generated by IoT devices in its network, trains a local intrusion detection model, and send this model to a central entity, the aggregator, who then computes a global model (using the models of all gateways) that is distributed back to clients.This approach protects the privacy of users as it does not require local clients to share their potentially private IoT data with any other parties, and it is in general more efficient than a centralized system.However, FL schemes have been subject to poising attacks, in particular to backdoor attacks.In this paper, we show that FL-based IoT intrusion detection systems are vulnerable to backdoor attacks.We present a novel data poisoning attack that allows an adversary to implant a backdoor into the aggregated detection model to incorrectly classify malicious traffic as benign.We show that the adversary can gradually poison the detection model by only using compromised IoT devices (and not gateways/clients) to inject small amounts of malicious data into the training process and remain undetected.Our extensive evaluation on three real-world IoT datasets generated from 46 IoT devices shows the effectiveness of our attack in injecting backdoors and circumventing state of the art defenses against FL poisoning.Finally, we discuss shortly possible mitigation approaches.
Color multiple image encryption scheme based on 3D-chaotic maps

In many research areas, production of images is increasing with every day. These days, the prime focus of researchers is on the security of digital images. Motivated by gray multiple image encryption algorithms, this paper suggests a novel Chaos-based color multiple image encryption technique. A 3D histogram equalization method has been applied to equalize the chaotic sequences histograms of Lorenz system. Confusion/diffusion of image data has been implemented by using sequences generated by histogram equalized Lorenz and Rossler system. In confusion stage, the input image colored pixels have been scrambled. Then in diffusion stage, pixel replacement is done by scrambled images and sequences of Rossler system. The proposed scheme efficiency is validated via key sensitivity, key space, entropy, horizontal, vertical, diagonal correlation, UACI and NPCR tests. Furthermore, the overall security analysis and experimental results show that the proposed encryption technique has achieved confidentiality and have resistance against classical attacks.
MovieNet: A Holistic Dataset for Movie Understanding

Recent years have seen remarkable advances in visual understanding. However, how to understand a story-based long video with artistic styles, e.g. movie, remains challenging. In this paper, we introduce MovieNet – a holistic dataset for movie understanding. MovieNet contains 1, 100 movies with a large amount of multi-modal data, e.g. trailers, photos, plot descriptions, etc.. Besides, different aspects of manual annotations are provided in MovieNet, including 1.1 M characters with bounding boxes and identities, 42 K scene boundaries, 2.5 K aligned description sentences, 65 K tags of place and action, and 92 K tags of cinematic style. To the best of our knowledge, MovieNet is the largest dataset with richest annotations for comprehensive movie understanding. Based on MovieNet, we set up several benchmarks for movie understanding from different angles. Extensive experiments are executed on these benchmarks to show the immeasurable value of MovieNet and the gap of current approaches towards comprehensive movie understanding. We believe that such a holistic dataset would promote the researches on story-based long video understanding and beyond. MovieNet will be published in compliance with regulations at https://movienet.github.io .
Quo vadis artificial intelligence?

Abstract The study of artificial intelligence (AI) has been a continuous endeavor of scientists and engineers for over 65 years. The simple contention is that human-created machines can do more than just labor-intensive work; they can develop human-like intelligence. Being aware or not, AI has penetrated into our daily lives, playing novel roles in industry, healthcare, transportation, education, and many more areas that are close to the general public. AI is believed to be one of the major drives to change socio-economical lives. In another aspect, AI contributes to the advancement of state-of-the-art technologies in many fields of study, as helpful tools for groundbreaking research. However, the prosperity of AI as we witness today was not established smoothly. During the past decades, AI has struggled through historical stages with several winters. Therefore, at this juncture, to enlighten future development, it is time to discuss the past, present, and have an outlook on AI. In this article, we will discuss from a historical perspective how challenges were faced on the path of revolution of both the AI tools and the AI systems. Especially, in addition to the technical development of AI in the short to mid-term, thoughts and insights are also presented regarding the symbiotic relationship of AI and humans in the long run.
MRI Super-Resolution With Ensemble Learning and Complementary Priors

Magnetic resonance imaging (MRI) is a widely used medical imaging modality. However, due to the limitations in hardware, scan time, and throughput, it is often clinically challenging to obtain high-quality MR images. The super-resolution approach is potentially promising to improve MR image quality without any hardware upgrade. In this paper, we propose an ensemble learning and deep learning framework for MR image super-resolution. In our study, we first enlarged low resolution images using 5 commonly used super-resolution algorithms and obtained differentially enlarged image datasets with complementary priors. Then, a generative adversarial network (GAN) is trained with each dataset to generate super-resolution MR images. Finally, a convolutional neural network is used for ensemble learning that synergizes the outputs of GANs into the final MR super-resolution images. According to our results, the ensemble learning results outcome any one of GAN outputs. Compared with some state-of-the-art deep learning-based super-resolution methods, our approach is advantageous in suppressing artifacts and keeping more image details.
Landsat-8, Advanced Spaceborne Thermal Emission and Reflection Radiometer, and WorldView-3 Multispectral Satellite Imagery for Prospecting Copper-Gold Mineralization in the Northeastern Inglefield Mobile Belt (IMB), Northwest Greenland

Several regions in the High Arctic still lingered poorly explored for a variety of mineralization types because of harsh climate environments and remoteness. Inglefield Land is an ice-free region in northwest Greenland that contains copper-gold mineralization associated with hydrothermal alteration mineral assemblages. In this study, Landsat-8, Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER), and WorldView-3 multispectral remote sensing data were used for hydrothermal alteration mapping and mineral prospecting in the Inglefield Land at regional, local, and district scales. Directed principal components analysis (DPCA) technique was applied to map iron oxide/hydroxide, Al/Fe-OH, Mg-Fe-OH minerals, silicification (Si-OH), and SiO2 mineral groups using specialized band ratios of the multispectral datasets. For extracting reference spectra directly from the Landsat-8, ASTER, and WorldView-3 (WV-3) images to generate fraction images of end-member minerals, the automated spectral hourglass (ASH) approach was implemented. Linear spectral unmixing (LSU) algorithm was thereafter used to produce a mineral map of fractional images. Furthermore, adaptive coherence estimator (ACE) algorithm was applied to visible and near-infrared and shortwave infrared (VINR + SWIR) bands of ASTER using laboratory reflectance spectra extracted from the USGS spectral library for verifying the presence of mineral spectral signatures. Results indicate that the boundaries between the Franklinian sedimentary successions and the Etah metamorphic and meta-igneous complex, the orthogneiss in the northeastern part of the Cu-Au mineralization belt adjacent to Dallas Bugt, and the southern part of the Cu-Au mineralization belt nearby Marshall Bugt show high content of iron oxides/hydroxides and Si-OH/SiO2 mineral groups, which warrant high potential for Cu-Au prospecting. A high spatial distribution of hematite/jarosite, chalcedony/opal, and chlorite/epidote/biotite were identified with the documented Cu-Au occurrences in central and southwestern sectors of the Cu-Au mineralization belt. The calculation of confusion matrix and Kappa Coefficient proved appropriate overall accuracy and good rate of agreement for alteration mineral mapping. This investigation accomplished the application of multispectral/multi-sensor satellite imagery as a valuable and economical tool for reconnaissance stages of systematic mineral exploration projects in remote and inaccessible metallogenic provinces around the world, particularly in the High Arctic regions.
Machine learning in haematological malignancies

Machine learning is a branch of computer science and statistics that generates predictive or descriptive models by learning from training data rather than by being rigidly programmed. It has attracted substantial attention for its many applications in medicine, both as a catalyst for research and as a means of improving clinical care across the cycle of diagnosis, prognosis, and treatment of disease. These applications include the management of haematological malignancy, in which machine learning has created inroads in pathology, radiology, genomics, and the analysis of electronic health record data. As computational power becomes cheaper and the tools for implementing machine learning become increasingly democratised, it is likely to become increasingly integrated into the research and practice landscape of haematology. As such, machine learning merits understanding and attention from researchers and clinicians alike. This narrative Review describes important concepts in machine learning for unfamiliar readers, details machine learning's current applications in haematological malignancy, and summarises important concepts for clinicians to be aware of when appraising research that uses machine learning.
Toward Wisdom-Evolutionary and Primitive-Concise 6G: A New Paradigm of Semantic Communication Networks

The sixth generation (6G) mobile networks will reshape the world by offering instant, efficient, and intelligent hyper-connectivity, as envisioned by the previously proposed Ubiquitous-X 6G networks. Such hyper-massive and global connectivity will introduce tremendous challenges into the operation and management of 6G networks, calling for revolutionary theories and technological innovations. To this end, we propose a new route to boost network capabilities toward a wisdom-evolutionary and primitive-concise network (WePCN) vision for the Ubiquitous-X 6G network. In particular, we aim to concretize the evolution path toward the WePCN by first conceiving a new semantic representation framework, namely semantic base, and then establishing an intelligent and efficient semantic communication (IE-SC) network architecture. In the IE-SC architecture, a semantic intelligence plane is employed to interconnect the semantic-empowered physical-bearing layer, network protocol layer, and application-intent layer via semantic information flows. The proposed architecture integrates artificial intelligence and network technologies to enable intelligent interactions among various communication objects in 6G. It features a lower bandwidth requirement, less redundancy, and more accurate intent identification. We also present a brief review of recent advances in semantic communications and highlight potential use cases, complemented by a range of open challenges for 6G.
Perching and resting—A paradigm for UAV maneuvering with modularized landing gears

A modularized and actuated landing gear framework allows a UAV to stably perch and rest on a wide range of different structures.
Achieving Verified Robustness to Symbol Substitutions via Interval Bound Propagation

Po-Sen Huang, Robert Stanforth, Johannes Welbl, Chris Dyer, Dani Yogatama, Sven Gowal, Krishnamurthy Dvijotham, Pushmeet Kohli. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.
Investigating BERT’s Knowledge of Language: Five Analysis Methods with NPIs

Though state-of-the-art sentence representation models can perform tasks requiring significant knowledge of grammar, it is an open question how best to evaluate their grammatical knowledge.We explore five experimental methods inspired by prior work evaluating pretrained sentence representation models.We use a single linguistic phenomenon, negative polarity item (NPI) licensing in English, as a case study for our experiments.NPIs like any are grammatical only if they appear in a licensing environment like negation (Sue doesn't have any cats vs. *Sue has any cats).This phenomenon is challenging because of the variety of NPI licensing environments that exist.We introduce an artificially generated dataset that manipulates key features of NPI licensing for the experiments.We find that BERT has significant knowledge of these features, but its success varies widely across different experimental methods.We conclude that a variety of methods is necessary to reveal all relevant aspects of a model's grammatical knowledge in a given domain.
Graph Convolutional Networks with Markov Random Field Reasoning for Social Spammer Detection

The recent growth of social networking platforms also led to the emergence of social spammers, who overwhelm legitimate users with unwanted content. The existing social spammer detection methods can be characterized into two categories: features based ones and propagation-based ones. Features based methods mainly rely on matrix factorization using tweet text features, and regularization using social graphs is incorporated. However, these methods are fully supervised and can only utilize labeled part of social graphs, which fail to work in a real-world semi-supervised setting. The propagation-based methods primarily employ Markov Random Fields (MRFs) to capture human intuitions in user following relations, which cannot take advantages of rich text features. In this paper, we propose a novel social spammer detection model based on Graph Convolutional Networks (GCNs) that operate on directed social graphs by explicitly considering three types of neighbors. Furthermore, inspired by the propagation-based methods, we propose a MRF layer with refining effects to encapsulate these human insights in social relations, which can be formulated as a RNN through mean-field approximate inference, and stack on top of GCN layers to enable end-to-end training. We evaluate our proposed method on two real-world social network datasets, and the results demonstrate that our method outperforms the state-of-the-art approaches.
Expert-augmented machine learning

Machine learning is proving invaluable across disciplines. However, its success is often limited by the quality and quantity of available data, while its adoption is limited by the level of trust afforded by given models. Human vs. machine performance is commonly compared empirically to decide whether a certain task should be performed by a computer or an expert. In reality, the optimal learning strategy may involve combining the complementary strengths of humans and machines. Here, we present expert-augmented machine learning (EAML), an automated method that guides the extraction of expert knowledge and its integration into machine-learned models. We used a large dataset of intensive-care patient data to derive 126 decision rules that predict hospital mortality. Using an online platform, we asked 15 clinicians to assess the relative risk of the subpopulation defined by each rule compared to the total sample. We compared the clinician-assessed risk to the empirical risk and found that, while clinicians agreed with the data in most cases, there were notable exceptions where they overestimated or underestimated the true risk. Studying the rules with greatest disagreement, we identified problems with the training data, including one miscoded variable and one hidden confounder. Filtering the rules based on the extent of disagreement between clinician-assessed risk and empirical risk, we improved performance on out-of-sample data and were able to train with less data. EAML provides a platform for automated creation of problem-specific priors, which help build robust and dependable machine-learning models in critical applications.
Attribute-Guided Feature Learning Network for Vehicle Reidentification

Vehicle reidentification (reID) targets at matching same vehicle images captured from multicameras, which has become a hot topic in recent years. However, it poses the critical but challenging problem that is caused by complicated environments and diversified illuminations. Inspired by the benefit of attributes that contain detailed descriptions, this article proposes a novel attribute-guided network (AGNet), which learns global representation with the abundant attribute features in an end-to-end manner. Specially, an attribute-guided module is proposed in AGNet to generate the attribute mask (AttrMask), which inversely guides to select discriminative features for category classification. Moreover, in AGNet, an attribute-based label smoothing (ASL) loss is presented to better train the reID model, which can strengthen the distinct ability of the reID model and regularize the AGNet model according to the attributes. The experiment results validate the effectiveness of AGNet and demonstrate that AGNet achieves excellent performance on two benchmark datasets.
Software Defect Prediction Using Ensemble Learning: A Systematic Literature Review

Recent advances in the domain of software defect prediction (SDP) include the integration of multiple classification techniques to create an ensemble or hybrid approach. This technique was introduced to improve the prediction performance by overcoming the limitations of any single classification technique. This research provides a systematic literature review on the use of the ensemble learning approach for software defect prediction. The review is conducted after critically analyzing research papers published since 2012 in four well-known online libraries: ACM, IEEE, Springer Link, and Science Direct. In this study, five research questions covering the different aspects of research progress on the use of ensemble learning for software defect prediction are addressed. To extract the answers to identified questions, 46 most relevant papers are shortlisted after a thorough systematic research process. This study will provide compact information regarding the latest trends and advances in ensemble learning for software defect prediction and provide a baseline for future innovations and further reviews. Through our study, we discovered that frequently employed ensemble methods by researchers are the random forest, boosting, and bagging. Less frequently employed methods include stacking, voting and Extra Trees. Researchers proposed many promising frameworks, such as EMKCA, SMOTE-Ensemble, MKEL, SDAEsTSE, TLEL, and LRCR, using ensemble learning methods. The AUC, accuracy, F-measure, Recall, Precision, and MCC were mostly utilized to measure the prediction performance of models. WEKA was widely adopted as a platform for machine learning. Many researchers showed through empirical analysis that features selection, and data sampling was necessary pre-processing steps that improve the performance of ensemble classifiers.