Reviewerly/exHarmony huggingface dataset:
SBERT-WK: A Sentence Embedding Method by Dissecting BERT-Based Word Models

Sentence embedding is an important research topic in natural language processing (NLP) since it can transfer knowledge to downstream tasks. Meanwhile, a contextualized word representation, called BERT, achieves the state-of-the-art performance in quite a few NLP tasks. Yet, it is an open problem to generate a high quality sentence representation from BERT-based word models. It was shown in previous study that different layers of BERT capture different linguistic properties. This allows us to fuse information across layers to find better sentence representations. In this work, we study the layer-wise pattern of the word representation of deep contextualized models. Then, we propose a new sentence embedding method by dissecting BERT-based word models through geometric analysis of the space spanned by the word representation. It is called the SBERT-WK method. No further training is required in SBERT-WK. We evaluate SBERT-WK on semantic textual similarity and downstream supervised tasks. Furthermore, ten sentence-level probing tasks are presented for detailed linguistic analysis. Experiments show that SBERT-WK achieves the state-of-the-art performance. Our codes are publicly available.
A comprehensive survey of multi-view video summarization

There has been an exponential growth in the amount of visual data on a daily basis acquired from single or multi-view surveillance camera networks. This massive amount of data requires efficient mechanisms such as video summarization to ensure that only significant data are reported and the redundancy is reduced. Multi-view video summarization (MVS) is a less redundant and more concise way of providing information from the video content of all the cameras in the form of either keyframes or video segments. This paper presents an overview of the existing strategies proposed for MVS, including their advantages and drawbacks. Our survey covers the genericsteps in MVS, such as the pre-processing of video data, feature extraction, and post-processing followed by summary generation. We also describe the datasets that are available for the evaluation of MVS. Finally, we examine the major current issues related to MVS and put forward the recommendations for future research1.
Remote Sensing Image Super-Resolution via Mixed High-Order Attention Network

Recently, remote sensing images have become increasingly popular in a number of tasks, such as environmental monitoring. However, the observed images from satellite sensors often suffer from low-resolution (LR), making it difficult to meet the requirements for further analysis. Super-resolution (SR) aims to increase the image resolution while providing finer spatial details, which perfectly remedies the weakness of satellite images. Therefore, in this article, we propose an innovative mixed high-order attention network (MHAN) for remote sensing SR. It comprises two components: a feature extraction network for feature extraction, and a feature refinement network with high-order attention (HOA) mechanism for detail restoration. In the feature extraction network, we replace the elementwise addition with weighted channelwise concatenation in all skip connections, which greatly facilitates the information flow. In the feature refinement network, rather than exploring the first-order statistics (spatial or channel attention), we introduce the HOA module to restore the missing details. Finally, to fully exploit hierarchical features, we introduce the frequency-aware connection to bridge the feature extraction and feature refinement networks. Experiments on two widely used remote sensing image data sets demonstrate that our MHAN not only obtains better accuracy than the state-of-the-art methods but also shows the superiority in terms of running time and GPU cost. Code is available at https://github.com/ZhangDY827/MHAN.
Spatiotemporal chaos in improved cross coupled map lattice and its application in a bit-level image encryption scheme

In this paper, an improved cross coupled map lattice (CCML) which is derived from CCML is proposed. The experimental analysis of CCML shows that it exhibits weak or even lose chaotic behaviors in a large range of parameters. To enhance its chaotic performance, the new model changes the internal chaotic map of CCML from the logistics map to the tent map and introduces the module operations to limit the obtained value. The theoretical analysis and experimental results prove that the proposed model has a broad chaotic regime over an extensive range of system parameters, positive Lyapunov exponents, higher information entropies and lower mutual information values when compared to CCML, which are highly suitable for chaos-based image encryption. Moreover, this paper applies that model on a bit-level image encryption scheme. The algorithm consists of three main operations: the generation of secret keys, confusion and diffusion operations that can break the limitation of row and column. To confirm the novel algorithm's effectiveness and safety against the common types of attacks, many experiments are done and security analyses are discussed. It demonstrates the good chaos of the proposed model from the aspect of encryption performance.
Development of Deterministic Artificial Intelligence for Unmanned Underwater Vehicles (UUV)

The major premise of deterministic artificial intelligence (D.A.I.) is to assert deterministic self-awareness statements based in either the physics of the underlying problem or system identification to establish governing differential equations. The key distinction between D.A.I. and ubiquitous stochastic methods for artificial intelligence is the adoption of first principles whenever able (in every instance available). One benefit of applying artificial intelligence principles over ubiquitous methods is the ease of the approach once the re-parameterization is derived, as done here. While the method is deterministic, researchers need only understand linear regression to understand the optimality of both self-awareness and learning. The approach necessitates full (autonomous) expression of a desired trajectory. Inspired by the exponential solution of ordinary differential equations and Euler’s expression of exponential solutions in terms of sinusoidal functions, desired trajectories will be formulated using such functions. Deterministic self-awareness statements, using the autonomous expression of desired trajectories with buoyancy control neglected, are asserted to control underwater vehicles in ideal cases only, while application to real-world deleterious effects is reserved for future study due to the length of this manuscript. In totality, the proposed methodology automates control and learning merely necessitating very simple user inputs, namely desired initial and final states and desired initial and final time, while tuning is eliminated completely.
Block5GIntell: Blockchain for AI-Enabled 5G Networks

Nowadays, 5G network is considered to be one of the main pillars of various industries, including the Internet of Things (IoT), smart cities, virtual reality, and many more. Unlike previous network generations, 5G utilizes complex digital technologies such as massive Multiple Input Multiple Output (mMIMO) and runs over higher radio frequencies. The introduction of new technologies and advanced features in the 5G network raises new challenges for network operators, and merging Artificial Intelligence (AI) is one of the effective solutions to address these complexities. However, AI-enabled 5G network engenders security concerns and requires improvement to meet the standardization and qualification of the new network generation. To mitigate these dilemmas, Blockchain must be integrated. Blockchain, as a decentralized methodology provides a secure sharing of information and resources among various nodes of 5G environments. Blockchain can support other technologies, such as AI-based 5G, to create smarter, more efficient, and secure cellular networks. In this article, we present a comprehensive intelligence and secure data analytics framework for 5G networks based on the convergence of Blockchain and AI named “Block5GIntell”. We depict the applications of Blockchain and AI on 5G networks separately and we argue on the support that Blockchain can provide for AI to create smart and secure 5G networks relying on our proposed framework. To support our proposition, we present an energy-saving case study using Blockchain for AI-enabled 5G. The simulation shows an overall 20% decrease in energy consumption at the RAN level.
Faster AutoAugment: Learning Augmentation Strategies Using Backpropagation

Data augmentation methods are indispensable heuristics to boost the performance of deep neural networks, especially in image recognition tasks. Recently, several studies have shown that augmentation strategies found by search algorithms outperform hand-made strategies. Such methods employ black-box search algorithms over image transformations with continuous or discrete parameters and require a long time to obtain better strategies. In this paper, we propose a differentiable policy search pipeline for data augmentation, which is much faster than previous methods. We introduce approximate gradients for several transformation operations with discrete parameters as well as a differentiable mechanism for selecting operations. As the objective of training, we minimize the distance between the distributions of augmented and original data, which can be differentiated. We show that our method, Faster AutoAugment, achieves significantly faster searching than prior methods without a performance drop.
Zero-Shot Image Dehazing

In this paper, we study two less-touched challenging problems in single image dehazing neural networks, namely, how to remove haze from a given image in an unsupervised and zeroshot manner. To the ends, we propose a novel method based on the idea of layer disentanglement by viewing a hazy image as the entanglement of several "simpler" layers, i.e., a hazy-free image layer, transmission map layer, and atmospheric light layer. The major advantages of the proposed ZID are two-fold. First, it is an unsupervised method that does not use any clean images including hazy-clean pairs as the ground-truth. Second, ZID is a "zero-shot" method, which just uses the observed single hazy image to perform learning and inference. In other words, it does not follow the conventional paradigm of training deep model on a large scale dataset. These two advantages enable our method to avoid the labor-intensive data collection and the domain shift issue of using the synthetic hazy images to address the real-world images. Extensive comparisons show the promising performance of our method compared with 15 approaches in the qualitative and quantitive evaluations. The source code could be found at www.pengxi.me.
Deep learning framework based on integration of S-Mask R-CNN and Inception-v3 for ultrasound image-aided diagnosis of prostate cancer

The computer-aided diagnosis of prostate ultrasound images can aid in the detection and treatment of prostate cancer. However, the ultrasound images of the prostate sometimes come with serious speckle noise, low signal-to-noise ratio, and poor detection accuracy. To overcome this shortcoming, we proposed a deep learning model that integrates S-Mask R-CNN and Inception-v3 in the ultrasound image-aided diagnosis of prostate cancer in this paper. The improved S-Mask R-CNN was used to realize the accurate segmentation of prostate ultrasound images and generate candidate regions. The region of interest align algorithm was used to realize the pixel-level feature point positioning. The corresponding binary mask of prostate images was generated by the convolution network to segment the prostate region and the background. Then, the background information was shielded, and a data set of segmented ultrasound images of the prostate was constructed for the Inception-v3 network for lesion detection. A new network model was added to replace the original classification module, which is composed of forward and back propagation. Forward propagation mainly transfers the characteristics extracted from the convolution layer pooling layer below the pool_3 layer through the transfer learning strategy to the input layer and then calculates the loss value between the classified and label values to identify the ultrasound lesion of the prostate. The experimental results showed that the proposed method can accurately detect the ultrasound image of the prostate and segment prostate information at the pixel-level simultaneously. The proposed method has higher accuracy than that of the doctor’s manual diagnosis and other detection methods. Our simple and effective approach will serve as a solid baseline and help ease future research in the computer-aided diagnosis of prostate ultrasound images. Furthermore, this work will promote the development of prostate cancer ultrasound diagnostic technology.
Overview and Importance of Data Quality for Machine Learning Tasks

It is well understood from literature that the performance of a machine learning (ML) model is upper bounded by the quality of the data. While researchers and practitioners have focused on improving the quality of models (such as neural architecture search and automated feature selection), there are limited efforts towards improving the data quality. One of the crucial requirements before consuming datasets for any application is to understand the dataset at hand and failure to do so can result in inaccurate analytics and unreliable decisions. Assessing the quality of the data across intelligently designed metrics and developing corresponding transformation operations to address the quality gaps helps to reduce the effort of a data scientist for iterative debugging of the ML pipeline to improve model performance. This tutorial highlights the importance of analysing data quality in terms of its value for machine learning applications. This tutorial surveys all the important data quality related approaches discussed in literature, focusing on the intuition behind them, highlighting their strengths and similarities, and illustrates their applicability to real-world problems. Finally we will discuss the interesting work IBM Research is doing in this space.
Emoji, Playfulness, and Brand Engagement on Twitter

Brands, both human and corporate, are increasingly communicating with their consumers using emojis. The current work examines if and how these pictographs shape online brand engagement on Twitter (i.e., likes & retweets). To do so, we first examine datasets generated by scraping the tweets of the most popular celebrity brands and most popular corporate brands (Study 1). This study demonstrates that emoji presence increases engagement with tweets, with more emoji leading to more likes and retweets. Two controlled experiments then explore the role of perceived playfulness in explaining this effect of emojis on engagement (Studies 2 and 3). We find that the effect of emojis on brand engagement varies depending on the nature of the interplay between emojis and text, and the subsequent effect of this interplay on perceived playfulness. Theoretical contributions and social media practitioner implications are also addressed.
Can we be friends with Mitsuku? A longitudinal study on the process of relationship formation between humans and a social chatbot

This explorative study investigated (a) whether social attraction, self-disclosure, interaction quality, intimacy, empathy and communicative competence play a role in getting-acquainted interactions between humans and a chatbot, and (b) whether humans can build a relationship with a chatbot. Although human-machine communication research suggests that humans can develop feelings for computers, this does not automatically imply that humans experience feelings of friendship with a chatbot. In this longitudinal study, 118 participants had seven interactions with chatbot Mitsuku over a 3-week period. After each interaction participants filled out a questionnaire. The results showed that the social processes decreased after each interaction and feelings of friendship were low. In line with the ABCDE model of relationship development, the social processes that aid relationship continuation decrease, leading to deterioration of the relationship. Furthermore, a novelty effect was at play after the first interaction, after which the chatbot became predictable and the interactions less enjoyable.
Coronavirus contact tracing

Many countries are deploying Covid-19 contact tracing apps that use Bluetooth Low Energy (LE) to detect proximity within 2m for 15 minutes. However, Bluetooth LE is an unproven technology for this application, raising concerns about the efficacy of these apps. Indeed, measurements indicate that the Bluetooth LE received signal strength can be strongly affected by factors including (i) the model of handset used, (ii) the relative orientation of handsets, (iii) absorption by human bodies, bags etc. and (iv) radio wave reflection from walls, floors, furniture. The impact on received signal strength is comparable with that caused by moving 2m, and so has the potential to seriously affect the reliability of proximity detection. These effects are due the physics of radio propagation and suggest that the development of accurate methods for proximity detection based on Bluetooth LE received signal strength is likely to be challenging. We call for action in three areas. Firstly, measurements are needed that allow the added value of deployed apps within the overall contact tracing system to be evaluated, e.g. data on how many of the people notified by the app would not have been found by manual contact tracing and what fraction of people notified by an app actually test positive for Covid-19. Secondly, the 2m/15 minute proximity limit is only a rough guideline. The real requirement is to use handset sensing to evaluate infection risk and this requires a campaign to collect measurements of both handset sensor data and infection outcomes. Thirdly, a concerted effort is needed to collect controlled Bluetooth LE measurements in a wide range of real-world environments, the data reported here being only a first step in that direction.
Bispace Domain Adaptation Network for Remotely Sensed Semantic Segmentation

Supervised learning for semantic segmentation has achieved impressive success in remote sensing, while this normally has a high demand on pixel-level ground truth from the testing images (target domain). Labeling data for semantic segmentation is labor-intensive and time-consuming. To reduce the workload of manual labeling, domain adaptation (DA) utilizes preexisting labeled images from other sources (source domain) to classify the images in the target domain. In this article, we propose a bispace alignment network for DA named BSANet. BSANet is designed to have a dual-branch structure which is able to extract features in the image domain and the wavelet domain simultaneously. To minimize the discrepancy between the source and target domains, we propose a bispace adversarial learning strategy. Specifically, BSANet employs two discriminators in different spaces, one aligning the source and target feature distributions, and the other helping the classification outputs render reasonable spatial layouts. The proposed method shows the ability to train an end-to-end network for semantic segmentation without using any label in the target domain. Extensive experiments and ablation studies are conducted in cross-city scenarios. Comparative experiments with several state-of-the-art DA methods show that our method achieves the best performance.
Blockchain in education management: present and future applications

Purpose This paper aims to provide a systematic literature review on blockchain technology in education to offer a detailed understanding of the present scenario in terms of benefits, barriers, present blockchain technology application and future areas where blockchain technology can be implemented in the other fields of education. Design/methodology/approach A bibliometric analysis is conducted on for data in the publications, journals, authors and citations were collected, and examined by applying bibliometric measures. The data was collected from SCOPUS database on the topic “Blockchain Technology in Education”. The following research questions guided this systematic literature review (SLR: How blockchain technology has been defined in educational settings? How were the technology examined (i.e. the methodology)? What were the results of using this technology in an education system? Findings The study identifies the benefits, barriers and present application of blockchain technology in education. The analysis shows that blockchain technology in education is still a young discipline, but has a lot of potential to benefits the educational sector at large. Practical implications This research provides a groundwork for education institutions, the policymakers and researchers to explore other areas where blockchain technology can be implemented, though this research has also suggested some prospective uses of blockchain technology in different functions of an education system, more application can be brought into the education system to exploit the potential of blockchain technology. Originality/value The paper discusses the application of blockchain technology in education with the help of bibliometric analysis. This is one of the first known studies to review the blockchain technology by identifying its benefits, barriers, present blockchain technology application. Based on the analysis, future application areas are also identified.
Aerial LaneNet: Lane-Marking Semantic Segmentation in Aerial Imagery Using Wavelet-Enhanced Cost-Sensitive Symmetric Fully Convolutional Neural Networks

The knowledge about the placement and appearance of lane markings is a prerequisite for the creation of maps with high precision, necessary for autonomous driving, infrastructure monitoring, lane-wise traffic management, and urban planning. Lane markings are one of the important components of such maps. Lane markings convey the rules of roads to drivers. While these rules are learned by humans, an autonomous driving vehicle should be taught to learn them to localize itself. Therefore, accurate and reliable lane marking semantic segmentation in the imagery of roads and highways is needed to achieve such goals. We use airborne imagery which can capture a large area in a short period of time by introducing an aerial lane marking dataset. In this work, we propose a Symmetric Fully Convolutional Neural Network enhanced by Wavelet Transform in order to automatically carry out lane marking segmentation in aerial imagery. Due to a heavily unbalanced problem in terms of number of lane marking pixels compared with background pixels, we use a customized loss function as well as a new type of data augmentation step. We achieve a very high accuracy in pixel-wise localization of lane markings without using 3rd-party information. In this work, we introduce the first high-quality dataset used within our experiments which contains a broad range of situations and classes of lane markings representative of current transportation systems. This dataset will be publicly available and hence, it can be used as the benchmark dataset for future algorithms within this domain.