Reviewerly/exHarmony huggingface dataset:
A Lightweight Privacy-Preserving Communication Protocol for Heterogeneous IoT Environment

While Internet-of-Things (IoT) significantly facilitates the convenience of people's daily life, the lack of security practice raises the risk of privacy-sensitive user data leakage. Securing data transmission among IoT devices is therefore a critical capability of IoT environments such as Intelligent Connected Vehicles, Smart Home, Intelligent City and so forth. However, cryptographic communication scheme is challenged by the limited resource of low-cost IoT devices, even negligible extra CPU usage of battery-powered sensors would result in dramatical decrease of the battery life. In this paper, to minimize the resource consumption, we propose a communication protocol involving only the symmetric key-based scheme, which provides ultra-lightweight yet effective encryptions to protect the data transmissions. Symmetric keys generated in this protocol are delegated based on a chaotic system, i.e., Logistic Map, to resist against the key reset and device capture attacks. We semantically model such protocol and analyze the security properties. Moreover, the resource consumption is also evaluated to guarantee runtime efficacy.
Non-Autoregressive Coarse-to-Fine Video Captioning

It is encouraged to see that progress has been made to bridge videos and natural language. However, mainstream video captioning methods suffer from slow inference speed due to the sequential manner of autoregressive decoding, and prefer generating generic descriptions due to the insufficient training of visual words (e.g., nouns and verbs) and inadequate decoding paradigm. In this paper, we propose a non-autoregressive decoding based model with a coarse-to-fine captioning procedure to alleviate these defects. In implementations, we employ a bi-directional self-attention based network as our language model for achieving inference speedup, based on which we decompose the captioning procedure into two stages, where the model has different focuses. Specifically, given that visual words determine the semantic correctness of captions, we design a mechanism of generating visual words to not only promote the training of scene-related words but also capture relevant details from videos to construct a coarse-grained sentence ``template''. Thereafter, we devise dedicated decoding algorithms that fill in the ``template'' with suitable words and modify inappropriate phrasing via iterative refinement to obtain a fine-grained description. Extensive experiments on two mainstream video captioning benchmarks, i.e., MSVD and MSR-VTT, demonstrate that our approach achieves state-of-the-art performance, generates diverse descriptions, and obtains high inference efficiency.
PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Tracking

We propose the task of outline-conditioned story generation: given an outline as a set of phrases that describe key characters and events to appear in a story, the task is to generate a coherent narrative that is consistent with the provided outline.This task is challenging as the input only provides a rough sketch of the plot, and thus, models need to generate a story by interweaving the key points provided in the outline.This requires the model to keep track of the dynamic states of the latent plot, conditioning on the input outline while generating the full story.We present PLOTMACHINES, a neural narrative model that learns to transform an outline into a coherent story by tracking the dynamic plot states.In addition, we enrich PLOTMACHINES with high-level discourse structure so that the model can learn different writing styles corresponding to different parts of the narrative.Comprehensive experiments over three fiction and non-fiction datasets demonstrate that large-scale language models, such as GPT-2 and GROVER, despite their impressive generation performance, are not sufficient in generating coherent narratives for the given outline, and dynamic plot state tracking is important for composing narratives with tighter, more consistent plots.
A State of Art Survey for Concurrent Computation and Clustering of Parallel Computing for Distributed Systems

In this paper, several works has been presented related to the clustering parallel computing for distributed system. The trend of the paper is to focus on the strength points of previous works in this field towards enhancing performance of the distributed systems. This concentration conducted via presenting several techniques where each of them has the weak and strong features. The most challenging points for all techniques vary from increasing the performance of the system to time responding to overcome overhead running of the system. For more specific addressing concurrent computation besides parallel computing classifications for distributed systems, this paper depended comprehensive features study and comparison between SYNC and ASYNC Modes.
RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER

Recently multimodal named entity recognition (MNER) has utilized images to improve the accuracy of NER in tweets. However, most of the multimodal methods use attention mechanisms to extract visual clues regardless of whether the text and image are relevant. Practically, the irrelevant text-image pairs account for a large proportion in tweets. The visual clues that are unrelated to the texts will exert uncertain or even negative effects on multimodal model learning. In this paper, we introduce a method of text-image relation propagation into the multimodal BERT model. We integrate soft or hard gates to select visual clues and propose a multitask algorithm to train and validate the effects of relation propagation on the MNER datasets. In the experiments, we deeply analyze the changes in visual attention before and after the use of relation propagation. Our model achieves state-of-the-art performance on the MNER datasets.
ESL Teachers’ Challenges in Implementing E-learning during COVID-19

Education sector in Malaysia had put emphasis on the use of online learning or e-learning with technology and devices as a mediator of communication to replace face-to-face learning during the COVID-19 pandemic. Subsequently, with the improvement of learning technologies, English as a Second Language (ESL) teachers faced various challenges in language teaching. In this regard, this study aimed to investigate the challenges ESL teachers faced in implementing e-learning during COVID-19. Using a qualitative approach, this research was a case study which involved 20 primary ESL teachers. Data collection was done through an in-depth interview to explore teachers’ e-learning experiences and challenges in teaching the English language. Based on the findings, the majority of teachers expressed that the use of e-learning was effective with various limitations such as teachers’ readiness to adopt e-learning, accessibility to mobile phones and Internet connectivity, classroom management in term of low students’ participation and assessment. Thus, the researcher recommended more studies to highlight teachers’ insight regarding the significance of e-learning. ESL teachers, stakeholders, policy makers, and institutions can benefit from the results of the study and come out with practical strategies to utilize online sources for education in the pandemic situation.
Imputation of missing data with class imbalance using conditional generative adversarial networks

Missing data is a common problem faced with real-world datasets. Imputation is a widely used technique to estimate the missing data. State-of-the-art imputation approaches model the distribution of observed data to approximate the missing values. Such an approach usually models a single distribution for the entire dataset, which overlooks the class-specific characteristics of the data. Class-specific characteristics are especially useful when there is a class imbalance. We propose a new method for imputing missing data based on its class-specific characteristics by adapting the popular Conditional Generative Adversarial Networks (CGAN). Our Conditional Generative Adversarial Imputation Network (CGAIN) imputes the missing data using class-specific distributions, which can produce the best estimates for the missing values. We tested our approach on baseline datasets and achieved superior performance compared with the state-of-the-art and popular imputation approaches.
Hierarchical Reinforcement Learning for Integrated Recommendation

Integrated recommendation aims to jointly recommend heterogeneous items in the main feed from different sources via multiple channels, which needs to capture user preferences on both item and channel levels. It has been widely used in practical systems by billions of users, while few works concentrate on the integrated recommendation systematically. In this work, we propose a novel Hierarchical reinforcement learning framework for integrated recommendation (HRL-Rec), which divides the integrated recommendation into two tasks to recommend channels and items sequentially. The low-level agent is a channel selector, which generates a personalized channel list. The high-level agent is an item recommender, which recommends specific items from heterogeneous channels under the channel constraints. We design various rewards for both recommendation accuracy and diversity, and propose four losses for fast and stable model convergence. We also conduct an online exploration for sufficient training. In experiments, we conduct extensive offline and online experiments on a billion-level real-world dataset to show the effectiveness of HRL-Rec. HRL-Rec has also been deployed on WeChat Top Stories, affecting millions of users. The source codes are released in https://github.com/modriczhang/HRL-Rec.
HifiFace: 3D Shape and Semantic Prior Guided High Fidelity Face Swapping

In this work, we propose a high fidelity face swapping method, called HifiFace, which can well preserve the face shape of the source face and generate photo-realistic results. Unlike other existing face swapping works that only use face recognition model to keep the identity similarity, we propose 3D shape-aware identity to control the face shape with the geometric supervision from 3DMM and 3D face reconstruction method. Meanwhile, we introduce the Semantic Facial Fusion module to optimize the combination of encoder and decoder features and make adaptive blending, which makes the results more photo-realistic. Extensive experiments on faces in the wild demonstrate that our method can preserve better identity, especially on the face shape, and can generate more photo-realistic results than previous state-of-the-art methods. Code is available at: https://johann.wang/HifiFace
Genetic mutation and biological pathway prediction based on whole slide images in breast carcinoma using deep learning

Abstract Breast carcinoma is the most common cancer among women worldwide that consists of a heterogeneous group of subtype diseases. The whole-slide images (WSIs) can capture the cell-level heterogeneity, and are routinely used for cancer diagnosis by pathologists. However, key driver genetic mutations related to targeted therapies are identified by genomic analysis like high-throughput molecular profiling. In this study, we develop a deep-learning model to predict the genetic mutations and biological pathway activities directly from WSIs. Our study offers unique insights into WSI visual interactions between mutation and its related pathway, enabling a head-to-head comparison to reinforce our major findings. Using the histopathology images from the Genomic Data Commons Database, our model can predict the point mutations of six important genes (AUC 0.68–0.85) and copy number alteration of another six genes (AUC 0.69–0.79). Additionally, the trained models can predict the activities of three out of ten canonical pathways (AUC 0.65–0.79). Next, we visualized the weight maps of tumor tiles in WSI to understand the decision-making process of deep-learning models via a self-attention mechanism. We further validated our models on liver and lung cancers that are related to metastatic breast cancer. Our results provide insights into the association between pathological image features, molecular outcomes, and targeted therapies for breast cancer patients.
Addressing the severity and intensity of poverty in Sub-Saharan Africa: how relevant is the ICT and financial development pathway?

The study examines the effectiveness of ICT diffusion and financial development in reducing the severity and intensity of poverty in Sub-Saharan Africa (SSA). Using data from the World Development Indicators and the Global Consumption and Income Project (1980–2019), we provide evidence, robust to several specifications from the dynamic system GMM and the panel corrected standard errors estimation techniques, to show that, compared to financial access, ICT usage, and ICT access, ICT skills is remarkable in reducing both the severity and intensity of poverty. The results further revealed that, though ICT skills reduce poverty, the effect is more pronounced in the presence of enhanced financial development. Policy recommendations are provided in line with the region's green growth agenda and technological progress.
Blockchain Identity Management

In the age of internet, everything about our personal identity can be found on the Web. Billions of email account details to millions of credit and identity data (Equifax) had compromised in the massive data breaches recently. So one of the greatest challenges faced today is identity management (IDM). Blockchain technology offers a way to prevent this problem by providing a secure solution without a central authority. People can store data on a blockchain by their own, thereby avoiding intermediaries and vulnerable servers. Information once stored is secured cryptographically and cannot be altered or deleted, thus making it secure from data breaches. This technique of IDM enhances decentralization, transparency, fault tolerance and user control in transactions that involve sensitive identity informations. The tremendous development of Bitcoin had given widespread attention and high-end research on blockchain technology. In the age of internet, everything about a person's identity can be found on the web. Billions of email account details to millions of credit and identity data (Equifax) had compromised in the massive data breaches recently. So one of the greatest challenges faced today is IDM. Blockchain technology offers a way to prevent this problem by providing a secure solution without a central authority. Blockchain is a distributed database system similar to an open, shared ledger that stores and manages transactions. Each record in the database is called a block and is cryptographically linked to the previous block. People can store data on a block by their own, thereby avoiding intermediaries and vulnerable servers. Information once stored is secured cryptographically and cannot be altered or deleted, thus making it secure from data breaches. This technique of IDM enhances decentralization, transparency, fault tolerance and user control in transactions that involve sensitive identity informations. In spite of these features, this distributed ledger technology based IDM lacks proper identity verification and classification of individuals.
A Conceptual Framework for Determining Quality Requirements for Mobile Learning Applications Using Delphi Method

The development of mobile learning apps might fail due to poor selection of the suitable technical requirements for mobile devices. This will affect the quality of mobile learning applications and, thus, will increase the development cost of mobile learning apps. Due to the above issues, we need to determine the most appropriate technical quality requirements for the development of mobile learning apps that meet user requirements. To achieve that, we propose a comprehensive framework to capture the most suitable technical quality requirements for mobile learning apps. A Delphi method was used to collect, evaluate, and analyze the data for this study. As a result of our Delphi study, we have identified nineteen technical quality requirements, divided into six quality dimensions, for the development of mobile learning applications. The proposed framework is expected to be a guideline for mobile apps designers and developers to successfully develop mobile learning apps.
Distributed Differential Evolution With Adaptive Resource Allocation

Distributed differential evolution (DDE) is an efficient paradigm that adopts multiple populations for cooperatively solving complex optimization problems. However, how to allocate fitness evaluation (FE) budget resources among the distributed multiple populations can greatly influence the optimization ability of DDE. Therefore, this article proposes a novel three-layer DDE framework with adaptive resource allocation (DDE-ARA), including the algorithm layer for evolving various differential evolution (DE) populations, the dispatch layer for dispatching the individuals in the DE populations to different distributed machines, and the machine layer for accommodating distributed computers. In the DDE-ARA framework, three novel methods are further proposed. First, a general performance indicator (GPI) method is proposed to measure the performance of different DEs. Second, based on the GPI, a FE allocation (FEA) method is proposed to adaptively allocate the FE budget resources from poorly performing DEs to well-performing DEs for better search efficiency. This way, the GPI and FEA methods achieve the ARA in the algorithm layer. Third, a load balance strategy is proposed in the dispatch layer to balance the FE burden of different computers in the machine layer for improving load balance and algorithm speedup. Moreover, theoretical analyses are provided to show why the proposed DDE-ARA framework can be effective and to discuss the lower bound of its optimization error. Extensive experiments are conducted on all the 30 functions of CEC 2014 competitions at 10, 30, 50, and 100 dimensions, and some state-of-the-art DDE algorithms are adopted for comparisons. The results show the great effectiveness and efficiency of the proposed framework and the three novel methods.
SVTR: Scene Text Recognition with a Single Visual Model

Dominant scene text recognition models commonly contain two building blocks, a visual model for feature extraction and a sequence model for text transcription. This hybrid architecture, although accurate, is complex and less efficient. In this study, we propose a Single Visual model for Scene Text recognition within the patch-wise image tokenization framework, which dispenses with the sequential modeling entirely. The method, termed SVTR, firstly decomposes an image text into small patches named character components. Afterward, hierarchical stages are recurrently carried out by component-level mixing, merging and/or combining. Global and local mixing blocks are devised to perceive the inter-character and intra-character patterns, leading to a multi-grained character component perception. Thus, characters are recognized by a simple linear prediction. Experimental results on both English and Chinese scene text recognition tasks demonstrate the effectiveness of SVTR. SVTR-L (Large) achieves highly competitive accuracy in English and outperforms existing methods by a large margin in Chinese, while running faster. In addition, SVTR-T (Tiny) is an effective and much smaller model, which shows appealing speed at inference. The code is publicly available at https://github.com/PaddlePaddle/PaddleOCR.
Medical image data augmentation: techniques, comparisons and interpretations

Designing deep learning based methods with medical images has always been an attractive area of research to assist clinicians in rapid examination and accurate diagnosis. Those methods need a large number of datasets including all variations in their training stages. On the other hand, medical images are always scarce due to several reasons, such as not enough patients for some diseases, patients do not want to allow their images to be used, lack of medical equipment or equipment, inability to obtain images that meet the desired criteria. This issue leads to bias in datasets, overfitting, and inaccurate results. Data augmentation is a common solution to overcome this issue and various augmentation techniques have been applied to different types of images in the literature. However, it is not clear which data augmentation technique provides more efficient results for which image type since different diseases are handled, different network architectures are used, and these architectures are trained and tested with different numbers of data sets in the literature. Therefore, in this work, the augmentation techniques used to improve performances of deep learning based diagnosis of the diseases in different organs (brain, lung, breast, and eye) from different imaging modalities (MR, CT, mammography, and fundoscopy) have been examined. Also, the most commonly used augmentation methods have been implemented, and their effectiveness in classifications with a deep network has been discussed based on quantitative performance evaluations. Experiments indicated that augmentation techniques should be chosen carefully according to image types.
Towards a Generic Method of Evaluating Game Levels

This paper addresses the problem of evaluating the quality of game levels across different games and even genres, which is of key importance for making procedural content generation and assisted game design tools more generally applicable. Three game design patterns are identified for having high generality while being easily quantifiable: area control, exploration and balance. Formulas for measuring the extent to which a level includes these concepts are proposed, and evaluation functions are derived for levels in two different game genres: multiplayer strategy game maps and single-player roguelike dungeons. To illustrate the impact of these evaluation functions, and the similarity of impact across domains, sets of levels for each function are generated using a constrained genetic algorithm. The proposed measures can easily be extended to other game genres.
Cross-Domain Extreme Learning Machines for Domain Adaptation

Extreme learning machines (ELMs), as “generalized” single hidden layer feedforward networks, have been proved to be effective and efficient for classification and regression problems. Traditional ELMs assume that the training and testing data are drawn from the same distribution, which however is often violated in real-world applications. In this paper, we propose a unified cross-domain ELM (CDELM) framework to address domain adaptation problems, in which the distributions of training data (source domain) and testing data (target domain) are different but related. CDELM not only fully leverages labeled source data and unlabeled target data simultaneously to construct an adaptive target classifier but also maintains the computational efficiency of ELMs. Specifically, CDELM adapts the source classifier to target domain by matching the projected means of both domains, and explores the structure property of target domain by using manifold regularization to make the final classifier more adaptable to target data. Based on the framework, two algorithms CDELM-M and CDELM-C are proposed, which aim at minimizing the marginal and conditional distribution distance between source and target domains, respectively. Moreover, CDELM-C can further enhance the classification accuracy by multiple iterations. Comprehensive experimental studies on artificial datasets and public text and image datasets demonstrate that both CDELM-M and CDELM-C are competitive with several state-of-the-art domain adaptation learning methods in terms of the classification accuracy and efficiency.