Reviewerly/exHarmony huggingface dataset:
Chaos-Based Confusion and Diffusion of Image Pixels Using Dynamic Substitution

The evolution of wireless and mobile communication from 0G to the upcoming 5G gives rise to data sharing through the Internet. This data transfer via open public networks are susceptible to several types of attacks. Encryption is a method that can protect information from hackers and hence confidential data can be secured through a cryptosystem. Due to the increased number of cyber attacks, encryption has become an important component of modern-day communication. In this article, a new image encryption algorithm is presented using chaos theory and dynamic substitution. The proposed scheme is based on two-dimensional Henon, Ikeda chaotic maps, and substitution box (S-box) transformation. Through Henon, a random S-Box is selected and the image pixel is substituted randomly. To analyze security and robustness of the proposed algorithm, several security tests such as information entropy, histogram investigation, correlation analysis, energy, homogeneity, and mean square error are performed. The entropy values of the test images are greater than 7.99 and the key space of the proposed algorithm is 2 <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">798</sup> . Furthermore, the correlation values of the encrypted images using the proposed scheme are close to zero when compared with other conventional schemes. The number of pixel change rate (NPCR) and unified average change intensity (UACI) for the proposed scheme are higher than 99.50% and 33, respectively. The simulation results and comparison with the state-of-the-art algorithms prove the efficiency and security of the proposed scheme.
Towards secure and practical consensus for blockchain based VANET

The massive adoption of the blockchain-based distributed framework has made it possible to store and transmit Vehicular Ad Hoc Network (VANET) application data transparently, securely, and without a central control point of trust. Introducing an efficient and scalable consensus mechanism, which is one of the most crucial components in the blockchain-based VANET application, is still an open research challenge, given the features related to high mobility vehicular network and resource constraint devices in vehicles. Considering the efficiency, fairness and scalability issues of state-of-the-art consensus protocols like Proof of Work (PoW), Proof of Stake (PoS) and Practical Byzantine Fault Tolerant (PBFT), in this paper we propose a new technique called Proof of Driving (PoD), to randomize the selection of honest miners for generating the blocks efficiently for blockchain-based VANET applications. Additionally, we introduce a filtering technique based on Service Standard Score (Sc) of the vehicular miner nodes to detect and eliminate the malicious nodes. Our proposed technique achieves an efficient and fair selection of miners in a blockchain-based VANET application (for example, ride-sharing) and it makes PBFT consensus adaptable in a vast public vehicular network. The proposed method also addresses the efficiency and fairness issues caused by PoW and PoS, respectively. Our extensive experimental results reflect that the proposed method is efficient as well as scalable and, more importantly, achieves smaller consensus sets with higher quality to eliminate the malicious vehicle nodes from participating in consensus. Finally, the security analysis shows that the proposed method is secure and fault-tolerant against various attacks.
Quantum-inspired multimodal fusion for video sentiment analysis

We tackle the crucial challenge of fusing different modalities of features for multimodal sentiment analysis. Mainly based on neural networks, existing approaches largely model multimodal interactions in an implicit and hard-to-understand manner. We address this limitation with inspirations from quantum theory, which contains principled methods for modeling complicated interactions and correlations. In our quantum-inspired framework, the word interaction within a single modality and the interaction across modalities are formulated with superposition and entanglement respectively at different stages. The complex-valued neural network implementation of the framework achieves comparable results to state-of-the-art systems on two benchmarking video sentiment analysis datasets. In the meantime, we produce the unimodal and bimodal sentiment directly from the model to interpret the entangled decision.
Dataset on the Acceptance of e-learning System among Universities Students' under the COVID-19 Pandemic Conditions

The COVID-19 pandemic has produced an unprecedented change in the educational system worldwide. Besides the economic and social impacts, there is a dilemma of accepting the new educational system "e-learning" by students within educational institutions. In particular, universities students have to handle several kinds of environmental, electronic and mental struggles due to COVID-19. To catch the current circumstances of more than two hundred thousand Jordanian university student during COVID-19. The students have been randomly selected to respond on an online survey using universities' portals and websites between March and April 2020. At the end of the data gathering process, we have received 587 records. The dataset includes 1) Demographics of students; 2) students' perspectives concerning the factors influencing their intention to use e-learning system within the Jordanian universities context. Data were analyzed using Partial Least Squares - Structural Equation Modelling (PLS-SEM). Next, the result has confirmed the positive of direct effect variables (subjective norm, perceived ease of use, and perceived usefulness) on the students' intention to use e-learning system. Next, the result has also confirmed the mediating effect of perceived usefulness and perceived ease of use between subjective norm and the behavioral intention to use the e-learning system with partially supported.
Delta lake

Cloud object stores such as Amazon S3 are some of the largest and most cost-effective storage systems on the planet, making them an attractive target to store large data warehouses and data lakes. Unfortunately, their implementation as key-value stores makes it difficult to achieve ACID transactions and high performance: metadata operations such as listing objects are expensive, and consistency guarantees are limited. In this paper, we present Delta Lake, an open source ACID table storage layer over cloud object stores initially developed at Databricks. Delta Lake uses a transaction log that is compacted into Apache Parquet format to provide ACID properties, time travel, and significantly faster metadata operations for large tabular datasets (e.g., the ability to quickly search billions of table partitions for those relevant to a query). It also leverages this design to provide high-level features such as automatic data layout optimization, upserts, caching, and audit logs. Delta Lake tables can be accessed from Apache Spark, Hive, Presto, Redshift and other systems. Delta Lake is deployed at thousands of Databricks customers that process exabytes of data per day, with the largest instances managing exabyte-scale datasets and billions of objects.
Intrusion Detection for Cyber–Physical Systems Using Generative Adversarial Networks in Fog Environment

Cyber-attacks cyber-physical systems (CPSs) can lead to sensing and actuation misbehavior, severe damages to physical objects, and safety risks. Machine learning algorithms have been proposed for hindering cyber-attacks on CPSs, but the absence of labeled data from novel attacks makes their detection quite challenging. In this context, generative adversarial networks (GANs) are a promising unsupervised approach to detect cyber-attacks by implicitly modeling the system. However, the detection of cyber-attacks on CPSs has strict latency requirements, since the attacks need to be stopped before the system is compromised. In this article, we propose FID-GAN, a novel fog-based, unsupervised intrusion detection system (IDS) for CPSs using GANs. The IDS is proposed for a fog architecture, which brings computation resources closer to the end nodes and thus contributes to meeting low-latency requirements. In order to achieve higher detection rates, the proposed architecture computes a reconstruction loss based on the reconstruction of data samples mapped to the latent space. Other works that follow a similar approach struggle with the time required to compute the reconstruction loss, which renders them impractical for latency constrained applications. We address this problem by training an encoder that accelerates the reconstruction loss computation. Experiments show that the proposed solution achieves higher detection rates and is at least 5.5 times faster than a baseline approach in the three studied data sets.
Leveraging Seen and Unseen Semantic Relationships for Generative Zero-Shot Learning

Zero-shot learning (ZSL) addresses the unseen class recognition problem by leveraging semantic information to transfer knowledge from seen classes to unseen classes. Generative models synthesize the unseen visual features and convert ZSL into a classical supervised learning problem. These generative models are trained using the seen classes and are expected to implicitly transfer the knowledge from seen to unseen classes. However, their performance is stymied by overfitting, which leads to substandard performance on Generalized Zero-Shot learning (GZSL). To address this concern, we propose the novel LsrGAN, a generative model that Leverages the Semantic Relationship between seen and unseen categories and explicitly performs knowledge transfer by incorporating a novel Semantic Regularized Loss (SR-Loss). The SR-loss guides the LsrGAN to generate visual features that mirror the semantic relationships between seen and unseen classes. Experiments on seven benchmark datasets, including the challenging Wikipedia text-based CUB and NABirds splits, and Attribute-based AWA, CUB, and SUN, demonstrates the superiority of the LsrGAN compared to previous state-of-the-art approaches under both ZSL and GZSL. Code is available at https://github.com/Maunil/LsrGAN.
Fuzz testing based data augmentation to improve robustness of deep neural networks

Deep neural networks (DNN) have been shown to be notoriously brittle to small perturbations in their input data. This problem is analogous to the over-fitting problem in test-based program synthesis and automatic program repair, which is a consequence of the incomplete specification, i.e., the limited tests or training examples, that the program synthesis or repair algorithm has to learn from. Recently, test generation techniques have been successfully employed to augment existing specifications of intended program behavior, to improve the generalizability of program synthesis and repair. Inspired by these approaches, in this paper, we propose a technique that re-purposes software testing methods, specifically mutation-based fuzzing, to augment the training data of DNNs, with the objective of enhancing their robustness. Our technique casts the DNN data augmentation problem as an optimization problem. It uses genetic search to generate the most suitable variant of an input data to use for training the DNN, while simultaneously identifying opportunities to accelerate training by skipping augmentation in many instances. We instantiate this technique in two tools, Sensei and Sensei-SA, and evaluate them on 15 DNN models spanning 5 popular image data-sets. Our evaluation shows that Sensei can improve the robust accuracy of the DNN, compared to the state of the art, on each of the 15 models, by upto 11.9% and 5.5% on average. Further, Sensei-SA can reduce the average DNN training time by 25%, while still improving robust accuracy.
MuST-C: A multilingual corpus for end-to-end speech translation

End-to-end spoken language translation (SLT) has recently gained popularity thanks to the advancement of sequence to sequence learning in its two parent tasks: automatic speech recognition (ASR) and machine translation (MT). However, research in the field has to confront with the scarcity of publicly available corpora to train data-hungry neural networks. Indeed, while traditional cascade solutions can build on sizable ASR and MT training data for a variety of languages, the available SLT corpora suitable for end-to-end training are few, typically small and of limited language coverage. We contribute to fill this gap by presenting MuST-C, a large and freely available Multilingual Speech Translation Corpus built from English TED Talks. Its unique features include: i) language coverage and diversity (from English into 14 languages from different families), ii) size (at least 237 hours of transcribed recordings per language, 430 on average), iii) variety of topics and speakers, and iv) data quality. Besides describing the corpus creation methodology and discussing the outcomes of empirical and manual quality evaluations, we present baseline results computed with strong systems on each language direction covered by MuST-C.
TextRay: Contour-based Geometric Modeling for Arbitrary-shaped Scene Text Detection

Arbitrary-shaped text detection is a challenging task due to the complex geometric layouts of texts such as large aspect ratios, various scales, random rotations and curve shapes. Most state-of-the-art methods solve this problem from bottom-up perspectives, seeking to model a text instance of complex geometric layouts with simple local units (e.g., local boxes or pixels) and generate detections with heuristic post-processings. In this work, we propose an arbitrary-shaped text detection method, namely TextRay, which conducts top-down contour-based geometric modeling and geometric parameter learning within a single-shot anchor-free framework. The geometric modeling is carried out under polar system with a bidirectional mapping scheme between shape space and parameter space, encoding complex geometric layouts into unified representations. For effective learning of the representations, we design a central-weighted training strategy and a content loss which builds propagation paths between geometric encodings and visual content. TextRay outputs simple polygon detections at one pass with only one NMS post-processing. Experiments on several benchmark datasets demonstrate the effectiveness of the proposed approach. The code is available at https://github.com/LianaWang/TextRay.
Multiple improved residual networks for medical image super-resolution

The rapid development of deep learning has resulted in great breakthroughs in image super-resolution reconstruction technology in medical imaging modalities. The application of artificial intelligence to medical image processing has been the focus of scholars both domestically and internationally in recent years. Due to the fast super-resolution convolutional neural network (FSRCNN) algorithm has fewer convolutional layers and lacks the correlation between the feature information of adjacent convolutional layers, it is difficult to be used to extract deep information of an image, and the super-resolution rate of the image reconstruction effect is not good. To solve this problem, we propose the multiple improved residual network (MIRN) super-resolution reconstruction method. First, MIRN designs the residual blocks connected by multi-level skips to build multiple improved residual block (MIRB) modules. A deep residual network with multi-level skip connection is used to solve the lack of correlation between the characteristic information of adjacent convolutional layers. Then, the stochastic gradient descent method (SGD) is used to train a deep residual network connected by multi-level jumpers with an adjustable learning rate strategy to obtain a super-resolution reconstruction model of the network. Finally, the low-resolution image is input in the MIRN super-resolution reconstruction model, and the residual block obtains the predicted residual eigenvalues and then combines the residual image and the low-resolution image into a high-resolution image. Most quantitative and qualitative evaluations on benchmark datasets demonstrate that the proposed model can better reconstruct the details and textures of images and avoid the over-smoothing of medical images after iteration, and the performance of the proposed algorithm is revealed to be better than that of existing state-of-the-art methods.
Asymmetric Two-Stream Architecture for Accurate RGB-D Saliency Detection

Most existing RGB-D saliency detection methods adopt symmetric two-stream architectures for learning discriminative RGB and depth representations. In fact, there is another level of ambiguity that is often overlooked: if RGB and depth data are necessary to fit into the same network. In this paper, we propose an asymmetric two-stream architecture taking account of the inherent differences between RGB and depth data for saliency detection. First, we design a flow ladder module (FLM) for the RGB stream to fully extract global and local information while maintaining the saliency details. This is achieved by constructing four detail-transfer branches, each of which preserves the detail information and receives global location information from representations of other vertical parallel branches in an evolutionary way. Second, we propose a novel depth attention module (DAM) to ensure depth features with high discriminative power in location and spatial structure being effectively utilized when combined with RGB features in challenging scenes. The depth features can also discriminatively guide the RGB features via our proposed DAM to precisely locate the salient objects. Extensive experiments demonstrate that our method achieves superior performance over 13 state-of-the-art RGB-D approaches on the 7 datasets. Our code will be publicly available.
Particle Swarm Optimisation

Particle Swarm Optimization (PSO) was built by mimicking the navigation pattern of entities, such as flock of birds or school of fishes. The algorithm uses established particles that wing over a search space for global optima location. Throughout the PSO iteration process, each particle updates its location based on the preceding knowledge or experience as well as the knowledge obtained from the neighborhood search. Detailed information on PSO and swarming behaviour of creatures is presented. Application of PSO in numerical optimization was implemented in the software MATLAB. The PSO convergence characteristic is presented, with best fitness function value obtained with the PSO model was –170 corresponding to the updated gbest (5 –5 5).
MuCAN: Multi-correspondence Aggregation Network for Video Super-Resolution

Video super-resolution (VSR) aims to utilize multiple low-resolution frames to generate a high-resolution prediction for each frame. In this process, inter- and intra-frames are the key sources for exploiting temporal and spatial information. However, there are a couple of limitations for existing VSR methods. First, optical flow is often used to establish one-on-one temporal correspondences. But flow estimation itself is error-prone and hence largely affects the ultimate recovery result. Second, similar patterns existing in natural images are rarely exploited for the VSR task. Motivated by these findings, we propose a temporal multi-correspondence aggregation strategy to leverage most similar patches across frames, and also a cross-scale nonlocal-correspondence aggregation scheme to explore self-similarity of images across scales. Based on these two novel modules, we build an effective multi-correspondence aggregation network (MuCAN) for VSR. Our method achieves state-of-the-art results on multiple benchmark datasets. Extensive experiments justify the effectiveness of our method.
Machine learning model for predicting malaria using clinical information

Rapid diagnosing is crucial for controlling malaria. Various studies have aimed at developing machine learning models to diagnose malaria using blood smear images; however, this approach has many limitations. This study developed a machine learning model for malaria diagnosis using patient information. To construct datasets, we extracted patient information from the PubMed abstracts from 1956 to 2019. We used two datasets: a solely parasitic disease dataset and total dataset by adding information about other diseases. We compared six machine learning models: support vector machine, random forest (RF), multilayered perceptron, AdaBoost, gradient boosting (GB), and CatBoost. In addition, a synthetic minority oversampling technique (SMOTE) was employed to address the data imbalance problem. Concerning the solely parasitic disease dataset, RF was found to be the best model regardless of using SMOTE. Concerning the total dataset, GB was found to be the best. However, after applying SMOTE, RF performed the best. Considering the imbalanced data, nationality was found to be the most important feature in malaria prediction. In case of the balanced data with SMOTE, the most important feature was symptom. The results demonstrated that machine learning techniques can be successfully applied to predict malaria using patient information.
InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Image

Analysis of hand-hand interactions is a crucial step towards better understanding human behavior. However, most researches in 3D hand pose estimation have focused on the isolated single hand case. Therefore, we firstly propose (1) a large-scale dataset, InterHand2.6M, and (2) a baseline network, InterNet, for 3D interacting hand pose estimation from a single RGB image. The proposed InterHand2.6M consists of 2.6 M labeled single and interacting hand frames under various poses from multiple subjects. Our InterNet simultaneously performs 3D single and interacting hand pose estimation. In our experiments, we demonstrate big gains in 3D interacting hand pose estimation accuracy when leveraging the interacting hand data in InterHand2.6M. We also report the accuracy of InterNet on InterHand2.6M, which serves as a strong baseline for this new dataset. Finally, we show 3D interacting hand pose estimation results from general images. Our code and dataset are available ( https://mks0601.github.io/InterHand2.6M/ ).