Reviewerly/exHarmony huggingface dataset:
Identification of Social Media Posts Containing Self-reported COVID-19 Symptoms using Triple Word Embeddings and Long Short-Term Memory

The COVID-19 pandemic has permeated the global sphere and influenced nearly all nations and regions. Common symptoms of this pandemic include fever, cough, fatigue, and loss of sense of smell. The impact of COVID-19 on public health and the economy has made it a significant global concern. It has caused economic contraction in Indonesia, particularly in face-to-face interaction and mobility sectors, such as transportation, warehousing, construction, and food and beverages. Since the pandemic began, Twitter users have shared symptoms in their tweets. However, they couldn't confirm their concerns due to testing limitations, reporting delays, and pre-registration requirements in healthcare. The classification of text from Twitter data about COVID-19 topics has predominantly focused on sentiment analysis regarding the pandemic or vaccination. Research on identifying COVID-19 symptoms through social media messages is limited in the literature. The main objective of this study is to identify symptoms using word embedding techniques and the LSTM algorithm. Various techniques such as Word2Vec, GloVe, FastText, and a composite approach are used. LSTM is used for classification, improving upon the RNN technique. Evaluation criteria include accuracy, precision, and recall. The model with an input dimension of 147x100 achieves the highest accuracy at 89%. This study aims to find the best LSTM model for detecting COVID-19 symptoms in social media tweets. It evaluates LSTM models with different word embedding techniques and input dimensions, providing insights into the optimal text-based method for COVID-19 detection through social media texts.
Data Theft

The Elgar Encyclopedia of Crime and Criminal Justice stands apart as the most comprehensive global reference title in its field. New entries will be added every month and PDF downloads will be available once the Encyclopedia is complete.
Fine-Grained Image Generation Network With Radar Range Profiles Using Cross-Modal Visual Supervision

Electromagnetic imaging methods mainly utilize converted sampling, dimensional transformation, and coherent processing to obtain spatial images of targets, which often suffer from accuracy and efficiency problems. Deep neural network (DNN)-based high-resolution imaging methods have achieved impressive results in improving resolution and reducing computational costs. However, previous works exploit single modality information from electromagnetic data; thus, the performances are limited. In this article, we propose an electromagnetic image generation network (EMIG-Net), which translates electromagnetic data of multiview 1-D range profiles (1DRPs), directly into bird-view 2-D high-resolution images under cross-modal supervision. We construct an adversarial generative framework with visual images as supervision to significantly improve the imaging accuracy. Moreover, the network structure is carefully designed to optimize computational efficiency. Experiments on self-built synthetic data and experimental data in the anechoic chamber show that our network has the ability to generate high-resolution images, whose visual quality is superior to that of traditional imaging methods and DNN-based methods, while consuming less computational cost. Compared with the backprojection (BP) algorithm, the EMIG-Net gains a significant improvement in entropy (72%), peak signal-to-noise ratio (PSNR; 150%), and structural similarity (SSIM; 153%). Our work shows the broad prospects of deep learning in radar data representation and high-resolution imaging and provides a path for researching electromagnetic imaging based on learning theory.
Exploring Multiple Hypergraphs for Heterogeneous Graph Neural Networks

Graph neural networks have demonstrated significant power in learning graph representations for homogeneous networks. However, real-world network data can often be denoted by heterogeneous networks with different types of nodes and edges, such as social, traffic, and molecular networks. Network heterogeneity presents significant challenges for network analysis and mining. Motif-based hypergraphs preserve high-order proximity and capture composite semantic interactions. Because not all nodes and edges in the original network always exist in a specific hypergraph, it is essential that multiple motif-based hypergraphs are considered to enhance the network representation. Therefore, we propose a novel framework for exploring Multiple Motif-based Hypergraphs for Heterogeneous Graph Neural Networks to learn network representations, named MoH-HGNN, which leverages hypergraph convolution and attention operations to capture complex connectivity patterns. Specifically, we conducted two levels of attention networks with hierarchical structures, namely hyperedge-level attention to learn the importance among different types of nodes and comprehensive semantic-level attention to capture the importance of different types of motif structures. We extensively experimented on four real-world datasets to verify the effectiveness of our proposed framework.
Variational Bayesian and generalized maximum-likelihood based adaptive robust nonlinear filtering framework

An adaptive robust nonlinear filtering framework is proposed based on the variational Bayesian (VB) method and generalized maximum likelihood estimation (GM estimation) to simultaneously handle the outliers and uncertain measurement noise covariance matrix (MNCM) for state estimation. This framework utilizes the cubature criterion to solve nonlinear integration problems. By embedding GM estimation in the VB method, the uncertain MNCM is modified while robust estimation is performed. The modified MNCM also provides more accurate model parameters for GM estimation, achieving the unity of adaptability and robustness. The VBCEECKF algorithm was obtained by applying the strong robust centered error entropy criterion to the adaptive robust nonlinear filtering framework. The simulation results of target tracking under different noise conditions verify the superiority of the adaptive robust filter compared to existing methods.
Large-scale data classification based on the integrated fusion of fuzzy learning and graph neural network

Deep learning and fuzzy models provide powerful and practical techniques for solving large-scale deep-learning tasks. The fusion technique on deep learning and fuzzy system are generally classified into ensemble and integrated modes and materializes in information fusion, model fusion, and feature fusion. In an ensemble-based fusion, the fuzzy model either acts as an activation function or is operated as a separate process aggregating/preprocessing the information. Some early attempts in the field have successfully fused deep neural networks and fuzzy modeling concepts in ensemble mode. However, no effective attempts were made to fuse fuzzy models as an integrated feature-level fusion learning with graph neural networks (GNNs). This is mainly due to two challenges related to this fusion: (1) the number of fuzzy rules grows exponentially with the number of features that causes computational inefficiency, and (2) the solution space created by this fusion of fuzzy rules becomes complex due to multiple regression relations between inputs and outputs. Additionally, a simple linear regression at the output space would not be sufficient to model deep learning tasks. Therefore, this paper addresses these challenges by proposing a feature-level fusion method to fuse deep learning and fuzzy modeling where the latter technique is for integrated feature learning, called fuzzy forest graph neural network (FuzzyGNN), which creates a fuzzy learning forest fusing the linear graph transformers for deep learning tasks. We conducted experiments on fourteen machine learning datasets to test and validate the efficiency of the proposed FuzzyGNN model. Compared to state-of-the-art methods, our algorithm achieves the best results on four out of five machine learning datasets. The source code will be available at https://github.com/lingping-fuzzy/ and https://github.com/P-N-Suganthan.
Coordinate Descent Optimized Trace Difference Model for Joint Clustering and Feature Extraction

Joint clustering and dimensionality reduction methods are a promising solution to clustering due to its scalability to high-dimensional data. Some methods leverage trace ratio criterion and attain clusters by borrowing the K-means algorithm. However, trace ratio criterion has no close-formed solution for the discriminative projection matrix and the K-means algorithm has a limited capacity to handle the many-cluster problem. In this paper, Coordinate Descent Optimized Trace Difference model (CDOTD) is proposed for joint clustering and feature extraction. Formulating the objective function as a direct trace difference criterion containing a balance parameter, CDOTD harmonizes between-cluster scatter maximization and within-cluster scatter minimization by the balance parameter. Using the direct trace difference criterion, CDOTD can straightforward solve for the discriminative projection matrix and avoid obtaining a poor discriminative projection matrix in the iterative manner when a bad cluster start is given. CDOTD uses the coordinate descent method for clustering optimization, improving the ability to address the many-cluster problem. Extensive experiments show that CDOTD has achieved significant performance improvements compared to previous trace ratio criterion related joint clustering and feature extraction methods, and also outperformed other clustering methods in most cases.
Real-Time Local Greedy Search for Multiaxis Globally Time-Optimal Trajectory

Time-optimal trajectory planning aims to minimize the traversal time of arbitrary geometric paths. The demand for real-time planning widely exists in robotics, numerical control manufacturing, and autonomous vehicle applications. Existing trajectory planning methods either compromise on time optimality to improve computational efficiency or suffer from at least linear time complexity, preventing the planning of long trajectories in real time. Motivated by these challenges, this article proposes a novel set invariant trajectory planning (SITP) method to address the problem of real-time time-optimal planning for continuous multiaxis trajectories under complete second-order kinodynamic constraints. First, a backup control strategy is synthesized to construct an implicit control invariant set (CIS). This set is designed so that a feasible control input always exists to keep the system within the defined kinodynamic bounds. Then, utilizing the principles of bang–bang control theory, the optimal control is sought within the CIS. A local greedy linear programming method is proposed to calculate the time-optimal trajectory at each control cycle. The proposed method is computationally efficient for even 1-kHz real-time applications and the planned results maintain strict global time optimality, which makes it promising in real-time planning scenarios of various automatic applications.
MSHGN: Multi-scenario adaptive hierarchical spatial graph convolution network for GPU utilization prediction in heterogeneous GPU clusters

Accurately predicting GPU utilization is crucial for effectively managing heterogeneous GPU clusters, yet existing prediction methods are tailored to homogeneous clusters or ignore the unique characteristics of heterogeneous ones. To address this problem, we propose the Multi-Scenarios Adaptive Hierarchical Spatial Graph Convolution Network (MSHGN) model. This model leverages the hierarchical relationships among users, tasks, and machines to construct multiple scenarios' undirected graphs and uses Graph Convolution Neural (GCN) to capture the spatial dependency relationships between the computational resources consumed during execution. The MSHGN model accurately predicts the future GPU utilization rates of each machine in a heterogeneous GPU cluster, achieving an RMSE of only 0.0101, an MAE of 0.0072, and an MAPE of 0.0641. We evaluate the MSHGN model on a real-world Alibaba dataset collected from a heterogeneous GPU cluster and find that it achieves superior accuracy and robustness in predicting resource utilization, outperforming other baseline models.
A novel dual-stage progressive enhancement network for single image deraining

The dense rain accumulation in heavy rain can significantly wash out images and thus destroy the background details of images. Although existing deep rain removal models lead to improved performance for heavy rain removal, we find that most of them ignore the detail reconstruction accuracy of rain-free images. In this paper, we propose a dual-stage progressive enhancement network (DPENet-v2) to achieve effective deraining with structure-accurate rain-free images. Three main modules are included in our framework, namely a rain streaks removal network (R2Net), a details reconstruction network (DRNet) and a cross-stage feature interaction module (CFIM). The former aims to achieve accurate rain removal, and the latter is designed to recover the details of rain-free images. We introduce two main strategies within our networks to achieve trade-off between the effectiveness of deraining and the detail restoration of rain-free images. Firstly, a dilated dense residual block (DDRB) within the rain streaks removal network is presented to aggregate high/low level features of heavy rain. Secondly, an enhanced residual pixel-wise attention block (ERPAB) within the details reconstruction network is designed for context information aggregation. Meanwhile, CFIM learns the long-range dependencies and achieves cross-stage information communication. We also propose a comprehensive loss function to highlight the marginal and regional accuracy of rain-free images. Extensive experiments on benchmark public datasets show both efficiency and effectiveness of the proposed method in achieving structure-preserving rain-free images for heavy rain removal.
Neural-Based Compression Scheme for Solar Image Data

Studying the solar system and especially the Sun relies on the data gathered daily from space missions.These missions are data-intensive and compressing this data to make them efficiently transferable to the ground station is a twofold decision to make.Stronger compression methods, by distorting the data, can increase data throughput at the cost of accuracy which could affect scientific analysis of the data.On the other hand, preserving subtle details in the compressed data requires a high amount of data to be transferred, reducing the desired gains from compression.In this work, we propose a neural network-based lossy compression method to be used in NASA's data-intensive imagery missions.We chose NASA's Solar Dynamics Observatory (SDO) mission which transmits 1.4 terabytes of data each day as a proof of concept for the proposed algorithm.In this work, we propose an adversarially trained neural network, equipped with local and non-local attention modules to capture both the local and global structure of the image resulting in a better trade-off in rate-distortion (RD) compared to conventional hand-engineered codecs.The RD variational autoencoder used in this work is jointly trained with a channel-dependent entropy model as a shared prior between the analysis and synthesis transforms to make the entropy coding of the latent code more effective.We also studied how optimizing perceptual losses could help our neural compressor to preserve high-frequency details of the data in the reconstructed compressed image.Our neural image compression algorithm outperforms currently-in-use and state-of-the-art codecs such as JPEG and JPEG-2000 in terms of the RD performance when compressing extreme-ultraviolet (EUV) data.As a proof of concept for use of this algorithm in SDO data analysis, we have performed coronal hole (CH) detection using our compressed images, and generated consistent segmentations, even at a compression rate of ∼ 0.1 bits per pixel (compared to 8 bits per pixel on the original data) using EUV data from SDO.
Detecting anomalies in security cameras with 3D-convolutional neural network and convolutional long short-term memory

&lt;p&gt;This paper presents a novel deep learning-based approach for anomaly detection in surveillance films. A deep network that has been trained to recognize objects and human activity in movies forms the foundation of the suggested approach. In order to detect anomalies in surveillance films, the proposed method combines the strengths of 3D-convolutional neural network (3DCNN) and convolutional long short-term memory (ConvLSTM). From the video frames, the 3DCNN is utilized to extract spatiotemporal features,while ConvLSTM is employed to record temporal relationships between frames. The technique was evaluated on five large-scale datasets from the actual world (UCFCrime, XDViolence, UBIFights, CCTVFights, UCF101) that had both indoor and outdoor video clips as well as synthetic datasets with a range of object shapes, sizes, and behaviors. The results further demonstrate that combining 3DCNN with ConvLSTM can increase precision and reduce false positives, achieving a high accuracy and area under the receiver operating characteristic-area under the curve (ROC-AUC) in both indoor and outdoor scenarios when compared to cuttingedge techniques mentioned in the comparison.&lt;/p&gt;
A start-stop points CenterNet for wideband signals detection and time-frequency localization in spectrum sensing

Recently, deep learning (DL) based object detection methods have attracted significant attention for wideband multisignal detection, which has been viewed as an essential part in the field of cognitive radio spectrum sensing. However, the existing DL methods are difficult or very likely fail to detect discontinuous burst signals, not to mention the signals with wide, instantaneous, dynamic bandwidth, and multiple channels. To solve this problem, the present study proposes a scheme that combines the start-stop point signal features for wideband multi-signal detection, namely the Fast Spectrum-Size Self-Training network (FSSNet). Considering the horizontal rectangle form of a wideband signal in the time-frequency domain, we innovatively utilize the start-stop points of the two-dimensional (2D) Box to build the signal model. Specifically, We propose a fast Start-stop HeatMap where the proposed LPS-YXE simultaneously labels and divides the start-stop points positions in the X-Y axis of a single HeatMap. We attribute the method’s success in discontinuous signal detection to the multidimensional space transformation of HeatMap, which is used to locate the start-stop points and extract features separated from the signal regions of start-stop points. Furthermore, FSSNet can realize the 2D Box estimation of the wideband signal by regressing only a single variable, and thus with satisfactory detection speed. Simulation results verify the effectiveness and superiority of the proposed start-stop based wideband signal detection scheme with practical received signals. All our models and code are available athttps://github.com/jn-z/SSNet2.
Sensing complicated meanings from unstructured data: a novel hybrid approach

The majority of data on computers nowadays is in the form of unstructured data and unstructured text. The inherent ambiguity of natural language makes it incredibly difficult but also highly profitable to find hidden information or comprehend complex semantics in unstructured text. In this paper, we present the combination of natural language processing (NLP) and convolution neural network (CNN) hybrid architecture called automated analysis of unstructured text using machine learning (AAUT-ML) for the detection of complex semantics from unstructured data that enables different users to make understand formal semantic knowledge to be extracted from an unstructured text corpus. The AAUT-ML has been evaluated using three datasets data mining (DM), operating system (OS), and data base (DB), and compared with the existing models, i.e., YAKE, term frequency-inverse document frequency (TF-IDF) and text-R. The results show better outcomes in terms of precision, recall, and macro-averaged F1-score. This work presents a novel method for identifying complex semantics using unstructured data.
Single-board device individual authentication based on hardware performance and autoencoder transformer models

The proliferation of the Internet of Things (IoT) has led to the emergence of crowdsensing applications, where a multitude of interconnected devices collaboratively collect and analyze data. Ensuring the authenticity and integrity of the data collected by these devices is crucial for reliable decision-making and maintaining trust in the system. Traditional authentication methods are often vulnerable to attacks or can be easily duplicated, posing challenges to securing crowdsensing applications. Besides, current solutions leveraging device behavior are mostly focused on device identification, which is a simpler task than authentication. To address these issues, an individual IoT device authentication framework based on hardware behavior fingerprinting and Transformer autoencoders is proposed in this work. To support the design, a threat model details the security problems faced when performing hardware-based authentication in IoT. This solution leverages the inherent imperfections and variations in IoT device hardware to differentiate between devices with identical specifications. By monitoring and analyzing the behavior of key hardware components, such as the CPU, GPU, RAM, and Storage on devices, unique fingerprints for each device are created. The performance samples are considered as time series data and used to train outlier detection transformer models, one per device and aiming to model its normal data distribution. Then, the framework is validated within a spectrum crowdsensing system leveraging Raspberry Pi devices. After a pool of experiments, the model from each device is able to individually authenticate it between the 45 devices employed for validation. An average True Positive Rate (TPR) of 0.74±0.13 and an average maximum False Positive Rate (FPR) of 0.06±0.09 demonstrate the effectiveness of this approach in enhancing authentication, security, and trust in crowdsensing applications.