ADKU/ResearchGPT_model_dataset huggingface dataset:
SlumberNet: deep learning classification of sleep stages using residual neural networks
Authors: Pawan K. Jha, Utham K. Valekunja, Akhilesh B. Reddy

Sleep research is fundamental to understanding health and well-being, as proper sleep is essential for maintaining optimal physiological function. Here we present SlumberNet, a novel deep learning model based on residual network (ResNet) architecture, designed to classify sleep states in mice using electroencephalogram (EEG) and electromyogram (EMG) signals. Our model was trained and tested on data from mice undergoing baseline sleep, sleep deprivation, and recovery sleep, enabling it to handle a wide range of sleep conditions. Employing k-fold cross-validation and data augmentation techniques, SlumberNet achieved high levels of overall performance (accuracy = 97%; F1 score = 96%) in predicting sleep stages and showed robust performance even with a small and diverse training dataset. Comparison of SlumberNet's performance to manual sleep stage classification revealed a significant reduction in analysis time (~ 50 × faster), without sacrificing accuracy. Our study showcases the potential of deep learning to facilitate sleep research by providing a more efficient, accurate, and scalable method for sleep stage classification. Our work with SlumberNet further demonstrates the power of deep learning in mouse sleep research.
A comparative analysis and classification of cancerous brain tumors detection based on classical machine learning and deep transfer learning models
Authors: Yajuvendra Pratap Singh, D.K Lobiyal

Brain tumor can be fatal for human life. Therefore, proper and timely diagnosis and treatment is important to save human lives. The similarity and variety between the normal and tumor tissues make it difficult for diagnosis through human assisted techniques. In the recent past, machine learning and deep learning techniques have been applied for the classification and segmentation of brain tumor. These techniques have shown promising results by improving the accuracy of classification and segmentation. In this paper, we proposed to implement various classical machine-learning techniques support vector machine, Naive Bayes classifier, K- Nearest Neighbor, random forest, and deep-learning CNN-based models Xception, Inceptionv3, VGG19, and DenseNet201 techniques to classify gliomas, meningiomas, and pituitary tumors and compare their performance. Further, we proposed to modify Xception model to improve the performance of classification and segmentation. In this research, we used the standard Figshare dataset consisting of 3064 images of size \(112\times 112\) each. The performance of these models is measured and compared in terms of precision, recall, F1-score, and accuracy. The classical Machine learning model gives scores varying from 88% to 93%. For the above four metrics. However, all the deep learning models give their scores of more than 96% for the above metrics. Our proposed modified Xception model gives scores more than 98% in all the above four metrics, which is comparable to the best scores reported in the literature.
Implementing Deep Learning-Based Intelligent Inspection for Investment Castings
Authors: Nabhan Yousef, Amit Sata

In this study, a user-friendly intelligent inspection device was developed employing deep learning techniques to effectively detect and characterize surface defects in investment castings. The inspection techniques encompassed a range from basic visual inspection to more specialized methods like liquid penetration and magnetic particle tests. The developed device leveraged convolutional neural networks (CNN), residual neural networks (ResNet), and recurrent neural networks (R-CNN) models, with a dataset of 3600 images depicting industrial castings, both defective and defect-free. A majority of the dataset was allocated for training (approximately 80%), while the remainder was used for testing. Among the deep learning models considered, ResNet exhibited superior accuracy in defect inspection, trailed by CNN and R-CNN. The resultant intelligent inspection device was successfully implemented in an industrial setting, enabling efficient defect identification in investment castings through the trained ResNet model.
Revealing the mechanisms of semantic satiation with deep learning models
Authors: Xinyu Zhang, Jing Lian, Zhaofei Yu, Huajin Tang, Dong Liang, Jizhao Liu, Jian K. Liu

The phenomenon of semantic satiation, which refers to the loss of meaning of a word or phrase after being repeated many times, is a well-known psychological phenomenon. However, the microscopic neural computational principles responsible for these mechanisms remain unknown. In this study, we use a deep learning model of continuous coupled neural networks to investigate the mechanism underlying semantic satiation and precisely describe this process with neuronal components. Our results suggest that, from a mesoscopic perspective, semantic satiation may be a bottom-up process. Unlike existing macroscopic psychological studies that suggest that semantic satiation is a top-down process, our simulations use a similar experimental paradigm as classical psychology experiments and observe similar results. Satiation of semantic objectives, similar to the learning process of our network model used for object recognition, relies on continuous learning and switching between objects. The underlying neural coupling strengthens or weakens satiation. Taken together, both neural and network mechanisms play a role in controlling semantic satiation.
Incremental–decremental data transformation based ensemble deep learning model (IDT-eDL) for temperature prediction
Authors: Vipin Kumar, Rana Kumar

Human life heavily depends on weather conditions, which affect the necessary operations like agriculture, aviation, tourism, industries, etc., where the temperature plays a vital role in deciding the weather conditions along with other meteorological variables. Therefore, temperature forecasting has drawn considerable attention from researchers because of its significant effect on daily life activities and the ever-challenging forecasting task. These research objectives are to investigate the transformation of data based on incremental and decremental approaches and to find the practical ensemble approach over proposed models for effective temperature prediction, where the proposed model is called the Incremental–Decremental Data Transformation-Based Ensemble Deep Learning Model (IDT-eDL). The temperature dataset from Delhi, India, has been utilized to compare proposed and traditional deep learning models over various performance measures. The proposed IDT-eDL with BiLSTM deep learning model (i.e., IDT-eDL_BiLSTM ) has performed the best among the proposed models and traditional deep learning model and achieved Performance over measures MSE: 1.36, RMSE: 1.16, MAE: 0.89, MAPE: 4.13 and \(R^2\):0.999. Additionally, non-parametric statistical analysis of Friedman ranking is also performed to validate the effectiveness of the proposed IDT-eDL model, which also shows a higher ranking of the proposed model than the traditional deep learning models.
Deep Learning Framework for Predicting Essential Proteins with Temporal Convolutional Networks
Authors: Pengli Lu 
            (卢鹏丽), Peishi Yang 
            (杨培实), Yonggang Liao 
            (廖永刚)

Essential proteins are an indispensable part of cells and play an extremely significant role in genetic disease diagnosis and drug development. Therefore, the prediction of essential proteins has received extensive attention from researchers. Many centrality methods and machine learning algorithms have been proposed to predict essential proteins. Nevertheless, the topological characteristics learned by the centrality method are not comprehensive enough, resulting in low accuracy. In addition, machine learning algorithms need sufficient prior knowledge to select features, and the ability to solve imbalanced classification problems needs to be further strengthened. These two factors greatly affect the performance of predicting essential proteins. In this paper, we propose a deep learning framework based on temporal convolutional networks to predict essential proteins by integrating gene expression data and protein-protein interaction (PPI) network. We make use of the method of network embedding to automatically learn more abundant features of proteins in the PPI network. For gene expression data, we treat it as sequence data, and use temporal convolutional networks to extract sequence features. Finally, the two types of features are integrated and put into the multi-layer neural network to complete the final classification task. The performance of our method is evaluated by comparing with seven centrality methods, six machine learning algorithms, and two deep learning models. The results of the experiment show that our method is more effective than the comparison methods for predicting essential proteins.
Unsupervised deep representation learning enables phenotype discovery for genetic association studies of brain imaging
Authors: Khush Patel, Ziqian Xie, Hao Yuan, Sheikh Muhammad Saiful Islam, Yaochen Xie, Wei He, Wanheng Zhang, Assaf Gottlieb, Han Chen, Luca Giancardo, Alexander Knaack, Evan Fletcher, Myriam Fornage, Shuiwang Ji, Degui Zhi

Understanding the genetic architecture of brain structure is challenging, partly due to difficulties in designing robust, non-biased descriptors of brain morphology. Until recently, brain measures for genome-wide association studies (GWAS) consisted of traditionally expert-defined or software-derived image-derived phenotypes (IDPs) that are often based on theoretical preconceptions or computed from limited amounts of data. Here, we present an approach to derive brain imaging phenotypes using unsupervised deep representation learning. We train a 3-D convolutional autoencoder model with reconstruction loss on 6130 UK Biobank (UKBB) participants’ T1 or T2-FLAIR (T2) brain MRIs to create a 128-dimensional representation known as Unsupervised Deep learning derived Imaging Phenotypes (UDIPs). GWAS of these UDIPs in held-out UKBB subjects (n = 22,880 discovery and n = 12,359/11,265 replication cohorts for T1/T2) identified 9457 significant SNPs organized into 97 independent genetic loci of which 60 loci were replicated. Twenty-six loci were not reported in earlier T1 and T2 IDP-based UK Biobank GWAS. We developed a perturbation-based decoder interpretation approach to show that these loci are associated with UDIPs mapped to multiple relevant brain regions. Our results established unsupervised deep learning can derive robust, unbiased, heritable, and interpretable brain imaging phenotypes.
Deep learning-based weld defect classification using VGG16 transfer learning adaptive fine-tuning
Authors: Samuel Kumaresan, K. S. Jai Aultrin, S. S. Kumar, M. Dev Anand

Welding is a vital joining process; however, occurrences of weld defects often degrade the quality of the welded part. The risk of occurrence of a variety of defects has led to the development of advanced weld defects detection systems such as automated weld defects detection and classification. The present work is a novel approach that proposes and investigates a unique image-centered method based on a deep learning model trained by a small X-ray image dataset. A data augmentation method able to process images on the go was used to offset the limitation of the small X-ray dataset. Fine-tuned transfer learning techniques were used to train two convolutional neural network based architectures with VGG16 and ResNet50 as the base models for the augmented sets. Out of the networks we fine-tuned, VGG16 based model performed well with a relatively higher average accuracy of 90%. Even though the small dataset was spread across 15 different classes in an unbalanced way, the learning curves showed acceptable model generalization characteristics.
Deep-learning-assisted online surface roughness monitoring in ultraprecision fly cutting
Authors: Adeel Shehzad, XiaoTing Rui, YuanYuan Ding, JianShu Zhang, Yu Chang, HanJing Lu, YiHeng Chen

Surface roughness is one of the most critical attributes of machined components, especially those used in high-performance systems. Online surface roughness monitoring offers advancements comparable to post-process inspection methods, reducing inspection time and costs and concurrently reducing the likelihood of defects. Currently, online monitoring approaches for surface roughness are constrained by several limitations, including the reliance on handcrafted feature extraction, which necessitates the involvement of human experts and entails time-consuming processes. Moreover, the prediction models trained under one set of cutting conditions exhibit poor performance when applied to different experimental settings. To address these challenges, this work presents a novel deep-learning-assisted online surface roughness monitoring method for ultraprecision fly cutting of copper workpieces under different cutting conditions. Tooltip acceleration signals were acquired during each cutting experiment to develop two datasets, and no handcrafted features were extracted. Five deep learning models were developed and evaluated using standard performance metrics. A convolutional neural network stacked on a long short-term memory network outperformed all other network models, yielding exceptional results, including a mean absolute percentage error as low as 1.51% and anR2 value of 96.6%. Furthermore, the robustness of the proposed model was assessed via a validation cohort analysis using experimental data obtained using cutting parameters different from those previously employed. The performance of the model remained consistent and commendable under varied conditions, asserting its applicability in real-world scenarios.
Robust Deep Learning for Accurate Landslide Identification and Prediction
Authors: T. Bhuvaneswari, R. Chandra Guru Sekar, M. Chengathir Selvi, J. Jemima Rubavathi, V. Kaviyaa

AbstractLandslide is the most common natural risk in mountainous regions on all five continents and they can pose a serious threat in these areas. Strong earthquakes, unusual weather events such as storms and eruptions of volcanoes, and human-caused events such as creating roadways that crossed the slopes are the main causes of landslides and they cause significant dangers to residential properties and society as a whole. The Landslide4sense dataset is used for identifying landslides, which contains 3799 training samples and 245 testing samples. These image patches are taken from the Sentinel-2 sensor, while the slope and Digital Elevation Model (DEM) are from the ALOS PALSAR sensor. Data was gathered from four distinct geographical areas namely Kodagu, Iburi, Taiwan, and Gorkha. We use Deep Learning (DL) models such as ResNet18, U-Net, and VGG16 to predict the landslide. By comparing the above models with the evaluation metrics like loss, precision, recall, F1 score and accuracy, ResNet18 model is selected as the best model for landslide identification.
DeepEPhishNet: a deep learning framework for email phishing detection using word embedding algorithms
Authors: M Somesha, Alwyn Roshan Pais

Email phishing is a social engineering scheme that uses spoofed emails intended to trick the user into disclosing legitimate business and personal credentials. Many phishing email detection techniques exist based on machine learning, deep learning, and word embedding. In this paper, we propose a new technique for the detection of phishing emails using word embedding (Word2Vec, FastText, and TF-IDF) and deep learning techniques (DNN and BiLSTM network). Our proposed technique makes use of only four header based (From, Returnpath, Subject, Message-ID) features of the emails for the email classification. We applied several word embeddings for the evaluation of our models. From the experimental evaluation, we observed that the DNN model with FastText-SkipGram achieved an accuracy of 99.52% and BiLSTM model with FastText-SkipGram achieved an accuracy of 99.42%. Among these two techniques, DNN outperformed BiLSTM using the same word embedding (FastText-SkipGram) techniques with an accuracy of 99.52%.
Quantum mechanics-based deep learning framework considering near-zero variance data
Authors: Eunseo Oh, Hyunsoo Lee

AbstractWith the development of automation technology, big data is collected during operation processes, and among various machine learning analysis techniques using such data, deep neural network (DNN) has high analysis performance. However, most industrial data has low-variance or near-zero variance data from the refined processes in the collected data itself. This reduces deep learning analysis performance, which is affected by data quality. To overcome this, in this study, the weight learning pattern of an applied DNN is modeled as a stochastic differential equation (SDE) based on quantum mechanics. Through the drift and diffuse terms of quantum mechanics, the patterns of the DNN and data are quickly acquired, and the data with near-zero variance is effectively analyzed simultaneously. To demonstrate the superiority of the proposed framework, DNN analysis was performed using data with near-zero variance issues, and it was proved that the proposed framework is effective in processing near-zero variance data compared with other existing algorithms.Graphical abstract
Deep learning-based network intrusion detection in smart healthcare enterprise systems
Authors: Vinayakumar Ravi

Network-based intrusion detection (N-IDS) is an essential system inside an organization in a smart healthcare enterprise system to prevent the system and its networks from network attacks. A survey of the literature shows that in recent days deep learning approaches are employed successfully for N-IDS using network connections. However, finding the right features from a network connection is a daunting task. This work proposes a multidimensional attention-based deep learning approach for N-IDS that extracts the optimal features for intrusion detection using network payload. The proposed approach includes an embedding that transforms every word in the payload into a 100-dimensional feature vector representation and embedding follows deep learning layers such as a convolutional neural network (CNN) and long short-term memory (LSTM) with attention to extracting optimal features for attack classification. Next, the features of CNN and LSTM layers are concatenated and passed into fully connected layers for intrusion detection. The proposed approach showed 99% accuracy on the KISTI enterprise network payload dataset. In addition, the proposed approach showed 98% accuracy and 99% accuracy on network-based datasets such as KDDCup-99, CICIDS-2017, and WSN-DS and UNSW-NB15 respectively. The good experimental results on various network-based datasets suggest that the proposed N-IDS in smart healthcare enterprise systems is robust and generalizable to detect attacks from different network environments. The proposed approach performed better in all the experiments than the other deep learning-based methods. The model showed a 5% accuracy performance improvement compared to the existing study using the KISTI dataset. In addition, the proposed model has shown similar performances on the other intrusion datasets. The proposed approach serves as a network monitoring tool for efficient and accurate detection of attacks inside an organization on a healthcare enterprise network system.
Discovery of a structural class of antibiotics with explainable deep learning
Authors: Felix Wong, Erica J. Zheng, Jacqueline A. Valeri, Nina M. Donghia, Melis N. Anahtar, Satotaka Omori, Alicia Li, Andres Cubillos-Ruiz, Aarti Krishnan, Wengong Jin, Abigail L. Manson, Jens Friedrichs, Ralf Helbig, Behnoush Hajian, Dawid K. Fiejtek, Florence F. Wagner, Holly H. Soutter, Ashlee M. Earl, Jonathan M. Stokes, Lars D. Renner, James J. Collins

The discovery of novel structural classes of antibiotics is urgently needed to address the ongoing antibiotic resistance crisis1,2,3,4,5,6,7,8,9. Deep learning approaches have aided in exploring chemical spaces1,10,11,12,13,14,15; these typically use black box models and do not provide chemical insights. Here we reasoned that the chemical substructures associated with antibiotic activity learned by neural network models can be identified and used to predict structural classes of antibiotics. We tested this hypothesis by developing an explainable, substructure-based approach for the efficient, deep learning-guided exploration of chemical spaces. We determined the antibiotic activities and human cell cytotoxicity profiles of 39,312 compounds and applied ensembles of graph neural networks to predict antibiotic activity and cytotoxicity for 12,076,365 compounds. Using explainable graph algorithms, we identified substructure-based rationales for compounds with high predicted antibiotic activity and low predicted cytotoxicity. We empirically tested 283 compounds and found that compounds exhibiting antibiotic activity against Staphylococcus aureus were enriched in putative structural classes arising from rationales. Of these structural classes of compounds, one is selective against methicillin-resistant S. aureus (MRSA) and vancomycin-resistant enterococci, evades substantial resistance, and reduces bacterial titres in mouse models of MRSA skin and systemic thigh infection. Our approach enables the deep learning-guided discovery of structural classes of antibiotics and demonstrates that machine learning models in drug discovery can be explainable, providing insights into the chemical substructures that underlie selective antibiotic activity.
Deep learning systems for forecasting the prices of crude oil and precious metals
Authors: Parisa Foroutan, Salim Lahmiri

Commodity markets, such as crude oil and precious metals, play a strategic role in the economic development of nations, with crude oil prices influencing geopolitical relations and the global economy. Moreover, gold and silver are argued to hedge the stock and cryptocurrency markets during market downsides. Therefore, accurate forecasting of crude oil and precious metals prices is critical. Nevertheless, due to the nonlinear nature, substantial fluctuations, and irregular cycles of crude oil and precious metals, predicting their prices is a challenging task. Our study contributes to the commodity market price forecasting literature by implementing and comparing advanced deep-learning models. We address this gap by including silver alongside gold in our analysis, offering a more comprehensive understanding of the precious metal markets. This research expands existing knowledge and provides valuable insights into predicting commodity prices. In this study, we implemented 16 deep- and machine-learning models to forecast the daily price of the West Texas Intermediate (WTI), Brent, gold, and silver markets. The employed deep-learning models are long short-term memory (LSTM), BiLSTM, gated recurrent unit (GRU), bidirectional gated recurrent units (BiGRU), T2V-BiLSTM, T2V-BiGRU, convolutional neural networks (CNN), CNN-BiLSTM, CNN-BiGRU, temporal convolutional network (TCN), TCN-BiLSTM, and TCN-BiGRU. We compared the forecasting performance of deep-learning models with the baseline random forest, LightGBM, support vector regression, and k-nearest neighborhood models using mean absolute error (MAE), mean absolute percentage error, and root mean squared error as evaluation criteria. By considering different sliding window lengths, we examine the forecasting performance of our models. Our results reveal that the TCN model outperforms the others for WTI, Brent, and silver, achieving the lowest MAE values of 1.444, 1.295, and 0.346, respectively. The BiGRU model performs best for gold, with an MAE of 15.188 using a 30-day input sequence. Furthermore, LightGBM exhibits comparable performance to TCN and is the best-performing machine-learning model overall. These findings are critical for investors, policymakers, mining companies, and governmental agencies to effectively anticipate market trends, mitigate risk, manage uncertainty, and make timely decisions and strategies regarding crude oil, gold, and silver markets.