ADKU/ResearchGPT_model_dataset huggingface dataset:
Deep Learning Enhanced Snapshot Generation for Efficient Hyper-reduction in Nonlinear Structural Dynamics
Authors: Hossein Najafi, Morteza Karamooz Mahdiabadi

PurposeThis study presents a novel approach to enhancing hyper-reduction in nonlinear structural dynamics by utilizing the predictive capabilities of stacked Long Short-Term Memory (LSTM) neural networks. Hyper-reduction methods are crucial for overcoming the limitations of traditional model order reduction techniques, particularly in accurately capturing the nonlinear behavior of internal force vectors in complex structures.Method The proposed technique employs stacked LSTM neural networks to generate training snapshots for the Energy Conserving Mesh Sampling and Weighting (ECSW) hyper-reduction method. By training the model on a well-defined dataset, we achieve an impressive accuracy of 97.5%. The effectiveness of our method is demonstrated through a geometrically nonlinear dynamic analysis of a leaf spring, resulting in only a 3.24% error when compared to full simulation results. This study emphasizes the potential of deep learning techniques in improving hyper-reduction methods and underscores the importance of computational efficiency in simulations of complex structural dynamics.ResultsThe findings reveal significant advancements in the application of deep learning for hyper-reduction methods, showcasing the ability to accurately model nonlinear structural behaviors while maintaining computational efficiency. This research contributes valuable insights into the integration of advanced machine learning techniques within the field of structural dynamics.
Optimization of job shop scheduling problem based on deep reinforcement learning
Authors: Dongping Qiao, Lvqi Duan, HongLei Li, Yanqiu Xiao

Aiming at the optimization problem of minimizing the maximum completion time in job shop scheduling, a deep reinforcement learning optimization algorithm is proposed. First, a deep reinforcement learning scheduling environment is built based on the disjunctive graph model, and three channels of state characteristics are established. The action space consists of 20 designed combination scheduling rules. The reward function is designed based on the proportional relationship between the total work of the scheduled operation and the current maximum completion time. The deep convolutional neural network is used to construct action network and target network, and the state features are used as inputs to output the Q value of each action. Then, the action is selected by using the action validity exploration and exploitation strategy. Finally, the immediate reward is calculated and the scheduling environment is updated. Experiments are carried out using benchmark instances to verify the algorithm. The results show that it can balance solution quality and computation time effectively, and the trained agent has good generalization ability to the scheduling problem in the non-zero initial state.
A Study on Different Deep Learning Algorithms Used in Deep Neural Nets: MLP SOM and DBN
Authors: J. Naskath, G. Sivakamasundari, A. Alif Siddiqua Begum

Deep learning is a wildly popular topic in machine learning and is structured as a series of nonlinear layers that learns various levels of data representations. Deep learning employs numerous layers to represent data abstractions to implement various computer models. Deep learning approaches like generative, discriminative models and model transfer have transformed information processing. This article proposes a comprehensive review of various deep learning algorithms Multi layer perception, Self-organizing map and deep belief networks algorithms. It first briefly introduces historical and recent state-of-the-art reviews with suitable architectures and implementation steps. Moreover, the various applications of those algorithms in various fields such as wireless networks, Adhoc networks, Mobile ad-hoc and vehicular ad-hoc networks, speech recognition engineering, medical applications, natural language processing, material science and remote sensing applications, etc. are classified.
A Review of Deep Learning Techniques for Glaucoma Detection
Authors: Takfarines Guergueb, Moulay A. Akhloufi

Glaucoma is one of the major reasons for visual impairment all across the globe. The recent advancements in machine learning techniques have greatly facilitated ophthalmologists in the early diagnosis of ocular diseases through the employment of automated systems. Several studies have been published lately to address the timely detection of glaucoma using deep learning approaches. A comprehensive review of the deep learning approaches employed for glaucoma detection using retinal fundus images is presented in this paper. The available retinal image datasets, image pre-processing techniques, state-of-the-art models, and performance evaluation metrics used in the recent studies are reviewed. This systematic review aims to provide critical insights and potential research directions to the ophthalmologists and researchers in this domain.
Investigating Deep Learning for Early Detection and Decision-Making in Alzheimer’s Disease: A Comprehensive Review
Authors: Ghazala Hcini, Imen Jdey, Habib Dhahri

Alzheimer’s disease (AD) is a neurodegenerative disorder that affects millions of people worldwide, making early detection essential for effective intervention. This review paper provides a comprehensive analysis of the use of deep learning techniques, specifically convolutional neural networks (CNN) and vision transformers (ViT), for the classification of AD using brain imaging data. While previous reviews have covered similar topics, this paper offers a unique perspective by providing a detailed comparison of CNN and ViT for AD classification, highlighting the strengths and limitations of each approach. Additionally, the review presents an updated and thorough analysis of the most recent studies in the field, including the latest advancements in CNN and ViT architectures, training methods, and performance evaluation metrics. Furthermore, the paper discusses the ethical considerations and challenges associated with the use of deep learning models for AD classification, such as the need for interpretability and the potential for bias. By addressing these issues, this review aims to provide valuable insights for future research and clinical applications, ultimately advancing the field of AD classification using deep learning techniques.
A multi-agent adaptive deep learning framework for online intrusion detection
Authors: Mahdi Soltani, Khashayar Khajavi, Mahdi Jafari Siavoshani, Amir Hossein Jahangir

The network security analyzers use intrusion detection systems (IDSes) to distinguish malicious traffic from benign ones. The deep learning-based (DL-based) IDSes are proposed to auto-extract high-level features and eliminate the time-consuming and costly signature extraction process. However, this new generation of IDSes still needs to overcome a number of challenges to be employed in practical environments. One of the main issues of an applicable IDS is facing traffic concept drift, which manifests itself as new (i.e. , zero-day) attacks, in addition to the changing behavior of benign users/applications. Furthermore, a practical DL-based IDS needs to be conformed to a distributed (i.e. , multi-sensor) architecture in order to yield more accurate detections, create a collective attack knowledge based on the observations of different sensors, and also handle big data challenges for supporting high throughput networks. This paper proposes a novel multi-agent network intrusion detection framework to address the above shortcomings, considering a more practical scenario (i.e., online adaptable IDSes). This framework employs continual deep anomaly detectors for adapting each agent to the changing attack/benign patterns in its local traffic. In addition, a federated learning approach is proposed for sharing and exchanging local knowledge between different agents. Furthermore, the proposed framework implements sequential packet labeling for each flow, which provides an attack probability score for the flow by gradually observing each flow packet and updating its estimation. We evaluate the proposed framework by employing different deep models (including CNN-based and LSTM-based) over the CIC-IDS2017 and CSE-CIC-IDS2018 datasets. Through extensive evaluations and experiments, we show that the proposed distributed framework is well adapted to the traffic concept drift. More precisely, our results indicate that the CNN-based models are well suited for continually adapting to the traffic concept drift (i.e. , achieving an average detection rate of above 95% while needing just 128 new flows for the updating phase), and the LSTM-based models are a good candidate for sequential packet labeling in practical online IDSes (i.e. , detecting intrusions by just observing their first 15 packets).
Deep learning implementation of image segmentation in agricultural applications: a comprehensive review
Authors: Lian Lei, Qiliang Yang, Ling Yang, Tao Shen, Ruoxi Wang, Chengbiao Fu

Image segmentation is a crucial task in computer vision, which divides a digital image into multiple segments and objects. In agriculture, image segmentation is extensively used for crop and soil monitoring, predicting the best times to sow, fertilize, and harvest, estimating crop yield, and detecting plant diseases. However, image segmentation faces difficulties in agriculture, such as the challenges of disease staging recognition, labeling inconsistency, and changes in plant morphology with the environment. Consequently, we have conducted a comprehensive review of image segmentation techniques based on deep learning, exploring the development and prospects of image segmentation in agriculture. Deep learning-based image segmentation solutions widely used in agriculture are categorized into eight main groups: encoder-decoder structures, multi-scale and pyramid-based methods, dilated convolutional networks, visual attention models, generative adversarial networks, graph neural networks, instance segmentation networks, and transformer-based models. In addition, the applications of image segmentation methods in agriculture are presented, such as plant disease detection, weed identification, crop growth monitoring, crop yield estimation, and counting. Furthermore, a collection of publicly available plant image segmentation datasets has been reviewed, and the evaluation and comparison of performance for image segmentation algorithms have been conducted on benchmark datasets. Finally, there is a discussion of the challenges and future prospects of image segmentation in agriculture.
Model-based deep learning framework for accelerated optical projection tomography
Authors: Marcos Obando, Andrea Bassi, Nicolas Ducros, Germán Mato, Teresa M. Correia

In this work, we propose a model-based deep learning reconstruction algorithm for optical projection tomography (ToMoDL), to greatly reduce acquisition and reconstruction times. The proposed method iterates over a data consistency step and an image domain artefact removal step achieved by a convolutional neural network. A preprocessing stage is also included to avoid potential misalignments between the sample center of rotation and the detector. The algorithm is trained using a database of wild-type zebrafish (Danio rerio) at different stages of development to minimise the mean square error for a fixed number of iterations. Using a cross-validation scheme, we compare the results to other reconstruction methods, such as filtered backprojection, compressed sensing and a direct deep learning method where the pseudo-inverse solution is corrected by a U-Net. The proposed method performs equally well or better than the alternatives. For a highly reduced number of projections, only the U-Net method provides images comparable to those obtained with ToMoDL. However, ToMoDL has a much better performance if the amount of data available for training is limited, given that the number of network trainable parameters is smaller.
Mammography using low-frequency electromagnetic fields with deep learning
Authors: Hamid Akbari-Chelaresi, Dawood Alsaedi, Seyed Hossein Mirjahanmardi, Mohamed El Badawe, Ali M. Albishi, Vahid Nayyeri, Omar M. Ramahi

In this paper, a novel technique for detecting female breast anomalous tissues is presented and validated through numerical simulations. The technique, to a high degree, resembles X-ray mammography; however, instead of using X-rays for obtaining images of the breast, low-frequency electromagnetic fields are leveraged. To capture breast impressions, a metasurface, which can be thought of as analogous to X-rays film, has been employed. To achieve deep and sufficient penetration within the breast tissues, the source of excitation is a simple narrow-band dipole antenna operating at 200 MHz. The metasurface is designed to operate at the same frequency. The detection mechanism is based on comparing the impressions obtained from the breast under examination to the reference case (healthy breasts) using machine learning techniques. Using this system, not only would it be possible to detect tumors (benign or malignant), but one can also determine the location and size of the tumors. Remarkably, deep learning models were found to achieve very high classification accuracy.
Taxonomy of deep learning-based intrusion detection system approaches in fog computing: a systematic review
Authors: Sepide Najafli, Abolfazl Toroghi Haghighat, Babak Karasfi

The Internet of Things (IoT) has been used in various aspects. Fundamental security issues must be addressed to accelerate and develop the Internet of Things. An intrusion detection system (IDS) is an essential element in network security designed to detect and determine the type of attacks. The use of deep learning (DL) shows promising results in the design of IDS based on IoT. DL facilitates analytics and learning in the dynamic IoT domain. Some deep learning-based IDS in IOT sensors cannot be executed, because of resource restrictions. Although cloud computing could overcome limitations, the distance between the cloud and the end IoT sensors causes high communication costs, security problems and delays. Fog computing has been presented to handle these issues and can bring resources to the edge of the network. Many studies have been conducted to investigate IDS based on IoT. Our goal is to investigate and classify deep learning-based IDS on fog processing. In this paper, researchers can access comprehensive resources in this field. Therefore, first, we provide a complete classification of IDS in IoT. Then practical and important proposed IDSs in the fog environment are discussed in three groups (binary, multi-class, and hybrid), and are examined the advantages and disadvantages of each approach. The results show that most of the studied methods consider hybrid strategies (binary and multi-class). In addition, in the reviewed papers the average Accuracy obtained in the binary method is better than the multi-class. Finally, we highlight some challenges and future directions for the next research in IDS techniques.
Deep learning-based pathway-centric approach to characterize recurrent hepatocellular carcinoma after liver transplantation
Authors: Jeffrey To, Soumita Ghosh, Xun Zhao, Elisa Pasini, Sandra Fischer, Gonzalo Sapisochin, Anand Ghanekar, Elmar Jaeckel, Mamatha Bhat

BackgroundLiver transplantation (LT) is offered as a cure for Hepatocellular carcinoma (HCC), however 15–20% develop recurrence post-transplant which tends to be aggressive. In this study, we examined the transcriptome profiles of patients with recurrent HCC to identify differentially expressed genes (DEGs), the involved pathways, biological functions, and potential gene signatures of recurrent HCC post-transplant using deep machine learning (ML) methodology.Materials and methodsWe analyzed the transcriptomic profiles of primary and recurrent tumor samples from 7 pairs of patients who underwent LT. Following differential gene expression analysis, we performed pathway enrichment, gene ontology (GO) analyses and protein-protein interactions (PPIs) with top 10 hub gene networks. We also predicted the landscape of infiltrating immune cells using Cibersortx. We next develop pathway and GO term-based deep learning models leveraging primary tissue gene expression data from The Cancer Genome Atlas (TCGA) to identify gene signatures in recurrent HCC.ResultsThe PI3K/Akt signaling pathway and cytokine-mediated signaling pathway were particularly activated in HCC recurrence. The recurrent tumors exhibited upregulation of an immune-escape related gene, CD274, in the top 10 hub gene analysis. Significantly higher infiltration of monocytes and lower M1 macrophages were found in recurrent HCC tumors. Our deep learning approach identified a 20-gene signature in recurrent HCC. Amongst the 20 genes, through multiple analysis, IL6 was found to be significantly associated with HCC recurrence.ConclusionOur deep learning approach identified PI3K/Akt signaling as potentially regulating cytokine-mediated functions and the expression of immune escape genes, leading to alterations in the pattern of immune cell infiltration. In conclusion, IL6 was identified to play an important role in HCC recurrence.
Deep learning models for perception of brightness related illusions
Authors: Amrita Mukherjee, Avijit Paul, Kuntal Ghosh

Illusions are like holes in our effortless visual mechanism through which we can peep into the internal mechanisms of the brain. Scientists attempted to explain underlying physiological, physical, and cognitive mechanisms of illusions by the receptive field hierarchical organizations, information sampling, filtering, etc. Some antagonistic illusions cannot be explained by them and for this, deep learning networks were used recently as a model for illusion perception. To further broaden the scope of the perceptual functionality in the brightness contrast genre, handle the background removal effects on some illusions that reduce the illusory effects, and replicate the antagonistic illusions with the same parameter setup, we have used Convolutional Neural Network, Autoencoder, U-Net, and U-Net++ models for replicating the visual illusions. The networks are specialized in low-level vision tasks like De-noising, De-blurring, and a combination of both. A high number of brightness contrast visual illusions are tested on all the networks and most of the outcomes significantly matched human perceptions. Overall, our method will guide the development of neurobiological frameworks which might enrich the computational neuroscience study by distilling some biological principles. On the other hand, the machine learning community will benefit from knowing the inherent flaws of the networks so that the true image of reality can be taken into consideration, especially in imaging situations where experts too can be deceived.
Exploiting biochemical data to improve osteosarcoma diagnosis with deep learning
Authors: Shidong Wang, Yangyang Shen, Fanwei Zeng, Meng Wang, Bohan Li, Dian Shen, Xiaodong Tang, Beilun Wang

Early and accurate diagnosis of osteosarcomas (OS) is of great clinical significance, and machine learning (ML) based methods are increasingly adopted. However, current ML-based methods for osteosarcoma diagnosis consider only X-ray images, usually fail to generalize to new cases, and lack explainability. In this paper, we seek to explore the capability of deep learning models in diagnosing primary OS, with higher accuracy, explainability, and generality. Concretely, we analyze the added value of integrating the biochemical data, i.e., alkaline phosphatase (ALP) and lactate dehydrogenase (LDH), and design a model that incorporates the numerical features of ALP and LDH and the visual features of X-ray imaging through a late fusion approach in the feature space. We evaluate this model on real-world clinic data with 848 patients aged from 4 to 81. The experimental results reveal the effectiveness of incorporating ALP and LDH simultaneously in a late fusion approach, with the accuracy of the considered 2608 cases increased to 97.17%, compared to 94.35% in the baseline. Grad-CAM visualizations consistent with orthopedic specialists further justified the model’s explainability.
Deep learning-based predictive classification of functional subpopulations of hematopoietic stem cells and multipotent progenitors
Authors: Shen Wang, Jianzhong Han, Jingru Huang, Khayrul Islam, Yuheng Shi, Yuyuan Zhou, Dongwook Kim, Jane Zhou, Zhaorui Lian, Yaling Liu, Jian Huang

BackgroundHematopoietic stem cells (HSCs) and multipotent progenitors (MPPs) play a pivotal role in maintaining lifelong hematopoiesis. The distinction between stem cells and other progenitors, as well as the assessment of their functions, has long been a central focus in stem cell research. In recent years, deep learning has emerged as a powerful tool for cell image analysis and classification/prediction.MethodsIn this study, we explored the feasibility of employing deep learning techniques to differentiate murine HSCs and MPPs based solely on their morphology, as observed through light microscopy (DIC) images.ResultsAfter rigorous training and validation using extensive image datasets, we successfully developed a three-class classifier, referred to as the LSM model, capable of reliably distinguishing long-term HSCs, short-term HSCs, and MPPs. The LSM model extracts intrinsic morphological features unique to different cell types, irrespective of the methods used for cell identification and isolation, such as surface markers or intracellular GFP markers. Furthermore, employing the same deep learning framework, we created a two-class classifier that effectively discriminates between aged HSCs and young HSCs. This discovery is particularly significant as both cell types share identical surface markers yet serve distinct functions. This classifier holds the potential to offer a novel, rapid, and efficient means of assessing the functional states of HSCs, thus obviating the need for time-consuming transplantation experiments.ConclusionOur study represents the pioneering use of deep learning to differentiate HSCs and MPPs under steady-state conditions. This novel and robust deep learning-based platform will provide a basis for the future development of a new generation stem cell identification and separation system. It may also provide new insight into the molecular mechanisms underlying stem cell self-renewal.
Fully dynamic reorder policies with deep reinforcement learning for multi-echelon inventory management
Authors: Patric Hammler, Nicolas Riesterer, Torsten Braun

The operation of inventory systems plays an important role in the success of manufacturing companies, making it a highly relevant domain for optimization. In particular, the domain lends itself to being approached via Deep Reinforcement Learning (DRL) models due to it requiring sequential reorder decisions based on uncertainty to minimize cost. In this paper, we evaluate state-of-the-art optimization approaches to determine whether Deep Reinforcement Learning can be applied to the multi-echelon inventory optimization (MEIO) framework in a practically feasible manner to generate fully dynamic reorder policies. We investigate how it performs in comparison to an optimized static reorder policy, how robust it is when it comes to structural changes in the environment, and whether the use of DRL is safe in terms of risk in real-world applications. Our results show promising performance for DRL with potential for improvement in terms of minimizing risky behavior.