ADKU/ResearchGPT_model_dataset huggingface dataset:
An improved federated deep learning for plant leaf disease detection
Authors: Pragya Hari, Maheshwari Prasad Singh, Amit Kumar Singh

Leaf diseases are hazardous to the yield and quality of food crops. There are many deep learning algorithms developed for their detection that may require large computational resources to train a single model with voluminous amounts of data. In the agriculture domain, various plant diseases are found across the country. Accumulating such a huge dataset from various regions is a tedious task, and training them with a single model can also be challenging. This paper proposes Federated Deep Learning (FDL) for Plant Leaf Disease Detection. This concept allows multiple local models to get trained with their region-based datasets and share their knowledge with siblings through the parent, instead of sharing complete datasets. Knowledge transfer significantly reduces the computational costs. This paper formulates the federated dataset using PlantVillage, to simulate the configuration of the FDL. A lightweight and efficient Hierarchical Convolutional Neural Network (H-CNN) is proposed for parent model and child models with 0.09 million parameters and 0.35MB model size. The simulation results show that the proposed FDL attains 93% testing accuracy, outperforming state-of-the-art methods namely, FedAdam and FedAvg with 86.8% and 87.7% respectively. In addition to this, the proposed FDL achieves 95.7%, 95.4% and 95.3% of weighted precision, weighted recall and weighted F1-score respectively for first local model and 92.1%, 90.8% and 91.2% respectively of weighted precision, weighted recall and weighted F1-score respectively for second local model.
Deep reinforcement learning imbalanced credit risk of SMEs in supply chain finance
Authors: Wen Zhang, Shaoshan Yan, Jian Li, Rui Peng, Xin Tian

It is crucial to predict the credit risk of small and medium-sized enterprises (SMEs) accurately for the success of supply chain finance (SCF). However, most of the existing research ignore the fact that the data distribution is usually imbalanced, that is, the proportion of default SMEs is much smaller than that of non-default SMEs. To fill this research gap, we propose a novel approach called DRL-Risk to deal with the imbalanced credit risk prediction (ICRP) of SMEs in SCF with deep reinforcement learning (DRL). Specifically, we formulate the ICRP problem as a Markov decision process and suggest an instance-based reward function to incorporate financial loss into the reward function with consideration of the actual loss caused by misclassification in the ICRP of SMEs. Then, we recommend a deep dueling neural network for decision policy to predict the credit risk of SMEs. With deep reinforcement learning, the DRL-Risk approach can prioritize the learning on the SMEs that would lead to great financial losses. Experimental results demonstrate that the DRL-Risk approach can significantly improve the performance of credit risk prediction of SMEs in SCF compared with the baseline methods in recall, G-mean, and financial loss. We have also identified management implications for the decision-makers participating in SCF.
Deep learning with autoencoders and LSTM for ENSO forecasting
Authors: Chibuike Chiedozie Ibebuchi, Michael B. Richman

El Niño Southern Oscillation (ENSO) is the prominent recurrent climatic pattern in the tropical Pacific Ocean with global impacts on regional climates. This study utilizes deep learning to predict the Niño 3.4 index by encoding non-linear sea surface temperature patterns in the tropical Pacific using an autoencoder neural network. The resulting encoded patterns identify crucial centers of action in the Pacific that serve as predictors of the ENSO mode. These patterns are utilized as predictors for forecasting the Niño 3.4 index with a lead time of at least 6 months using the Long Short-Term Memory (LSTM) deep learning model. The analysis uncovers multiple non-linear dipole patterns in the tropical Pacific, with anomalies that are both regionalized and latitudinally oriented that should support a single inter-tropical convergence zone for modeling efforts. Leveraging these encoded patterns as predictors, the LSTM - trained on monthly data from 1950 to 2007 and tested from 2008 to 2022 - shows fidelity in predicting the Niño 3.4 index. The encoded patterns captured the annual cycle of ENSO with a 0.94 correlation between the actual and predicted Niño 3.4 index for lag 12 and 0.91 for lags 6 and 18. Additionally, the 6-month lag predictions excel in detecting extreme ENSO events, achieving an 85% hit rate, outperforming the 70% hit rate at lag 12 and 55% hit rate at lag 18. The prediction accuracy peaks from November to March, with correlations ranging from 0.94 to 0.96. The average correlations in the boreal spring were as large as 0.84, indicating the method has the capability to decrease the spring predictability barrier.
HCR-Net: a deep learning based script independent handwritten character recognition network
Authors: Vinod Kumar Chauhan, Sukhdeep Singh, Anuj Sharma

Handwritten character recognition (HCR) remains a challenging pattern recognition problem despite decades of research, and lacks research on script independent recognition techniques. This is mainly because of similar character structures, different handwriting styles, diverse scripts, handcrafted feature extraction techniques, unavailability of data and code, and the development of script-specific deep learning techniques. To address these limitations, we have proposed a script independent deep learning network for HCR research, called HCR-Net, that sets a new research direction for the field. HCR-Net is based on a novel transfer learning approach for HCR, which partly utilizes feature extraction layers of a pre-trained network. Due to transfer learning and image augmentation, HCR-Net provides faster and computationally efficient training, better performance and generalizations, and can work with small datasets. HCR-Net is extensively evaluated on 40 publicly available datasets of Bangla, Punjabi, Hindi, English, Swedish, Urdu, Farsi, Tibetan, Kannada, Malayalam, Telugu, Marathi, Nepali and Arabic languages, and established 26 new benchmark results while performed close to the best results in the rest cases. HCR-Net showed performance improvements up to 11% against the existing results and achieved a fast convergence rate showing up to 99% of final performance in the very first epoch. HCR-Net significantly outperformed the state-of-the-art transfer learning techniques and also reduced the number of trainable parameters by 34% as compared with the corresponding pre-trained network. To facilitate reproducibility and further advancements of HCR research, the complete code is publicly released at https://github.com/jmdvinodjmd/HCR-Net.
A predictive analytics framework for sensor data using time series and deep learning techniques
Authors: Hend A. Selmy, Hoda K. Mohamed, Walaa Medhat

IoT devices convert billions of objects into data-generating entities, enabling them to report status and interact with their surroundings. This data comes in various formats, like structured, semi-structured, or unstructured. In addition, it can be collected in batches or in real time. The problem now is how to benefit from all of this data gathered by sensing and monitoring changes like temperature, light, and position. In this paper, we propose a predictive analytics framework constructed on top of open-source technologies such as Apache Spark and Kafka. The framework focuses on forecasting temperature time series data using traditional and deep learning predictive analytics methods. The analysis and prediction tasks were performed using Autoregressive Integrated Moving Average (ARIMA), Seasonal Autoregressive Integrated Moving Average (SARIMA), Long Short-Term Memory (LSTM), and a novel hybrid model based on Convolution Neural Network (CNN) and LSTM. The purpose of this paper is to determine whether and how recently developed deep learning-based models outperform traditional algorithms in the prediction of time series data. The empirical studies conducted and reported in this paper demonstrate that deep learning-based models, specifically LSTM and CNN-LSTM, exhibit superior performance compared to traditional-based algorithms, ARIMA and SARIMA. More specifically, the average reduction in error rates obtained by LSTM and CNN-LSTM models were substantial when compared to other models indicating the superiority of deep learning. Moreover, the CNN-LSTM-based deep learning model exhibits a higher degree of closeness to the actual values when compared to the LSTM-based model.
Deep learning-based comprehensive review on pulmonary tuberculosis
Authors: Twinkle Bansal, Sheifali Gupta, Neeru Jindal

In areas with high tuberculosis (TB) prevalence, high mortality rate has significantly increased over the past few decades. Even though tuberculosis can be treated, areas with high disease burden continue to have insufficient screening tools, leading to diagnostic delays and incorrect diagnoses. As a result of these challenges, a computer-aided diagnostics (CAD) system has been developed that can automatically detect tuberculosis. There are few different methods that can be used to screen for tuberculosis; however, chest X-ray (CXR) is most commonly used and strongly suggested because it is so effective in identifying lung irregularities. Over past ten years, we have seen a meteoric rise in amount of research conducted into application of machine learning strategies to examination of chest X-ray images for screening regarding pulmonary abnormalities. Particularly, we have also noticed significant interest in testing for TB. This attentiveness has increased in tandem with phenomenal progress that has been made in deep learning (DL), which is predominately founded on convolutional neural networks (CNNs). Because of these advancements, significant research contributions have been made in field of DL techniques for TB screening by utilizing CXR images. The main focus of this paper is to emphasize favorable methods and data collection, as well as methodological contributions, identify data collections, and identify challenges.
Adversarial defence by learning differentiated feature representation in deep ensemble
Authors: Xi Chen, Wei Huang, Wei Guo, Fan Zhang, Jiayu Du, Zhizhong Zhou

Deep learning models have been shown to be vulnerable to critical attacks under adversarial conditions. Attackers are able to generate powerful adversarial examples by searching for adversarial perturbations, without interfering with model training or directly modifying the model. This phenomenon indicates an endogenous problem in existing deep learning frameworks. Therefore, optimizing individual models for defense is often limited and can always be defeated by new attack methods. Ensemble defense has been shown to be effective in defending against adversarial attacks by combining diverse models. However, the problem of insufficient differentiation among existing models persists. Active defense in cyberspace security has successfully defended against unknown vulnerabilities by integrating subsystems with multiple different implementations to achieve a unified mission objective. Inspired by this, we propose exploring the feasibility of achieving model differentiation by changing the data features used in training individual models, as they are the core factor of functional implementation. We utilize several feature extraction methods to preprocess the data and train differentiated models based on these features. By generating adversarial perturbations to attack different models, we demonstrate that the feature representation of the data is highly resistant to adversarial perturbations. The entire ensemble is able to operate normally in an error-bearing environment.
Scaling deep learning for materials discovery
Authors: Amil Merchant, Simon Batzner, Samuel S. Schoenholz, Muratahan Aykol, Gowoon Cheon, Ekin Dogus Cubuk

Novel functional materials enable fundamental breakthroughs across technological applications from clean energy to information processing1,2,3,4,5,6,7,8,9,10,11. From microchips to batteries and photovoltaics, discovery of inorganic crystals has been bottlenecked by expensive trial-and-error approaches. Concurrently, deep-learning models for language, vision and biology have showcased emergent predictive capabilities with increasing data and computation12,13,14. Here we show that graph networks trained at scale can reach unprecedented levels of generalization, improving the efficiency of materials discovery by an order of magnitude. Building on 48,000 stable crystals identified in continuing studies15,16,17, improved efficiency enables the discovery of 2.2 million structures below the current convex hull, many of which escaped previous human chemical intuition. Our work represents an order-of-magnitude expansion in stable materials known to humanity. Stable discoveries that are on the final convex hull will be made available to screen for technological applications, as we demonstrate for layered materials and solid-electrolyte candidates. Of the stable structures, 736 have already been independently experimentally realized. The scale and diversity of hundreds of millions of first-principles calculations also unlock modelling capabilities for downstream applications, leading in particular to highly accurate and robust learned interatomic potentials that can be used in condensed-phase molecular-dynamics simulations and high-fidelity zero-shot prediction of ionic conductivity.
Deep learning-aided 3D proxy-bridged region-growing framework for multi-organ segmentation
Authors: Zhihong Chen, Lisha Yao, Yue Liu, Xiaorui Han, Zhengze Gong, Jichao Luo, Jietong Zhao, Gang Fang

Accurate multi-organ segmentation in 3D CT images is imperative for enhancing computer-aided diagnosis and radiotherapy planning. However, current deep learning-based methods for 3D multi-organ segmentation face challenges such as the need for labor-intensive manual pixel-level annotations and high hardware resource demands, especially regarding GPU resources. To address these issues, we propose a 3D proxy-bridged region-growing framework specifically designed for the segmentation of the liver and spleen. Specifically, a key slice is selected from each 3D volume according to the corresponding intensity histogram. Subsequently, a deep learning model is employed to pinpoint the semantic central patch on this key slice, to calculate the growing seed. To counteract the impact of noise, segmentation of the liver and spleen is conducted on superpixel images created through proxy-bridging strategy. The segmentation process is then extended to adjacent slices by applying the same methodology iteratively, culminating in the comprehensive segmentation results. Experimental results demonstrate that the proposed framework accomplishes segmentation of the liver and spleen with an average Dice Similarity Coefficient of approximately 0.93 and a Jaccard Similarity Coefficient of around 0.88. These outcomes substantiate the framework's capability to achieve performance on par with that of deep learning methods, albeit requiring less guidance information and lower GPU resources.
Biometrics recognition using deep learning: a survey
Authors: Shervin Minaee, Amirali Abdolrashidi, Hang Su, Mohammed Bennamoun, David Zhang

In the past few years, deep learning-based models have been very successful in achieving state-of-the-art results in many tasks in computer vision, speech recognition, and natural language processing. These models seem to be a natural fit for handling the ever-increasing scale of biometric recognition problems, from cellphone authentication to airport security systems. Deep learning-based models have increasingly been leveraged to improve the accuracy of different biometric recognition systems in recent years. In this work, we provide a comprehensive survey of more than 150 promising works on biometric recognition (including face, fingerprint, iris, palmprint, ear, voice, signature, and gait recognition), which deploy deep learning models, and show their strengths and potentials in different applications. For each biometric, we first introduce the available datasets that are widely used in the literature and their characteristics. We will then talk about several promising deep learning works developed for that biometric, and show their performance on popular public benchmarks. We will also discuss some of the main challenges while using these models for biometric recognition, and possible future directions to which research in this area is headed.
Harnessing the Power of 6G Connectivity for Advanced Big Data Analytics with Deep Learning
Authors: Maojin Sun, Luyi Sun

The smart applications development worldwide demands for ultra-reliable data communication to assure the richness of data and processing in time. These smart applications create massive amounts of data to be processed in 6G networks with advanced technologies. 6G big data analytics become the demand for next-generation data communication and smart city applications. Traditional data analytics algorithms lag in efficiency while processing big data due to huge volume, data dependency and timely processing. A deep learning model called reinforcement learning is promising for processing big data in smart applications. The proposed study, advanced big data Analytics using Deep learning (ABDAS-DL), gives a pioneering approach that combines Deep Reinforcement learning (DRL) based Deep Q network (DQN) with long-term, short-term memory (LSTM) for harnessing the vast capacity of 6G connectivity within the domain of advanced big data analytics. This study utilises smart transport-based data for taxi route optimisation by analysing climatic and surrounding factors. The look of 6G connectivity guarantees incredible facts of data transmission speeds and tremendously low latency, taking off new horizons for managing large datasets in real time. The performance of the proposed model is measured in terms of processing time, network, reliability and scalability. The proposed model takes 30 s to process the data and fix the taxi route, while another traditional model consumes more than an hour.
Assessments of Data-Driven Deep Learning Models on One-Month Predictions of Pan-Arctic Sea Ice Thickness
Authors: Chentao Song, Jiang Zhu, Xichen Li

In recent years, deep learning methods have gradually been applied to prediction tasks related to Arctic sea ice concentration, but relatively little research has been conducted for larger spatial and temporal scales, mainly due to the limited time coverage of observations and reanalysis data. Meanwhile, deep learning predictions of sea ice thickness (SIT) have yet to receive ample attention. In this study, two data-driven deep learning (DL) models are built based on the ConvLSTM and fully convolutional U-net (FC-Unet) algorithms and trained using CMIP6 historical simulations for transfer learning and fine-tuned using reanalysis/observations. These models enable monthly predictions of Arctic SIT without considering the complex physical processes involved. Through comprehensive assessments of prediction skills by season and region, the results suggest that using a broader set of CMIP6 data for transfer learning, as well as incorporating multiple climate variables as predictors, contribute to better prediction results, although both DL models can effectively predict the spatiotemporal features of SIT anomalies. Regarding the predicted SIT anomalies of the FC-Unet model, the spatial correlations with reanalysis reach an average level of 89% over all months, while the temporal anomaly correlation coefficients are close to unity in most cases. The models also demonstrate robust performances in predicting SIT and SIE during extreme events. The effectiveness and reliability of the proposed deep transfer learning models in predicting Arctic SIT can facilitate more accurate pan-Arctic predictions, aiding climate change research and real-time business applications.
Early betel leaf disease detection using vision transformer and deep learning algorithms
Authors: S. Kusuma, K. R. Jothi

Betel leaves benefits include their high content of antioxidants, which can help protect against oxidative stress and promote overall health. Additionally, these leaves are known for their potential anti-inflammatory properties, making them valuable in traditional medicine practises. The biggest threat to the security of the food supply is posed by plant diseases, and it is difficult to detect them early enough to prevent potential economic harm. This crop loss not only affects the economy but also poses a threat to food security, as betel leaves are widely used in traditional cuisines and herbal remedies. By analysing large datasets of plant images, deep learning algorithms can quickly identify specific patterns and symptoms associated with various diseases. In this study, we evaluated how well four deep learning models—VGG19, DenseNet201, ResNet152V2, and a Vision Transform model—performed at detecting diseases that affect betel leaves. Both the ResNet152V2 and VIT models attained levels of accuracy, with testing accuracies of 98.42% and 97.83%, respectively. However, the VGG19 model had slightly lower accuracy, with a testing accuracy of 91%. Overall, these deep learning models showed promising results in detecting diseases affecting betel leaves, with the DenseNet201 model performing the best with a testing accuracy of 98.77%.
Exploring the deep learning of artificial intelligence in nursing: a concept analysis with Walker and Avant’s approach
Authors: Supichaya Wangpitipanit, Lininger Jiraporn, Nick Anderson

BackgroundIn recent years, increased attention has been given to using deep learning (DL) of artificial intelligence (AI) in healthcare to address nursing challenges. The adoption of new technologies in nursing needs to be improved, and AI in nursing is still in its early stages. However, the current literature needs more clarity, which affects clinical practice, research, and theory development. This study aimed to clarify the meaning of deep learning and identify the defining attributes of artificial intelligence within nursing.MethodsWe conducted a concept analysis of the deep learning of AI in nursing care using Walker and Avant’s 8-step approach. Our search strategy employed Boolean techniques and MeSH terms across databases, including BMC, CINAHL, ClinicalKey for Nursing, Embase, Ovid, Scopus, SpringerLink and Spinger Nature, ProQuest, PubMed, and Web of Science. By focusing on relevant keywords in titles and abstracts from articles published between 2018 and 2024, we initially found 571 sources.ResultsThirty-seven articles that met the inclusion criteria were analyzed in this study. The attributes of evidence included four themes: focus and immersion, coding and understanding, arranging layers and algorithms, and implementing within the process of use cases to modify recommendations. Antecedents, unclear systems and communication, insufficient data management knowledge and support, and compound challenges can lead to suffering and risky caregiving tasks. Applying deep learning techniques enables nurses to simulate scenarios, predict outcomes, and plan care more precisely. Embracing deep learning equipment allows nurses to make better decisions. It empowers them with enhanced knowledge while ensuring adequate support and resources essential for caregiver and patient well-being. Access to necessary equipment is vital for high-quality home healthcare.ConclusionThis study provides a clearer understanding of the use of deep learning in nursing and its implications for nursing practice. Future research should focus on exploring the impact of deep learning on healthcare operations management through quantitative and qualitative studies. Additionally, developing a framework to guide the integration of deep learning into nursing practice is recommended to facilitate its adoption and implementation.