1
|
Wang Q, Yan N, Qin Y, Zhang X, Li X. BED-YOLO: An Enhanced YOLOv10n-Based Tomato Leaf Disease Detection Algorithm. SENSORS (BASEL, SWITZERLAND) 2025; 25:2882. [PMID: 40363318 PMCID: PMC12074195 DOI: 10.3390/s25092882] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/26/2025] [Revised: 04/28/2025] [Accepted: 05/01/2025] [Indexed: 05/15/2025]
Abstract
As an important economic crop, tomato is highly susceptible to diseases that, if not promptly managed, can severely impact yield and quality, leading to significant economic losses. Traditional diagnostic methods rely on expert visual inspection, which is not only laborious but also prone to subjective bias. In recent years, object detection algorithms have gained widespread application in tomato disease detection due to their efficiency and accuracy, providing reliable technical support for crop disease identification. In this paper, we propose an improved tomato leaf disease detection method based on the YOLOv10n algorithm, named BED-YOLO. We constructed an image dataset containing four common tomato diseases (early blight, late blight, leaf mold, and septoria leaf spot), with 65% of the images sourced from field collections in natural environments, and the remainder obtained from the publicly available PlantVillage dataset. All images were annotated with bounding boxes, and the class distribution was relatively balanced to ensure the stability of training and the fairness of evaluation. First, we introduced a Deformable Convolutional Network (DCN) to replace the conventional convolution in the YOLOv10n backbone network, enhancing the model's adaptability to overlapping leaves, occlusions, and blurred lesion edges. Second, we incorporated a Bidirectional Feature Pyramid Network (BiFPN) on top of the FPN + PAN structure to optimize feature fusion and improve the extraction of small disease regions, thereby enhancing the detection accuracy for small lesion targets. Lastly, the Efficient Multi-Scale Attention (EMA) mechanism was integrated into the C2f module to enhance feature fusion, effectively focusing on disease regions while reducing background noise and ensuring the integrity of disease features in multi-scale fusion. The experimental results demonstrated that the improved BED-YOLO model achieved significant performance improvements compared to the original model. Precision increased from 85.1% to 87.2%, recall from 86.3% to 89.1%, and mean average precision (mAP) from 87.4% to 91.3%. Therefore, the improved BED-YOLO model demonstrated significant enhancements in detection accuracy, recall ability, and overall robustness. Notably, it exhibited stronger practical applicability, particularly in image testing under natural field conditions, making it highly suitable for intelligent disease monitoring tasks in large-scale agricultural scenarios.
Collapse
Affiliation(s)
- Qing Wang
- College of Information Engineering, Tarim University, Alaer 843300, China; (Q.W.); (N.Y.); (Y.Q.)
- Key Laboratory of Tarim Oasis Agriculture, Ministry of Education, Tarim University, Alaer 843300, China
| | - Ning Yan
- College of Information Engineering, Tarim University, Alaer 843300, China; (Q.W.); (N.Y.); (Y.Q.)
- Key Laboratory of Tarim Oasis Agriculture, Ministry of Education, Tarim University, Alaer 843300, China
| | - Yasen Qin
- College of Information Engineering, Tarim University, Alaer 843300, China; (Q.W.); (N.Y.); (Y.Q.)
- Key Laboratory of Tarim Oasis Agriculture, Ministry of Education, Tarim University, Alaer 843300, China
| | - Xuedong Zhang
- College of Information Engineering, Tarim University, Alaer 843300, China; (Q.W.); (N.Y.); (Y.Q.)
| | - Xu Li
- College of Information Engineering, Tarim University, Alaer 843300, China; (Q.W.); (N.Y.); (Y.Q.)
| |
Collapse
|
2
|
Islam M, Azad A, Arman SE, Alyami SA, Hasan MM. PlantCareNet: an advanced system to recognize plant diseases with dual-mode recommendations for prevention. PLANT METHODS 2025; 21:52. [PMID: 40264213 PMCID: PMC12016399 DOI: 10.1186/s13007-025-01366-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/19/2025] [Accepted: 03/24/2025] [Indexed: 04/24/2025]
Abstract
Plant diseases adversely affect the agricultural sector by substantially affecting food security and limiting production. We introduce PlantCareNet, a novel, automated, end-to-end diagnostic system for plant diseases that can also offer interactive guidance to users. The system utilizes a dual mode strategy that integrates advanced deep learning algorithms for precise disease diagnosis with a knowledge-based framework guided by experts for preventive measures. The proposed architecture utilizes a convolutional neural network (CNN) to examine images of plant leaves, with the final block flattened and subsequently forwarded to Dense-100 and ultimately Dense-35 for the precise classification of various plant diseases. Subsequently, PlantCareNet promptly offers two types of recommendations: automated suggestions based on identified symptoms and expert-guided advice for personalized treatment. Both categories of recommendations are accessible immediately. The experimental findings indicate that PlantCareNet can accurately diagnose diseases in five well-known datasets, with an accuracy between 82% and 97%, outperforming notable models like Inception and ResNet in most cases. The overall approach demonstrates advancement by surpassing lightweight CNN models with 97% precision and an average inference time of 0.0021 s, hence offering farmers precise and quick actions for remedy. This study emphasises a novel blend of artificial intelligence-driven recognition and expert consultation, which contributes to the advancement of sustainable agriculture practices.
Collapse
Affiliation(s)
- Muhaiminul Islam
- Department of Robotics and Machatronics Engineering, Faculty of Engineering and Technology, University of Dhaka, Dhaka, 1000, Bangladesh
| | - Akm Azad
- Department of Mathematics and Statistics, Faculty of Science, Imam Mohammad Ibn Saud Islamic University, Riyadh, 13318, Saudi Arabia
| | - Shifat E Arman
- Department of Robotics and Machatronics Engineering, Faculty of Engineering and Technology, University of Dhaka, Dhaka, 1000, Bangladesh
| | - Salem A Alyami
- Department of Mathematics and Statistics, Faculty of Science, Imam Mohammad Ibn Saud Islamic University, Riyadh, 13318, Saudi Arabia.
| | - Md Mehedi Hasan
- Department of Robotics and Machatronics Engineering, Faculty of Engineering and Technology, University of Dhaka, Dhaka, 1000, Bangladesh.
| |
Collapse
|
3
|
Raufer L, Wiedey J, Mueller M, Penava P, Buettner R. A deep learning-based approach for the detection of cucumber diseases. PLoS One 2025; 20:e0320764. [PMID: 40215456 PMCID: PMC11991725 DOI: 10.1371/journal.pone.0320764] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2024] [Accepted: 02/24/2025] [Indexed: 04/14/2025] Open
Abstract
Cucumbers play a significant role as a greenhouse crop globally. In numerous countries, they are fundamental to dietary practices, contributing significantly to the nutritional patterns of various populations. Due to unfavorable environmental conditions, they are highly vulnerable to various diseases. Therefore the accurate detection of cucumber diseases is essential for maintaining crop quality and ensuring food security. Traditional methods, reliant on human inspection, are prone to errors, especially in the early stages of disease progression. Based on a VGG19 architecture, this paper uses an innovative transfer learning approach for detecting and classifying cucumber diseases, showing the applicability of artificial intelligence in this area. The model effectively distinguishes between healthy and diseased cucumber images, including Anthracnose, Bacterial Wilt, Belly Rot, Downy Mildew, Fresh Cucumber, Fresh Leaf, Pythium Fruit Rot, and Gummy Stem Blight. Using this novel approach, a balanced accuracy of 97.66% on unseen test data is achieved, compared to a balanced accuracy of 93.87% obtained with the conventional transfer learning approach, where fine-tuning is employed. This result sets a new benchmark within the dataset, highlighting the potential of deep learning techniques in agricultural disease detection. By enabling early disease diagnosis and informed agricultural management, this research contributes to enhancing crop productivity and sustainability.
Collapse
Affiliation(s)
- Lars Raufer
- Chair of Information Systems and Data Science, University of Bayreuth, 95447 Bayreuth, Germany
| | - Jasper Wiedey
- Chair of Information Systems and Data Science, University of Bayreuth, 95447 Bayreuth, Germany
| | - Malte Mueller
- Chair of Information Systems and Data Science, University of Bayreuth, 95447 Bayreuth, Germany
| | - Pascal Penava
- Chair of Hybrid Intelligence, Helmut-Schmidt-University / University of the Federal Armed Forces Hamburg, 22043 Hamburg, Germany
| | - Ricardo Buettner
- Chair of Hybrid Intelligence, Helmut-Schmidt-University / University of the Federal Armed Forces Hamburg, 22043 Hamburg, Germany
| |
Collapse
|
4
|
Srivathsan MS, Jenish SA, Arvindhan K, Karthik R. An explainable hybrid feature aggregation network with residual inception positional encoding attention and EfficientNet for cassava leaf disease classification. Sci Rep 2025; 15:11750. [PMID: 40189680 PMCID: PMC11973141 DOI: 10.1038/s41598-025-95985-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2024] [Accepted: 03/25/2025] [Indexed: 04/09/2025] Open
Abstract
Cassava is a tuberous edible plant native to the American tropics and is essential for its versatile applications including cassava flour, bread, tapioca, and laundry starch. Cassava leaf diseases reduce crop yields, elevate production costs, and disrupt market stability. This places significant burdens on farmers and economies while highlighting the need for effective management strategies. Traditional methods of manual disease diagnosis are costly, labor-intensive, and time-consuming. This research aims to address the challenge of accurate disease classification by overcoming the limitations of existing methods, which encounter difficulties with the complexity and variability of leaf disease symptoms. To the best of our knowledge, this is the first study to propose a novel dual-track feature aggregation architecture that integrates the Residual Inception Positional Encoding Attention (RIPEA) Network with EfficientNet for the classification of cassava leaf diseases. The proposed model employs a dual-track feature aggregation architecture which integrates the RIPEA Network with EfficientNet. The RIPEA track extracts significant features by leveraging residual connections for preserving gradients and uses multi-scale feature fusion for combining fine-grained details with broader patterns. It also incorporates Coordinate and Mixed Attention mechanisms which focus on cross-channel and long-range dependencies. The extracted features from both tracks are aggregated for classification. Furthermore, it incorporates an image augmentation method and a cosine decay learning rate schedule to improve model training. This improves the ability of the model to accurately differentiate between Cassava Bacterial Blight (CBB), Brown Streak Disease (CBSD), Green Mottle (CGM), Mosaic Disease (CMD), and healthy leaves, addressing both local textures and global structures. Additionally, to enhance the interpretability of the model, we apply Grad-CAM to provide visual explanations for the model's decision-making process, helping to understand which regions of the leaf images contribute to the classification results. The proposed network achieved a classification accuracy of 93.06%.
Collapse
Affiliation(s)
- M Sundara Srivathsan
- School of Electronics Engineering, Vellore Institute of Technology, Chennai, India
| | - S Alden Jenish
- School of Electronics Engineering, Vellore Institute of Technology, Chennai, India
| | - K Arvindhan
- School of Electronics Engineering, Vellore Institute of Technology, Chennai, India
| | - R Karthik
- Centre for Cyber Physical Systems, Vellore Institute of Technology, Chennai, India.
| |
Collapse
|
5
|
Zhang H, Li S, Xie J, Chen Z, Chen J, Guo J. VMamba for plant leaf disease identification: design and experiment. FRONTIERS IN PLANT SCIENCE 2025; 16:1515021. [PMID: 40241820 PMCID: PMC12000097 DOI: 10.3389/fpls.2025.1515021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/22/2024] [Accepted: 03/13/2025] [Indexed: 04/18/2025]
Abstract
Introduction The rapid spread of crop diseases poses a severe threat to agricultural production, significantly reducing both the yield and quality of crops. In recent years, plant disease recognition technologies based on machine vision and artificial intelligence have made significant progress. However, current mainstream deep learning architectures still face numerous challenges in detecting agricultural plant diseases. These include issues such as the complexity of agricultural environments and the reduced accuracy and increased training time caused by small sample sizes of agricultural plant diseases. Methods To address these challenges, we introduce the VMamba visual backbone model into the task of detecting agricultural plant diseases. This model effectively reduces computational complexity through a selective scanning mechanism while significantly improving classification accuracy by maintaining a global receptive field and leveraging dynamic weighting advantages. Our study proposes the DDHTLVMamba method, which combines VMamba with diffusion models and transfer learning techniques, and applies it to the detection of plant diseases in small-sample agricultural datasets. This research evaluates the performance of VMamba across different datasets and training methods, conducting comparative analyses with mainstream deep learning architectures. Results and discussion Experimental results demonstrate that the VMamba model outperforms mainstream models such as ResNet50, Vision Transformer, and Swin Transformer in disease recognition accuracy, whether on large-scale datasets like PlantVillage or optimized small-sample disease datasets, showcasing superior performance. Compared to Swin Transformer, VMamba achieves a 3.49% increase in accuracy while reducing training time by 80%. Furthermore, the proposed DDHTLVMamba training method demonstrates its effectiveness on small-sample datasets, significantly reducing pre-training time while maintaining recognition accuracy comparable to that achieved with large-sample transfer learning. This study provides an innovative approach for the efficient identification of agricultural diseases and is expected to advance the development of intelligent agricultural disease prevention and control technologies.
Collapse
Affiliation(s)
| | | | | | | | | | - Jianwen Guo
- School of Mechanical Engineering, Dongguan University of Technology, Dongguan, China
| |
Collapse
|
6
|
Wang Y, Wang Q, Su Y, Jing B, Feng M. Detection of kidney bean leaf spot disease based on a hybrid deep learning model. Sci Rep 2025; 15:11185. [PMID: 40169647 PMCID: PMC11961604 DOI: 10.1038/s41598-025-93742-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2025] [Accepted: 03/10/2025] [Indexed: 04/03/2025] Open
Abstract
Rapid diagnosis of kidney bean leaf spot disease is crucial for ensuring crop health and increasing yield. However, traditional machine learning methods face limitations in feature extraction, while deep learning approaches, despite their advantages, are computationally expensive and do not always yield optimal results. Moreover, reliable datasets for kidney bean leaf spot disease remain scarce. To address these challenges, this study constructs the first-ever kidney bean leaf spot disease (KBLD) dataset, filling a significant gap in the field. Based on this dataset, a novel hybrid deep learning model framework is proposed, which integrates deep learning models (EfficientNet-B7, MobileNetV3, ResNet50, and VGG16) for feature extraction with machine learning algorithms (Logistic Regression, Random Forest, AdaBoost, and Stochastic Gradient Boosting) for classification. By leveraging the Optuna tool for hyperparameter optimization, 16 combined models were evaluated. Experimental results show that the hybrid model combining EfficientNet-B7 and Stochastic Gradient Boosting achieves the highest detection accuracy of 96.26% on the KBLD dataset, with an F1-score of 0.97. The innovations of this study lie in the construction of a high-quality KBLD dataset and the development of a novel framework combining deep learning and machine learning, significantly improving the detection efficiency and accuracy of kidney bean leaf spot disease. This research provides a new approach for intelligent diagnosis and management of crop diseases in precision agriculture, contributing to increased agricultural productivity and ensuring food security.
Collapse
Affiliation(s)
- Yiwei Wang
- College of Agriculture, Shanxi Agricultural University, Jinzhong, China
| | - Qianyu Wang
- College of Agriculture, Shanxi Agricultural University, Jinzhong, China
| | - Yue Su
- College of Agriculture, Shanxi Agricultural University, Jinzhong, China
| | - Binghan Jing
- College of Agriculture, Shanxi Agricultural University, Jinzhong, China
| | - Meichen Feng
- College of Agriculture, Shanxi Agricultural University, Jinzhong, China.
| |
Collapse
|
7
|
Ham JY, Kim YT, Ha STT, In BC. Vase-Life Monitoring System for Cut Flowers Using Deep Learning and Multiple Cameras. PLANTS (BASEL, SWITZERLAND) 2025; 14:1076. [PMID: 40219143 PMCID: PMC11991080 DOI: 10.3390/plants14071076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/24/2025] [Revised: 02/13/2025] [Accepted: 03/24/2025] [Indexed: 04/14/2025]
Abstract
Here, we developed a vase-life monitoring system (VMS) to automatically and accurately assess the post-harvest quality and vase life (VL) of cut roses. The VMS integrates camera imaging with the YOLOv8 (You Only Look Once version 8) deep learning algorithm to continuously monitor major physiological parameters including flower opening, fresh weight, water uptake, and gray mold disease incidence. Our results showed that the VMS can automatically measure the main physiological factors of cut roses by obtaining precise and consistent data. The values measured for physiology and disease by the VMS closely correlated with those measured by observation (OBS). Additionally, YOLOv8 achieved a high performance in the model by obtaining an object detection accuracy of 90%. Additionally, the mAP0.5 supported the high accuracy of the model in evaluating the VL of cut roses. Regression analysis revealed a strong correlation between the VL, VMS, and OBS. The VMS incorporating the microscope detected physiological and disease factors in the early stages of development. These results show that the plant monitoring system incorporating a microscope is highly effective for evaluating the post-harvest quality of cut roses. The early detection method using the VMS could also be applied to the flower breeding process, which requires rapid measurements of important characteristics of flower species, such as VL and disease resistance, to develop superior cultivars.
Collapse
Affiliation(s)
| | | | | | - Byung-Chun In
- Department of Smart Horticultural Science, Andong National University, Andong 36729, Republic of Korea; (J.Y.H.); (Y.-T.K.); (S.T.T.H.)
| |
Collapse
|
8
|
Yin J, Li W, Shen J, Zhou C, Li S, Suo J, Yang J, Jia R, Lv C. A Diffusion-Based Detection Model for Accurate Soybean Disease Identification in Smart Agricultural Environments. PLANTS (BASEL, SWITZERLAND) 2025; 14:675. [PMID: 40094551 PMCID: PMC11902056 DOI: 10.3390/plants14050675] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/05/2025] [Revised: 02/18/2025] [Accepted: 02/20/2025] [Indexed: 03/19/2025]
Abstract
Accurate detection of soybean diseases is a critical component in achieving intelligent agricultural management. However, traditional methods often underperform in complex field scenarios. This paper proposes a diffusion-based object detection model that integrates the endogenous diffusion sub-network and the endogenous diffusion loss function to progressively optimize feature distributions, significantly enhancing detection performance for complex backgrounds and diverse disease regions. Experimental results demonstrate that the proposed method outperforms multiple baseline models, achieving a precision of 94%, recall of 90%, accuracy of 92%, and mAP@50 and mAP@75 of 92% and 91%, respectively, surpassing RetinaNet, DETR, YOLOv10, and DETR v2. In fine-grained disease detection, the model performs best on rust detection, with a precision of 96% and a recall of 93%. For more complex diseases such as bacterial blight and Fusarium head blight, precision and mAP exceed 90%. Compared to self-attention and CBAM, the proposed endogenous diffusion attention mechanism further improves feature extraction accuracy and robustness. This method demonstrates significant advantages in both theoretical innovation and practical application, providing critical technological support for intelligent soybean disease detection.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | | | - Chunli Lv
- China Agricultural University, Beijing 100083, China
| |
Collapse
|
9
|
Lee YS, Patil MP, Kim JG, Seo YB, Ahn DH, Kim GD. Hyperparameter Optimization for Tomato Leaf Disease Recognition Based on YOLOv11m. PLANTS (BASEL, SWITZERLAND) 2025; 14:653. [PMID: 40094534 PMCID: PMC11901684 DOI: 10.3390/plants14050653] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/20/2025] [Revised: 02/17/2025] [Accepted: 02/17/2025] [Indexed: 03/19/2025]
Abstract
The automated recognition of disease in tomato leaves can greatly enhance yield and allow farmers to manage challenges more efficiently. This study investigates the performance of YOLOv11 for tomato leaf disease recognition. All accessible versions of YOLOv11 were first fine-tuned on an improved tomato leaf disease dataset consisting of a healthy class and 10 disease classes. YOLOv11m was selected for further hyperparameter optimization based on its evaluation metrics. It achieved a fitness score of 0.98885, with a precision of 0.99104, a recall of 0.98597, and a mAP@.5 of 0.99197. This model underwent rigorous hyperparameter optimization using the one-factor-at-a-time (OFAT) algorithm, with a focus on essential parameters such as batch size, learning rate, optimizer, weight decay, momentum, dropout, and epochs. Subsequently, random search (RS) with 100 configurations was performed based on the results of OFAT. Among them, the C47 model demonstrated a fitness score of 0.99268 (a 0.39% improvement), with a precision of 0.99190 (0.09%), a recall of 0.99348 (0.76%), and a mAP@.5 of 0.99262 (0.07%). The results suggest that the final model works efficiently and is capable of accurately detecting and identifying tomato leaf diseases, making it suitable for practical farming applications.
Collapse
Affiliation(s)
- Yong-Suk Lee
- Department of Food Science and Technology/Institute of Food Science, Pukyong National University, Busan 48513, Republic of Korea;
- Industry University Cooperation Foundation, Pukyong National University, Busan 48513, Republic of Korea;
| | - Maheshkumar Prakash Patil
- Industry University Cooperation Foundation, Pukyong National University, Busan 48513, Republic of Korea;
| | - Jeong Gyu Kim
- Department of Microbiology, Pukyong National University, Busan 48513, Republic of Korea; (J.G.K.); (Y.B.S.)
| | - Yong Bae Seo
- Department of Microbiology, Pukyong National University, Busan 48513, Republic of Korea; (J.G.K.); (Y.B.S.)
| | - Dong-Hyun Ahn
- Department of Food Science and Technology/Institute of Food Science, Pukyong National University, Busan 48513, Republic of Korea;
| | - Gun-Do Kim
- Department of Microbiology, Pukyong National University, Busan 48513, Republic of Korea; (J.G.K.); (Y.B.S.)
| |
Collapse
|
10
|
Xie Z, Li L, Hou W, Fan Z, Zeng L, He L, Ji Y, Zhang J, Wang F, Xing Z, Wang Y, Ye Y. Critical role of Oas1g and STAT1 pathways in neuroinflammation: insights for Alzheimer's disease therapeutics. J Transl Med 2025; 23:182. [PMID: 39953505 PMCID: PMC11829366 DOI: 10.1186/s12967-025-06112-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2024] [Accepted: 01/08/2025] [Indexed: 02/17/2025] Open
Abstract
BACKGROUND Alzheimer's disease (AD) has a significant impact on an individual's health and places a heavy burden on society. Studies have emphasized the importance of microglia in the progression and development of AD. Interferon responses and Interferon-stimulated genes (ISGs) significantly function in neuroinflammatory and neurodegenerative diseases involving AD. Therefore, further exploration of the relationship among microglia, ISGs, and neuroinflammation in AD is warranted. METHODS Microglia datasets from the GEO database were retrieved, along with additional microglia RNA-seq data from laboratory mice. Weighted Correlation Network Analysis was used on the training dataset to identify gene co-expression networks. Genes from the black module were intersected with interferon-stimulated genes, and differentially expressed genes (DEGs) were identified. Machine learning algorithms were applied to DEGs, and genes selected by both methods were identified as hub genes, with ROC curves used to evaluate their diagnostic accuracy. Gene Set Enrichment Analysis was performed to reveal functional pathways closely relating to hub genes. Microglia cells were transfected with siRNAs targeting Oas1g and STAT1. Total RNA from microglia cells and mouse brain tissues was extracted, reverse-transcribed, and analyzed via qRT-PCR. Proteins were extracted from cells, quantified, separated by SDS-PAGE, transferred to PVDF membranes, and probed with antibodies. Microglia cells were fixed, permeabilized, blocked, and stained with antibodies for STAT1, then visualized and photographed. RESULTS Bioinformatics and machine learning algorithms revealed that Oas1g was identified as a hub gene, with an AUC of 0.812. Enrichment Analysis revealed that Oas1g is closely associated with interferon-related pathways. Expression of Oas1g was validated in AD mouse models, where it was significantly upregulated after microglial activation. Knockdown experiments suggested siOas1g attenuated the effect of siSTAT1, and the expressions of STAT1 and p-STAT1 were elevated. siOas1g could reverse the effect of siSTAT1, indicating that Oas1g potentially regulates the ISGs through the STAT1 pathway. CONCLUSION We demonstrated that Oas1g was identified as a hub ISG in AD and can downregulate the activation of IFN-β and STAT1, reducing the expression of ISGs in neuroinflammation. Oas1g might potentially be a beneficial candidate for both prevention and treatment of AD.
Collapse
Affiliation(s)
- Zhixin Xie
- The Second Clinical Medicine School, Guangzhou Medical University, Guangzhou, China
| | - Linxi Li
- Department of Neurosurgery, Institute of Neuroscience, the Second Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Weizhong Hou
- The Second Clinical Medicine School, Guangzhou Medical University, Guangzhou, China
| | - Zhongxi Fan
- The Third Clinical Medicine School, Guangzhou Medical University, Guangzhou, China
| | - Lifan Zeng
- The Third Clinical Medicine School, Guangzhou Medical University, Guangzhou, China
| | - Limin He
- The Sixth Clinical Medicine School, Guangzhou Medical University, Guangzhou, China
| | - Yunxiang Ji
- Department of Neurosurgery, Institute of Neuroscience, the Second Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Jingbai Zhang
- Department of Neurosurgery, Institute of Neuroscience, the Second Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Fangran Wang
- Department of Neurosurgery, Institute of Neuroscience, the Second Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Zhou Xing
- Department of Neurosurgery, Institute of Neuroscience, the Second Affiliated Hospital of Guangzhou Medical University, Guangzhou, China.
| | - Yezhong Wang
- Department of Neurosurgery, Institute of Neuroscience, the Second Affiliated Hospital of Guangzhou Medical University, Guangzhou, China.
| | - Yongyi Ye
- Department of Neurosurgery, Institute of Neuroscience, the Second Affiliated Hospital of Guangzhou Medical University, Guangzhou, China.
| |
Collapse
|
11
|
Uzhinskiy A. Evaluation of Different Few-Shot Learning Methods in the Plant Disease Classification Domain. BIOLOGY 2025; 14:99. [PMID: 39857329 PMCID: PMC11762969 DOI: 10.3390/biology14010099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/13/2024] [Revised: 01/14/2025] [Accepted: 01/17/2025] [Indexed: 01/27/2025]
Abstract
Early detection of plant diseases is crucial for agro-holdings, farmers, and smallholders. Various neural network architectures and training methods have been employed to identify optimal solutions for plant disease classification. However, research applying one-shot or few-shot learning approaches, based on similarity determination, to the plantdisease classification domain remains limited. This study evaluates different loss functions used in similarity learning, including Contrastive, Triplet, Quadruplet, SphereFace, CosFace, and ArcFace, alongside various backbone networks, such as MobileNet, EfficientNet, ConvNeXt, and ResNeXt. Custom datasets of real-life images, comprising over 4000 samples across 68 classes of plant diseases, pests, and their effects, were utilized. The experiments evaluate standard transfer learning approaches alongside similarity learning methods based on two classes of loss function. Results demonstrate the superiority of cosine-based methods over Siamese networks in embedding extraction for disease classification. Effective approaches for model organization and training are determined. Additionally, the impact of data normalization is tested, and the generalization ability of the models is assessed using a special dataset consisting of 400 images of difficult-to-identify plant disease cases.
Collapse
|
12
|
Tanveer MU, Munir K, Raza A, Abualigah L, Garay H, Gonzalez LEP, Ashraf I. Novel Transfer Learning Approach for Detecting Infected and Healthy Maize Crop Using Leaf Images. Food Sci Nutr 2025; 13:e4655. [PMID: 39803246 PMCID: PMC11717004 DOI: 10.1002/fsn3.4655] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2024] [Revised: 11/18/2024] [Accepted: 11/23/2024] [Indexed: 01/16/2025] Open
Abstract
Maize is a staple crop worldwide, essential for food security, livestock feed, and industrial uses. Its health directly impacts agricultural productivity and economic stability. Effective detection of maize crop health is crucial for preventing disease spread and ensuring high yields. This study presents VG-GNBNet, an innovative transfer learning model that accurately detects healthy and infected maize crops through a two-step feature extraction process. The proposed model begins by leveraging the visual geometry group (VGG-16) network to extract initial pixel-based spatial features from the crop images. These features are then further refined using the Gaussian Naive Bayes (GNB) model and feature decomposition-based matrix factorization mechanism, which generates more informative features for classification purposes. This study incorporates machine learning models to ensure a comprehensive evaluation. By comparing VG-GNBNet's performance against these models, we validate its robustness and accuracy. Integrating deep learning and machine learning techniques allows VG-GNBNet to capitalize on the strengths of both approaches, leading to superior performance. Extensive experiments demonstrate that the proposed VG-GNBNet+GNB model significantly outperforms other models, achieving an impressive accuracy score of 99.85%. This high accuracy highlights the model's potential for practical application in the agricultural sector, where the precise detection of crop health is crucial for effective disease management and yield optimization.
Collapse
Affiliation(s)
- Muhammad Usama Tanveer
- Institute of Information Technology, Khwaja Fareed University of Engineering and Information TechnologyRahim Yar KhanPakistan
| | - Kashif Munir
- Institute of Information Technology, Khwaja Fareed University of Engineering and Information TechnologyRahim Yar KhanPakistan
| | - Ali Raza
- Department of Software EngineeringUniversity of LahoreLahorePakistan
| | - Laith Abualigah
- Computer Science DepartmentAl al‐Bayt UniversityMafraqJordan
- Centre for Research Impact & OutcomeChitkara University Institute of Engineering and TechnologyRajpuraIndia
- Applied Science Research CenterApplied Science Private UniversityAmmanJordan
| | - Helena Garay
- Universidad Europea del AtlanticoSantanderSpain
- Universidade Internacional Do CuanzaCuitoAngola
- Universidad de La RomanaLa RomanaDominican Republic
| | - Luis Eduardo Prado Gonzalez
- Universidad Europea del AtlanticoSantanderSpain
- Universidad Internacional IberoamericanaCampecheMexico
- Fundacion Universitaria Internacional de ColombiaBogotaColombia
| | - Imran Ashraf
- Department of Information & Communication EngineeringYeungnam UniversityGyeongsan‐siKorea
| |
Collapse
|
13
|
Bai C, Zhang L, Gao L, Peng L, Li P, Yang L. DINOV2-FCS: a model for fruit leaf disease classification and severity prediction. FRONTIERS IN PLANT SCIENCE 2024; 15:1475282. [PMID: 39711594 PMCID: PMC11658969 DOI: 10.3389/fpls.2024.1475282] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/03/2024] [Accepted: 11/20/2024] [Indexed: 12/24/2024]
Abstract
Introduction The assessment of the severity of fruit disease is crucial for the optimization of fruit production. By quantifying the percentage of leaf disease, an effective approach to determining the severity of the disease is available. However, the current prediction of disease degree by machine learning methods still faces challenges, including suboptimal accuracy and limited generalizability. Methods In light of the growing application of large model technology across a range of fields, this study draws upon the DINOV2 visual large vision model backbone network to construct the DINOV2-Fruit Leaf Classification and Segmentation Model (DINOV2-FCS), a model designed for the classification and severity prediction of diverse fruit leaf diseases. DINOV2-FCS employs the DINOv2-B (distilled) backbone feature extraction network to enhance the extraction of features from fruit disease leaf images. In fruit leaf disease classification, for the problem that leaf spots of different diseases have great similarity, we have proposed Class-Patch Feature Fusion Module (C-PFFM), which integrates the local detailed feature information of the spots and the global feature information of the class markers. For the problem that the model ignores the fine spots in the segmentation process, we propose Explicit Feature Fusion Architecture (EFFA) and Alterable Kernel Atrous Spatial Pyramid Pooling (AKASPP), which improve the segmentation effect of the model. Results To verify the accuracy and generalizability of the model, two sets of experiments were conducted. First, the labeled leaf disease dataset of five fruits was randomly divided. The trained model exhibited an accuracy of 99.67% in disease classification, an mIoU of 90.29%, and an accuracy of 95.68% in disease severity classification. In the generalizability experiment, four disease data sets were used for training and one for testing. The mIoU of the trained model reached 83.95%, and the accuracy of disease severity grading was 95.24%. Discussion The results demonstrate that the model exhibits superior performance compared to other state-of-the-art models and that the model has strong generalization capabilities. This study provides a new method for leaf disease classification and leaf disease severity prediction for a variety of fruits. Code is available at https://github.com/BaiChunhui2001/DINOV2-FCS.
Collapse
Affiliation(s)
- Chunhui Bai
- College of Big Data, Yunnan Agricultural University, Kunming, China
- Yunnan Engineering Technology Research Center of Agricultural Big Data, Kunming, China
- Yunnan Engineering Research Center for Big Data Intelligent Information Processing of Green Agricultural Products, Kunming, China
| | - Lilian Zhang
- College of Big Data, Yunnan Agricultural University, Kunming, China
- Yunnan Engineering Technology Research Center of Agricultural Big Data, Kunming, China
- Yunnan Engineering Research Center for Big Data Intelligent Information Processing of Green Agricultural Products, Kunming, China
| | - Lutao Gao
- College of Big Data, Yunnan Agricultural University, Kunming, China
- Yunnan Engineering Technology Research Center of Agricultural Big Data, Kunming, China
- Yunnan Engineering Research Center for Big Data Intelligent Information Processing of Green Agricultural Products, Kunming, China
| | - Lin Peng
- College of Big Data, Yunnan Agricultural University, Kunming, China
- Yunnan Engineering Technology Research Center of Agricultural Big Data, Kunming, China
- Yunnan Engineering Research Center for Big Data Intelligent Information Processing of Green Agricultural Products, Kunming, China
| | - Peishan Li
- College of Big Data, Yunnan Agricultural University, Kunming, China
- Yunnan Engineering Technology Research Center of Agricultural Big Data, Kunming, China
- Yunnan Engineering Research Center for Big Data Intelligent Information Processing of Green Agricultural Products, Kunming, China
| | - Linnan Yang
- College of Big Data, Yunnan Agricultural University, Kunming, China
- Yunnan Engineering Technology Research Center of Agricultural Big Data, Kunming, China
- Yunnan Engineering Research Center for Big Data Intelligent Information Processing of Green Agricultural Products, Kunming, China
| |
Collapse
|
14
|
Fu Z, Yin L, Cui C, Wang Y. A lightweight MHDI-DETR model for detecting grape leaf diseases. FRONTIERS IN PLANT SCIENCE 2024; 15:1499911. [PMID: 39711587 PMCID: PMC11659005 DOI: 10.3389/fpls.2024.1499911] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/03/2024] [Accepted: 11/18/2024] [Indexed: 12/24/2024]
Abstract
Accurate diagnosis of grape leaf diseases is critical in agricultural production, yet existing detection techniques face challenges in achieving model lightweighting while ensuring high accuracy. In this study, a real-time, end-to-end, lightweight grape leaf disease detection model, MHDI-DETR, based on an improved RT-DETR architecture, is presented to address these challenges. The original residual backbone network was improved using the MobileNetv4 network, significantly reducing the model's computational requirements and complexity. Additionally, a lightSFPN feature fusion structure is presented, combining the Hierarchical Scale Feature Pyramid Network with the Dilated Reparam Block structure design from the UniRepLKNet network. This structure is designed to overcome the challenges of capturing complex high-level and subtle low-level features, and it uses Efficient Local Attention to focus more efficiently on regions of interest, thereby enhancing the model's ability to detect complex targets while improving accuracy and inference speed. Finally, the integration of GIou and Focaler-IoU into Focaler-GIoU enhances detection accuracy and convergence speed for small targets by focusing more effectively on both simple and difficult samples. The findings from the experiments suggest that The MHDI-DETR model results in a 56% decrease in parameters and a 49% reduction in floating-point operations, respectively, compared with the RT-DETR model, in terms of accuracy, the model achieved precision rates of 96.9%, 92.6%, and 72.5% for accuracy, mAP50, and mAP50:95, respectively. Compared with the RT-DETR model, these represent improvements of 1.9%, 1.2%, and 1.2%. Overall, the MHDI-DETR model surpasses the RT-DETR and other mainstream detection models in both detection accuracy and degree of lightness, achieving dual optimization in efficiency and accuracy, and providing an efficient technical solution for automated agricultural disease management.
Collapse
|
15
|
Nanavaty A, Sharma R, Pandita B, Goyal O, Rallapalli S, Mandal M, Singh VK, Narang P, Chamola V. Integrating deep learning for visual question answering in Agricultural Disease Diagnostics: Case Study of Wheat Rust. Sci Rep 2024; 14:28203. [PMID: 39548249 PMCID: PMC11568177 DOI: 10.1038/s41598-024-79793-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2024] [Accepted: 11/12/2024] [Indexed: 11/17/2024] Open
Abstract
This paper presents a novel approach to agricultural disease diagnostics through the integration of Deep Learning (DL) techniques with Visual Question Answering (VQA) systems, specifically targeting the detection of wheat rust. Wheat rust is a pervasive and destructive disease that significantly impacts wheat production worldwide. Traditional diagnostic methods often require expert knowledge and time-consuming processes, making rapid and accurate detection challenging. We drafted a new, WheatRustDL2024 dataset (7998 images of healthy and infected leaves) specifically designed for VQA in the context of wheat rust detection and utilized it to retrieve the initial weights on the federated learning server. This dataset comprises high-resolution images of wheat plants, annotated with detailed questions and answers pertaining to the presence, type, and severity of rust infections. Our dataset also contains images collected from various sources and successfully highlights a wide range of conditions (different lighting, obstructions in the image, etc.) in which a wheat image may be taken, therefore making a generalized universally applicable model. The trained model was federated using Flower. Following extensive analysis, the chosen central model was ResNet. Our fine-tuned ResNet achieved an accuracy of 97.69% on the existing data. We also implemented the BLIP (Bootstrapping Language-Image Pre-training) methods that enable the model to understand complex visual and textual inputs, thereby improving the accuracy and relevance of the generated answers. The dual attention mechanism, combined with BLIP techniques, allows the model to simultaneously focus on relevant image regions and pertinent parts of the questions. We also created a custom dataset (WheatRustVQA) with our augmented dataset containing 1800 augmented images and their associated question-answer pairs. The model fetches an answer with an average BLEU score of 0.6235 on our testing partition of the dataset. This federated model is lightweight and can be seamlessly integrated into mobile phones, drones, etc. without any hardware requirement. Our results indicate that integrating deep learning with VQA for agricultural disease diagnostics not only accelerates the detection process but also reduces dependency on human experts, making it a valuable tool for farmers and agricultural professionals. This approach holds promise for broader applications in plant pathology and precision agriculture and can consequently address food security issues.
Collapse
Affiliation(s)
- Akash Nanavaty
- Department of Computer Science and Information Systems, Birla Institute of Technology and Science, Pilani, Rajasthan, 333031, India
| | - Rishikesh Sharma
- Department of Civil Engineering, Birla Institute of Technology and Science, Pilani, Rajasthan, 333031, India
| | - Bhuman Pandita
- Department of Civil Engineering, Birla Institute of Technology and Science, Pilani, Rajasthan, 333031, India
| | - Ojasva Goyal
- Department of Civil Engineering, Birla Institute of Technology and Science, Pilani, Rajasthan, 333031, India
| | - Srinivas Rallapalli
- Department of Civil Engineering, Birla Institute of Technology and Science, Pilani, Rajasthan, 333031, India.
| | - Murari Mandal
- School of Computer Engineering, KIIT Bhubaneshwar, Patia, India
| | - Vaibhav Kumar Singh
- Division of Plant Pathology, ICAR-Indian Agricultural Research Institute, New Delhi, India.
| | - Pratik Narang
- Department of Computer Science and Information Systems, Birla Institute of Technology and Science, Pilani, Rajasthan, 333031, India
| | - Vinay Chamola
- Department of Electrical and Electronics Engineering, Birla Institute of Technology and Science, Pilani, Rajasthan, 333031, India
| |
Collapse
|
16
|
Jelali M. Deep learning networks-based tomato disease and pest detection: a first review of research studies using real field datasets. FRONTIERS IN PLANT SCIENCE 2024; 15:1493322. [PMID: 39524561 PMCID: PMC11543466 DOI: 10.3389/fpls.2024.1493322] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/08/2024] [Accepted: 10/04/2024] [Indexed: 11/16/2024]
Abstract
Recent advances in deep neural networks in terms of convolutional neural networks (CNNs) have enabled researchers to significantly improve the accuracy and speed of object recognition systems and their application to plant disease and pest detection and diagnosis. This paper presents the first comprehensive review and analysis of deep learning approaches for disease and pest detection in tomato plants, using self-collected field-based and benchmarking datasets extracted from real agricultural scenarios. The review shows that only a few studies available in the literature used data from real agricultural fields such as the PlantDoc dataset. The paper also reveals overoptimistic results of the huge number of studies in the literature that used the PlantVillage dataset collected under (controlled) laboratory conditions. This finding is consistent with the characteristics of the dataset, which consists of leaf images with a uniform background. The uniformity of the background images facilitates object detection and classification, resulting in higher performance-metric values for the models. However, such models are not very useful in agricultural practice, and it remains desirable to establish large datasets of plant diseases under real conditions. With some of the self-generated datasets from real agricultural fields reviewed in this paper, high performance values above 90% can be achieved by applying different (improved) CNN architectures such as Faster R-CNN and YOLO.
Collapse
Affiliation(s)
- Mohieddine Jelali
- Cologne Lab for Artificial Intelligence and Smart Automation (CAISA), Institute of Product Development and Engineering Design (IPK), TH Köln – University of Applied Sciences, Cologne, Germany
| |
Collapse
|
17
|
Zahir A, Ali Z, Al-Shamayleh AS, Bas SRA, Mahmood B, Al-Ghushami AH, Adnan R, Akhunzada A. Enhanced climate change resilience on wheat anther morphology using optimized deep learning techniques. Sci Rep 2024; 14:24533. [PMID: 39424825 PMCID: PMC11489760 DOI: 10.1038/s41598-024-74875-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2024] [Accepted: 09/30/2024] [Indexed: 10/21/2024] Open
Abstract
Wheat commands attention due to its significant impact on culture, nutrition, the economy, and the guarantee of food security. The anticipated rise in temperatures resulting from climate change is a key factor contributing to food insecurity, as it markedly reduces wheat harvests. Terminal heat stress mostly affects spike fertility in wheat, specifically influencing pollen fertility and anther morphology. This research especially focuses on the shape of anthers and examines the effects of heat stress. The DinoLite Microscope's high-resolution images are used to measure the length and width of wheat anthers. By using object identification techniques, the research accurately measures the length and width of each anther in images, offering valuable insights into the differences between various wheat varieties. Furthermore, Deep Learning (DL) methodologies are utilized to enhance agriculture, specifically employing record categorization to advance plant breeding management. Given the ongoing challenges in agriculture, there is a belief that incorporating the latest technologies is crucial. The primary objective of this study is to explore how Deep Learning algorithms can be beneficial in categorizing agricultural records, particularly in monitoring and identifying variations in spring wheat germplasm. Various Deep Learning algorithms, including Convolution Neural Network (CNN), LeNet, and Inception-V3 are implemented to classify the records and extract various patterns. LeNet demonstrates optimized accuracy in classifying the records, outperforming CNN by 52% and Inception-V3 by 70%. Moreover, Precision, Recall, and F1 Measure are utilized to ascertain accuracy levels. The investigation also enhances our comprehension of the distinct roles played by various genes in abiotic stress tolerance among diverse wheat varieties. The outcomes of the research hold the potential to transform agricultural practices by introducing a more effective, data-driven approach to plant breeding management.
Collapse
Affiliation(s)
- Arifa Zahir
- Department of Bioscience, COMSATS University, Islamabad, 45550, Pakistan
| | - Zulfiqar Ali
- Department of Computer Science, COMSATS University, Islamabad, 45550, Pakistan.
| | - Ahmad Sami Al-Shamayleh
- Department of Data Science and Artificial Intelligence, Faculty of Information Technology, Al-Ahliyya Amman University, Amman, Jordan
| | - Syed Raza Ab Bas
- Department of Bioscience, COMSATS University, Islamabad, 45550, Pakistan
| | - Basharat Mahmood
- Department of Computer Science, COMSATS University, Islamabad, 45550, Pakistan
| | | | - Rubina Adnan
- Department of Computer Science, COMSATS University, Islamabad, 45550, Pakistan
| | - Adnan Akhunzada
- College of Computing & IT, University of Doha for Science and Technology, Doha, Qatar
| |
Collapse
|
18
|
Zhou H, Huang D, Wu BM. Deep recognition of rice disease images: how many training samples do we really need? JOURNAL OF THE SCIENCE OF FOOD AND AGRICULTURE 2024; 104:8070-8078. [PMID: 38877787 DOI: 10.1002/jsfa.13636] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Revised: 04/27/2024] [Accepted: 05/23/2024] [Indexed: 06/16/2024]
Abstract
BACKGROUND With the rapid development of deep learning, the recognition of rice disease images using deep neural networks has become a hot research topic. However, most previous studies only focus on the modification of deep learning models, while lacking research to systematically and scientifically explore the impact of different data sizes on the image recognition task for rice diseases. In this study, a functional model was developed to predict the relationship between the size of dataset and the accuracy rate of model recognition. RESULTS Training VGG16 deep learning models with different quantities of images of rice blast-diseased leaves and healthy rice leaves, it was found that the test accuracy of the resulting models could be well fitted with an exponential model (A = 0.9965 - e(-0.0603×I50-1.6693)). Experimental results showed that with an increase of image quantity, the recognition accuracy of deep learning models would show a rapid increase at first. Yet when the image quantity increases beyond a certain threshold, the accuracy of image classification would not improve much, and the marginal benefit would be reduced. This trend remained similar when the composition of the dataset was changed, no matter whether (i) the disease class was changed, (ii) the number of classes was increased or (iii) the image data were augmented. CONCLUSIONS This study provided a scientific basis for the impact of data size on the accuracy of rice disease image recognition, and may also serve as a reference for researchers for database construction. © 2024 Society of Chemical Industry.
Collapse
Affiliation(s)
- Huiru Zhou
- College of Plant Protection, South China Agricultural University, Guangzhou, China
| | - Dong Huang
- College of Mathematics and Informatics, South China Agricultural University, Guangzhou, China
| | - Bo Ming Wu
- College of Plant Protection, China Agricultural University, Beijing, China
| |
Collapse
|
19
|
Xu M, Park JE, Lee J, Yang J, Yoon S. Plant disease recognition datasets in the age of deep learning: challenges and opportunities. FRONTIERS IN PLANT SCIENCE 2024; 15:1452551. [PMID: 39399537 PMCID: PMC11466843 DOI: 10.3389/fpls.2024.1452551] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/21/2024] [Accepted: 09/04/2024] [Indexed: 10/15/2024]
Abstract
Although plant disease recognition has witnessed a significant improvement with deep learning in recent years, a common observation is that current deep learning methods with decent performance tend to suffer in real-world applications. We argue that this illusion essentially comes from the fact that current plant disease recognition datasets cater to deep learning methods and are far from real scenarios. Mitigating this illusion fundamentally requires an interdisciplinary perspective from both plant disease and deep learning, and a core question arises. What are the characteristics of a desired dataset? This paper aims to provide a perspective on this question. First, we present a taxonomy to describe potential plant disease datasets, which provides a bridge between the two research fields. We then give several directions for making future datasets, such as creating challenge-oriented datasets. We believe that our paper will contribute to creating datasets that can help achieve the ultimate objective of deploying deep learning in real-world plant disease recognition applications. To facilitate the community, our project is publicly available at https://github.com/xml94/PPDRD with the information of relevant public datasets.
Collapse
Affiliation(s)
- Mingle Xu
- Department of Electronic Engineering, Core Research Institute of Intelligent Robots, Jeonbuk National University, Jeonju, Republic of Korea
| | - Ji-Eun Park
- Department of Electronic Engineering, Core Research Institute of Intelligent Robots, Jeonbuk National University, Jeonju, Republic of Korea
| | - Jaehwan Lee
- Department of Electronic Engineering, Core Research Institute of Intelligent Robots, Jeonbuk National University, Jeonju, Republic of Korea
| | - Jucheng Yang
- College of Artificial Intelligence, Tianjin University of Science and Technology, Tianjin, China
| | - Sook Yoon
- Department of Computer Engineering, Mokpo National University, Mokpo, Republic of Korea
| |
Collapse
|
20
|
Zhang X, Feng Q, Zhu D, Liang X, Zhang J. Compressing recognition network of cotton disease with spot-adaptive knowledge distillation. FRONTIERS IN PLANT SCIENCE 2024; 15:1433543. [PMID: 39391779 PMCID: PMC11464345 DOI: 10.3389/fpls.2024.1433543] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/16/2024] [Accepted: 09/05/2024] [Indexed: 10/12/2024]
Abstract
Deep networks play a crucial role in the recognition of agricultural diseases. However, these networks often come with numerous parameters and large sizes, posing a challenge for direct deployment on resource-limited edge computing devices for plant protection robots. To tackle this challenge for recognizing cotton diseases on the edge device, we adopt knowledge distillation to compress the big networks, aiming to reduce the number of parameters and the computational complexity of the networks. In order to get excellent performance, we conduct combined comparison experiments from three aspects: teacher network, student network and distillation algorithm. The teacher networks contain three classical convolutional neural networks, while the student networks include six lightweight networks in two categories of homogeneous and heterogeneous structures. In addition, we investigate nine distillation algorithms using spot-adaptive strategy. The results demonstrate that the combination of DenseNet40 as the teacher and ShuffleNetV2 as the student show best performance when using NST algorithm, yielding a recognition accuracy of 90.59% and reducing FLOPs from 0.29 G to 0.045 G. The proposed method can facilitate the lightweighting of the model for recognizing cotton diseases while maintaining high recognition accuracy and offer a practical solution for deploying deep models on edge computing devices.
Collapse
Affiliation(s)
- Xinwen Zhang
- School of Mechanical and Electrical Engineering, Gansu Agricultural University, Lanzhou, China
| | - Quan Feng
- School of Mechanical and Electrical Engineering, Gansu Agricultural University, Lanzhou, China
| | - Dongqin Zhu
- School of Mechanical and Electrical Engineering, Gansu Agricultural University, Lanzhou, China
| | - Xue Liang
- School of Mechanical and Electrical Engineering, Gansu Agricultural University, Lanzhou, China
| | - Jianhua Zhang
- Agricultural Information Institute, Chinese Academy of Agricultural Sciences, Beijing, China
- National Nanfan Research Institute, Chinese Academy of Agricultural Sciences, Sanya, China
| |
Collapse
|
21
|
Bouhouch Y, Esmaeel Q, Richet N, Barka EA, Backes A, Steffenel LA, Hafidi M, Jacquard C, Sanchez L. Deep Learning-Based Barley Disease Quantification for Sustainable Crop Production. PHYTOPATHOLOGY 2024; 114:2045-2054. [PMID: 38831567 DOI: 10.1094/phyto-02-24-0056-kc] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2024]
Abstract
Net blotch disease caused by Drechslera teres is a major fungal disease that affects barley (Hordeum vulgare) plants and can result in significant crop losses. In this study, we developed a deep learning model to quantify net blotch disease symptoms on different days postinfection on seedling leaves using Cascade R-CNN (region-based convolutional neural network) and U-Net (a convolutional neural network) architectures. We used a dataset of barley leaf images with annotations of net blotch disease to train and evaluate the model. The model achieved an accuracy of 95% for Cascade R-CNN in net blotch disease detection and a Jaccard index score of 0.99, indicating high accuracy in disease quantification and location. The combination of Cascade R-CNN and U-Net architectures improved the detection of small and irregularly shaped lesions in the images at 4 days postinfection, leading to better disease quantification. To validate the model developed, we compared the results obtained by automated measurement with a classical method (necrosis diameter measurement) and a pathogen detection by real-time PCR. The proposed deep learning model could be used in automated systems for disease quantification and to screen the efficacy of potential biocontrol agents to protect against disease.
Collapse
Affiliation(s)
- Yassine Bouhouch
- Université de Reims Champagne-Ardenne, Unité de recherche Résistance Induite et Bioprotection des Plantes (RIBP), EA 4707 USC INRAE 1488, Reims, France
- Faculté des sciences, Université Moulay Ismail, Laboratoire de biotechnologie végétale et de biologie moléculaire, B.P. 11201, Zitoune, Meknès, Maroc
| | - Qassim Esmaeel
- Université de Reims Champagne-Ardenne, Unité de recherche Résistance Induite et Bioprotection des Plantes (RIBP), EA 4707 USC INRAE 1488, Reims, France
| | - Nicolas Richet
- Université de Reims Champagne-Ardenne, Unité de recherche Résistance Induite et Bioprotection des Plantes (RIBP), EA 4707 USC INRAE 1488, Reims, France
| | - Essaïd Aït Barka
- Université de Reims Champagne-Ardenne, Unité de recherche Résistance Induite et Bioprotection des Plantes (RIBP), EA 4707 USC INRAE 1488, Reims, France
| | - Aurélie Backes
- Université de Reims Champagne-Ardenne, Unité de recherche Résistance Induite et Bioprotection des Plantes (RIBP), EA 4707 USC INRAE 1488, Reims, France
| | - Luiz Angelo Steffenel
- Université de Reims Champagne-Ardenne, LICIIS-Laboratoire d'Informatique en Calcul Intensif et Image pour la Simulation/LRC DIGIT URCA-CEA, Reims, France
| | - Majida Hafidi
- Faculté des sciences, Université Moulay Ismail, Laboratoire de biotechnologie végétale et de biologie moléculaire, B.P. 11201, Zitoune, Meknès, Maroc
| | - Cédric Jacquard
- Université de Reims Champagne-Ardenne, Unité de recherche Résistance Induite et Bioprotection des Plantes (RIBP), EA 4707 USC INRAE 1488, Reims, France
| | - Lisa Sanchez
- Université de Reims Champagne-Ardenne, Unité de recherche Résistance Induite et Bioprotection des Plantes (RIBP), EA 4707 USC INRAE 1488, Reims, France
| |
Collapse
|
22
|
Cubero J, Zarco-Tejada PJ, Cuesta-Morrondo S, Palacio-Bielsa A, Navas-Cortés JA, Sabuquillo P, Poblete T, Landa BB, Garita-Cambronero J. New Approaches to Plant Pathogen Detection and Disease Diagnosis. PHYTOPATHOLOGY 2024; 114:1989-2006. [PMID: 39264350 DOI: 10.1094/phyto-10-23-0366-ia] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/13/2024]
Abstract
Detecting plant pathogens and diagnosing diseases are critical components of successful pest management. These key areas have undergone significant advancements driven by breakthroughs in molecular biology and remote sensing technologies within the realm of precision agriculture. Notably, nucleic acid amplification techniques, with recent emphasis on sequencing procedures, particularly next-generation sequencing, have enabled improved DNA or RNA amplification detection protocols that now enable previously unthinkable strategies aimed at dissecting plant microbiota, including the disease-causing components. Simultaneously, the domain of remote sensing has seen the emergence of cutting-edge imaging sensor technologies and the integration of powerful computational tools, such as machine learning. These innovations enable spectral analysis of foliar symptoms and specific pathogen-induced alterations, making imaging spectroscopy and thermal imaging fundamental tools for large-scale disease surveillance and monitoring. These technologies contribute significantly to understanding the temporal and spatial dynamics of plant diseases.
Collapse
Affiliation(s)
- Jaime Cubero
- Instituto Nacional de Investigación y Tecnología Agraria y Alimentaria (INIA), Consejo Superior de Investigaciones Científicas (CSIC), Madrid, Spain
| | - Pablo J Zarco-Tejada
- School of Agriculture, Food and Ecosystem Sciences, Faculty of Science and Faculty of Engineering and Information Technology (IE-FEIT), University of Melbourne, Melbourne, VIC, Australia
- Instituto de Agricultura Sostenible (IAS), Consejo Superior de Investigaciones Científicas (CSIC), Córdoba, Spain
| | - Sara Cuesta-Morrondo
- Instituto Nacional de Investigación y Tecnología Agraria y Alimentaria (INIA), Consejo Superior de Investigaciones Científicas (CSIC), Madrid, Spain
- Departamento de Biotecnología-Biología Vegetal, Escuela Técnica Superior de Ingeniería Agronómica, Alimentaria y de Biosistemas, Universidad Politécnica de Madrid, Madrid, Spain
| | - Ana Palacio-Bielsa
- Centro de Investigación y Tecnología Agroalimentaria de Aragón-Instituto Agroalimentario de Aragón-IA2 (CITA-Universidad de Zaragoza), Zaragoza, Spain
| | - Juan A Navas-Cortés
- Instituto de Agricultura Sostenible (IAS), Consejo Superior de Investigaciones Científicas (CSIC), Córdoba, Spain
| | - Pilar Sabuquillo
- Instituto Nacional de Investigación y Tecnología Agraria y Alimentaria (INIA), Consejo Superior de Investigaciones Científicas (CSIC), Madrid, Spain
| | - Tomás Poblete
- School of Agriculture, Food and Ecosystem Sciences, Faculty of Science and Faculty of Engineering and Information Technology (IE-FEIT), University of Melbourne, Melbourne, VIC, Australia
| | - Blanca B Landa
- Instituto de Agricultura Sostenible (IAS), Consejo Superior de Investigaciones Científicas (CSIC), Córdoba, Spain
| | | |
Collapse
|
23
|
Liu J, Wang X. Multisource information fusion method for vegetable disease detection. BMC PLANT BIOLOGY 2024; 24:738. [PMID: 39095689 PMCID: PMC11295898 DOI: 10.1186/s12870-024-05346-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/26/2023] [Accepted: 06/26/2024] [Indexed: 08/04/2024]
Abstract
Automated detection and identification of vegetable diseases can enhance vegetable quality and increase profits. Images of greenhouse-grown vegetable diseases often feature complex backgrounds, a diverse array of diseases, and subtle symptomatic differences. Previous studies have grappled with accurately pinpointing lesion positions and quantifying infection degrees, resulting in overall low recognition rates. To tackle the challenges posed by insufficient validation datasets and low detection and recognition rates, this study capitalizes on the geographical advantage of Shouguang, renowned as the "Vegetable Town," to establish a self-built vegetable base for data collection and validation experiments. Concentrating on a broad spectrum of fruit and vegetable crops afflicted with various diseases, we conducted on-site collection of greenhouse disease images, compiled a large-scale dataset, and introduced the Space-Time Fusion Attention Network (STFAN). STFAN integrates multi-source information on vegetable disease occurrences, bolstering the model's resilience. Additionally, we proposed the Multilayer Encoder-Decoder Feature Fusion Network (MEDFFN) to counteract feature disappearance in deep convolutional blocks, complemented by the Boundary Structure Loss function to guide the model in acquiring more detailed and accurate boundary information. By devising a detection and recognition model that extracts high-resolution feature representations from multiple sources, precise disease detection and identification were achieved. This study offers technical backing for the holistic prevention and control of vegetable diseases, thereby advancing smart agriculture. Results indicate that, on our self-built VDGE dataset, compared to YOLOv7-tiny, YOLOv8n, and YOLOv9, the proposed model (Multisource Information Fusion Method for Vegetable Disease Detection, MIFV) has improved mAP by 3.43%, 3.02%, and 2.15%, respectively, showcasing significant performance advantages. The MIFV model parameters stand at 39.07 M, with a computational complexity of 108.92 GFLOPS, highlighting outstanding real-time performance and detection accuracy compared to mainstream algorithms. This research suggests that the proposed MIFV model can swiftly and accurately detect and identify vegetable diseases in greenhouse environments at a reduced cost.
Collapse
Affiliation(s)
- Jun Liu
- Shandong Provincial University Laboratory for Protected Horticulture, Weifang University of Science and Technology, Weifang, China.
| | - Xuewei Wang
- Shandong Provincial University Laboratory for Protected Horticulture, Weifang University of Science and Technology, Weifang, China
| |
Collapse
|
24
|
V. P, Kumar AMS, Praveen JIR, Venkatraman S, Kumar SP, Aravintakshan SA, Abeshek A, Kannan A. Improved tomato leaf disease classification through adaptive ensemble models with exponential moving average fusion and enhanced weighted gradient optimization. FRONTIERS IN PLANT SCIENCE 2024; 15:1382416. [PMID: 38828218 PMCID: PMC11140105 DOI: 10.3389/fpls.2024.1382416] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/05/2024] [Accepted: 04/02/2024] [Indexed: 06/05/2024]
Abstract
Tomato is one of the most popular and most important food crops consumed globally. The quality and quantity of yield by tomato plants are affected by the impact made by various kinds of diseases. Therefore, it is essential to identify these diseases early so that it is possible to reduce the occurrences and effect of the diseases on tomato plants to improve the overall crop yield and to support the farmers. In the past, many research works have been carried out by applying the machine learning techniques to segment and classify the tomato leaf images. However, the existing machine learning-based classifiers are not able to detect the new types of diseases more accurately. On the other hand, deep learning-based classifiers with the support of swarm intelligence-based optimization techniques are able to enhance the classification accuracy, leading to the more effective and accurate detection of leaf diseases. This research paper proposes a new method for the accurate classification of tomato leaf diseases by harnessing the power of an ensemble model in a sample dataset of tomato plants, containing images pertaining to nine different types of leaf diseases. This research introduces an ensemble model with an exponential moving average function with temporal constraints and an enhanced weighted gradient optimizer that is integrated into fine-tuned Visual Geometry Group-16 (VGG-16) and Neural Architecture Search Network (NASNet) mobile training methods for providing improved learning and classification accuracy. The dataset used for the research consists of 10,000 tomato leaf images categorized into nine classes for training and validating the model and an additional 1,000 images reserved for testing the model. The results have been analyzed thoroughly and benchmarked with existing performance metrics, thus proving that the proposed approach gives better performance in terms of accuracy, loss, precision, recall, receiver operating characteristic curve, and F1-score with values of 98.7%, 4%, 97.9%, 98.6%, 99.97%, and 98.7%, respectively.
Collapse
Affiliation(s)
- Pandiyaraju V.
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - A. M. Senthil Kumar
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - Joe I. R. Praveen
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - Shravan Venkatraman
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - S. Pavan Kumar
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - S. A. Aravintakshan
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - A. Abeshek
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - A. Kannan
- School of Computer Science and Engineering, Vellore Institute of Technology, Vellore, India
| |
Collapse
|
25
|
Isinkaye FO, Olusanya MO, Singh PK. Deep learning and content-based filtering techniques for improving plant disease identification and treatment recommendations: A comprehensive review. Heliyon 2024; 10:e29583. [PMID: 38737274 PMCID: PMC11088271 DOI: 10.1016/j.heliyon.2024.e29583] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Revised: 03/30/2024] [Accepted: 04/10/2024] [Indexed: 05/14/2024] Open
Abstract
The importance of identifying plant diseases has risen recently due to the adverse effect they have on agricultutal production. Plant diseases have been a big concern in agriculture, as they affect crop production, and constitute a major threat to global food security. In the domain of modern agriculture, effective plant disease management is vital to ensure healthy crop yields and sustainable practices. Traditional means of identifying plant disease are faced with lots of challenges and the need for better and efficient detection methods cannot be overemphazised. The emergence of advanced technologies, particularly deep learning and content-based filtering techniques, if integrated together can changed the way plant diseases are identified and treated. Such as speedy and correct identification of plant diseases and efficient treatment recommendations which are keys for sustainable food production. In this work, We try to investigate the current state of research, identified gaps and limitations in knowledge, and suggests future directions for researchers, experts and farmers that could help to provide better ways of mitigating plant disease problems.
Collapse
Affiliation(s)
- Folasade Olubusola Isinkaye
- Department of Computer Science and Information Technology, Sol Plaatje University Kimberley, 8301, South Africa
| | - Michael Olusoji Olusanya
- Department of Computer Science and Information Technology, Sol Plaatje University Kimberley, 8301, South Africa
| | - Pramod Kumar Singh
- Department of Computer Science and Engineering, ABV-Indian Institute of Information Technology and Management Gwalior, Gwalior, 474015, MP, India
| |
Collapse
|
26
|
Shoaib M, Junaid A, Husnain G, Qadir M, Ghadi YY, Askar SS, Abouhawwash M. Advanced detection of coronary artery disease via deep learning analysis of plasma cytokine data. Front Cardiovasc Med 2024; 11:1365481. [PMID: 38525188 PMCID: PMC10957635 DOI: 10.3389/fcvm.2024.1365481] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Accepted: 02/19/2024] [Indexed: 03/26/2024] Open
Abstract
The 2017 World Health Organization Fact Sheet highlights that coronary artery disease is the leading cause of death globally, responsible for approximately 30% of all deaths. In this context, machine learning (ML) technology is crucial in identifying coronary artery disease, thereby saving lives. ML algorithms can potentially analyze complex patterns and correlations within medical data, enabling early detection and accurate diagnosis of CAD. By leveraging ML technology, healthcare professionals can make informed decisions and implement timely interventions, ultimately leading to improved outcomes and potentially reducing the mortality rate associated with coronary artery disease. Machine learning algorithms create non-invasive, quick, accurate, and economical diagnoses. As a result, machine learning algorithms can be employed to supplement existing approaches or as a forerunner to them. This study shows how to use the CNN classifier and RNN based on the LSTM classifier in deep learning to attain targeted "risk" CAD categorization utilizing an evolving set of 450 cytokine biomarkers that could be used as suggestive solid predictive variables for treatment. The two used classifiers are based on these "45" different cytokine prediction characteristics. The best Area Under the Receiver Operating Characteristic curve (AUROC) score achieved is (0.98) for a confidence interval (CI) of 95; the classifier RNN-LSTM used "450" cytokine biomarkers had a great (AUROC) score of 0.99 with a confidence interval of 0.95 the percentage 95, the CNN model containing cytokines received the second best AUROC score (0.92). The RNN-LSTM classifier considerably beats the CNN classifier regarding AUROC scores, as evidenced by a p-value smaller than 7.48 obtained via an independent t-test. As large-scale initiatives to achieve early, rapid, reliable, inexpensive, and accessible individual identification of CAD risk gain traction, robust machine learning algorithms can now augment older methods such as angiography. Incorporating 65 new sensitive cytokine biomarkers can increase early detection even more. Investigating the novel involvement of cytokines in CAD could lead to better risk detection, disease mechanism discovery, and new therapy options.
Collapse
Affiliation(s)
- Muhammad Shoaib
- Department of Computer Science, CECOS University of IT and Emerging Sciences, Peshawar, Pakistan
| | - Ahmad Junaid
- Department of Computer Science, CECOS University of IT and Emerging Sciences, Peshawar, Pakistan
| | - Ghassan Husnain
- Department of Computer Science, CECOS University of IT and Emerging Sciences, Peshawar, Pakistan
| | - Mansoor Qadir
- Department of Computer Science, CECOS University of IT and Emerging Sciences, Peshawar, Pakistan
| | | | - S. S. Askar
- Department of Statistics and Operations Research, College of Science, King Saud University, Riyadh, Saudi Arabia
| | - Mohamed Abouhawwash
- Department of Computational Mathematics, Science and Engineering (CMSE), College of Engineering, Michigan State University, East Lansing, MI, United States
- Department of Mathematics, Faculty of Science, Mansoura University, Mansoura, Egypt
| |
Collapse
|
27
|
Wang X, Liu J. Vegetable disease detection using an improved YOLOv8 algorithm in the greenhouse plant environment. Sci Rep 2024; 14:4261. [PMID: 38383751 PMCID: PMC10881480 DOI: 10.1038/s41598-024-54540-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Accepted: 02/14/2024] [Indexed: 02/23/2024] Open
Abstract
This study introduces YOLOv8n-vegetable, a model designed to address challenges related to imprecise detection of vegetable diseases in greenhouse plant environment using existing network models. The model incorporates several improvements and optimizations to enhance its effectiveness. Firstly, a novel C2fGhost module replaces partial C2f. with GhostConv based on Ghost lightweight convolution, reducing the model's parameters and improving detection performance. Second, the Occlusion Perception Attention Module (OAM) is integrated into the Neck section to better preserve feature information after fusion, enhancing vegetable disease detection in greenhouse settings. To address challenges associated with detecting small-sized objects and the depletion of semantic knowledge due to varying scales, an additional layer for detecting small-sized objects is included. This layer improves the amalgamation of extensive and basic semantic knowledge, thereby enhancing overall detection accuracy. Finally, the HIoU boundary loss function is introduced, leading to improved convergence speed and regression accuracy. These improvement strategies were validated through experiments using a self-built vegetable disease detection dataset in a greenhouse environment. Multiple experimental comparisons have demonstrated the model's effectiveness, achieving the objectives of improving detection speed while maintaining accuracy and real-time detection capability. According to experimental findings, the enhanced model exhibited a 6.46% rise in mean average precision (mAP) over the original model on the self-built vegetable disease detection dataset under greenhouse conditions. Additionally, the parameter quantity and model size decreased by 0.16G and 0.21 MB, respectively. The proposed model demonstrates significant advancements over the original algorithm and exhibits strong competitiveness when compared with other advanced object detection models. The lightweight and fast detection of vegetable diseases offered by the proposed model presents promising applications in vegetable disease detection tasks.
Collapse
Affiliation(s)
- Xuewei Wang
- Shandong Provincial University Laboratory for Protected Horticulture, Weifang University of Science and Technology, Weifang, China
| | - Jun Liu
- Shandong Provincial University Laboratory for Protected Horticulture, Weifang University of Science and Technology, Weifang, China.
| |
Collapse
|
28
|
Debnath A, Hasan MM, Raihan M, Samrat N, Alsulami MM, Masud M, Bairagi AK. A Smartphone-Based Detection System for Tomato Leaf Disease Using EfficientNetV2B2 and Its Explainability with Artificial Intelligence (AI). SENSORS (BASEL, SWITZERLAND) 2023; 23:8685. [PMID: 37960385 PMCID: PMC10648786 DOI: 10.3390/s23218685] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Revised: 10/19/2023] [Accepted: 10/20/2023] [Indexed: 11/15/2023]
Abstract
The occurrence of tomato diseases has substantially reduced agricultural output and financial losses. The timely detection of diseases is crucial to effectively manage and mitigate the impact of episodes. Early illness detection can improve output, reduce chemical use, and boost a nation's economy. A complete system for plant disease detection using EfficientNetV2B2 and deep learning (DL) is presented in this paper. This research aims to develop a precise and effective automated system for identifying several illnesses that impact tomato plants. This will be achieved by analyzing tomato leaf photos. A dataset of high-resolution photographs of healthy and diseased tomato leaves was created to achieve this goal. The EfficientNetV2B2 model is the foundation of the deep learning system and excels at picture categorization. Transfer learning (TF) trains the model on a tomato leaf disease dataset using EfficientNetV2B2's pre-existing weights and a 256-layer dense layer. Tomato leaf diseases can be identified using the EfficientNetV2B2 model and a dense layer of 256 nodes. An ideal loss function and algorithm train and tune the model. Next, the concept is deployed in smartphones and online apps. The user can accurately diagnose tomato leaf diseases with this application. Utilizing an automated system facilitates the rapid identification of diseases, assisting in making informed decisions on disease management and promoting sustainable tomato cultivation practices. The 5-fold cross-validation method achieved 99.02% average weighted training accuracy, 99.22% average weighted validation accuracy, and 98.96% average weighted test accuracy. The split method achieved 99.93% training accuracy and 100% validation accuracy. Using the DL approach, tomato leaf disease identification achieves nearly 100% accuracy on a test dataset.
Collapse
Affiliation(s)
- Anjan Debnath
- Department of Computer Science and Engineering, North Western University, Khulna 9100, Bangladesh; (A.D.); (M.M.H.); (N.S.)
| | - Md. Mahedi Hasan
- Department of Computer Science and Engineering, North Western University, Khulna 9100, Bangladesh; (A.D.); (M.M.H.); (N.S.)
| | - M. Raihan
- Department of Computer Science and Engineering, North Western University, Khulna 9100, Bangladesh; (A.D.); (M.M.H.); (N.S.)
| | - Nadim Samrat
- Department of Computer Science and Engineering, North Western University, Khulna 9100, Bangladesh; (A.D.); (M.M.H.); (N.S.)
| | - Mashael M. Alsulami
- Department of Information Technology, College of Computers and Information Technology, Taif University, Taif 21944, Saudi Arabia;
| | - Mehedi Masud
- Department of Computer Science, College of Computers and Information Technology, Taif University, Taif 21944, Saudi Arabia;
| | - Anupam Kumar Bairagi
- Computer Science and Engineering Discipline, Khulna University, Khulna 9208, Bangladesh
| |
Collapse
|
29
|
Shoaib M, Shah B, Sayed N, Ali F, Ullah R, Hussain I. Deep learning for plant bioinformatics: an explainable gradient-based approach for disease detection. FRONTIERS IN PLANT SCIENCE 2023; 14:1283235. [PMID: 37900739 PMCID: PMC10612337 DOI: 10.3389/fpls.2023.1283235] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Accepted: 09/27/2023] [Indexed: 10/31/2023]
Abstract
Emerging in the realm of bioinformatics, plant bioinformatics integrates computational and statistical methods to study plant genomes, transcriptomes, and proteomes. With the introduction of high-throughput sequencing technologies and other omics data, the demand for automated methods to analyze and interpret these data has increased. We propose a novel explainable gradient-based approach EG-CNN model for both omics data and hyperspectral images to predict the type of attack on plants in this study. We gathered gene expression, metabolite, and hyperspectral image data from plants afflicted with four prevalent diseases: powdery mildew, rust, leaf spot, and blight. Our proposed EG-CNN model employs a combination of these omics data to learn crucial plant disease detection characteristics. We trained our model with multiple hyperparameters, such as the learning rate, number of hidden layers, and dropout rate, and attained a test set accuracy of 95.5%. We also conducted a sensitivity analysis to determine the model's resistance to hyperparameter variations. Our analysis revealed that our model exhibited a notable degree of resilience in the face of these variations, resulting in only marginal changes in performance. Furthermore, we conducted a comparative examination of the time efficiency of our EG-CNN model in relation to baseline models, including SVM, Random Forest, and Logistic Regression. Although our model necessitates additional time for training and validation due to its intricate architecture, it demonstrates a faster testing time per sample, offering potential advantages in real-world scenarios where speed is paramount. To gain insights into the internal representations of our EG-CNN model, we employed saliency maps for a qualitative analysis. This visualization approach allowed us to ascertain that our model effectively captures crucial aspects of plant disease, encompassing alterations in gene expression, metabolite levels, and spectral discrepancies within plant tissues. Leveraging omics data and hyperspectral images, this study underscores the potential of deep learning methods in the realm of plant disease detection. The proposed EG-CNN model exhibited impressive accuracy and displayed a remarkable degree of insensitivity to hyperparameter variations, which holds promise for future plant bioinformatics applications.
Collapse
Affiliation(s)
- Muhammad Shoaib
- Department of Computer Science, CECOS University of IT and Emerging Sciences, Peshawar, Pakistan
| | - Babar Shah
- College of Technological Innovation, Zayed University, Dubai, United Arab Emirates
| | - Nasir Sayed
- Department of Computer Science, Islamia College Peshawar, Peshawar, Pakistan
| | - Farman Ali
- Department of Computer Science and Engineering, School of Convergence, College of Computing and Informatics, Sungkyunkwan University, Seoul, Republic of Korea
| | - Rafi Ullah
- Department of Medical Laboratory Technology, Riphah International University, Islamabad, Pakistan
| | - Irfan Hussain
- Centre for Autonomous Robotic Systems, Khalifa University, Abu Dhabi, United Arab Emirates
| |
Collapse
|
30
|
Dong J, Fuentes A, Yoon S, Kim H, Park DS. An iterative noisy annotation correction model for robust plant disease detection. FRONTIERS IN PLANT SCIENCE 2023; 14:1238722. [PMID: 37941667 PMCID: PMC10628849 DOI: 10.3389/fpls.2023.1238722] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Accepted: 09/22/2023] [Indexed: 11/10/2023]
Abstract
Previous work on plant disease detection demonstrated that object detectors generally suffer from degraded training data, and annotations with noise may cause the training task to fail. Well-annotated datasets are therefore crucial to build a robust detector. However, a good label set generally requires much expert knowledge and meticulous work, which is expensive and time-consuming. This paper aims to learn robust feature representations with inaccurate bounding boxes, thereby reducing the model requirements for annotation quality. Specifically, we analyze the distribution of noisy annotations in the real world. A teacher-student learning paradigm is proposed to correct inaccurate bounding boxes. The teacher model is used to rectify the degraded bounding boxes, and the student model extracts more robust feature representations from the corrected bounding boxes. Furthermore, the method can be easily generalized to semi-supervised learning paradigms and auto-labeling techniques. Experimental results show that applying our method to the Faster-RCNN detector achieves a 26% performance improvement on the noisy dataset. Besides, our method achieves approximately 75% of the performance of a fully supervised object detector when 1% of the labels are available. Overall, this work provides a robust solution to real-world location noise. It alleviates the challenges posed by noisy data to precision agriculture, optimizes data labeling technology, and encourages practitioners to further investigate plant disease detection and intelligent agriculture at a lower cost. The code will be released at https://github.com/JiuqingDong/TS_OAMIL-for-Plant-disease-detection.
Collapse
Affiliation(s)
- Jiuqing Dong
- Department of Electronic Engineering, Jeonbuk National University, Jeonju, Republic of Korea
- Core Research Institute of Intelligent Robots, Jeonbuk National University, Jeonju, Republic of Korea
| | - Alvaro Fuentes
- Department of Electronic Engineering, Jeonbuk National University, Jeonju, Republic of Korea
- Core Research Institute of Intelligent Robots, Jeonbuk National University, Jeonju, Republic of Korea
| | - Sook Yoon
- Department of Computer Engineering, Mokpo National University, Muan, Republic of Korea
| | - Hyongsuk Kim
- Department of Electronic Engineering, Jeonbuk National University, Jeonju, Republic of Korea
- Core Research Institute of Intelligent Robots, Jeonbuk National University, Jeonju, Republic of Korea
| | - Dong Sun Park
- Department of Electronic Engineering, Jeonbuk National University, Jeonju, Republic of Korea
- Core Research Institute of Intelligent Robots, Jeonbuk National University, Jeonju, Republic of Korea
| |
Collapse
|
31
|
Elragal R, Elragal A, Habibipour A. Healthcare analytics-A literature review and proposed research agenda. Front Big Data 2023; 6:1277976. [PMID: 37869248 PMCID: PMC10585099 DOI: 10.3389/fdata.2023.1277976] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2023] [Accepted: 09/19/2023] [Indexed: 10/24/2023] Open
Abstract
This research addresses the demanding need for research in healthcare analytics, by explaining how previous studies have used big data, AI, and machine learning to identify, address, or solve healthcare problems. Healthcare science methods are combined with contemporary data science techniques to examine the literature, identify research gaps, and propose a research agenda for researchers, academic institutions, and governmental healthcare organizations. The study contributes to the body of literature by providing a state-of-the-art review of healthcare analytics as well as proposing a research agenda to advance the knowledge in this area. The results of this research can be beneficial for both healthcare science and data science researchers as well as practitioners in the field.
Collapse
Affiliation(s)
| | - Ahmed Elragal
- Department of Computer Science, Electrical, and Space Engineering, Luleå University of Technology, Luleå, Sweden
| | | |
Collapse
|
32
|
Dong J, Fuentes A, Yoon S, Kim H, Jeong Y, Park DS. A New Deep Learning-based Dynamic Paradigm Towards Open-World Plant Disease Detection. FRONTIERS IN PLANT SCIENCE 2023; 14:1243822. [PMID: 37849839 PMCID: PMC10577201 DOI: 10.3389/fpls.2023.1243822] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 09/13/2023] [Indexed: 10/19/2023]
Abstract
Plant disease detection has made significant strides thanks to the emergence of deep learning. However, existing methods have been limited to closed-set and static learning settings, where models are trained using a specific dataset. This confinement restricts the model's adaptability when encountering samples from unseen disease categories. Additionally, there is a challenge of knowledge degradation for these static learning settings, as the acquisition of new knowledge tends to overwrite the old when learning new categories. To overcome these limitations, this study introduces a novel paradigm for plant disease detection called open-world setting. Our approach can infer disease categories that have never been seen during the model training phase and gradually learn these unseen diseases through dynamic knowledge updates in the next training phase. Specifically, we utilize a well-trained unknown-aware region proposal network to generate pseudo-labels for unknown diseases during training and employ a class-agnostic classifier to enhance the recall rate for unknown diseases. Besides, we employ a sample replay strategy to maintain recognition ability for previously learned classes. Extensive experimental evaluation and ablation studies investigate the efficacy of our method in detecting old and unknown classes. Remarkably, our method demonstrates robust generalization ability even in cross-species disease detection experiments. Overall, this open-world and dynamically updated detection method shows promising potential to become the future paradigm for plant disease detection. We discuss open issues including classification and localization, and propose promising approaches to address them. We encourage further research in the community to tackle the crucial challenges in open-world plant disease detection. The code will be released at https://github.com/JiuqingDong/OWPDD.
Collapse
Affiliation(s)
- Jiuqing Dong
- Department of Electronic Engineering, Jeonbuk National University, Jeonju, Republic of Korea
- Core Research Institute of Intelligent Robots, Jeonbuk National University, Jeonju, Republic of Korea
| | - Alvaro Fuentes
- Department of Electronic Engineering, Jeonbuk National University, Jeonju, Republic of Korea
- Core Research Institute of Intelligent Robots, Jeonbuk National University, Jeonju, Republic of Korea
| | - Sook Yoon
- Department of Computer Engineering, Mokpo National University, Muan, Republic of Korea
| | - Hyongsuk Kim
- Department of Electronic Engineering, Jeonbuk National University, Jeonju, Republic of Korea
- Core Research Institute of Intelligent Robots, Jeonbuk National University, Jeonju, Republic of Korea
| | - Yongchae Jeong
- Department of Electronic Engineering, Jeonbuk National University, Jeonju, Republic of Korea
| | - Dong Sun Park
- Department of Electronic Engineering, Jeonbuk National University, Jeonju, Republic of Korea
- Core Research Institute of Intelligent Robots, Jeonbuk National University, Jeonju, Republic of Korea
| |
Collapse
|
33
|
Wekesa JS, Kimwele M. A review of multi-omics data integration through deep learning approaches for disease diagnosis, prognosis, and treatment. Front Genet 2023; 14:1199087. [PMID: 37547471 PMCID: PMC10398577 DOI: 10.3389/fgene.2023.1199087] [Citation(s) in RCA: 21] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2023] [Accepted: 07/11/2023] [Indexed: 08/08/2023] Open
Abstract
Accurate diagnosis is the key to providing prompt and explicit treatment and disease management. The recognized biological method for the molecular diagnosis of infectious pathogens is polymerase chain reaction (PCR). Recently, deep learning approaches are playing a vital role in accurately identifying disease-related genes for diagnosis, prognosis, and treatment. The models reduce the time and cost used by wet-lab experimental procedures. Consequently, sophisticated computational approaches have been developed to facilitate the detection of cancer, a leading cause of death globally, and other complex diseases. In this review, we systematically evaluate the recent trends in multi-omics data analysis based on deep learning techniques and their application in disease prediction. We highlight the current challenges in the field and discuss how advances in deep learning methods and their optimization for application is vital in overcoming them. Ultimately, this review promotes the development of novel deep-learning methodologies for data integration, which is essential for disease detection and treatment.
Collapse
|
34
|
Wang S, Khan A, Lin Y, Jiang Z, Tang H, Alomar SY, Sanaullah M, Bhatti UA. Deep reinforcement learning enables adaptive-image augmentation for automated optical inspection of plant rust. FRONTIERS IN PLANT SCIENCE 2023; 14:1142957. [PMID: 37484461 PMCID: PMC10360175 DOI: 10.3389/fpls.2023.1142957] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Accepted: 05/29/2023] [Indexed: 07/25/2023]
Abstract
This study proposes an adaptive image augmentation scheme using deep reinforcement learning (DRL) to improve the performance of a deep learning-based automated optical inspection system. The study addresses the challenge of inconsistency in the performance of single image augmentation methods. It introduces a DRL algorithm, DQN, to select the most suitable augmentation method for each image. The proposed approach extracts geometric and pixel indicators to form states, and uses DeepLab-v3+ model to verify the augmented images and generate rewards. Image augmentation methods are treated as actions, and the DQN algorithm selects the best methods based on the images and segmentation model. The study demonstrates that the proposed framework outperforms any single image augmentation method and achieves better segmentation performance than other semantic segmentation models. The framework has practical implications for developing more accurate and robust automated optical inspection systems, critical for ensuring product quality in various industries. Future research can explore the generalizability and scalability of the proposed framework to other domains and applications. The code for this application is uploaded at https://github.com/lynnkobe/Adaptive-Image-Augmentation.git.
Collapse
Affiliation(s)
- Shiyong Wang
- School of Mechanical and Automotive Engineering, South China University of Technology, Guangzhou, China
| | - Asad Khan
- Metaverse Research Institute, School of Computer Science and Cyber Engineering, Guangzhou University, Guangzhou, China
| | - Ying Lin
- School of Mechanical and Automotive Engineering, South China University of Technology, Guangzhou, China
| | - Zhuo Jiang
- College of Food Science, South China Agricultural University, Guangzhou, China
| | - Hao Tang
- School of Information and Communication Engineering, Hainan University, Haikou, China
| | | | - Muhammad Sanaullah
- Department of Computer Science, Bahauddin Zakariya University, Multan, Pakistan
| | - Uzair Aslam Bhatti
- School of Information and Communication Engineering, Hainan University, Haikou, China
| |
Collapse
|
35
|
Khan T, Choi G, Lee S. EFFNet-CA: An Efficient Driver Distraction Detection Based on Multiscale Features Extractions and Channel Attention Mechanism. SENSORS (BASEL, SWITZERLAND) 2023; 23:3835. [PMID: 37112176 PMCID: PMC10145749 DOI: 10.3390/s23083835] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/04/2023] [Revised: 04/03/2023] [Accepted: 04/06/2023] [Indexed: 06/19/2023]
Abstract
Driver distraction is considered a main cause of road accidents, every year, thousands of people obtain serious injuries, and most of them lose their lives. In addition, a continuous increase can be found in road accidents due to driver's distractions, such as talking, drinking, and using electronic devices, among others. Similarly, several researchers have developed different traditional deep learning techniques for the efficient detection of driver activity. However, the current studies need further improvement due to the higher number of false predictions in real time. To cope with these issues, it is significant to develop an effective technique which detects driver's behavior in real time to prevent human lives and their property from being damaged. In this work, we develop a convolutional neural network (CNN)-based technique with the integration of a channel attention (CA) mechanism for efficient and effective detection of driver behavior. Moreover, we compared the proposed model with solo and integration flavors of various backbone models and CA such as VGG16, VGG16+CA, ResNet50, ResNet50+CA, Xception, Xception+CA, InceptionV3, InceptionV3+CA, and EfficientNetB0. Additionally, the proposed model obtained optimal performance in terms of evaluation metrics, for instance, accuracy, precision, recall, and F1-score using two well-known datasets such as AUC Distracted Driver (AUCD2) and State Farm Distracted Driver Detection (SFD3). The proposed model achieved 99.58% result in terms of accuracy using SFD3 while 98.97% accuracy on AUCD2 datasets.
Collapse
Affiliation(s)
- Taimoor Khan
- Department of Computer Engineering, Gachon University, Seongnam-si 13120, Republic of Korea
| | - Gyuho Choi
- Department of Artificial Intelligence Engineering, Chosun University, Gwangju 61452, Republic of Korea;
| | - Sokjoon Lee
- Department of Smart Security, Gachon University, Seongnam-si 13120, Republic of Korea
| |
Collapse
|