1
|
Pushpa B, Jyothsna S, Lasya S. HybNet: A hybrid deep models for medicinal plant species identification. MethodsX 2025; 14:103126. [PMID: 39830878 PMCID: PMC11741051 DOI: 10.1016/j.mex.2024.103126] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2024] [Accepted: 12/20/2024] [Indexed: 01/22/2025] Open
Abstract
Real-time plant species detection plays an important role in fields ranging from medicine to biodiversity conservation. Images captured under unconstrained environments, scale variations, different lighting conditions, leaf orientation, complicated backdrops, and leaflet structure make plant species recognition rigorous and time-consuming. Our study addresses this challenge by introducing three pioneering hybrid models, seamlessly integrating the strengths of convolution neural networks. In the first model, two deep learning models such as VGG16 and MobileNet are fused to extract features. Then, the extracted features are subjected to KNN classifier achieving an impressive 85.85 % accuracy, while the second model adopts MobileNet in conjunction with ResNet50 for feature extraction which is further classified using a deep learning classifier to achieve 88 % accuracy. The third model incorporates MobileNetV2 with the Squeeze and Excitation (SE) layers for the classification tasks. Our research highlights the immense potential of modern image processing techniques and deep learning models in comprehending and safeguarding the earth's diverse plant species. The experiments are carried out on self-created medicinal plant datasets captured in real-time conditions. From the experimentations, it is observed that hybrid model 3 reflects an improved performance of 94.24 % by utilizing recalibration efforts compared with the other two hybrid models.•One of the significant contributions of the study lies in a focused emphasis on feature enhancement achieved through the utilization of hybrid models majorly to enrich the features.•The feature scaling model incorporated in hybrid model 3 exhibits a superior and better performance demonstrating higher accuracy compared to the other models presented in this work.•The deebp learning models are trained and tested on the small dataset yet achieved good accuracy.
Collapse
Affiliation(s)
- B.R. Pushpa
- Department of Computer Science, School of Computing, Amrita Vishwa Vidyapeetham, Mysuru, India
| | - S. Jyothsna
- Department of Computer Science, School of Computing, Amrita Vishwa Vidyapeetham, Mysuru, India
| | - S. Lasya
- Department of Computer Science, School of Computing, Amrita Vishwa Vidyapeetham, Mysuru, India
| |
Collapse
|
2
|
Chimate Y, Patil S, Prathapan K, Patil J, Khot J. Optimized sequential model for superior classification of plant disease. Sci Rep 2025; 15:3700. [PMID: 39880879 PMCID: PMC11779840 DOI: 10.1038/s41598-025-86427-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2024] [Accepted: 01/10/2025] [Indexed: 01/31/2025] Open
Abstract
Indian agriculture is vital sector in the country's economy, providing employment and sustenance to millions of farmers. However, Plant diseases are a serious risk to crop yields and farmers' livelihoods. Traditional plant disease diagnosis methods rely heavily on human expertise, which can lead to inaccuracies due to the invisible nature of early disease symptoms and the labor-intensive process, making them inefficient for large-scale agricultural management. To recover from this and, address these challenges, this study explores deep learning, specifically Convolutional Neural Networks (CNN), as a means to enhance the accuracy and efficiency of plant disease detection. Deep learning architectures, like convolutional neural network, can autonomously learn and extract complicated characteristics and patterns from huge datasets. Our research, conducted on mango and groundnut leaves collected during field visits in western Maharashtra and supplemented by online datasets, demonstrates a CNN model that achieves an impressive 96% accuracy as compared to machine learning techniques that follow tedious feature extraction. Furthermore, image processing contributes to enhancing the dataset through normalization, resizing, and augmentation for better classification results. Overall, CNN can continuously improve and adapt its performance through iterative training, resulting in higher accuracy rates and reduced false positives in contrast to conventional machine learning methods.
Collapse
Affiliation(s)
- Yogesh Chimate
- Department of Computer Science and Engineering, D. Y. Patil Agriculture and Technical University, Talsande, Maharashtra, India.
| | - Sangram Patil
- D. Y. Patil Agriculture and Technical University, Talsande, Maharashtra, India
| | - K Prathapan
- D. Y. Patil Agriculture and Technical University, Talsande, Maharashtra, India
| | - Jaydeep Patil
- D. Y. Patil Agriculture and Technical University, Talsande, Maharashtra, India
| | - Jayendra Khot
- D. Y. Patil Agriculture and Technical University, Talsande, Maharashtra, India
| |
Collapse
|
3
|
Shahid MF, Khanzada TJS, Aslam MA, Hussain S, Baowidan SA, Ashari RB. An ensemble deep learning models approach using image analysis for cotton crop classification in AI-enabled smart agriculture. PLANT METHODS 2024; 20:104. [PMID: 39004764 PMCID: PMC11246586 DOI: 10.1186/s13007-024-01228-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/14/2024] [Accepted: 06/22/2024] [Indexed: 07/16/2024]
Abstract
BACKGROUND Agriculture is one of the most crucial assets of any country, as it brings prosperity by alleviating poverty, food shortages, unemployment, and economic instability. The entire process of agriculture comprises many sectors, such as crop cultivation, water irrigation, the supply chain, and many more. During the cultivation process, the plant is exposed to many challenges, among which pesticide attacks and disease in the plant are the main threats. Diseases affect yield production, which affects the country's economy. Over the past decade, there have been significant advancements in agriculture; nevertheless, a substantial portion of crop yields continues to be compromised by diseases and pests. Early detection and prevention are crucial for successful crop management. METHODS To address this, we propose a framework that utilizes state-of-the-art computer vision (CV) and artificial intelligence (AI) techniques, specifically deep learning (DL), for detecting healthy and unhealthy cotton plants. Our approach combines DL with feature extraction methods such as continuous wavelet transform (CWT) and fast Fourier transform (FFT). The detection process involved employing pre-trained models such as AlexNet, GoogLeNet, InceptionV3, and VGG-19. Implemented models performance was analysed based on metrics such as accuracy, precision, recall, F1-Score, and Confusion matrices. Moreover, the proposed framework employed ensemble learning framework which uses averaging method to fuse the classification score of individual DL model, thereby improving the overall classification accuracy. RESULTS During the training process, the framework achieved better performance when features extracted from CWT were used as inputs to the DL model compared to features extracted from FFT. Among the learning models, GoogleNet obtained a remarkable accuracy of 93.4% and a notable F1-score of 0.953 when trained on features extracted by CWT in comparison to FFT-extracted features. It was closely followed by AlexNet and InceptionV3 with an accuracy of 93.4% and 91.8% respectively. To further improve the classification accuracy, ensemble learning framework achieved 98.4% on the features extracted from CWT as compared to feature extracted from FFT. CONCLUSION The results show that the features extracted as scalograms more accurately detect each plant condition using DL models, facilitating the early detection of diseases in cotton plants. This early detection leads to better yield and profit which positively affects the economy.
Collapse
Affiliation(s)
- Muhammad Farrukh Shahid
- FAST School of Computing, National University of Computer & Emerging Sciences, Karachi, 75030, Pakistan.
| | - Tariq J S Khanzada
- Department of Information Systems, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah, 21589, Saudi Arabia
- Computer Systems Engineering Department, Mehran University of Engineering and Technology, Jamshoro, 76062, Pakistan
| | | | - Shehroz Hussain
- FAST School of Computing, National University of Computer & Emerging Sciences, Karachi, 75030, Pakistan
| | - Souad Ahmad Baowidan
- Information Technology Department, King Abdulaziz University, Jeddah, 21589, Saudi Arabia
| | - Rehab Bahaaddin Ashari
- Department of Information Systems, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah, 21589, Saudi Arabia
| |
Collapse
|
4
|
Ullah W, Javed K, Khan MA, Alghayadh FY, Bhatt MW, Al Naimi IS, Ofori I. Efficient identification and classification of apple leaf diseases using lightweight vision transformer (ViT). DISCOVER SUSTAINABILITY 2024; 5:116. [DOI: 10.1007/s43621-024-00307-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 06/05/2024] [Indexed: 08/25/2024]
Abstract
AbstractThe timely diagnosis and identification of apple leaf diseases is essential to prevent the spread of diseases and ensure the sound development of the apple industry. Convolutional neural networks (CNNs) have achieved phenomenal success in the area of leaf disease detection, which can greatly benefit the agriculture industry. However, their large size and intricate design continue to pose a challenge when it comes to deploying these models on lightweight devices. Although several successful models (e.g., EfficientNets and MobileNets) have been designed to adapt to resource-constrained devices, these models have not been able to achieve significant results in leaf disease detection tasks and leave a performance gap behind. This research gap has motivated us to develop an apple leaf disease detection model that can not only be deployed on lightweight devices but also outperform existing models. In this work, we propose AppViT, a hybrid vision model, combining the features of convolution blocks and multi-head self-attention, to compete with the best-performing models. Specifically, we begin by introducing the convolution blocks that narrow down the size of the feature maps and help the model encode local features progressively. Then, we stack ViT blocks in combination with convolution blocks, allowing the network to capture non-local dependencies and spatial patterns. Embodied with these designs and a hierarchical structure, AppViT demonstrates excellent performance in apple leaf disease detection tasks. Specifically, it achieves 96.38% precision on Plant Pathology 2021—FGVC8 with about 1.3 million parameters, which is 11.3% and 4.3% more accurate than ResNet-50 and EfficientNet-B3. The precision, recall and F score of our proposed model on Plant Pathology 2021—FGVC8 are 0.967, 0.959, and 0.963 respectively.
Collapse
|
5
|
Aldakheel EA, Zakariah M, Alabdalall AH. Detection and identification of plant leaf diseases using YOLOv4. FRONTIERS IN PLANT SCIENCE 2024; 15:1355941. [PMID: 38711603 PMCID: PMC11070553 DOI: 10.3389/fpls.2024.1355941] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/14/2023] [Accepted: 03/27/2024] [Indexed: 05/08/2024]
Abstract
Detecting plant leaf diseases accurately and promptly is essential for reducing economic consequences and maximizing crop yield. However, farmers' dependence on conventional manual techniques presents a difficulty in accurately pinpointing particular diseases. This research investigates the utilization of the YOLOv4 algorithm for detecting and identifying plant leaf diseases. This study uses the comprehensive Plant Village Dataset, which includes over fifty thousand photos of healthy and diseased plant leaves from fourteen different species, to develop advanced disease prediction systems in agriculture. Data augmentation techniques including histogram equalization and horizontal flip were used to improve the dataset and strengthen the model's resilience. A comprehensive assessment of the YOLOv4 algorithm was conducted, which involved comparing its performance with established target identification methods including Densenet, Alexanet, and neural networks. When YOLOv4 was used on the Plant Village dataset, it achieved an impressive accuracy of 99.99%. The evaluation criteria, including accuracy, precision, recall, and f1-score, consistently showed high performance with a value of 0.99, confirming the effectiveness of the proposed methodology. This study's results demonstrate substantial advancements in plant disease detection and underscore the capabilities of YOLOv4 as a sophisticated tool for accurate disease prediction. These developments have significant significance for everyone involved in agriculture, researchers, and farmers, providing improved capacities for disease control and crop protection.
Collapse
Affiliation(s)
- Eman Abdullah Aldakheel
- Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia
| | - Mohammed Zakariah
- Department of Computer Science, College of Computer and Information Science, King Saud University, Riyadh, Saudi Arabia
| | - Amira H. Alabdalall
- Department of Biology, College of Science, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| |
Collapse
|
6
|
Prasad KV, Vaidya H, Rajashekhar C, Karekal KS, Sali R, Nisar KS. Multiclass classification of diseased grape leaf identification using deep convolutional neural network(DCNN) classifier. Sci Rep 2024; 14:9002. [PMID: 38637587 PMCID: PMC11026459 DOI: 10.1038/s41598-024-59562-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Accepted: 04/12/2024] [Indexed: 04/20/2024] Open
Abstract
The cultivation of grapes encounters various challenges, such as the presence of pests and diseases, which have the potential to considerably diminish agricultural productivity. Plant diseases pose a significant impediment, resulting in diminished agricultural productivity and economic setbacks, thereby affecting the quality of crop yields. Hence, the precise and timely identification of plant diseases holds significant importance. This study employs a Convolutional neural network (CNN) with and without data augmentation, in addition to a DCNN Classifier model based on VGG16, to classify grape leaf diseases. A publicly available dataset is utilized for the purpose of investigating diseases affecting grape leaves. The DCNN Classifier Model successfully utilizes the strengths of the VGG16 model and modifies it by incorporating supplementary layers to enhance its performance and ability to generalize. Systematic evaluation of metrics, such as accuracy and F1-score, is performed. With training and test accuracy rates of 99.18 and 99.06%, respectively, the DCNN Classifier model does a better job than the CNN models used in this investigation. The findings demonstrate that the DCNN Classifier model, utilizing the VGG16 architecture and incorporating three supplementary CNN layers, exhibits superior performance. Also, the fact that the DCNN Classifier model works well as a decision support system for farmers is shown by the fact that it can quickly and accurately identify grape diseases, making it easier to take steps to stop them. The results of this study provide support for the reliability of the DCNN classifier model and its potential utility in the field of agriculture.
Collapse
Affiliation(s)
- Kerehalli Vinayaka Prasad
- Department of Studies in Mathematics, Vijayanagara Sri Krishnadevaraya University, Ballari, Karnataka, India
| | - Hanumesh Vaidya
- Department of Studies in Mathematics, Vijayanagara Sri Krishnadevaraya University, Ballari, Karnataka, India
| | - Choudhari Rajashekhar
- Department of Mathematics, Manipal Institute of Technology Bengaluru, Manipal Academy of Higher Education, Manipal, Karnataka, India
| | - Kumar Swamy Karekal
- Department of Studies in Computer Science, Vijayanagara Sri Krishnadevaraya University, Ballari, Karnataka, India
| | - Renuka Sali
- Department of Studies in Computer Science, Vijayanagara Sri Krishnadevaraya University, Ballari, Karnataka, India
| | - Kottakkaran Sooppy Nisar
- Department of Mathematics, College of Science and Humanities in Alkharj, Prince Sattam Bin Abdulaziz University, Alkharj, 11942, Saudi Arabia.
| |
Collapse
|
7
|
Zahra U, Khan MA, Alhaisoni M, Alasiry A, Marzougui M, Masood A. An Integrated Framework of Two-Stream Deep Learning Models Optimal Information Fusion for Fruits Disease Recognition. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING 2024; 17:3038-3052. [DOI: 10.1109/jstars.2023.3339297] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/25/2024]
Affiliation(s)
- Unber Zahra
- Department of Computer Science, HITEC University, Taxila, Pakistan
| | | | - Majed Alhaisoni
- Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah Bint Abdul Rahman University, Riyadh, Saudi Arabia
| | - Areej Alasiry
- College of Computer Science, King Khalid University, Abha, Saudi Arabia
| | - Mehrez Marzougui
- College of Computer Science, King Khalid University, Abha, Saudi Arabia
| | - Anum Masood
- Department of Physics, Norwegian University of Science and Technology, Trondheim, Norway
| |
Collapse
|
8
|
Lv Z, Cheng C, Lv H. Automatic identification of pavement cracks in public roads using an optimized deep convolutional neural network model. PHILOSOPHICAL TRANSACTIONS. SERIES A, MATHEMATICAL, PHYSICAL, AND ENGINEERING SCIENCES 2023; 381:20220169. [PMID: 37454685 DOI: 10.1098/rsta.2022.0169] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/10/2022] [Accepted: 08/19/2022] [Indexed: 07/18/2023]
Abstract
The current study aims to improve the efficiency of automatic identification of pavement distress and improve the status quo of difficult identification and detection of pavement distress. First, the identification method of pavement distress and the types of pavement distress are analysed. Then, the design concept of deep learning in pavement distress recognition is described. Finally, the mask region-based convolutional neural network (Mask R-CNN) model is designed and applied in the recognition of road crack distress. The results show that in the evaluation of the model's comprehensive recognition performance, the highest accuracy is 99%, and the lowest accuracy is 95% after the test and evaluation of the designed model in different datasets. In the evaluation of different crack identification and detection methods, the highest accuracy of transverse crack detection is 98% and the lowest accuracy is 95%. In longitudinal crack detection, the highest accuracy is 98% and the lowest accuracy is 92%. In mesh crack detection, the highest accuracy is 98% and the lowest accuracy is 92%. This work not only provides an in-depth reference for the application of deep CNNs in pavement distress recognition but also promotes the improvement of road traffic conditions, thus contributing to the progression of smart cities in the future. This article is part of the theme issue 'Artificial intelligence in failure analysis of transportation infrastructure and materials'.
Collapse
Affiliation(s)
- Zhihan Lv
- Department of Game design, Faculty of Arts, 752 36 Uppsala, Uppsala University, Sweden
| | - Chen Cheng
- The Second Monitoring and Application Center, CEA, Xìan, People's Republic of China
| | - Haibin Lv
- North China Sea Offshore Engineering Survey Institute, Ministry Of Natural Resources North Sea Bureau, People's Republic of China
| |
Collapse
|
9
|
Liu Z, Wang S, Zhang Y, Feng Y, Liu J, Zhu H. Artificial Intelligence in Food Safety: A Decade Review and Bibliometric Analysis. Foods 2023; 12:1242. [PMID: 36981168 PMCID: PMC10048131 DOI: 10.3390/foods12061242] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Revised: 03/06/2023] [Accepted: 03/09/2023] [Indexed: 03/17/2023] Open
Abstract
Artificial Intelligence (AI) technologies have been powerful solutions used to improve food yield, quality, and nutrition, increase safety and traceability while decreasing resource consumption, and eliminate food waste. Compared with several qualitative reviews on AI in food safety, we conducted an in-depth quantitative and systematic review based on the Core Collection database of WoS (Web of Science). To discover the historical trajectory and identify future trends, we analysed the literature concerning AI technologies in food safety from 2012 to 2022 by CiteSpace. In this review, we used bibliometric methods to describe the development of AI in food safety, including performance analysis, science mapping, and network analysis by CiteSpace. Among the 1855 selected articles, China and the United States contributed the most literature, and the Chinese Academy of Sciences released the largest number of relevant articles. Among all the journals in this field, PLoS ONE and Computers and Electronics in Agriculture ranked first and second in terms of annual publications and co-citation frequency. The present character, hot spots, and future research trends of AI technologies in food safety research were determined. Furthermore, based on our analyses, we provide researchers, practitioners, and policymakers with the big picture of research on AI in food safety across the whole process, from precision agriculture to precision nutrition, through 28 enlightening articles.
Collapse
Affiliation(s)
- Zhe Liu
- School of Management, Henan University of Technology, Zhengzhou 450001, China
| | - Shuzhe Wang
- School of Management, Henan University of Technology, Zhengzhou 450001, China
| | - Yudong Zhang
- School of Computing and Mathematical Sciences, University of Leicester, Leicester LE1 7RH, UK
| | - Yichen Feng
- School of Management, Henan University of Technology, Zhengzhou 450001, China
| | - Jiajia Liu
- School of Management, Henan University of Technology, Zhengzhou 450001, China
| | - Hengde Zhu
- School of Computing and Mathematical Sciences, University of Leicester, Leicester LE1 7RH, UK
| |
Collapse
|
10
|
Bhandari M, Shahi TB, Neupane A, Walsh KB. BotanicX-AI: Identification of Tomato Leaf Diseases Using an Explanation-Driven Deep-Learning Model. J Imaging 2023; 9:jimaging9020053. [PMID: 36826972 PMCID: PMC9964407 DOI: 10.3390/jimaging9020053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2022] [Revised: 02/13/2023] [Accepted: 02/14/2023] [Indexed: 02/23/2023] Open
Abstract
Early and accurate tomato disease detection using easily available leaf photos is essential for farmers and stakeholders as it help reduce yield loss due to possible disease epidemics. This paper aims to visually identify nine different infectious diseases (bacterial spot, early blight, Septoria leaf spot, late blight, leaf mold, two-spotted spider mite, mosaic virus, target spot, and yellow leaf curl virus) in tomato leaves in addition to healthy leaves. We implemented EfficientNetB5 with a tomato leaf disease (TLD) dataset without any segmentation, and the model achieved an average training accuracy of 99.84% ± 0.10%, average validation accuracy of 98.28% ± 0.20%, and average test accuracy of 99.07% ± 0.38% over 10 cross folds.The use of gradient-weighted class activation mapping (GradCAM) and local interpretable model-agnostic explanations are proposed to provide model interpretability, which is essential to predictive performance, helpful in building trust, and required for integration into agricultural practice.
Collapse
Affiliation(s)
- Mohan Bhandari
- Department of Science and Technology, Samriddhi College, Bhaktapur 44800, Nepal
| | - Tej Bahadur Shahi
- School of Engineering and Technology, Central Queensland University, Norman Gardens, Rockhampton 4701, Australia
- Central Department of Computer Science and IT, Tribhuvan University, Kathmandu 44600, Nepal
| | - Arjun Neupane
- School of Engineering and Technology, Central Queensland University, Norman Gardens, Rockhampton 4701, Australia
- Correspondence:
| | - Kerry Brian Walsh
- Institute for Future Farming Systems, Central Queensland University, Rockhampton 4701, Australia
| |
Collapse
|
11
|
Shi T, Liu Y, Zheng X, Hu K, Huang H, Liu H, Huang H. Recent advances in plant disease severity assessment using convolutional neural networks. Sci Rep 2023; 13:2336. [PMID: 36759626 PMCID: PMC9911734 DOI: 10.1038/s41598-023-29230-7] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Accepted: 01/31/2023] [Indexed: 02/11/2023] Open
Abstract
In modern agricultural production, the severity of diseases is an important factor that directly affects the yield and quality of plants. In order to effectively monitor and control the entire production process of plants, not only the type of disease, but also the severity of the disease must be clarified. In recent years, deep learning for plant disease species identification has been widely used. In particular, the application of convolutional neural network (CNN) to plant disease images has made breakthrough progress. However, there are relatively few studies on disease severity assessment. The group first traced the prevailing views of existing disease researchers to provide criteria for grading the severity of plant diseases. Then, depending on the network architecture, this study outlined 16 studies on CNN-based plant disease severity assessment in terms of classical CNN frameworks, improved CNN architectures and CNN-based segmentation networks, and provided a detailed comparative analysis of the advantages and disadvantages of each. Common methods for acquiring datasets and performance evaluation metrics for CNN models were investigated. Finally, this study discussed the major challenges faced by CNN-based plant disease severity assessment methods in practical applications, and provided feasible research ideas and possible solutions to address these challenges.
Collapse
Affiliation(s)
- Tingting Shi
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, 410004, China
- Research Center of Smart Forestry Cloud, Central South University of Forestry and Technology, Changsha, 410004, China
| | - Yongmin Liu
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, 410004, China.
- Research Center of Smart Forestry Cloud, Central South University of Forestry and Technology, Changsha, 410004, China.
| | - Xinying Zheng
- Business School of Hunan Normal University, Changsha, 410081, China
| | - Kui Hu
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, 410004, China
- Research Center of Smart Forestry Cloud, Central South University of Forestry and Technology, Changsha, 410004, China
| | - Hao Huang
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, 410004, China
- Research Center of Smart Forestry Cloud, Central South University of Forestry and Technology, Changsha, 410004, China
| | - Hanlin Liu
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, 410004, China
- Research Center of Smart Forestry Cloud, Central South University of Forestry and Technology, Changsha, 410004, China
| | - Hongxu Huang
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, 410004, China
- Research Center of Smart Forestry Cloud, Central South University of Forestry and Technology, Changsha, 410004, China
| |
Collapse
|
12
|
Bożko A, Ambroziak L. Influence of Insufficient Dataset Augmentation on IoU and Detection Threshold in CNN Training for Object Detection on Aerial Images. SENSORS (BASEL, SWITZERLAND) 2022; 22:9080. [PMID: 36501781 PMCID: PMC9740240 DOI: 10.3390/s22239080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2022] [Revised: 11/18/2022] [Accepted: 11/21/2022] [Indexed: 06/17/2023]
Abstract
The objects and events detection tasks are being performed progressively often by robotic systems like unmanned aerial vehicles (UAV) or unmanned surface vehicles (USV). Autonomous operations and intelligent sensing are becoming standard in numerous scenarios such as supervision or even search and rescue (SAR) missions. The low cost of autonomous vehicles, vision sensors and portable computers allows the incorporation of the deep learning, mainly convolutional neural networks (CNN) in these solutions. Many systems meant for custom purposes rely on insufficient training datasets, what may cause a decrease of effectiveness. Moreover, the system's accuracy is usually dependent on the returned bounding boxes highlighting the supposed targets. In desktop applications, precise localisation might not be particularly relevant; however, in real situations, with low visibility and non-optimal camera orientation, it becomes crucial. One of the solutions for dataset enhancement is its augmentation. The presented work is an attempt to evaluate the influence of the training images augmentation on the detection parameters important for the effectiveness of neural networks in the context of object detection. In this research, network appraisal relies on the detection confidence and bounding box prediction accuracy (IoU). All the applied image modifications were simple pattern and colour alterations. The obtained results imply that there is a measurable impact of the augmentation process on the localisation accuracy. It was concluded that a positive or negative influence is related to the complexity and variability of the objects classes.
Collapse
|
13
|
Cruz M, Mafra S, Teixeira E, Figueiredo F. Smart Strawberry Farming Using Edge Computing and IoT. SENSORS (BASEL, SWITZERLAND) 2022; 22:5866. [PMID: 35957425 PMCID: PMC9371401 DOI: 10.3390/s22155866] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Revised: 07/27/2022] [Accepted: 07/29/2022] [Indexed: 05/02/2023]
Abstract
Strawberries are sensitive fruits that are afflicted by various pests and diseases. Therefore, there is an intense use of agrochemicals and pesticides during production. Due to their sensitivity, temperatures or humidity at extreme levels can cause various damages to the plantation and to the quality of the fruit. To mitigate the problem, this study developed an edge technology capable of handling the collection, analysis, prediction, and detection of heterogeneous data in strawberry farming. The proposed IoT platform integrates various monitoring services into one common platform for digital farming. The system connects and manages Internet of Things (IoT) devices to analyze environmental and crop information. In addition, a computer vision model using Yolo v5 architecture searches for seven of the most common strawberry diseases in real time. This model supports efficient disease detection with 92% accuracy. Moreover, the system supports LoRa communication for transmitting data between the nodes at long distances. In addition, the IoT platform integrates machine learning capabilities for capturing outliers in collected data, ensuring reliable information for the user. All these technologies are unified to mitigate the disease problem and the environmental damage on the plantation. The proposed system is verified through implementation and tested on a strawberry farm, where the capabilities were analyzed and assessed.
Collapse
Affiliation(s)
| | - Samuel Mafra
- Instituto Nacional de Telecomunições (INATEL) Santa Rita Sapucai, Santa Rita do Sapucai 37540-000, MG, Brazil
| | | | | |
Collapse
|
14
|
Smart Agriculture Applications Using Deep Learning Technologies: A Survey. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12125919] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Agriculture is considered an important field with a significant economic impact in several countries. Due to the substantial population growth, meeting people’s dietary needs has become a relevant concern. The transition to smart agriculture has become inevitable to achieve these food security goals. In recent years, deep learning techniques, such as convolutional neural networks (CNN) and recurrent neural networks (RNN), have been intensely researched and applied in various fields, including agriculture. This study analyzed the recent research articles on deep learning techniques in agriculture over the previous five years and discussed the most important contributions and the challenges that have been solved. Furthermore, we investigated the agriculture parameters being monitored by the internet of things and used them to feed the deep learning algorithm for analysis. Additionally, we compared different studies regarding focused agriculture area, problems solved, the dataset used, the deep learning model used, the framework used, data preprocessing and augmentation method, and results with accuracy. We concluded in this survey that although CNN provides better results, it lacks in early detection of plant diseases. To cope with this issue, we proposed an intelligent agriculture system based on a hybrid model of CNN and SVM, capable of detecting and classifying plant leaves disease early.
Collapse
|
15
|
Albattah W, Javed A, Nawaz M, Masood M, Albahli S. Artificial Intelligence-Based Drone System for Multiclass Plant Disease Detection Using an Improved Efficient Convolutional Neural Network. FRONTIERS IN PLANT SCIENCE 2022; 13:808380. [PMID: 35755664 PMCID: PMC9218756 DOI: 10.3389/fpls.2022.808380] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Accepted: 04/08/2022] [Indexed: 05/31/2023]
Abstract
The role of agricultural development is very important in the economy of a country. However, the occurrence of several plant diseases is a major hindrance to the growth rate and quality of crops. The exact determination and categorization of crop leaf diseases is a complex and time-required activity due to the occurrence of low contrast information in the input samples. Moreover, the alterations in the size, location, structure of crop diseased portion, and existence of noise and blurriness effect in the input images further complicate the classification task. To solve the problems of existing techniques, a robust drone-based deep learning approach is proposed. More specifically, we have introduced an improved EfficientNetV2-B4 with additional added dense layers at the end of the architecture. The customized EfficientNetV2-B4 calculates the deep key points and classifies them in their related classes by utilizing an end-to-end training architecture. For performance evaluation, a standard dataset, namely, the PlantVillage Kaggle along with the samples captured using a drone is used which is complicated in the aspect of varying image samples with diverse image capturing conditions. We attained the average precision, recall, and accuracy values of 99.63, 99.93, and 99.99%, respectively. The obtained results confirm the robustness of our approach in comparison to other recent techniques and also show less time complexity.
Collapse
Affiliation(s)
- Waleed Albattah
- Department of Information Technology, College of Computer, Qassim University, Buraydah, Saudi Arabia
| | - Ali Javed
- Department of Computer Science, University of Engineering and Technology Taxila, Taxila, Pakistan
| | - Marriam Nawaz
- Department of Computer Science, University of Engineering and Technology Taxila, Taxila, Pakistan
| | - Momina Masood
- Department of Computer Science, University of Engineering and Technology Taxila, Taxila, Pakistan
| | - Saleh Albahli
- Department of Information Technology, College of Computer, Qassim University, Buraydah, Saudi Arabia
| |
Collapse
|
16
|
A Hybrid Model for Leaf Diseases Classification Based on the Modified Deep Transfer Learning and Ensemble Approach for Agricultural AIoT-Based Monitoring. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:6504616. [PMID: 35422854 PMCID: PMC9005283 DOI: 10.1155/2022/6504616] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/26/2022] [Accepted: 03/02/2022] [Indexed: 12/14/2022]
Abstract
As possible diseases develop on plant leaves, classification is constantly hampered by obstacles such as overfitting and low accuracy. To distinguish healthy products from defective ones, the agricultural industry requires precise and error-free analysis. Deep convolutional neural networks are an efficient model of autonomous feature extraction that has been shown to be fairly effective for detection and classification tasks. However, deep convolutional neural networks often require a large amount of training data, cannot be translated, and need a number of parameters to be specified and tweaked. This paper proposes a highly effective structure that can be applied to classifying multiple leaf diseases of plants and fruits during the feature extraction step. It uses a deep transfer learning model that has been modified to serve this purpose. In summary, we use model engineering (ME) to extract features. Multiple support vector machine (SVM) models are employed to enhance feature discrimination and processing speed. The kernel parameters of the radial basis function (RBF) are determined based on the selected model in the training step. PlantVillage and UCI datasets were used to analyze six leaf image sets containing healthy and diseased leaves of apple, corn, cotton, grape, pepper, and rice. The classification process resulted in approximately 90,000 images. During the experimental implementation phase, the results show the potential of a powerful model in classification operations, which will be beneficial for a variety of future leaf disease diagnostic applications for the agricultural industry.
Collapse
|