1
|
Wang Y, Wang Y, Mu J, Raza Mustafa G, Wu Q, Wang Y, Zhao B, Zhao S. Enhanced multiscale plant disease detection with the PYOLO model innovations. Sci Rep 2025; 15:5179. [PMID: 39939662 PMCID: PMC11821822 DOI: 10.1038/s41598-025-89034-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2024] [Accepted: 02/03/2025] [Indexed: 02/14/2025] Open
Abstract
Timely detection of plant diseases is crucial for agricultural safety, product quality, and environmental protection. However, plant disease detection faces several challenges, including the diversity of plant disease scenarios and complex backgrounds. To address these issues, we propose a plant disease detection model named PYOLO. Firstly, the model enhances feature fusion capabilities by optimizing the PAN structure, introducing a weighted bidirectional feature pyramid network (BiFPN), and repeatedly fusing top and bottom scale features. Additionally, the model's ability to focus on different parts of the image is improved by redesigning the EC2f structure and dynamically adjusting the convolutional kernel size to better capture features at various scales. Finally, the MHC2f mechanism is designed to enhance the model's ability to perceive complex backgrounds and targets at different scales by utilizing its self-attention mechanism for parallel processing. Experiments demonstrate that the model's mAP value increases by 4.1% compared to YOLOv8n, confirming its superiority in plant disease detection.
Collapse
Affiliation(s)
- Yirong Wang
- College of Water Conservancy and Hydropower, Sichuan Agricultural University, Yaan, Sichuan, China
- College of Life Science, Sichuan Agricultural University, Yaan, Sichuan, China
| | - Yuhao Wang
- College of Water Conservancy and Hydropower, Sichuan Agricultural University, Yaan, Sichuan, China
- College of Information Engineering, Sichuan Agricultural University, Yaan, Sichuan, China
| | - Jiong Mu
- College of Information Engineering, Sichuan Agricultural University, Yaan, Sichuan, China
| | | | - Qianqian Wu
- College of Information Engineering, Sichuan Agricultural University, Yaan, Sichuan, China
| | - Ying Wang
- College of Water Conservancy and Hydropower, Sichuan Agricultural University, Yaan, Sichuan, China
| | - Bi Zhao
- Tea Research Institute, Yunnan Academy of Agricultural Sciences, Yunnan Key Laboratory of Tea Science, Kunming, 650205, China.
| | - Siyue Zhao
- College of Water Conservancy and Hydropower, Sichuan Agricultural University, Yaan, Sichuan, China.
- College of Life Science, Sichuan Agricultural University, Yaan, Sichuan, China.
| |
Collapse
|
2
|
Mac TT, Nguyen TD, Dang HK, Nguyen DT, Nguyen XT. Intelligent agricultural robotic detection system for greenhouse tomato leaf diseases using soft computing techniques and deep learning. Sci Rep 2024; 14:23887. [PMID: 39396063 PMCID: PMC11470943 DOI: 10.1038/s41598-024-75285-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2024] [Accepted: 10/03/2024] [Indexed: 10/14/2024] Open
Abstract
The development of soft computing methods has had a significant influence on the subject of autonomous intelligent agriculture. This paper offers a system for autonomous greenhouse navigation that employs a fuzzy control algorithm and a deep learning-based disease classification model for tomato plants, identifying illnesses using photos of tomato leaves. The primary novelty in this study is the introduction of an upgraded Deep Convolutional Generative Adversarial Network (DCGAN) that creates augmented pictures of disease tomato leaves from original genuine samples, considerably enhancing the training dataset. To find the optimum training model, four deep learning networks (VGG19, Inception-v3, DenseNet-201, and ResNet-152) were carefully compared on a dataset of nine tomato leaf disease classes. These models have validation accuracy of 92.32%, 90.83%, 96.61%, and 97.07%, respectively, when using the original PlantVillage dataset. The system then uses an enhanced dataset with ResNet-152 network design to achieve a high accuracy of 99.69%, as compared to the original dataset with ResNet-152's accuracy of 97.07%. This improvement indicates the use of the proposed DCGAN in improving the performance of the deep learning model for greenhouse plant monitoring and disease detection. Furthermore, the proposed approach may have a broader use in various agricultural scenarios, potentially altering the field of autonomous intelligent agriculture.
Collapse
Affiliation(s)
- Thi Thoa Mac
- School of Mechanical Engineering, Hanoi University of Science and Technology, 1st Dai Co Viet Road, Hai Ba Trung District, Hanoi, 100000, Vietnam
| | - Tien-Duc Nguyen
- School of Mechanical Engineering, Hanoi University of Science and Technology, 1st Dai Co Viet Road, Hai Ba Trung District, Hanoi, 100000, Vietnam.
| | - Hong-Ky Dang
- School of Mechanical Engineering, Hanoi University of Science and Technology, 1st Dai Co Viet Road, Hai Ba Trung District, Hanoi, 100000, Vietnam
| | - Duc-Toan Nguyen
- School of Mechanical Engineering, Hanoi University of Science and Technology, 1st Dai Co Viet Road, Hai Ba Trung District, Hanoi, 100000, Vietnam
| | - Xuan-Thuan Nguyen
- School of Mechanical Engineering, Hanoi University of Science and Technology, 1st Dai Co Viet Road, Hai Ba Trung District, Hanoi, 100000, Vietnam
| |
Collapse
|
3
|
Whata A, Dibeco K, Madzima K, Obagbuwa I. Uncertainty quantification in multi-class image classification using chest X-ray images of COVID-19 and pneumonia. Front Artif Intell 2024; 7:1410841. [PMID: 39359646 PMCID: PMC11445153 DOI: 10.3389/frai.2024.1410841] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2024] [Accepted: 08/29/2024] [Indexed: 10/04/2024] Open
Abstract
This paper investigates uncertainty quantification (UQ) techniques in multi-class classification of chest X-ray images (COVID-19, Pneumonia, and Normal). We evaluate Bayesian Neural Networks (BNN) and the Deep Neural Network with UQ (DNN with UQ) techniques, including Monte Carlo dropout, Ensemble Bayesian Neural Network (EBNN), Ensemble Monte Carlo (EMC) dropout, across different evaluation metrics. Our analysis reveals that DNN with UQ, especially EBNN and EMC dropout, consistently outperform BNNs. For example, in Class 0 vs. All, EBNN achieved a UAcc of 92.6%, UAUC-ROC of 95.0%, and a Brier Score of 0.157, significantly surpassing BNN's performance. Similarly, EMC Dropout excelled in Class 1 vs. All with a UAcc of 83.5%, UAUC-ROC of 95.8%, and a Brier Score of 0.165. These advanced models demonstrated higher accuracy, better discriaminative capability, and more accurate probabilistic predictions. Our findings highlight the efficacy of DNN with UQ in enhancing model reliability and interpretability, making them highly suitable for critical healthcare applications like chest X-ray imageQ6 classification.
Collapse
Affiliation(s)
- Albert Whata
- Department of Mathematical Sciences, Sol Plaatje University, Kimberley, South Africa
| | - Katlego Dibeco
- Department of Mathematical Sciences, Sol Plaatje University, Kimberley, South Africa
| | - Kudakwashe Madzima
- Department of Computer Science and Information Technology, Sol Plaatje University, Kimberley, South Africa
| | - Ibidun Obagbuwa
- Department of Computer Science and Information Technology, Sol Plaatje University, Kimberley, South Africa
| |
Collapse
|
4
|
Stock M, Pieters O, De Swaef T, wyffels F. Plant science in the age of simulation intelligence. FRONTIERS IN PLANT SCIENCE 2024; 14:1299208. [PMID: 38293629 PMCID: PMC10824965 DOI: 10.3389/fpls.2023.1299208] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Accepted: 12/07/2023] [Indexed: 02/01/2024]
Abstract
Historically, plant and crop sciences have been quantitative fields that intensively use measurements and modeling. Traditionally, researchers choose between two dominant modeling approaches: mechanistic plant growth models or data-driven, statistical methodologies. At the intersection of both paradigms, a novel approach referred to as "simulation intelligence", has emerged as a powerful tool for comprehending and controlling complex systems, including plants and crops. This work explores the transformative potential for the plant science community of the nine simulation intelligence motifs, from understanding molecular plant processes to optimizing greenhouse control. Many of these concepts, such as surrogate models and agent-based modeling, have gained prominence in plant and crop sciences. In contrast, some motifs, such as open-ended optimization or program synthesis, still need to be explored further. The motifs of simulation intelligence can potentially revolutionize breeding and precision farming towards more sustainable food production.
Collapse
Affiliation(s)
- Michiel Stock
- KERMIT and Biobix, Department of Data Analysis and Mathematical Modelling, Ghent University, Ghent, Belgium
| | - Olivier Pieters
- IDLAB-AIRO, Ghent University, imec, Ghent, Belgium
- Plant Sciences Unit, Flanders Research Institute for Agriculture, Fisheries and Food, Melle, Belgium
| | - Tom De Swaef
- Plant Sciences Unit, Flanders Research Institute for Agriculture, Fisheries and Food, Melle, Belgium
| | | |
Collapse
|
5
|
Jeger M, Hamelin F, Cunniffe N. Emerging Themes and Approaches in Plant Virus Epidemiology. PHYTOPATHOLOGY 2023; 113:1630-1646. [PMID: 36647183 DOI: 10.1094/phyto-10-22-0378-v] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
Plant diseases caused by viruses share many common features with those caused by other pathogen taxa in terms of the host-pathogen interaction, but there are also distinctive features in epidemiology, most apparent where transmission is by vectors. Consequently, the host-virus-vector-environment interaction presents a continuing challenge in attempts to understand and predict the course of plant virus epidemics. Theoretical concepts, based on the underlying biology, can be expressed in mathematical models and tested through quantitative assessments of epidemics in the field; this remains a goal in understanding why plant virus epidemics occur and how they can be controlled. To this end, this review identifies recent emerging themes and approaches to fill in knowledge gaps in plant virus epidemiology. We review quantitative work on the impact of climatic fluctuations and change on plants, viruses, and vectors under different scenarios where impacts on the individual components of the plant-virus-vector interaction may vary disproportionately; there is a continuing, sometimes discordant, debate on host resistance and tolerance as plant defense mechanisms, including aspects of farmer behavior and attitudes toward disease management that may affect deployment in crops; disentangling host-virus-vector-environment interactions, as these contribute to temporal and spatial disease progress in field populations; computational techniques for estimating epidemiological parameters from field observations; and the use of optimal control analysis to assess disease control options. We end by proposing new challenges and questions in plant virus epidemiology.
Collapse
Affiliation(s)
- Mike Jeger
- Department of Life Sciences, Imperial College London, Silwood Park, U.K
| | - Fred Hamelin
- IGEPP INRAE, University of Rennes, Rennes, France
| | - Nik Cunniffe
- Department of Plant Sciences, University of Cambridge, Cambridge, U.K
| |
Collapse
|
6
|
Kang M, Kang S. Surrogate approach to uncertainty quantification of neural networks for regression. Appl Soft Comput 2023. [DOI: 10.1016/j.asoc.2023.110234] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/28/2023]
|
7
|
Liu LC, Lv KC, Zheng YJ. Crop cultivation planning with fuzzy estimation using water wave optimization. FRONTIERS IN PLANT SCIENCE 2023; 14:1139094. [PMID: 36950353 PMCID: PMC10027006 DOI: 10.3389/fpls.2023.1139094] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/06/2023] [Accepted: 02/03/2023] [Indexed: 06/18/2023]
Abstract
In a complex agricultural region, determine the appropriate crop for each plot of land to maximize the expected total profit is the key problem in cultivation management. However, many factors such as cost, yield, and selling price are typically uncertain, which causes an exact programming method impractical. In this paper, we present a problem of crop cultivation planning, where the uncertain factors are estimated as fuzzy parameters. We adapt an efficient evolutionary algorithm, water wave optimization (WWO), to solve this problem, where each solution is evaluated based on three metrics including the expected, optimistic and pessimistic values, the combination of which enables the algorithm to search credible solutions under uncertain conditions. Test results on a set of agricultural regions in East China showed that the solutions of our fuzzy optimization approach obtained significantly higher profits than those of non-fuzzy optimization methods based on only the expected values.
Collapse
|
8
|
Wang X, Dong H. Click-through Rate Prediction and Uncertainty Quantification Based on Bayesian Deep Learning. ENTROPY (BASEL, SWITZERLAND) 2023; 25:406. [PMID: 36981295 PMCID: PMC10048037 DOI: 10.3390/e25030406] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Revised: 02/16/2023] [Accepted: 02/21/2023] [Indexed: 06/18/2023]
Abstract
Click-through rate (CTR) prediction is a research point for measuring recommendation systems and calculating AD traffic. Existing studies have proved that deep learning performs very well in prediction tasks, but most of the existing studies are based on deterministic models, and there is a big gap in capturing uncertainty. Modeling uncertainty is a major challenge when using machine learning solutions to solve real-world problems in various domains. In order to quantify the uncertainty of the model and achieve accurate and reliable prediction results. This paper designs a CTR prediction framework combining feature selection and feature interaction. In this framework, a CTR prediction model based on Bayesian deep learning is proposed to quantify the uncertainty in the prediction model. On the squeeze network and DNN parallel prediction model framework, the approximate posterior parameter distribution of the model is obtained using the Monte Carlo dropout, and obtains the integrated prediction results. Epistemic and aleatoric uncertainty are defined and adopt information entropy to calculate the sum of the two kinds of uncertainties. Epistemic uncertainty could be measured by mutual information. Experimental results show that the model proposed is superior to other models in terms of prediction performance and has the ability to quantify uncertainty.
Collapse
|
9
|
Cifci MA. A Deep Learning-Based Framework for Uncertainty Quantification in Medical Imaging Using the DropWeak Technique: An Empirical Study with Baresnet. Diagnostics (Basel) 2023; 13:800. [PMID: 36832288 PMCID: PMC9955446 DOI: 10.3390/diagnostics13040800] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2023] [Revised: 02/13/2023] [Accepted: 02/15/2023] [Indexed: 02/22/2023] Open
Abstract
Lung cancer is a leading cause of cancer-related deaths globally. Early detection is crucial for improving patient survival rates. Deep learning (DL) has shown promise in the medical field, but its accuracy must be evaluated, particularly in the context of lung cancer classification. In this study, we conducted uncertainty analysis on various frequently used DL architectures, including Baresnet, to assess the uncertainties in the classification results. This study focuses on the use of deep learning for the classification of lung cancer, which is a critical aspect of improving patient survival rates. The study evaluates the accuracy of various deep learning architectures, including Baresnet, and incorporates uncertainty quantification to assess the level of uncertainty in the classification results. The study presents a novel automatic tumor classification system for lung cancer based on CT images, which achieves a classification accuracy of 97.19% with an uncertainty quantification. The results demonstrate the potential of deep learning in lung cancer classification and highlight the importance of uncertainty quantification in improving the accuracy of classification results. This study's novelty lies in the incorporation of uncertainty quantification in deep learning for lung cancer classification, which can lead to more reliable and accurate diagnoses in clinical settings.
Collapse
Affiliation(s)
- Mehmet Akif Cifci
- The Institute of Computer Technology, Tu Wien University, 1040 Vienna, Austria;
- Department of Computer Eng., Bandirma Onyedi Eylul University, 10200 Balikesir, Turkey
- Department of Informatics, Klaipeda University, 92294 Klaipeda, Lithuania;
| |
Collapse
|
10
|
Sharma V, Tripathi AK, Mittal H. DLMC-Net: Deeper lightweight multi-class classification model for plant leaf disease detection. ECOL INFORM 2023. [DOI: 10.1016/j.ecoinf.2023.102025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/18/2023]
|
11
|
Deshpande R, Patidar H. Tomato plant leaf disease detection using generative adversarial network and deep convolutional neural network. THE IMAGING SCIENCE JOURNAL 2023. [DOI: 10.1080/13682199.2022.2161696] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Affiliation(s)
- Rashmi Deshpande
- Department of Electronics & Communication Engineering, Oriental University, Indore, Madhya Pradesh, India
| | - Hemant Patidar
- Department of Electronics & Communication Engineering, Oriental University, Indore, Madhya Pradesh, India
| |
Collapse
|
12
|
Chulif S, Lee SH, Chang YL, Chai KC. A machine learning approach for cross-domain plant identification using herbarium specimens. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07951-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
AbstractThe preservation of plant specimens in herbaria has been carried out for centuries in efforts to study and confirm plant taxa. With the increasing collection of herbaria made available digitally, it is practical to use herbarium specimens for the automation of plant identification. They are also substantially more accessible and less expensive to obtain compared to field images. In fact, in remote and inaccessible habitats, field images of rare plant species are still immensely lacking. As a result, rare plant species identification is challenging due to the deficiency of training data. To address this problem, we investigate a cross-domain adaptation approach that allows knowledge transfer from a model learned from herbarium specimens to field images. We propose a model called Herbarium–Field Triplet Loss Network (HFTL network) to learn the mapping between herbarium and field domains. Specifically, the model is trained to maximize the embedding distance of different plant species and minimize the embedding distance of the same plant species given herbarium–field pairs. This paper presents the implementation and performance of the HFTL network to assess the herbarium–field similarity of plants. It corresponds to the cross-domain plant identification challenge in PlantCLEF 2020 and PlantCLEF 2021. Despite the lack of field images, our results show that the network can generalize and identify rare species. Our proposed HFTL network achieved a mean reciprocal rank score of 0.108 and 0.158 on the test set related to the species with few training field photographs in PlantCLEF 2020 and PlantCLEF 2021, respectively.
Collapse
|
13
|
Liu G, Jin H, Li J, Hu X, Li J. A Bayesian deep learning method for freeway incident detection with uncertainty quantification. ACCIDENT; ANALYSIS AND PREVENTION 2022; 176:106796. [PMID: 35985178 DOI: 10.1016/j.aap.2022.106796] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/07/2021] [Revised: 07/24/2022] [Accepted: 08/05/2022] [Indexed: 06/15/2023]
Abstract
Incident detection is fundamental for freeway management to reduce non-recurrent congestions and secondary incidents. Recently, machine learning technologies have made considerable progress in the incident detection field, but many still face challenges in uncertainty quantification due to the aleatoric uncertainty of traffic data and the epistemic uncertainty of model deviations. In this study, a Bayesian deep learning method was proposed for freeway incident detection with uncertainty quantification. A convolutional neural network variant was designed on a Bayesian framework, and mechanisms of Bayes by backpropagation and local reparameterization technics were used to update the weight of the proposed model. The predictive uncertainty of the proposed method was modeled jointly by integrating the aleatoric and epistemic uncertainty. The proposed model was tested on the PORTAL dataset and compared with four benchmark models: standard normal deviate, wavelet neural network, long-short term memory neural network, and convolutional neural network. The results show that the proposed model outperforms the baseline methods in terms of accuracy, detection rate and false alarm rate. Perturbation experiments were used to test the robustness of the model against noise. The results indicated that the aleatoric uncertainty of the model remained almost constant under different noise levels. The proposed method may benefit future studies on uncertainty quantification while using machine learning method in incident management and other fields in intelligent transportation systems.
Collapse
Affiliation(s)
- Genwang Liu
- Key Laboratory of Road Traffic Engineering of the Ministry of Education, Tongji University, College of Transportation Engineering, Tongji University, 4800 Cao'an Road, Shanghai 201804, PR China.
| | - Haolin Jin
- Fujian Zhengfu Software Co., Ltd, PR China.
| | - Jiaze Li
- School of Software, Zhengzhou University, 450000, 97 Wenhua Road, Jinshui District, Zhengzhou, Henan, PR China.
| | - Xianbiao Hu
- Department of Civil and Environmental Engineering, Pennsylvania State University, University Park, PA 16802, USA.
| | - Jian Li
- Key Laboratory of Road Traffic Engineering of the Ministry of Education, Tongji University, College of Transportation Engineering, Tongji University, 4800 Cao'an Road, Shanghai 201804, PR China.
| |
Collapse
|
14
|
A Lightweight Model for Wheat Ear Fusarium Head Blight Detection Based on RGB Images. REMOTE SENSING 2022. [DOI: 10.3390/rs14143481] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
Detection of the Fusarium head blight (FHB) is crucial for wheat yield protection, with precise and rapid FHB detection increasing wheat yield and protecting the agricultural ecological environment. FHB detection tasks in agricultural production are currently handled by cloud servers and utilize unmanned aerial vehicles (UAVs). Hence, this paper proposed a lightweight model for wheat ear FHB detection based on UAV-enabled edge computing, aiming to achieve the purpose of intelligent prevention and control of agricultural disease. Our model utilized the You Only Look Once version 4 (YOLOv4) and MobileNet deep learning architectures and was applicable in edge devices, balancing accuracy, and FHB detection in real-time. Specifically, the backbone network Cross Stage Partial Darknet53 (CSPDarknet53) of YOLOv4 was replaced by a lightweight network, significantly decreasing the network parameters and the computing complexity. Additionally, we employed the Complete Intersection over Union (CIoU) and Non-Maximum Suppression (NMS) to regress the loss function to guarantee the detection accuracy of FHB. Furthermore, the loss function incorporated the focal loss to reduce the error caused by the unbalanced positive and negative sample distribution. Finally, mixed-up and transfer learning schemes enhanced the model’s generalization ability. The experimental results demonstrated that the proposed model performed admirably well in detecting FHB of the wheat ear, with an accuracy of 93.69%, and it was somewhat better than the MobileNetv2-YOLOv4 model (F1 by 4%, AP by 3.5%, Recall by 4.1%, and Precision by 1.6%). Meanwhile, the suggested model was scaled down to a fifth of the size of the state-of-the-art object detection models. Overall, the proposed model could be deployed on UAVs so that wheat ear FHB detection results could be sent back to the end-users to intelligently decide in time, promoting the intelligent control of agricultural disease.
Collapse
|
15
|
Deep learning-based multi-task prediction system for plant disease and species detection. ECOL INFORM 2022. [DOI: 10.1016/j.ecoinf.2022.101679] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
16
|
Yang J, Guo X, Li Y, Marinello F, Ercisli S, Zhang Z. A survey of few-shot learning in smart agriculture: developments, applications, and challenges. PLANT METHODS 2022; 18:28. [PMID: 35248105 PMCID: PMC8897954 DOI: 10.1186/s13007-022-00866-2] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/20/2021] [Accepted: 03/01/2022] [Indexed: 05/08/2023]
Abstract
With the rise of artificial intelligence, deep learning is gradually applied to the field of agriculture and plant science. However, the excellent performance of deep learning needs to be established on massive numbers of samples. In the field of plant science and biology, it is not easy to obtain a large amount of labeled data. The emergence of few-shot learning solves this problem. It imitates the ability of humans' rapid learning and can learn a new task with only a small number of labeled samples, which greatly reduces the time cost and financial resources. At present, the advanced few-shot learning methods are mainly divided into four categories based on: data augmentation, metric learning, external memory, and parameter optimization, solving the over-fitting problem from different viewpoints. This review comprehensively expounds on few-shot learning in smart agriculture, introduces the definition of few-shot learning, four kinds of learning methods, the publicly available datasets for few-shot learning, various applications in smart agriculture, and the challenges in smart agriculture in future development.
Collapse
Affiliation(s)
- Jiachen Yang
- School of Electrical and Information Engineering, Tianjin University, Tianjin, China
| | - Xiaolan Guo
- School of Electrical and Information Engineering, Tianjin University, Tianjin, China
| | - Yang Li
- College of Mechanical and Electrical Engineering, Shihezi University, Xinjiang, China.
| | - Francesco Marinello
- Department of Land Environment Agriculture and Forestry, University of Padova, Legnaro, Italy
| | - Sezai Ercisli
- Department of Horticulture, Faculty of Agriculture, Ataturk University, Erzurum, Turkey
| | - Zhuo Zhang
- School of Electrical and Information Engineering, Tianjin University, Tianjin, China
| |
Collapse
|
17
|
Zhang Z, Qiao Y, Guo Y, He D. Deep Learning Based Automatic Grape Downy Mildew Detection. FRONTIERS IN PLANT SCIENCE 2022; 13:872107. [PMID: 35755646 PMCID: PMC9227981 DOI: 10.3389/fpls.2022.872107] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/09/2022] [Accepted: 04/27/2022] [Indexed: 05/04/2023]
Abstract
Grape downy mildew (GDM) disease is a common plant leaf disease, and it causes serious damage to grape production, reducing yield and fruit quality. Traditional manual disease detection relies on farm experts and is often time-consuming. Computer vision technologies and artificial intelligence could provide automatic disease detection for real-time controlling the spread of disease on the grapevine in precision viticulture. To achieve the best trade-off between GDM detection accuracy and speed under natural environments, a deep learning based approach named YOLOv5-CA is proposed in this study. Here coordinate attention (CA) mechanism is integrated into YOLOv5, which highlights the downy mildew disease-related visual features to enhance the detection performance. A challenging GDM dataset was acquired in a vineyard under a nature scene (consisting of different illuminations, shadows, and backgrounds) to test the proposed approach. Experimental results show that the proposed YOLOv5-CA achieved a detection precision of 85.59%, a recall of 83.70%, and a mAP@0.5 of 89.55%, which is superior to the popular methods, including Faster R-CNN, YOLOv3, and YOLOv5. Furthermore, our proposed approach with inference occurring at 58.82 frames per second, could be deployed for the real-time disease control requirement. In addition, the proposed YOLOv5-CA based approach could effectively capture leaf disease related visual features resulting in higher GDE detection accuracy. Overall, this study provides a favorable deep learning based approach for the rapid and accurate diagnosis of grape leaf diseases in the field of automatic disease detection.
Collapse
Affiliation(s)
- Zhao Zhang
- College of Mechanical and Electronic Engineering, Northwest A&F University, Xianyang, China
- College of Electronic and Electrical Engineering, Baoji University of Arts and Sciences, Baoji, China
- Key Laboratory of Agricultural Internet of Things, Ministry of Agriculture and Rural Affairs, Northwest A&F University, Xianyang, China
- Shaanxi Key Laboratory of Agricultural Information Perception and Intelligent Service, Northwest A&F University, Xianyang, China
| | - Yongliang Qiao
- Faculty of Engineering, Australian Centre for Field Robotics (ACFR), The University of Sydney, Sydney, NSW, Australia
- *Correspondence: Yongliang Qiao
| | - Yangyang Guo
- College of Mechanical and Electronic Engineering, Northwest A&F University, Xianyang, China
- Key Laboratory of Agricultural Internet of Things, Ministry of Agriculture and Rural Affairs, Northwest A&F University, Xianyang, China
- Shaanxi Key Laboratory of Agricultural Information Perception and Intelligent Service, Northwest A&F University, Xianyang, China
| | - Dongjian He
- College of Mechanical and Electronic Engineering, Northwest A&F University, Xianyang, China
- Key Laboratory of Agricultural Internet of Things, Ministry of Agriculture and Rural Affairs, Northwest A&F University, Xianyang, China
- Shaanxi Key Laboratory of Agricultural Information Perception and Intelligent Service, Northwest A&F University, Xianyang, China
- Dongjian He
| |
Collapse
|
18
|
Jadhav S, Lal AM. Multi-Class Plant Leaf Disease Detection Using a Deep Convolutional Neural Network. INTERNATIONAL JOURNAL OF INFORMATION SYSTEM MODELING AND DESIGN 2022. [DOI: 10.4018/ijismd.315126] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
Traditional machine learning methods of plant leaf disease detection lack successful performances due to poor feature representation and correlation. This paper presents a novel methodology for automatic plant leaf disease detection using cascaded deep convolutional neural network (CDCNN) which focusses on increasing the feature representation and correlation factors. It provides distinctive features that gives low intra-class variability and higher inter-class variability. CDCNN were performed on a plant-village leaf disease database which consists of 13 classes of tomato, potato, and pepper bell plant diseases; DCNN model performs better with an overall accuracy, recall, and precision of 98.50%, 0.98, and 0.97 respectively. Additionally, performance of the proposed algorithm is evaluated on real time cotton leaf database for bacterial blight, leaf miner, and spider mite diseases detection and provides 99.00% accuracy. The proposed DCNN outperforms well compared to traditional machine learning and deep learning models and is able to detect the diseases present in the leaves of the plant.
Collapse
|
19
|
Janakiramaiah B, Kalyani G, Prasad LN, Karuna A, Krishna M. Intelligent system for leaf disease detection using capsule networks for horticulture. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2021. [DOI: 10.3233/jifs-210593] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Horticulture crops take a crucial part of the Indian economy by creating employment, supplying raw materials to different food processing industries. Mangoes are one of the major crops in horticulture. General Infections in Mango trees are common by various climatic and fungal infections, which became a cause for reducing the quality and quantity of the mangos. The most common diseases with bacterial infection are anthracnose and Powdery Mildew. In recent years, it has been perceived that different variants of deep learning architectures are proposed for detecting and classifying the problems in the agricultural domain. The Convolutional Neural Network (CNN) based architectures have performed amazingly well for disease detection in plants but at the same time lacks rotational or spatial invariance. A relatively new neural organization called Capsule Network (CapsNet) addresses these limitations of CNN architectures. Hence, in this work, a variant of CapsNet called Multilevel CapsNet is introduced to characterize the mango leaves tainted by the anthracnose and powdery mildew diseases. The proposed architecture of this work is validated on a dataset of mango leaves collected in the natural environment. The dataset comprises both healthy and contaminated leaf pictures. The test results approved the undeniable level of exactness of the proposed framework for the characterization of mango leaf diseases with an accuracy of 98.5%. The outcomes conceive the higher-order precision of the proposed Multi-level CapsNet model when contrasted with the other classification algorithms such as Support Vector Machine (SVM) and CNNs.
Collapse
Affiliation(s)
- B. Janakiramaiah
- Prasad V. Potluri Siddhartha Institute of Technology, Vijayawada, Andhra Pradesh, India
| | - G. Kalyani
- Velagapudi Ramakrishna Siddhartha Engineering College, Vijayawada, Andhra Pradesh, India
| | | | - A. Karuna
- University College of Engineering Kakinada(A), Jawaharlal Nehru Technological University Kakinada, Andhra Pradesh, India
| | - M. Krishna
- Sir C R Reddy College of Engineering, Eluru, Andhra Pradesh, India
| |
Collapse
|
20
|
Genaev MA, Skolotneva ES, Gultyaeva EI, Orlova EA, Bechtold NP, Afonnikov DA. Image-Based Wheat Fungi Diseases Identification by Deep Learning. PLANTS 2021; 10:plants10081500. [PMID: 34451545 PMCID: PMC8399806 DOI: 10.3390/plants10081500] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/20/2021] [Revised: 06/07/2021] [Accepted: 07/15/2021] [Indexed: 11/19/2022]
Abstract
Diseases of cereals caused by pathogenic fungi can significantly reduce crop yields. Many cultures are exposed to them. The disease is difficult to control on a large scale; thus, one of the relevant approaches is the crop field monitoring, which helps to identify the disease at an early stage and take measures to prevent its spread. One of the effective control methods is disease identification based on the analysis of digital images, with the possibility of obtaining them in field conditions, using mobile devices. In this work, we propose a method for the recognition of five fungal diseases of wheat shoots (leaf rust, stem rust, yellow rust, powdery mildew, and septoria), both separately and in case of multiple diseases, with the possibility of identifying the stage of plant development. A set of 2414 images of wheat fungi diseases (WFD2020) was generated, for which expert labeling was performed by the type of disease. More than 80% of the images in the dataset correspond to single disease labels (including seedlings), more than 12% are represented by healthy plants, and 6% of the images labeled are represented by multiple diseases. In the process of creating this set, a method was applied to reduce the degeneracy of the training data based on the image hashing algorithm. The disease-recognition algorithm is based on the convolutional neural network with the EfficientNet architecture. The best accuracy (0.942) was shown by a network with a training strategy based on augmentation and transfer of image styles. The recognition method was implemented as a bot on the Telegram platform, which allows users to assess plants by lesions in the field conditions.
Collapse
Affiliation(s)
- Mikhail A. Genaev
- Institute of Cytology and Genetics, Siberian Branch of the Russian Academy of Sciences, 630090 Novosibirsk, Russia; (M.A.G.); (E.S.S.)
- Faculty of Natural Sciences, Novosibirsk State University, 630090 Novosibirsk, Russia
- Kurchatov Genomics Center, Institute of Cytology and Genetics, Siberian Branch of the Russian Academy of Sciences, 630090 Novosibirsk, Russia
| | - Ekaterina S. Skolotneva
- Institute of Cytology and Genetics, Siberian Branch of the Russian Academy of Sciences, 630090 Novosibirsk, Russia; (M.A.G.); (E.S.S.)
- Faculty of Natural Sciences, Novosibirsk State University, 630090 Novosibirsk, Russia
| | - Elena I. Gultyaeva
- All Russian Institute of Plant Protection, Pushkin, 196608 St. Petersburg, Russia;
| | - Elena A. Orlova
- Siberian Research Institute of Plant Production and Breeding, Branch of the Institute of Cytology and Genetics, Siberian Branch of Russian Academy of Sciences, 630501 Krasnoobsk, Russia; (E.A.O.); (N.P.B.)
| | - Nina P. Bechtold
- Siberian Research Institute of Plant Production and Breeding, Branch of the Institute of Cytology and Genetics, Siberian Branch of Russian Academy of Sciences, 630501 Krasnoobsk, Russia; (E.A.O.); (N.P.B.)
| | - Dmitry A. Afonnikov
- Institute of Cytology and Genetics, Siberian Branch of the Russian Academy of Sciences, 630090 Novosibirsk, Russia; (M.A.G.); (E.S.S.)
- Faculty of Natural Sciences, Novosibirsk State University, 630090 Novosibirsk, Russia
- Kurchatov Genomics Center, Institute of Cytology and Genetics, Siberian Branch of the Russian Academy of Sciences, 630090 Novosibirsk, Russia
- Correspondence: ; Tel.: +7-(383)-363-49-63
| |
Collapse
|
21
|
Benos L, Tagarakis AC, Dolias G, Berruto R, Kateris D, Bochtis D. Machine Learning in Agriculture: A Comprehensive Updated Review. SENSORS (BASEL, SWITZERLAND) 2021; 21:3758. [PMID: 34071553 PMCID: PMC8198852 DOI: 10.3390/s21113758] [Citation(s) in RCA: 82] [Impact Index Per Article: 20.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/06/2021] [Revised: 05/21/2021] [Accepted: 05/24/2021] [Indexed: 01/05/2023]
Abstract
The digital transformation of agriculture has evolved various aspects of management into artificial intelligent systems for the sake of making value from the ever-increasing data originated from numerous sources. A subset of artificial intelligence, namely machine learning, has a considerable potential to handle numerous challenges in the establishment of knowledge-based farming systems. The present study aims at shedding light on machine learning in agriculture by thoroughly reviewing the recent scholarly literature based on keywords' combinations of "machine learning" along with "crop management", "water management", "soil management", and "livestock management", and in accordance with PRISMA guidelines. Only journal papers were considered eligible that were published within 2018-2020. The results indicated that this topic pertains to different disciplines that favour convergence research at the international level. Furthermore, crop management was observed to be at the centre of attention. A plethora of machine learning algorithms were used, with those belonging to Artificial Neural Networks being more efficient. In addition, maize and wheat as well as cattle and sheep were the most investigated crops and animals, respectively. Finally, a variety of sensors, attached on satellites and unmanned ground and aerial vehicles, have been utilized as a means of getting reliable input data for the data analyses. It is anticipated that this study will constitute a beneficial guide to all stakeholders towards enhancing awareness of the potential advantages of using machine learning in agriculture and contributing to a more systematic research on this topic.
Collapse
Affiliation(s)
- Lefteris Benos
- Centre of Research and Technology-Hellas (CERTH), Institute for Bio-Economy and Agri-Technology (IBO), 6th km Charilaou-Thermi Rd, GR 57001 Thessaloniki, Greece; (L.B.); (A.C.T.); (G.D.); (D.K.)
| | - Aristotelis C. Tagarakis
- Centre of Research and Technology-Hellas (CERTH), Institute for Bio-Economy and Agri-Technology (IBO), 6th km Charilaou-Thermi Rd, GR 57001 Thessaloniki, Greece; (L.B.); (A.C.T.); (G.D.); (D.K.)
| | - Georgios Dolias
- Centre of Research and Technology-Hellas (CERTH), Institute for Bio-Economy and Agri-Technology (IBO), 6th km Charilaou-Thermi Rd, GR 57001 Thessaloniki, Greece; (L.B.); (A.C.T.); (G.D.); (D.K.)
| | - Remigio Berruto
- Department of Agriculture, Forestry and Food Science (DISAFA), University of Turin, Largo Braccini 2, 10095 Grugliasco, Italy;
| | - Dimitrios Kateris
- Centre of Research and Technology-Hellas (CERTH), Institute for Bio-Economy and Agri-Technology (IBO), 6th km Charilaou-Thermi Rd, GR 57001 Thessaloniki, Greece; (L.B.); (A.C.T.); (G.D.); (D.K.)
| | - Dionysis Bochtis
- Centre of Research and Technology-Hellas (CERTH), Institute for Bio-Economy and Agri-Technology (IBO), 6th km Charilaou-Thermi Rd, GR 57001 Thessaloniki, Greece; (L.B.); (A.C.T.); (G.D.); (D.K.)
- FarmB Digital Agriculture P.C., Doiranis 17, GR 54639 Thessaloniki, Greece
| |
Collapse
|
22
|
Wang Y, Xiao Z, Tiong RL, Zhang L. Data-driven quantification of public–private partnership experience levels under uncertainty with Bayesian hierarchical model. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2021.107176] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
23
|
|