1
|
Qiu Z, Wang F, Li T, Liu C, Jin X, Qing S, Shi Y, Wu Y, Liu C. LGWheatNet: A Lightweight Wheat Spike Detection Model Based on Multi-Scale Information Fusion. PLANTS (BASEL, SWITZERLAND) 2025; 14:1098. [PMID: 40219167 PMCID: PMC11991583 DOI: 10.3390/plants14071098] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/26/2025] [Revised: 03/19/2025] [Accepted: 03/30/2025] [Indexed: 04/14/2025]
Abstract
Wheat spike detection holds significant importance for agricultural production as it enhances the efficiency of crop management and the precision of operations. This study aims to improve the accuracy and efficiency of wheat spike detection, enabling efficient crop monitoring under resource-constrained conditions. To this end, a wheat spike dataset encompassing multiple growth stages was constructed, leveraging the advantages of MobileNet and ShuffleNet to design a novel network module, SeCUIB. Building on this foundation, a new wheat spike detection network, LGWheatNet, was proposed by integrating a lightweight downsampling module (DWDown), spatial pyramid pooling (SPPF), and a lightweight detection head (LightDetect). The experimental results demonstrate that LGWheatNet excels in key performance metrics, including Precision, Recall, and Mean Average Precision (mAP50 and mAP50-95). Specifically, the model achieved a Precision of 0.956, a Recall of 0.921, an mAP50 of 0.967, and an mAP50-95 of 0.747, surpassing several YOLO models as well as EfficientDet and RetinaNet. Furthermore, LGWheatNet demonstrated superior resource efficiency with a parameter count of only 1,698,529 and GFLOPs of 5.0, significantly lower than those of competing models. Additionally, when combined with the Slicing Aided Hyper Inference strategy, LGWheatNet further improved the detection accuracy of wheat spikes, especially for small-scale targets and edge regions, when processing large-scale high-resolution images. This strategy significantly enhanced both inference efficiency and accuracy, making it particularly suitable for image analysis from drone-captured data. In wheat spike counting experiments, LGWheatNet also delivered exceptional performance, particularly in predictions during the filling and maturity stages, outperforming other models by a substantial margin. This study not only provides an efficient and reliable solution for wheat spike detection but also introduces innovative methods for lightweight object detection tasks in resource-constrained environments.
Collapse
Affiliation(s)
- Zhaomei Qiu
- College of Agricultural Equipment Engineering, Henan University of Science and Technology, Luoyang 471000, China
| | - Fei Wang
- College of Agricultural Equipment Engineering, Henan University of Science and Technology, Luoyang 471000, China
| | - Tingting Li
- College of Agricultural Equipment Engineering, Henan University of Science and Technology, Luoyang 471000, China
| | - Chongjun Liu
- College of Agricultural Equipment Engineering, Henan University of Science and Technology, Luoyang 471000, China
| | - Xin Jin
- College of Agricultural Equipment Engineering, Henan University of Science and Technology, Luoyang 471000, China
- Science & Technology Innovation Center for Completed Set Equipment, Longmen Laboratory, Luoyang 471003, China
| | - Shunhao Qing
- College of Agricultural Equipment Engineering, Henan University of Science and Technology, Luoyang 471000, China
| | - Yi Shi
- College of Agricultural Equipment Engineering, Henan University of Science and Technology, Luoyang 471000, China
| | - Yuntao Wu
- Hebei Nonghaha Agricultural Machinery Group Co., Ltd., Shijiazhuang 052560, China
| | - Congbin Liu
- Hebei Nonghaha Agricultural Machinery Group Co., Ltd., Shijiazhuang 052560, China
| |
Collapse
|
2
|
Deng Q, Zhao J, Li R, Liu G, Hu Y, Ye Z, Zhou G. A Precise Segmentation Algorithm of Pumpkin Seedling Point Cloud Stem Based on CPHNet. PLANTS (BASEL, SWITZERLAND) 2024; 13:2300. [PMID: 39204736 PMCID: PMC11359360 DOI: 10.3390/plants13162300] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/11/2024] [Revised: 07/18/2024] [Accepted: 07/23/2024] [Indexed: 09/04/2024]
Abstract
Accurate segmentation of the stem of pumpkin seedlings has a great influence on the modernization of pumpkin cultivation, and can provide detailed data support for the growth of pumpkin plants. We collected and constructed a pumpkin seedling point cloud dataset for the first time. Potting soil and wall background in point cloud data often interfere with the accuracy of partial cutting of pumpkin seedling stems. The stem shape of pumpkin seedlings varies due to other environmental factors during the growing stage. The stem of the pumpkin seedling is closely connected with the potting soil and leaves, and the boundary of the stem is easily blurred. These problems bring challenges to the accurate segmentation of pumpkin seedling point cloud stems. In this paper, an accurate segmentation algorithm for pumpkin seedling point cloud stems based on CPHNet is proposed. First, a channel residual attention multilayer perceptron (CRA-MLP) module is proposed, which suppresses background interference such as soil. Second, a position-enhanced self-attention (PESA) mechanism is proposed, enabling the model to adapt to diverse morphologies of pumpkin seedling point cloud data stems. Finally, a hybrid loss function of cross entropy loss and dice loss (HCE-Dice Loss) is proposed to address the issue of fuzzy stem boundaries. The experimental results show that CPHNet achieves a 90.4% average cross-to-merge ratio (mIoU), 93.1% average accuracy (mP), 95.6% average recall rate (mR), 94.4% F1 score (mF1) and 0.03 plants/second (speed) on the self-built dataset. Compared with other popular segmentation models, this model is more accurate and stable for cutting the stem part of the pumpkin seedling point cloud.
Collapse
Affiliation(s)
- Qiaomei Deng
- College of Computer & Mathematics, Central South University of Forestry and Technology, Changsha 410004, China; (Q.D.); (R.L.)
| | - Junhong Zhao
- Institute of Facility Agriculture, Guangdong Academy of Agricultural Sciences, Guangzhou 510640, China;
| | - Rui Li
- College of Computer & Mathematics, Central South University of Forestry and Technology, Changsha 410004, China; (Q.D.); (R.L.)
| | - Genhua Liu
- College of Electronic Information & Physics, Central South University of Forestry and Technology, Changsha 410073, China;
| | - Yaowen Hu
- College of Computer, National University of Defense Technology, Changsha 410073, China;
| | - Ziqing Ye
- College of Electronic Information & Physics, Central South University of Forestry and Technology, Changsha 410073, China;
| | - Guoxiong Zhou
- College of Electronic Information & Physics, Central South University of Forestry and Technology, Changsha 410073, China;
| |
Collapse
|
3
|
Prasad KV, Vaidya H, Rajashekhar C, Karekal KS, Sali R, Nisar KS. Multiclass classification of diseased grape leaf identification using deep convolutional neural network(DCNN) classifier. Sci Rep 2024; 14:9002. [PMID: 38637587 PMCID: PMC11026459 DOI: 10.1038/s41598-024-59562-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Accepted: 04/12/2024] [Indexed: 04/20/2024] Open
Abstract
The cultivation of grapes encounters various challenges, such as the presence of pests and diseases, which have the potential to considerably diminish agricultural productivity. Plant diseases pose a significant impediment, resulting in diminished agricultural productivity and economic setbacks, thereby affecting the quality of crop yields. Hence, the precise and timely identification of plant diseases holds significant importance. This study employs a Convolutional neural network (CNN) with and without data augmentation, in addition to a DCNN Classifier model based on VGG16, to classify grape leaf diseases. A publicly available dataset is utilized for the purpose of investigating diseases affecting grape leaves. The DCNN Classifier Model successfully utilizes the strengths of the VGG16 model and modifies it by incorporating supplementary layers to enhance its performance and ability to generalize. Systematic evaluation of metrics, such as accuracy and F1-score, is performed. With training and test accuracy rates of 99.18 and 99.06%, respectively, the DCNN Classifier model does a better job than the CNN models used in this investigation. The findings demonstrate that the DCNN Classifier model, utilizing the VGG16 architecture and incorporating three supplementary CNN layers, exhibits superior performance. Also, the fact that the DCNN Classifier model works well as a decision support system for farmers is shown by the fact that it can quickly and accurately identify grape diseases, making it easier to take steps to stop them. The results of this study provide support for the reliability of the DCNN classifier model and its potential utility in the field of agriculture.
Collapse
Affiliation(s)
- Kerehalli Vinayaka Prasad
- Department of Studies in Mathematics, Vijayanagara Sri Krishnadevaraya University, Ballari, Karnataka, India
| | - Hanumesh Vaidya
- Department of Studies in Mathematics, Vijayanagara Sri Krishnadevaraya University, Ballari, Karnataka, India
| | - Choudhari Rajashekhar
- Department of Mathematics, Manipal Institute of Technology Bengaluru, Manipal Academy of Higher Education, Manipal, Karnataka, India
| | - Kumar Swamy Karekal
- Department of Studies in Computer Science, Vijayanagara Sri Krishnadevaraya University, Ballari, Karnataka, India
| | - Renuka Sali
- Department of Studies in Computer Science, Vijayanagara Sri Krishnadevaraya University, Ballari, Karnataka, India
| | - Kottakkaran Sooppy Nisar
- Department of Mathematics, College of Science and Humanities in Alkharj, Prince Sattam Bin Abdulaziz University, Alkharj, 11942, Saudi Arabia.
| |
Collapse
|
4
|
Gao X, Tang Z, Deng Y, Hu S, Zhao H, Zhou G. HSSNet: A End-to-End Network for Detecting Tiny Targets of Apple Leaf Diseases in Complex Backgrounds. PLANTS (BASEL, SWITZERLAND) 2023; 12:2806. [PMID: 37570960 PMCID: PMC10420854 DOI: 10.3390/plants12152806] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Revised: 07/21/2023] [Accepted: 07/26/2023] [Indexed: 08/13/2023]
Abstract
Apple leaf diseases are one of the most important factors that reduce apple quality and yield. The object detection technology based on deep learning can detect diseases in a timely manner and help automate disease control, thereby reducing economic losses. In the natural environment, tiny apple leaf disease targets (a resolution is less than 32 × 32 pixel2) are easily overlooked. To address the problems of complex background interference, difficult detection of tiny targets and biased detection of prediction boxes that exist in standard detectors, in this paper, we constructed a tiny target dataset TTALDD-4 containing four types of diseases, which include Alternaria leaf spot, Frogeye leaf spot, Grey spot and Rust, and proposed the HSSNet detector based on the YOLOv7-tiny benchmark for professional detection of apple leaf disease tiny targets. Firstly, the H-SimAM attention mechanism is proposed to focus on the foreground lesions in the complex background of the image. Secondly, SP-BiFormer Block is proposed to enhance the ability of the model to perceive tiny targets of leaf diseases. Finally, we use the SIOU loss to improve the case of prediction box bias. The experimental results show that HSSNet achieves 85.04% mAP (mean average precision), 67.53% AR (average recall), and 83 FPS (frames per second). Compared with other standard detectors, HSSNet maintains high real-time detection speed with higher detection accuracy. This provides a reference for the automated control of apple leaf diseases.
Collapse
Affiliation(s)
| | | | | | | | - Hongmin Zhao
- College of Computer & Information Engineering, Central South University of Forestry and Technology, Changsha 410004, China; (X.G.); (Z.T.); (Y.D.); (S.H.)
| | - Guoxiong Zhou
- College of Computer & Information Engineering, Central South University of Forestry and Technology, Changsha 410004, China; (X.G.); (Z.T.); (Y.D.); (S.H.)
| |
Collapse
|
5
|
Xin X, Gong H, Hu R, Ding X, Pang S, Che Y. Intelligent large-scale flue-cured tobacco grading based on deep densely convolutional network. Sci Rep 2023; 13:11119. [PMID: 37429961 DOI: 10.1038/s41598-023-38334-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Accepted: 07/06/2023] [Indexed: 07/12/2023] Open
Abstract
Flue-cured tobacco grading plays a crucial role in tobacco leaf purchase and the formulation of tobacco leaf groups. However, the traditional flue-cured tobacco grading mode is usually manual, which is time-consuming, laborious, and subjective. Hence, it is essential to research more efficient and intelligent flue-cured tobacco grading methods. Most existing methods suffer from the more classes less accuracy problem. Meanwhile, limited by different industry applications, the flue-cured tobacco datasets are hard to be obtained publicly. The existing methods employ relatively small and lower resolution tobacco data that are hard to apply in practice. Therefore, aiming at the insufficiency of feature extraction ability and the inadaptability to multiple flue-cured tobacco grades, we collected the largest and highest resolution dataset and proposed an efficient flue-cured tobacco grading method based on deep densely convolutional network (DenseNet). Diverging from other approaches, our method has a unique connectivity pattern of convolutional neural network that concatenates preceding tobacco feature data. This mode connects all previous layers to the subsequent layer directly for tobacco feature transmission. This idea can better extract depth tobacco image information features and transmit each layer's data, thereby reducing the information loss and encouraging tobacco feature reuse. Then, we designed the whole data pre-processing process and experimented with traditional and deep learning algorithms to verify our dataset usability. The experimental results showed that DenseNet could be easily adapted by changing the output of the fully connected layers. With an accuracy of 0.997, significantly higher than the other intelligent tobacco grading methods, DenseNet came to the best model for solving our flue-cured tobacco grading problem.
Collapse
Affiliation(s)
- Xiaowei Xin
- Faculty of Information Science and Engineering, Ocean University of China, Qingdao, 266100, Shandong, China.
| | - Huili Gong
- Faculty of Information Science and Engineering, Ocean University of China, Qingdao, 266100, Shandong, China.
| | - Ruotong Hu
- Faculty of Information Science and Engineering, Ocean University of China, Qingdao, 266100, Shandong, China
| | - Xiangqian Ding
- Faculty of Information Science and Engineering, Ocean University of China, Qingdao, 266100, Shandong, China
| | - Shunpeng Pang
- School of Computer Engineering, Weifang University, Weifang, 261061, Shandong, China
| | - Yue Che
- Exhibition Department, Qingdao Revolutionary Martyrs Memorial Hall, Qingdao, 266071, Shandong, China
| |
Collapse
|
6
|
Liu E, Gold KM, Combs D, Cadle-Davidson L, Jiang Y. Deep semantic segmentation for the quantification of grape foliar diseases in the vineyard. FRONTIERS IN PLANT SCIENCE 2022; 13:978761. [PMID: 36161031 PMCID: PMC9501698 DOI: 10.3389/fpls.2022.978761] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/26/2022] [Accepted: 08/18/2022] [Indexed: 06/16/2023]
Abstract
Plant disease evaluation is crucial to pathogen management and plant breeding. Human field scouting has been widely used to monitor disease progress and provide qualitative and quantitative evaluation, which is costly, laborious, subjective, and often imprecise. To improve disease evaluation accuracy, throughput, and objectiveness, an image-based approach with a deep learning-based analysis pipeline was developed to calculate infection severity of grape foliar diseases. The image-based approach used a ground imaging system for field data acquisition, consisting of a custom stereo camera with strobe light for consistent illumination and real time kinematic (RTK) GPS for accurate localization. The deep learning-based pipeline used the hierarchical multiscale attention semantic segmentation (HMASS) model for disease infection segmentation, color filtering for grapevine canopy segmentation, and depth and location information for effective region masking. The resultant infection, canopy, and effective region masks were used to calculate the severity rate of disease infections in an image sequence collected in a given unit (e.g., grapevine panel). Fungicide trials for grape downy mildew (DM) and powdery mildew (PM) were used as case studies to evaluate the developed approach and pipeline. Experimental results showed that the HMASS model achieved acceptable to good segmentation accuracy of DM (mIoU > 0.84) and PM (mIoU > 0.74) infections in testing images, demonstrating the model capability for symptomatic disease segmentation. With the consistent image quality and multimodal metadata provided by the imaging system, the color filter and overlapping region removal could accurately and reliably segment grapevine canopies and identify repeatedly imaged regions between consecutive image frames, leading to critical information for infection severity calculation. Image-derived severity rates were highly correlated (r > 0.95) with human-assessed values, and had comparable statistical power in differentiating fungicide treatment efficacy in both case studies. Therefore, the developed approach and pipeline can be used as an effective and efficient tool to quantify the severity of foliar disease infections, enabling objective, high-throughput disease evaluation for fungicide trial evaluation, genetic mapping, and breeding programs.
Collapse
Affiliation(s)
- Ertai Liu
- Department of Biological and Environmental Engineering, Cornell University, Ithaca, NY, United States
| | - Kaitlin M. Gold
- Plant Pathology and Plant-Microbe Biology Section, School of Integrative Plant Science, Cornell AgriTech, Cornell University, Geneva, NY, United States
| | - David Combs
- Plant Pathology and Plant-Microbe Biology Section, School of Integrative Plant Science, Cornell AgriTech, Cornell University, Geneva, NY, United States
| | - Lance Cadle-Davidson
- Plant Pathology and Plant-Microbe Biology Section, School of Integrative Plant Science, Cornell AgriTech, Cornell University, Geneva, NY, United States
- Grape Genetics Research Unit, United States Department of Agriculture-Agricultural Research Service, Geneva, NY, United States
| | - Yu Jiang
- Horticulture Section, School of Integrative Plant Science, Cornell AgriTech, Cornell University, Geneva, NY, United States
| |
Collapse
|