1
|
Alsaber A, Setiya P, Satpathi A, Aljamaan A, Pan J. Advancing pearl millet yield forecasting: Comparative analysis of individual and ensemble machine learning approaches over Rajasthan, India. PLoS One 2025; 20:e0317602. [PMID: 40067871 PMCID: PMC11896074 DOI: 10.1371/journal.pone.0317602] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2024] [Accepted: 12/31/2024] [Indexed: 03/15/2025] Open
Abstract
Pearl millet (Pennisetum glaucum L.) is a resilient crop known for its ability to thrive in arid and semi-arid regions, making it a crucial staple in regions prone to drought. Rajasthan, a state in India, emerged as the top producer of pearl millet. This study enhances yield forecasting for pearl millet using machine learning models across nine districts viz. Jaipur, Ajmer, Jodhpur, Bikaner, Bharatpur, Alwar, Sikar, Jhunjhunu and Nagaur in Rajasthan, India. Data from 1997-2019 (23 years), including yield data from the Directorate of Economics and Statistics and weather data from the NASA POWER web portal, were analysed. The study employed individual machine learning methods (GLM, ELNET, XGB, SVR and RF) and their ensemble combinations (GLM, ELNET, Cubist and RF). Discerning the overall best performing model across all locations remained challenging. For instance, while ensemble models exhibited subpar performance in Barmer and Nagaur, their performance ranged from satisfactory to commendable in other locations. To identify the best model, all models were ranked based on their R2 and nRMSE (%) values. Combined average ranks during training and testing revealed the model performance ranking as I-XGB (3.83) > I-GLM (4.28) > E-ELNET (4.32) > I-RF (4.67) > E-GLM (4.88) > I-SVR (4.90) > I-ELNET (4.94) > E-RF (6.03) > E-Cubist (7.15), where I denotes individual model, while E denotes ensemble model. Intriguingly, while individual GLM and XGB models demonstrated superior performance during calibration, they exhibited poorer performance during validation, potentially indicating issues of data overfitting. Hence, the ensemble ELNET approach is recommended for accurate prediction of pearl millet yield, followed by the individual RF model. These performances underscore the importance of tailored model selection based on specific geographic and environmental conditions.
Collapse
Affiliation(s)
- Ahmad Alsaber
- Department of Management, College of Business and Economics, American University of Kuwait, Salmiya, Kuwait
| | - Parul Setiya
- Govind Ballabh Pant University of Agriculture and Technology, Pantnagar, Uttarakhand, India
| | - Anurag Satpathi
- Division of Agrometeorology, Sher-e-Kashmir University of Agricultural Sciences and Technology, Kashmir Shalimar campus, Srinagar, India
| | - Abrar Aljamaan
- College of Art and Science, American University of Kuwait, Slamiya, Kuwait
| | - Jiazhu Pan
- Department of Mathematics and Statistics, University of Strathclyde, Glasgow, United Kingdom
| |
Collapse
|
2
|
Saini A, Gill NS, Gulia P, Tiwari AK, Maratha P, Shah MA. Smart crop disease monitoring system in IoT using optimization enabled deep residual network. Sci Rep 2025; 15:1456. [PMID: 39789170 PMCID: PMC11718082 DOI: 10.1038/s41598-025-85486-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2024] [Accepted: 01/03/2025] [Indexed: 01/12/2025] Open
Abstract
The Internet of Things (IoT) has recently attracted substantial interest because of its diverse applications. In the agriculture sector, automated methods for detecting plant diseases offer numerous advantages over traditional methods. In the current study, a new model is developed to categorize plant diseases within an IoT network. The IoT network is simulated for monitoring crop diseases. Routing is performed with Henry Gas Chicken Swarm Optimization (HGCSO), which is designed by integrating Henry Gas Solubility Optimization (HGSO) and Chicken Swarm Optimization (CSO). The fitness parameters of the model include delay, energy, distance, and link lifetime (LLT). At the Base Station (BS), plant disease categorization is performed by collecting plant leaf images. Preprocessing is done on the input images using median filtering. Various features, such as Histogram of Oriented Gradient (HoG), statistical features, Spider Local Image Features (SLIF), and Local Ternary Patterns (LTP) are extracted. Plant disease categorization is carried out using a Deep Residual Network (DRN), which is trained using the developed Caviar Henry Gas Chicken Swarm Optimization (CHGCSO) that combines the CAViaR model with HGCSO. Comparative results show an accuracy of 94.3%, a maximum sensitivity of 93.3%, a maximum specificity of 92%, and an F1-score of 93%, indicating that the CHGCSO-based DRN outperforms existing methods. Graphic Abstract.
Collapse
Affiliation(s)
- Ashish Saini
- Department of Computer Science & Applications, Maharshi Dayanand University, Rohtak, 124001, India
| | - Nasib Singh Gill
- Department of Computer Science & Applications, Maharshi Dayanand University, Rohtak, 124001, India
| | - Preeti Gulia
- Department of Computer Science & Applications, Maharshi Dayanand University, Rohtak, 124001, India
| | - Anoop Kumar Tiwari
- Department of Computer Science & Information Technology, Central University of Haryana, Mahendragarh, 123031, India
| | - Priti Maratha
- Department of Computer Science & Information Technology, Central University of Haryana, Mahendragarh, 123031, India.
| | - Mohd Asif Shah
- Department of Economics, Kardan University, Kabul, Afghanistan.
- Centre for Research Impact & Outcome, Chitkara University Institute of Engineering and Technology, Chitkara University, 140401, Rajpura, Punjab, India.
- Chitkara Centre for Research and Development, Chitkara University, Baddi, Himachal Pradesh, 174103, India.
- Division of Research and Development, Lovely Professional University, Phagwara, Punjab, India.
| |
Collapse
|
3
|
Gawande A, Sherekar S, Gawande R. Early prediction of grape disease attack using a hybrid classifier in association with IoT sensors. Heliyon 2024; 10:e38093. [PMID: 39386824 PMCID: PMC11462189 DOI: 10.1016/j.heliyon.2024.e38093] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2023] [Revised: 09/03/2024] [Accepted: 09/17/2024] [Indexed: 10/12/2024] Open
Abstract
Machine learning with IoT practices in the agriculture sector has the potential to address numerous challenges encountered by farmers, including disease prediction and estimation of soil profile. This paper extensively explores the classification of diseases in grape plants and provides detailed information about the conducted experiments. It is important to keep track of each crop's current environmental conditions because different environmental conditions, such as humidity, temperature, moisture, leaf wetness, light intensity, wind speed, and wind direction, can affect or sustain the quality of a crop. IoT will increasingly be used in precision agriculture and smart environments to detect, gather, and share data about environmental occurrences. The environmental factor that is active at all times and has an effect on a crop from its cultivation to harvest. With the aid of an IoT, we will monitor the following factors: temperature, humidity, and leaf wetness, all of which have an impact on the overall quality and lifespan of grapes. A Self-created database of weather parameter using sensors is introduced in this article. It consists of 5 categories with a total of 10,000 records. Here, experiment has been carried out using our dataset to predict grape diseases on various machines learning algorithm. The system receives overall accuracy of 98.25 % for Powdery Mildew, 98.85 % for Downy Mildew and 93.95 % for Bacterial Leaf Spot.
Collapse
Affiliation(s)
- Apeksha Gawande
- Department of Computer Science & Engineering, Sant Gadge Baba Amravati University, Amravati, Maharashtra, India
| | - Swati Sherekar
- Department of Computer Science & Engineering, Sant Gadge Baba Amravati University, Amravati, Maharashtra, India
| | - Ranjit Gawande
- Department of Computer Engineering, Matoshri College of Engineering & Research Centre, Nashik, Maharashtra, India
| |
Collapse
|
4
|
Deng J, Huang W, Zhou G, Hu Y, Li L, Wang Y. Identification of banana leaf disease based on KVA and GR-ARNet. JOURNAL OF INTEGRATIVE AGRICULTURE 2024; 23:3554-3575. [DOI: 10.1016/j.jia.2023.11.037] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2025]
|
5
|
Yang J, Deng H, Zhang Y, Zhou Y, Miao T. Application of amodal segmentation for shape reconstruction and occlusion recovery in occluded tomatoes. FRONTIERS IN PLANT SCIENCE 2024; 15:1376138. [PMID: 38938637 PMCID: PMC11208628 DOI: 10.3389/fpls.2024.1376138] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/25/2024] [Accepted: 05/27/2024] [Indexed: 06/29/2024]
Abstract
Common object detection and image segmentation methods are unable to accurately estimate the shape of the occluded fruit. Monitoring the growth status of shaded crops in a specific environment is challenging, and certain studies related to crop harvesting and pest detection are constrained by the natural shadow conditions. Amodal segmentation can focus on the occluded part of the fruit and complete the overall shape of the fruit. We proposed a Transformer-based amodal segmentation algorithm to infer the amodal shape of occluded tomatoes. Considering the high cost of amodal annotation, we only needed modal dataset to train the model. The dataset was taken from two greenhouses on the farm and contains rich occlusion information. We introduced boundary estimation in the hourglass structured network to provide a priori information about the completion of the amodal shapes, and reconstructed the occluded objects using a GAN network (with discriminator) and GAN loss. The model in this study showed accuracy, with average pairwise accuracy of 96.07%, mean intersection-over-union (mIoU) of 94.13% and invisible mIoU of 57.79%. We also examined the quality of pseudo-amodal annotations generated by our proposed model using Mask R-CNN. Its average precision (AP) and average precision with intersection over union (IoU) 0.5 (AP50) reached 63.91%,86.91% respectively. This method accurately and rationally achieves the shape of occluded tomatoes, saving the cost of manual annotation, and is able to deal with the boundary information of occlusion while decoupling the relationship of occluded objects from each other. Future work considers how to complete the amodal segmentation task without overly relying on the occlusion order and the quality of the modal mask, thus promising applications to provide technical support for the advancement of ecological monitoring techniques and ecological cultivation.
Collapse
Affiliation(s)
- Jing Yang
- College of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang, China
| | - Hanbing Deng
- College of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang, China
- Liaoning Agricultural Informatization Engineering Technology Research Center, Shenyang Agricultural University, Shenyang, China
| | - Yufeng Zhang
- College of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang, China
| | - Yuncheng Zhou
- College of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang, China
| | - Teng Miao
- College of Information and Electrical Engineering, Shenyang Agricultural University, Shenyang, China
| |
Collapse
|
6
|
Afsharpour P, Zoughi T, Deypir M, Zoqi MJ. Robust deep learning method for fruit decay detection and plant identification: enhancing food security and quality control. FRONTIERS IN PLANT SCIENCE 2024; 15:1366395. [PMID: 38774219 PMCID: PMC11106415 DOI: 10.3389/fpls.2024.1366395] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/06/2024] [Accepted: 04/17/2024] [Indexed: 05/24/2024]
Abstract
This paper presents a robust deep learning method for fruit decay detection and plant identification. By addressing the limitations of previous studies that primarily focused on model accuracy, our approach aims to provide a more comprehensive solution that considers the challenges of robustness and limited data scenarios. The proposed method achieves exceptional accuracy of 99.93%, surpassing established models. In addition to its exceptional accuracy, the proposed method highlights the significance of robustness and adaptability in limited data scenarios. The proposed model exhibits strong performance even under the challenging conditions, such as intense lighting variations and partial image obstructions. Extensive evaluations demonstrate its robust performance, generalization ability, and minimal misclassifications. The inclusion of Class Activation Maps enhances the model's capability to identify distinguishing features between fresh and rotten fruits. This research has significant implications for fruit quality control, economic loss reduction, and applications in agriculture, transportation, and scientific research. The proposed method serves as a valuable resource for fruit and plant-related industries. It offers precise adaptation to specific data, customization of the network architecture, and effective training even with limited data. Overall, this research contributes to fruit quality control, economic loss reduction, and waste minimization.
Collapse
Affiliation(s)
- Pariya Afsharpour
- Department of Electrical and Computer Engineering, Shariaty College, Technical and Vocational University (TVU), Tehran, Iran
| | - Toktam Zoughi
- Department of Electrical and Computer Engineering, Shariaty College, Technical and Vocational University (TVU), Tehran, Iran
| | - Mahmood Deypir
- Faculty of Computer Engineering, Shahid Sattari Aeronautical University of Science and Technology, Tehran, Iran
| | - Mohamad Javad Zoqi
- Department of Civil Engineering, Faculty of Engineering, University of Birjand, Birjand, Iran
| |
Collapse
|
7
|
Kumar Y, Koul A, Kamini, Woźniak M, Shafi J, Ijaz MF. Automated detection and recognition system for chewable food items using advanced deep learning models. Sci Rep 2024; 14:6589. [PMID: 38504098 PMCID: PMC10951243 DOI: 10.1038/s41598-024-57077-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Accepted: 03/14/2024] [Indexed: 03/21/2024] Open
Abstract
Identifying and recognizing the food on the basis of its eating sounds is a challenging task, as it plays an important role in avoiding allergic foods, providing dietary preferences to people who are restricted to a particular diet, showcasing its cultural significance, etc. In this research paper, the aim is to design a novel methodology that helps to identify food items by analyzing their eating sounds using various deep learning models. To achieve this objective, a system has been proposed that extracts meaningful features from food-eating sounds with the help of signal processing techniques and deep learning models for classifying them into their respective food classes. Initially, 1200 audio files for 20 food items labeled have been collected and visualized to find relationships between the sound files of different food items. Later, to extract meaningful features, various techniques such as spectrograms, spectral rolloff, spectral bandwidth, and mel-frequency cepstral coefficients are used for the cleaning of audio files as well as to capture the unique characteristics of different food items. In the next phase, various deep learning models like GRU, LSTM, InceptionResNetV2, and the customized CNN model have been trained to learn spectral and temporal patterns in audio signals. Besides this, the models have also been hybridized i.e. Bidirectional LSTM + GRU and RNN + Bidirectional LSTM, and RNN + Bidirectional GRU to analyze their performance for the same labeled data in order to associate particular patterns of sound with their corresponding class of food item. During evaluation, the highest accuracy, precision,F1 score, and recall have been obtained by GRU with 99.28%, Bidirectional LSTM + GRU with 97.7% as well as 97.3%, and RNN + Bidirectional LSTM with 97.45%, respectively. The results of this study demonstrate that deep learning models have the potential to precisely identify foods on the basis of their sound by computing the best outcomes.
Collapse
Affiliation(s)
- Yogesh Kumar
- Department of CSE, School of Technology, Pandit Deendayal Energy University, Gandhinagar, Gujarat, India
| | - Apeksha Koul
- Department of Computer Science and Engineering, Punjabi University, Patiala, Punjab, India
| | - Kamini
- Southern Alberta Institute of Technology, Calgary, Alberta, Canada
| | - Marcin Woźniak
- Faculty of Applied Mathematics, Silesian University of Technology, Kaszubska 23, 44100, Gliwice, Poland.
| | - Jana Shafi
- Department of Computer Engineering and Information, College of Engineering in Wadi Al Dawasir, Prince Sattam Bin Abdulaziz University, 11991, Wadi Al Dawasir, Saudi Arabia
| | - Muhammad Fazal Ijaz
- School of IT and Engineering, Melbourne Institute of Technology, Melbourne, 3000, Australia.
| |
Collapse
|
8
|
Wang J, Jia J, Zhang Y, Wang H, Zhu S. RAAWC-UNet: an apple leaf and disease segmentation method based on residual attention and atrous spatial pyramid pooling improved UNet with weight compression loss. FRONTIERS IN PLANT SCIENCE 2024; 15:1305358. [PMID: 38529067 PMCID: PMC10961398 DOI: 10.3389/fpls.2024.1305358] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/01/2023] [Accepted: 02/15/2024] [Indexed: 03/27/2024]
Abstract
Introduction Early detection of leaf diseases is necessary to control the spread of plant diseases, and one of the important steps is the segmentation of leaf and disease images. The uneven light and leaf overlap in complex situations make segmentation of leaves and diseases quite difficult. Moreover, the significant differences in ratios of leaf and disease pixels results in a challenge in identifying diseases. Methods To solve the above issues, the residual attention mechanism combined with atrous spatial pyramid pooling and weight compression loss of UNet is proposed, which is named RAAWC-UNet. Firstly, weights compression loss is a method that introduces a modulation factor in front of the cross-entropy loss, aiming at solving the problem of the imbalance between foreground and background pixels. Secondly, the residual network and the convolutional block attention module are combined to form Res_CBAM. It can accurately localize pixels at the edge of the disease and alleviate the vanishing of gradient and semantic information from downsampling. Finally, in the last layer of downsampling, the atrous spatial pyramid pooling is used instead of two convolutions to solve the problem of insufficient spatial context information. Results The experimental results show that the proposed RAAWC-UNet increases the intersection over union in leaf and disease segmentation by 1.91% and 5.61%, and the pixel accuracy of disease by 4.65% compared with UNet. Discussion The effectiveness of the proposed method was further verified by the better results in comparison with deep learning methods with similar network architectures.
Collapse
Affiliation(s)
- Jianlong Wang
- School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo, China
| | - Junhao Jia
- School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo, China
| | - Yake Zhang
- School of Computer and Information Engineering, Henan Normal University, Xinxiang, China
| | - Haotian Wang
- School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo, China
| | - Shisong Zhu
- School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo, China
| |
Collapse
|
9
|
Alotaibi Y, Rajendran B, Rani K. G, Rajendran S. Dipper throated optimization with deep convolutional neural network-based crop classification for remote sensing image analysis. PeerJ Comput Sci 2024; 10:e1828. [PMID: 38435591 PMCID: PMC10909238 DOI: 10.7717/peerj-cs.1828] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Accepted: 12/29/2023] [Indexed: 03/05/2024]
Abstract
Problem With the rapid advancement of remote sensing technology is that the need for efficient and accurate crop classification methods has become increasingly important. This is due to the ever-growing demand for food security and environmental monitoring. Traditional crop classification methods have limitations in terms of accuracy and scalability, especially when dealing with large datasets of high-resolution remote sensing images. This study aims to develop a novel crop classification technique, named Dipper Throated Optimization with Deep Convolutional Neural Networks based Crop Classification (DTODCNN-CC) for analyzing remote sensing images. The objective is to achieve high classification accuracy for various food crops. Methods The proposed DTODCNN-CC approach consists of the following key components. Deep convolutional neural network (DCNN) a GoogleNet architecture is employed to extract robust feature vectors from the remote sensing images. The Dipper throated optimization (DTO) optimizer is used for hyper parameter tuning of the GoogleNet model to achieve optimal feature extraction performance. Extreme Learning Machine (ELM): This machine learning algorithm is utilized for the classification of different food crops based on the extracted features. The modified sine cosine algorithm (MSCA) optimization technique is used to fine-tune the parameters of ELM for improved classification accuracy. Results Extensive experimental analyses are conducted to evaluate the performance of the proposed DTODCNN-CC approach. The results demonstrate that DTODCNN-CC can achieve significantly higher crop classification accuracy compared to other state-of-the-art deep learning methods. Conclusion The proposed DTODCNN-CC technique provides a promising solution for efficient and accurate crop classification using remote sensing images. This approach has the potential to be a valuable tool for various applications in agriculture, food security, and environmental monitoring.
Collapse
Affiliation(s)
- Youseef Alotaibi
- College of Computer and Information Systems, Umm Al Qura University, Makkah, Saudi Arabia
| | - Brindha Rajendran
- Department of Computing Technologies, SRM Institute of Science and Technology, Kattankulathur, India
| | - Geetha Rani K.
- Department of Computer Science and Engineering, Jain (Deemed-to-be University), Bangalore, India
| | - Surendran Rajendran
- Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences, Chennai, India
| |
Collapse
|
10
|
Lv M, Su WH. YOLOV5-CBAM-C3TR: an optimized model based on transformer module and attention mechanism for apple leaf disease detection. FRONTIERS IN PLANT SCIENCE 2024; 14:1323301. [PMID: 38288410 PMCID: PMC10822903 DOI: 10.3389/fpls.2023.1323301] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Accepted: 12/26/2023] [Indexed: 01/31/2024]
Abstract
Apple trees face various challenges during cultivation. Apple leaves, as the key part of the apple tree for photosynthesis, occupy most of the area of the tree. Diseases of the leaves can hinder the healthy growth of trees and cause huge economic losses to fruit growers. The prerequisite for precise control of apple leaf diseases is the timely and accurate detection of different diseases on apple leaves. Traditional methods relying on manual detection have problems such as limited accuracy and slow speed. In this study, both the attention mechanism and the module containing the transformer encoder were innovatively introduced into YOLOV5, resulting in YOLOV5-CBAM-C3TR for apple leaf disease detection. The datasets used in this experiment were uniformly RGB images. To better evaluate the effectiveness of YOLOV5-CBAM-C3TR, the model was compared with different target detection models such as SSD, YOLOV3, YOLOV4, and YOLOV5. The results showed that YOLOV5-CBAM-C3TR achieved mAP@0.5, precision, and recall of 73.4%, 70.9%, and 69.5% for three apple leaf diseases including Alternaria blotch, Grey spot, and Rust. Compared with the original model YOLOV5, the mAP 0.5increased by 8.25% with a small change in the number of parameters. In addition, YOLOV5-CBAM-C3TR can achieve an average accuracy of 92.4% in detecting 208 randomly selected apple leaf disease samples. Notably, YOLOV5-CBAM-C3TR achieved 93.1% and 89.6% accuracy in detecting two very similar diseases including Alternaria Blotch and Grey Spot, respectively. The YOLOV5-CBAM-C3TR model proposed in this paper has been applied to the detection of apple leaf diseases for the first time, and also showed strong recognition ability in identifying similar diseases, which is expected to promote the further development of disease detection technology.
Collapse
Affiliation(s)
| | - Wen-Hao Su
- College of Engineering, China Agricultural University, Beijing, China
| |
Collapse
|
11
|
He Y, Zhang G, Gao Q. A novel ensemble learning method for crop leaf disease recognition. FRONTIERS IN PLANT SCIENCE 2024; 14:1280671. [PMID: 38264019 PMCID: PMC10804852 DOI: 10.3389/fpls.2023.1280671] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/21/2023] [Accepted: 11/28/2023] [Indexed: 01/25/2024]
Abstract
Deep learning models have been widely applied in the field of crop disease recognition. There are various types of crops and diseases, each potentially possessing distinct and effective features. This brings a great challenge to the generalization performance of recognition models and makes it very difficult to build a unified model capable of achieving optimal recognition performance on all kinds of crops and diseases. In order to solve this problem, we have proposed a novel ensemble learning method for crop leaf disease recognition (named ELCDR). Unlike the traditional voting strategy of ensemble learning, ELCDR assigns different weights to the models based on their feature extraction performance during ensemble learning. In ELCDR, the models' feature extraction performance is measured by the distribution of the feature vectors of the training set. If a model could distinguish more feature differences between different categories, then it receives a higher weight during ensemble learning. We conducted experiments on the disease images of four kinds of crops. The experimental results show that in comparison to the optimal single model recognition method, ELCDR improves by as much as 1.5 (apple), 0.88 (corn), 2.25 (grape), and 1.5 (rice) percentage points in accuracy. Compared with the voting strategy of ensemble learning, ELCDR improves by as much as 1.75 (apple), 1.25 (corn), 0.75 (grape), and 7 (rice) percentage points in accuracy in each case. Additionally, ELCDR also has improvements on precision, recall, and F1 measure metrics. These experiments provide evidence of the effectiveness of ELCDR in the realm of crop leaf disease recognition.
Collapse
Affiliation(s)
- Yun He
- School of Big Data, Yunnan Agricultural University, Kunming, China
- Key Laboratory for Crop Production and Intelligent Agriculture of Yunnan Province, Yunnan Agricultural University, Kunming, China
| | - Guangchuan Zhang
- Key Laboratory for Crop Production and Intelligent Agriculture of Yunnan Province, Yunnan Agricultural University, Kunming, China
- School of Mechanical and Electrical Engineering, Yunnan Agricultural University, Kunming, China
| | - Quan Gao
- School of Big Data, Yunnan Agricultural University, Kunming, China
- Key Laboratory for Crop Production and Intelligent Agriculture of Yunnan Province, Yunnan Agricultural University, Kunming, China
| |
Collapse
|
12
|
Tarek Z, Elhoseny M, Alghamdi MI, El-Hasnony IM. Leveraging three-tier deep learning model for environmental cleaner plants production. Sci Rep 2023; 13:19499. [PMID: 37945683 PMCID: PMC10636176 DOI: 10.1038/s41598-023-43465-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2022] [Accepted: 09/24/2023] [Indexed: 11/12/2023] Open
Abstract
The world's population is expected to exceed 9 billion people by 2050, necessitating a 70% increase in agricultural output and food production to meet the demand. Due to resource shortages, climate change, the COVID-19 pandemic, and highly harsh socioeconomic predictions, such a demand is challenging to complete without using computation and forecasting methods. Machine learning has grown with big data and high-performance computers technologies to open up new data-intensive scientific opportunities in the multidisciplinary agri-technology area. Throughout the plant's developmental period, diseases and pests are natural disasters, from seed production to seedling growth. This paper introduces an early diagnosis framework for plant diseases based on fog computing and edge environment by IoT sensors measurements and communication technologies. The effectiveness of employing pre-trained CNN architectures as feature extractors in identifying plant illnesses has been studied. As feature extractors, standard pre-trained CNN models, AlexNet are employed. The obtained in-depth features are eliminated by proposing a revised version of the grey wolf optimization (GWO) algorithm that approved its efficiency through experiments. The features subset selected were used to train the SVM classifier. Ten datasets for different plants are utilized to assess the proposed model. According to the findings, the proposed model achieved better outcomes for all used datasets. As an average for all datasets, the accuracy of the proposed model is 93.84 compared to 85.49, 87.89, 87.04 for AlexNet, GoogleNet, and the SVM, respectively.
Collapse
Affiliation(s)
- Zahraa Tarek
- Faculty of Computers and Information Science, Mansoura University, Mansoura, Egypt
| | - Mohamed Elhoseny
- Faculty of Computers and Information Science, Mansoura University, Mansoura, Egypt
- College of Computing and Informatics, University of Sharjah, Sharjah, United Arab Emirates
| | - Mohamemd I Alghamdi
- Department of Computer Science, Al-Baha University, Al Bahah, Kingdom of Saudi Arabia
| | - Ibrahim M El-Hasnony
- Faculty of Computers and Information Science, Mansoura University, Mansoura, Egypt.
| |
Collapse
|
13
|
Su P, Li H, Wang X, Wang Q, Hao B, Feng M, Sun X, Yang Z, Jing B, Wang C, Qin M, Song X, Xiao L, Sun J, Zhang M, Yang W. Improvement of the YOLOv5 Model in the Optimization of the Brown Spot Disease Recognition Algorithm of Kidney Bean. PLANTS (BASEL, SWITZERLAND) 2023; 12:3765. [PMID: 37960121 PMCID: PMC10648829 DOI: 10.3390/plants12213765] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Revised: 10/23/2023] [Accepted: 10/27/2023] [Indexed: 11/15/2023]
Abstract
The kidney bean is an important cash crop whose growth and yield are severely affected by brown spot disease. Traditional target detection models cannot effectively screen out key features, resulting in model overfitting and weak generalization ability. In this study, a Bi-Directional Feature Pyramid Network (BiFPN) and Squeeze and Excitation (SE) module were added to a YOLOv5 model to improve the multi-scale feature fusion and key feature extraction abilities of the improved model. The results show that the BiFPN and SE modules show higher heat in the target location region and pay less attention to irrelevant environmental information in the non-target region. The detection Precision, Recall, and mean average Precision (mAP@0.5) of the improved YOLOv5 model are 94.7%, 88.2%, and 92.5%, respectively, which are 4.9% higher in Precision, 0.5% higher in Recall, and 25.6% higher in the mean average Precision compared to the original YOLOv5 model. Compared with the YOLOv5-SE, YOLOv5-BiFPN, FasterR-CNN, and EfficientDet models, detection Precision improved by 1.8%, 3.0%, 9.4%, and 9.5%, respectively. Moreover, the rate of missed and wrong detection in the improved YOLOv5 model is only 8.16%. Therefore, the YOLOv5-SE-BiFPN model can more effectively detect the brown spot area of kidney beans.
Collapse
Affiliation(s)
- Pengyan Su
- College of Agriculture, Shanxi Agricultural University, Taigu, Jingzhong 030801, China; (P.S.); (X.W.); (J.S.)
| | - Hao Li
- College of Agriculture, Shanxi Agricultural University, Taigu, Jingzhong 030801, China; (P.S.); (X.W.); (J.S.)
| | - Xiaoyun Wang
- College of Agriculture, Shanxi Agricultural University, Taigu, Jingzhong 030801, China; (P.S.); (X.W.); (J.S.)
| | - Qianyu Wang
- College of Agriculture, Shanxi Agricultural University, Taigu, Jingzhong 030801, China; (P.S.); (X.W.); (J.S.)
| | - Bokun Hao
- College of Agriculture, Shanxi Agricultural University, Taigu, Jingzhong 030801, China; (P.S.); (X.W.); (J.S.)
| | - Meichen Feng
- College of Agriculture, Shanxi Agricultural University, Taigu, Jingzhong 030801, China; (P.S.); (X.W.); (J.S.)
| | - Xinkai Sun
- College of Agriculture, Shanxi Agricultural University, Taigu, Jingzhong 030801, China; (P.S.); (X.W.); (J.S.)
| | - Zhongyu Yang
- College of Agriculture, Shanxi Agricultural University, Taigu, Jingzhong 030801, China; (P.S.); (X.W.); (J.S.)
| | - Binghan Jing
- College of Agriculture, Shanxi Agricultural University, Taigu, Jingzhong 030801, China; (P.S.); (X.W.); (J.S.)
| | - Chao Wang
- College of Agriculture, Shanxi Agricultural University, Taigu, Jingzhong 030801, China; (P.S.); (X.W.); (J.S.)
| | - Mingxing Qin
- College of Resources and Environment, Shanxi Agricultural University, Taigu, Jingzhong 030801, China
| | - Xiaoyan Song
- College of Agriculture, Shanxi Agricultural University, Taigu, Jingzhong 030801, China; (P.S.); (X.W.); (J.S.)
| | - Lujie Xiao
- College of Agriculture, Shanxi Agricultural University, Taigu, Jingzhong 030801, China; (P.S.); (X.W.); (J.S.)
| | - Jingjing Sun
- College of Agriculture, Shanxi Agricultural University, Taigu, Jingzhong 030801, China; (P.S.); (X.W.); (J.S.)
| | - Meijun Zhang
- College of Agriculture, Shanxi Agricultural University, Taigu, Jingzhong 030801, China; (P.S.); (X.W.); (J.S.)
| | - Wude Yang
- College of Agriculture, Shanxi Agricultural University, Taigu, Jingzhong 030801, China; (P.S.); (X.W.); (J.S.)
| |
Collapse
|
14
|
Islam MM, Talukder MA, Sarker MRA, Uddin MA, Akhter A, Sharmin S, Mamun MSA, Debnath SK. A deep learning model for cotton disease prediction using fine-tuning with smart web application in agriculture. INTELLIGENT SYSTEMS WITH APPLICATIONS 2023; 20:200278. [DOI: 10.1016/j.iswa.2023.200278] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/30/2024]
|
15
|
Dhaka VS, Kundu N, Rani G, Zumpano E, Vocaturo E. Role of Internet of Things and Deep Learning Techniques in Plant Disease Detection and Classification: A Focused Review. SENSORS (BASEL, SWITZERLAND) 2023; 23:7877. [PMID: 37765934 PMCID: PMC10537018 DOI: 10.3390/s23187877] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Revised: 08/10/2023] [Accepted: 08/14/2023] [Indexed: 09/29/2023]
Abstract
The automatic detection, visualization, and classification of plant diseases through image datasets are key challenges for precision and smart farming. The technological solutions proposed so far highlight the supremacy of the Internet of Things in data collection, storage, and communication, and deep learning models in automatic feature extraction and feature selection. Therefore, the integration of these technologies is emerging as a key tool for the monitoring, data capturing, prediction, detection, visualization, and classification of plant diseases from crop images. This manuscript presents a rigorous review of the Internet of Things and deep learning models employed for plant disease monitoring and classification. The review encompasses the unique strengths and limitations of different architectures. It highlights the research gaps identified from the related works proposed in the literature. It also presents a comparison of the performance of different deep learning models on publicly available datasets. The comparison gives insights into the selection of the optimum deep learning models according to the size of the dataset, expected response time, and resources available for computation and storage. This review is important in terms of developing optimized and hybrid models for plant disease classification.
Collapse
Affiliation(s)
- Vijaypal Singh Dhaka
- Department of Computer and Communication Engineering, Manipal University Jaipur, Jaipur 303007, India;
| | - Nidhi Kundu
- Sri Karan Narendra Agriculture, Jobner 303328, India;
| | - Geeta Rani
- Department of Computer and Communication Engineering, Manipal University Jaipur, Jaipur 303007, India;
| | - Ester Zumpano
- Department of Informatics, Modeling Electronics and Systems (DIMES), University of Calabria, Arcavacata di Rende, 87036 Rende, Italy; (E.Z.); (E.V.)
- National Research Council-Institute of Nanotechnology, Piazzale Aldo Moro, 33C, Arcavacata, 87036 Rome, Italy
| | - Eugenio Vocaturo
- Department of Informatics, Modeling Electronics and Systems (DIMES), University of Calabria, Arcavacata di Rende, 87036 Rende, Italy; (E.Z.); (E.V.)
- National Research Council-Institute of Nanotechnology, Piazzale Aldo Moro, 33C, Arcavacata, 87036 Rome, Italy
| |
Collapse
|
16
|
Parez S, Dilshad N, Alghamdi NS, Alanazi TM, Lee JW. Visual Intelligence in Precision Agriculture: Exploring Plant Disease Detection via Efficient Vision Transformers. SENSORS (BASEL, SWITZERLAND) 2023; 23:6949. [PMID: 37571732 PMCID: PMC10422257 DOI: 10.3390/s23156949] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Revised: 07/31/2023] [Accepted: 08/01/2023] [Indexed: 08/13/2023]
Abstract
In order for a country's economy to grow, agricultural development is essential. Plant diseases, however, severely hamper crop growth rate and quality. In the absence of domain experts and with low contrast information, accurate identification of these diseases is very challenging and time-consuming. This leads to an agricultural management system in need of a method for automatically detecting disease at an early stage. As a consequence of dimensionality reduction, CNN-based models use pooling layers, which results in the loss of vital information, including the precise location of the most prominent features. In response to these challenges, we propose a fine-tuned technique, GreenViT, for detecting plant infections and diseases based on Vision Transformers (ViTs). Similar to word embedding, we divide the input image into smaller blocks or patches and feed these to the ViT sequentially. Our approach leverages the strengths of ViTs in order to overcome the problems associated with CNN-based models. Experiments on widely used benchmark datasets were conducted to evaluate the proposed GreenViT performance. Based on the obtained experimental outcomes, the proposed technique outperforms state-of-the-art (SOTA) CNN models for detecting plant diseases.
Collapse
Affiliation(s)
- Sana Parez
- Department of Software, Sejong University, Seoul 05006, Republic of Korea;
| | - Naqqash Dilshad
- Department of Convergence Engineering for Intelligent Drone, Sejong University, Seoul 05006, Republic of Korea;
| | - Norah Saleh Alghamdi
- Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia;
| | - Turki M. Alanazi
- Department of Electrical Engineering, College of Engineering, Jouf University, Sakaka 72388, Saudi Arabia;
| | - Jong Weon Lee
- Department of Software, Sejong University, Seoul 05006, Republic of Korea;
| |
Collapse
|
17
|
Daphal SD, Koli SM. Enhancing sugarcane disease classification with ensemble deep learning: A comparative study with transfer learning techniques. Heliyon 2023; 9:e18261. [PMID: 37520940 PMCID: PMC10382639 DOI: 10.1016/j.heliyon.2023.e18261] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2022] [Revised: 07/12/2023] [Accepted: 07/12/2023] [Indexed: 08/01/2023] Open
Abstract
Deep learning practices in the agriculture sector can address many challenges faced by the farmers such as disease detection, yield estimation, soil profile estimation, etc. In this paper, disease classification for the sugarcane plant and the experimentation involved thereby is thoroughly discussed. Experimental results include the performances of the well-known existing transfer learning techniques and proposed ensemble deep learning based architecture that incorporates stack ensemble of two networks with one having level-wise spatial attention helping to provide better generalization. A Self-created database of sugarcane leaf diseases is introduced to the research community through this paper. It involves 5 categories with a total of 2569 images. Here, it is observed that best performing transfer learning method, MobileNet-V2 shows an accuracy of around 84% with the lowest number of parameters whereas ensemble model reaching to 86.53% with less epochs and with acceptable number of parameters.
Collapse
Affiliation(s)
- Swapnil Dadabhau Daphal
- Department of E&TC Engineering, G. H. Raisoni College of Engineering & Management, Wagholi, Pune, 412207, Maharashtra, India
| | - Sanjay M. Koli
- Department of E&TC Engineering, Ajeenkya DY Patil School of Engineering, Charholi Bk., Pune, 412105, Maharashtra, India
| |
Collapse
|
18
|
Venkatachala Appa Swamy M, Periyasamy J, Thangavel M, Khan SB, Almusharraf A, Santhanam P, Ramaraj V, Elsisi M. Design and Development of IoT and Deep Ensemble Learning Based Model for Disease Monitoring and Prediction. Diagnostics (Basel) 2023; 13:diagnostics13111942. [PMID: 37296794 DOI: 10.3390/diagnostics13111942] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2023] [Revised: 05/04/2023] [Accepted: 05/11/2023] [Indexed: 06/12/2023] Open
Abstract
With the rapidly increasing reliance on advances in IoT, we persist towards pushing technology to new heights. From ordering food online to gene editing-based personalized healthcare, disruptive technologies like ML and AI continue to grow beyond our wildest dreams. Early detection and treatment through AI-assisted diagnostic models have outperformed human intelligence. In many cases, these tools can act upon the structured data containing probable symptoms, offer medication schedules based on the appropriate code related to diagnosis conventions, and predict adverse drug effects, if any, in accordance with medications. Utilizing AI and IoT in healthcare has facilitated innumerable benefits like minimizing cost, reducing hospital-obtained infections, decreasing mortality and morbidity etc. DL algorithms have opened up several frontiers by contributing towards healthcare opportunities through their ability to understand and learn from different levels of demonstration and generalization, which is significant in data analysis and interpretation. In contrast to ML which relies more on structured, labeled data and domain expertise to facilitate feature extractions, DL employs human-like cognitive abilities to extract hidden relationships and patterns from uncategorized data. Through the efficient application of DL techniques on the medical dataset, precise prediction, and classification of infectious/rare diseases, avoiding surgeries that can be preventable, minimization of over-dosage of harmful contrast agents for scans and biopsies can be reduced to a greater extent in future. Our study is focused on deploying ensemble deep learning algorithms and IoT devices to design and develop a diagnostic model that can effectively analyze medical Big Data and diagnose diseases by identifying abnormalities in early stages through medical images provided as input. This AI-assisted diagnostic model based on Ensemble Deep learning aims to be a valuable tool for healthcare systems and patients through its ability to diagnose diseases in the initial stages and present valuable insights to facilitate personalized treatment by aggregating the prediction of each base model and generating a final prediction.
Collapse
Affiliation(s)
| | - Jayalakshmi Periyasamy
- School of Information Technology and Engineering, Vellore Institute of Technology, Vellore 632014, Tamil Nadu, India
| | - Muthamilselvan Thangavel
- School of Information Technology and Engineering, Vellore Institute of Technology, Vellore 632014, Tamil Nadu, India
| | - Surbhi B Khan
- Department of Electrical and Computer Engineering, Lebanese American University, Byblos 13-5053, Lebanon
- Department of Data Science, School of Science, Engineering and Environment, University of Sanford, Manchester M5 4WT, UK
| | - Ahlam Almusharraf
- Department of Business Administration, College of Business and Administration, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
| | - Prasanna Santhanam
- School of Information Technology and Engineering, Vellore Institute of Technology, Vellore 632014, Tamil Nadu, India
| | - Vijayan Ramaraj
- School of Information Technology and Engineering, Vellore Institute of Technology, Vellore 632014, Tamil Nadu, India
| | - Mahmoud Elsisi
- Department of Electrical Engineering, National Kaohsiung University of Science and Technology, Kaohsiung City 807618, Taiwan
- Department of Electrical Engineering, Faculty of Engineering (Shoubra), Benha University, 108 Shoubra St., Cairo P.O. Box 11241, Egypt
| |
Collapse
|
19
|
Upadhyay S, Kumar M, Upadhyay A, Verma S, Kaur M, Khurma RA, Castillo PA. Challenges and Limitation Analysis of an IoT-Dependent System for Deployment in Smart Healthcare Using Communication Standards Features. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23115155. [PMID: 37299881 DOI: 10.3390/s23115155] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/06/2023] [Revised: 05/20/2023] [Accepted: 05/25/2023] [Indexed: 06/12/2023]
Abstract
The use of IoT technology is rapidly increasing in healthcare development and smart healthcare system for fitness programs, monitoring, data analysis, etc. To improve the efficiency of monitoring, various studies have been conducted in this field to achieve improved precision. The architecture proposed herein is based on IoT integrated with a cloud system in which power absorption and accuracy are major concerns. We discuss and analyze development in this domain to improve the performance of IoT systems related to health care. Standards of communication for IoT data transmission and reception can help to understand the exact power absorption in different devices to achieve improved performance for healthcare development. We also systematically analyze the use of IoT in healthcare systems using cloud features, as well as the performance and limitations of IoT in this field. Furthermore, we discuss the design of an IoT system for efficient monitoring of various healthcare issues in elderly people and limitations of an existing system in terms of resources, power absorption and security when implemented in different devices as per requirements. Blood pressure and heartbeat monitoring in pregnant women are examples of high-intensity applications of NB-IoT (narrowband IoT), technology that supports widespread communication with a very low data cost and minimum processing complexity and battery lifespan. This article also focuses on analysis of the performance of narrowband IoT in terms of delay and throughput using single- and multinode approaches. We performed analysis using the message queuing telemetry transport protocol (MQTTP), which was found to be efficient compared to the limited application protocol (LAP) in sending information from sensors.
Collapse
Affiliation(s)
- Shrikant Upadhyay
- Department of Electronics & Communication Engineering, Cambridge Institute of Technology (CIT), Tatisilwai 835103, India
| | - Mohit Kumar
- Department of IT, MIT Art, Design and Technology University, Pune 412201, India
| | - Aditi Upadhyay
- Department of Electronics and Communication Engineering, School of Engineering, Jaipur National University, Jaipur 302017, India
| | - Sahil Verma
- Department of Computer Science & Engineering, Uttranchal University, Dehradun 248007, India
| | - Maninder Kaur
- Department of Computer Science and Applications, Guru Gobind Singh College for Women, Chandigarh 160019, India
| | - Ruba Abu Khurma
- Computer Science Department, Faculty of Information Technology, Al-Ahliyya Amman University, Amman 19328, Jordan
| | - Pedro A Castillo
- Department of Computer Engineering, Automation and Robotics, ETSIIT, University of Granada, 18012 Granada, Spain
| |
Collapse
|
20
|
Hayıt T, Erbay H, Varçın F, Hayıt F, Akci N. The classification of wheat yellow rust disease based on a combination of textural and deep features. MULTIMEDIA TOOLS AND APPLICATIONS 2023:1-19. [PMID: 37362723 PMCID: PMC10173929 DOI: 10.1007/s11042-023-15199-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/19/2022] [Revised: 01/09/2023] [Accepted: 03/30/2023] [Indexed: 06/28/2023]
Abstract
Yellow rust is a devastating disease that causes significant losses in wheat production worldwide and significantly affects wheat quality. It can be controlled by cultivating resistant cultivars, applying fungicides, and appropriate agricultural practices. The degree of precautions depends on the extent of the disease. Therefore, it is critical to detect the disease as early as possible. The disease causes deformations in the wheat leaf texture that reveals the severity of the disease. The gray-level co-occurrence matrix(GLCM) is a conventional texture feature descriptor extracted from gray-level images. However, numerous studies in the literature attempt to incorporate texture color with GLCM features to reveal hidden patterns that exist in color channels. On the other hand, recent advances in image analysis have led to the extraction of data-representative features so-called deep features. In particular, convolutional neural networks (CNNs) have the remarkable capability of recognizing patterns and show promising results for image classification when fed with image texture. Herein, the feasibility of using a combination of textural features and deep features to determine the severity of yellow rust disease in wheat was investigated. Textural features include both gray-level and color-level information. Also, pre-trained DenseNet was employed for deep features. The dataset, so-called Yellow-Rust-19, composed of wheat leaf images, was employed. Different classification models were developed using different color spaces such as RGB, HSV, and L*a*b, and two classification methods such as SVM and KNN. The combined model named CNN-CGLCM_HSV, where HSV and SVM were employed, with an accuracy of 92.4% outperformed the other models.
Collapse
Affiliation(s)
- Tolga Hayıt
- Department of Computer Engineering, Faculty of Engineering and Architecture, Yozgat Bozok University, Yozgat, 66900 Türkiye
| | - Hasan Erbay
- Computer Engineering Department, Engineering Faculty, University of Turkish Aeronautical Association, 06790 Etimesgut Ankara, Türkiye
- Computer Engineering Department, Engineering Faculty, Ostim Technical University, 06374 Ostim Ankara, Türkiye
| | - Fatih Varçın
- Department of Computer Engineering, Faculty of Technology, Sakarya University of Applied Sciences, Sakarya, 54187 Türkiye
| | - Fatma Hayıt
- Department of Gastronomy and Culinary Arts, Tourism Faculty, Yozgat Bozok University, Yozgat, 66900 Türkiye
| | - Nilüfer Akci
- Directorate of Plant Protection Central Research Institute, Republic of Türkiye Ministry of Agriculture and Forestry, Ankara, 06172 Türkiye
| |
Collapse
|
21
|
Choudhary P, Shukla P, Muthamilarasan M. Genetic enhancement of climate-resilient traits in small millets: A review. Heliyon 2023; 9:e14502. [PMID: 37064482 PMCID: PMC10102230 DOI: 10.1016/j.heliyon.2023.e14502] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2022] [Revised: 02/10/2023] [Accepted: 03/09/2023] [Indexed: 03/28/2023] Open
Abstract
Agriculture is facing the challenge of feeding the ever-growing population that is projected to reach ten billion by 2050. While improving crop yield and productivity can address this challenge, the increasing effects of global warming and climate change seriously threaten agricultural productivity. Thus, genomics and genome modification technologies are crucial to improving climate-resilient traits to enable sustained yield and productivity; however, significant research focuses on staple crops such as rice, wheat, and maize. Crops that are naturally climate-resilient and nutritionally superior to staple cereals, such as small millets, remain neglected and underutilized by mainstream research. The ability of small millets to grow in marginal regions having limited irrigation and poor soil fertility makes these crops a better choice for cultivation in arid and semi-arid areas. Hence, mainstreaming small millets for cultivation and using omics technologies to dissect the climate-resilient traits to identify the molecular determinants underlying these traits are imperative for addressing food and nutritional security. In this context, the review discusses the genomics and genome modification approaches for dissecting key traits in small millets and their application for improving these traits in cultivated germplasm. The review also discusses biofortification for nutritional security and machine-learning approaches for trait improvement in small millets. Altogether, the review provides a roadmap for the effective use of next-generation approaches for trait improvement in small millets. This will lead to the development of improved varieties for addressing multiple insecurities prevailing in the present climate change scenario.
Collapse
Affiliation(s)
- Pooja Choudhary
- Department of Plant Sciences, School of Life Sciences, University of Hyderabad, Hyderabad 500046, Telangana, India
| | - Pooja Shukla
- Department of Plant Sciences, School of Life Sciences, University of Hyderabad, Hyderabad 500046, Telangana, India
| | - Mehanathan Muthamilarasan
- Department of Plant Sciences, School of Life Sciences, University of Hyderabad, Hyderabad 500046, Telangana, India
| |
Collapse
|
22
|
Zhu X, Li J, Jia R, Liu B, Yao Z, Yuan A, Huo Y, Zhang H. LAD-Net: A Novel Light Weight Model for Early Apple Leaf Pests and Diseases Classification. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2023; 20:1156-1169. [PMID: 35849665 DOI: 10.1109/tcbb.2022.3191854] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
Aphids, brown spots, mosaics, rusts, powdery mildew and Alternaria blotches are common types of early apple leaf pests and diseases that severely affect the yield and quality of apples. Recently, deep learning has been regarded as the best classification model for apple leaf pests and diseases. However, these models with large parameters have difficulty providing an accurate and fast diagnosis of apple leaf pests and diseases on mobile terminals. This paper proposes a novel and real-time early apple leaf disease recognition model. AD Convolution is firstly utilized to replace standard convolution to make smaller number of parameters and calculations. Meanwhile, a LAD-Inception is built to enhance the ability of extracting multiscale features of different sizes of disease spots. Finally, the LAD-Net model is built by the LR-CBAM and the LAD-Inception modules, replacing a full connection with global average pooling to further reduce parameters. The results show that the LAD-Net, with a size of only 1.25MB, can achieve a recognition performance of 98.58%. Additionally, it is only delayed by 15.2ms on HUAWEI P40 and by 100.1ms on Jetson Nano, illustrating that the LAD-Net can accurately recognize early apple leaf pests and diseases on mobile devices in real-time, providing portable technical support.
Collapse
|
23
|
A Mobile-Based System for Detecting Ginger Leaf Disorders Using Deep Learning. FUTURE INTERNET 2023. [DOI: 10.3390/fi15030086] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/23/2023] Open
Abstract
The agriculture sector plays a crucial role in supplying nutritious and high-quality food. Plant disorders significantly impact crop productivity, resulting in an annual loss of 33%. The early and accurate detection of plant disorders is a difficult task for farmers and requires specialized knowledge, significant effort, and labor. In this context, smart devices and advanced artificial intelligence techniques have significant potential to pave the way toward sustainable and smart agriculture. This paper presents a deep learning-based android system that can diagnose ginger plant disorders such as soft rot disease, pest patterns, and nutritional deficiencies. To achieve this, state-of-the-art deep learning models were trained on a real dataset of 4,394 ginger leaf images with diverse backgrounds. The trained models were then integrated into an Android-based mobile application that takes ginger leaf images as input and performs the real-time detection of crop disorders. The proposed system shows promising results in terms of accuracy, precision, recall, confusion matrices, computational cost, Matthews correlation coefficient (MCC), mAP, and F1-score.
Collapse
|
24
|
Zhang W, Sun X, Zhou L, Xie X, Zhao W, Liang Z, Zhuang P. Dual-branch collaborative learning network for crop disease identification. FRONTIERS IN PLANT SCIENCE 2023; 14:1117478. [PMID: 36844059 PMCID: PMC9950499 DOI: 10.3389/fpls.2023.1117478] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/07/2022] [Accepted: 01/20/2023] [Indexed: 06/18/2023]
Abstract
Crop diseases seriously affect the quality, yield, and food security of crops. redBesides, traditional manual monitoring methods can no longer meet intelligent agriculture's efficiency and accuracy requirements. Recently, deep learning methods have been rapidly developed in computer vision. To cope with these issues, we propose a dual-branch collaborative learning network for crop disease identification, called DBCLNet. Concretely, we propose a dual-branch collaborative module using convolutional kernels of different scales to extract global and local features of images, which can effectively utilize both global and local features. Meanwhile, we embed a channel attention mechanism in each branch module to refine the global and local features. Whereafter, we cascade multiple dual-branch collaborative modules to design a feature cascade module, which further learns features at more abstract levels via the multi-layer cascade design strategy. Extensive experiments on the Plant Village dataset demonstrated the best classification performance of our DBCLNet method compared to the state-of-the-art methods for the identification of 38 categories of crop diseases. Besides, the Accuracy, Precision, Recall, and F-score of our DBCLNet for the identification of 38 categories of crop diseases are 99.89%, 99.97%, 99.67%, and 99.79%, respectively. 811.
Collapse
Affiliation(s)
- Weidong Zhang
- School of Information Engineering, Henan Institute of Science and Technology, Xinxiang, China
| | - Xuewei Sun
- School of Information Engineering, Henan Institute of Science and Technology, Xinxiang, China
| | - Ling Zhou
- School of Information Engineering, Henan Institute of Science and Technology, Xinxiang, China
| | - Xiwang Xie
- School of Information Science and Technology, Dalian Maritime University, Dalian, Liaoning, China
| | - Wenyi Zhao
- School of Artificial Intelligence, Beijing University of Posts and Telecommunications (BUPT), Beijing, China
| | - Zheng Liang
- Internet Academy, Anhui University, Hefei, Anhui, China
| | - Peixian Zhuang
- School of Information Engineering, Henan Institute of Science and Technology, Xinxiang, China
- School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, China
| |
Collapse
|
25
|
Moges G, McDonnell K, Delele MA, Ali AN, Fanta SW. Development and comparative analysis of ANN and SVR-based models with conventional regression models for predicting spray drift. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2023; 30:21927-21944. [PMID: 36280637 DOI: 10.1007/s11356-022-23571-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/15/2022] [Accepted: 10/07/2022] [Indexed: 06/16/2023]
Abstract
As monitoring of spray drift during application can be expensive, time-consuming, and labor-intensive, drift predicting models may provide a practical complement. Several mechanistic models have been developed as drift prediction tool for various types of application equipment. Nevertheless, mechanistic models are quite often intricate and complex with a large number of input parameters required. Quite often, the detailed data needed for such models are not readily available. In this study, two advanced machine learning models (artificial neural network (ANN) and support vector regression (SVR)) were developed for pesticide drift prediction and compared with three conventional regression-based models: multiple linear regression (MLR), generalized linear model (GLM), and generalized nonlinear least squares (GNLS). The models were evaluated in fivefold cross-validation and by external validation using the coefficient of determination (R2), root mean square error (RMSE), mean absolute error (MAE), and mean absolute bias (MAB). From regression-based models, GLM and GNLS models performed very well when evaluated by cross-validation with R2 = 0.96 and 0.95 and RMSE = 0.70 and 0.82 respectively, while MLR performed less with R2 of 0.65 and RMSE of 2.25. Simultaneously, ANN and SVR models performed very well with R2 = 0.98 and 0.97 and RMSE = 0.58 and 0.71 respectively. Overall, ANN model performed best compared to the other four models followed by SVR. A comparison was also made between the high-performing model, ANN, and two previously published empirical models. The ANN model outperformed the two previously published empirical models and can be used to predict pesticide drift. Therefore, the ANN model is a potentially promising new approach for predicting ground drift that merits further study. In conclusion, our work demonstrated that the new approach, ANN and SVR-based models, for pesticide drift modeling has better predictive power than conventional regression models. Their ability to model complex relationships is a clear benefit in pesticide drift modeling where the variability in pesticide drift is often affected by a number of variables and the relationships between drift and predictors are very complicated. We believe such insights will pave better way for the application of machine learning towards spray drift modeling.
Collapse
Affiliation(s)
- Girma Moges
- Ethiopian Institute of Agricultural Research, P.O. Box 436, Nazareth, Ethiopia
- Faculty of Mechanical and Industrial Engineering, Bahir Dar Institute of Technology, Bahir Dar University, P.O Box 26, Bahir Dar, Ethiopia
| | - Kevin McDonnell
- School of Agriculture and Food Science, University College Dublin, Belfield, Dublin 4, D04 N2E5, Ireland
| | - Mulugeta Admasu Delele
- Faculty of Chemical and Food Engineering, Bahir Dar Institute of Technology, Bahir Dar University, P.O Box 26, Bahir Dar, Ethiopia.
| | - Addisu Negash Ali
- Faculty of Mechanical and Industrial Engineering, Bahir Dar Institute of Technology, Bahir Dar University, P.O Box 26, Bahir Dar, Ethiopia
| | - Solomon Workneh Fanta
- Faculty of Chemical and Food Engineering, Bahir Dar Institute of Technology, Bahir Dar University, P.O Box 26, Bahir Dar, Ethiopia
| |
Collapse
|
26
|
Zheng L, Zhao M, Zhu J, Huang L, Zhao J, Liang D, Zhang D. Fusion of hyperspectral imaging (HSI) and RGB for identification of soybean kernel damages using ShuffleNet with convolutional optimization and cross stage partial architecture. FRONTIERS IN PLANT SCIENCE 2023; 13:1098864. [PMID: 36743540 PMCID: PMC9889993 DOI: 10.3389/fpls.2022.1098864] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Accepted: 12/19/2022] [Indexed: 06/18/2023]
Abstract
Identification of soybean kernel damages is significant to prevent further disoperation. Hyperspectral imaging (HSI) has shown great potential in cereal kernel identification, but its low spatial resolution leads to external feature infidelity and limits the analysis accuracy. In this study, the fusion of HSI and RGB images and improved ShuffleNet were combined to develop an identification method for soybean kernel damages. First, the HSI-RGB fusion network (HRFN) was designed based on super-resolution and spectral modification modules to process the registered HSI and RGB image pairs and generate super-resolution HSI (SR-HSI) images. ShuffleNet improved with convolution optimization and cross-stage partial architecture (ShuffleNet_COCSP) was used to build classification models with the optimal image set of effective wavelengths (OISEW) of SR-HSI images obtained by support vector machine and ShuffleNet. High-quality fusion of HSI and RGB with the obvious spatial promotion and satisfactory spectral conservation was gained by HRFN. ShuffleNet_COCSP and OISEW obtained the optimal recognition performance of ACCp=98.36%, Params=0.805 M, and FLOPs=0.097 G, outperforming other classification methods and other types of images. Overall, the proposed method provides an accurate and reliable identification of soybean kernel damages and would be extended to analysis of other quality indicators of various crop kernels.
Collapse
|
27
|
Lin S, Hao X, Liu Y, Yan D, Liu J, Zhong M. Lightweight deep learning methods for panoramic dental X-ray image segmentation. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-08102-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
AbstractDental X-ray image segmentation is helpful for assisting clinicians to examine tooth conditions and identify dental diseases. Fast and lightweight segmentation algorithms without using cloud computing may be required to be implemented in X-ray imaging systems. This paper aims to investigate lightweight deep learning methods for dental X-ray image segmentation for the purpose of deployment on edge devices, such as dental X-ray imaging systems. A novel lightweight neural network scheme using knowledge distillation is proposed in this paper. The proposed lightweight method and a number of existing lightweight deep learning methods were trained on a panoramic dental X-ray image data set. These lightweight methods were evaluated and compared by using several accuracy metrics. The proposed lightweight method only requires 0.33 million parameters ($$\sim 7.5$$
∼
7.5
megabytes) for the trained model, while it achieved the best performance in terms of IoU (0.804) and Dice (0.89) comparing to other lightweight methods. This work shows that the proposed method for dental X-ray image segmentation requires small memory storage, while it achieved comparative performance. The method could be deployed on edge devices and could potentially assist clinicians to alleviate their daily workflow and improve the quality of their analysis.
Collapse
|
28
|
Srinivasu PN, Shafi J, Krishna TB, Sujatha CN, Praveen SP, Ijaz MF. Using Recurrent Neural Networks for Predicting Type-2 Diabetes from Genomic and Tabular Data. Diagnostics (Basel) 2022; 12:3067. [PMID: 36553074 PMCID: PMC9776641 DOI: 10.3390/diagnostics12123067] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Revised: 12/01/2022] [Accepted: 12/04/2022] [Indexed: 12/12/2022] Open
Abstract
The development of genomic technology for smart diagnosis and therapies for various diseases has lately been the most demanding area for computer-aided diagnostic and treatment research. Exponential breakthroughs in artificial intelligence and machine intelligence technologies could pave the way for identifying challenges afflicting the healthcare industry. Genomics is paving the way for predicting future illnesses, including cancer, Alzheimer's disease, and diabetes. Machine learning advancements have expedited the pace of biomedical informatics research and inspired new branches of computational biology. Furthermore, knowing gene relationships has resulted in developing more accurate models that can effectively detect patterns in vast volumes of data, making classification models important in various domains. Recurrent Neural Network models have a memory that allows them to quickly remember knowledge from previous cycles and process genetic data. The present work focuses on type 2 diabetes prediction using gene sequences derived from genomic DNA fragments through automated feature selection and feature extraction procedures for matching gene patterns with training data. The suggested model was tested using tabular data to predict type 2 diabetes based on several parameters. The performance of neural networks incorporating Recurrent Neural Network (RNN) components, Long Short-Term Memory (LSTM), and Gated Recurrent Units (GRU) was tested in this research. The model's efficiency is assessed using the evaluation metrics such as Sensitivity, Specificity, Accuracy, F1-Score, and Mathews Correlation Coefficient (MCC). The suggested technique predicted future illnesses with fair Accuracy. Furthermore, our research showed that the suggested model could be used in real-world scenarios and that input risk variables from an end-user Android application could be kept and evaluated on a secure remote server.
Collapse
Affiliation(s)
- Parvathaneni Naga Srinivasu
- Department of Computer Science and Engineering, Prasad V. Potluri Siddhartha Institute of Technology, Vijayawada 520007, Andhra Pradesh, India
| | - Jana Shafi
- Department of Computer Science, College of Arts and Science, Prince Sattam bin Abdul Aziz University, Wadi Ad-Dawasir 11991, Saudi Arabia
| | - T Balamurali Krishna
- Department of Computer Science and Engineering, Dhanekula Institute of Engineering and Technology, Vijayawada 521139, Andhra Pradesh, India
| | - Canavoy Narahari Sujatha
- Department of Electronics and Communication Engineering, Sreenidhi Institute of Science and Technology, Hyderabad 501301, Telangana, India
| | - S Phani Praveen
- Department of Computer Science and Engineering, Prasad V. Potluri Siddhartha Institute of Technology, Vijayawada 520007, Andhra Pradesh, India
| | - Muhammad Fazal Ijaz
- Department of Intelligent Mechatronics Engineering, Sejong University, Seoul 05006, Republic of Korea
| |
Collapse
|
29
|
Chen R, Qi H, Liang Y, Yang M. Identification of plant leaf diseases by deep learning based on channel attention and channel pruning. FRONTIERS IN PLANT SCIENCE 2022; 13:1023515. [PMID: 36438120 PMCID: PMC9686387 DOI: 10.3389/fpls.2022.1023515] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/19/2022] [Accepted: 10/21/2022] [Indexed: 06/16/2023]
Abstract
Plant diseases cause significant economic losses and food security in agriculture each year, with the critical path to reducing losses being accurate identification and timely diagnosis of plant diseases. Currently, deep neural networks have been extensively applied in plant disease identification, but such approaches still suffer from low identification accuracy and numerous parameters. Hence, this paper proposes a model combining channel attention and channel pruning called CACPNET, suitable for disease identification of common species. The channel attention mechanism adopts a local cross-channel strategy without dimensionality reduction, which is inserted into a ResNet-18-based model that combines global average pooling with global max pooling to effectively improve the features' extracting ability of plant leaf diseases. Based on the model's optimum feature extraction condition, unimportant channels are removed to reduce the model's parameters and complexity via the L1-norm channel weight and local compression ratio. The accuracy of CACPNET on the public dataset PlantVillage reaches 99.7% and achieves 97.7% on the local peanut leaf disease dataset. Compared with the base ResNet-18 model, the floating point operations (FLOPs) decreased by 30.35%, the parameters by 57.97%, the model size by 57.85%, and the GPU RAM requirements by 8.3%. Additionally, CACPNET outperforms current models considering inference time and throughput, reaching 22.8 ms/frame and 75.5 frames/s, respectively. The results outline that CACPNET is appealing for deployment on edge devices to improve the efficiency of precision agriculture in plant disease detection.
Collapse
Affiliation(s)
- Riyao Chen
- College of Engineering, South China Agricultural University, Guangzhou, China
- National Center for International Collaboration Research on Precision Agricultural Aviation Pesticides Spraying Technology, Guangzhou, Guangdong, China
| | - Haixia Qi
- College of Engineering, South China Agricultural University, Guangzhou, China
- National Center for International Collaboration Research on Precision Agricultural Aviation Pesticides Spraying Technology, Guangzhou, Guangdong, China
- Guangdong Laboratory for Lingnan Modern Agriculture, Guangzhou, Guangdong, China
| | - Yu Liang
- College of Engineering, South China Agricultural University, Guangzhou, China
- National Center for International Collaboration Research on Precision Agricultural Aviation Pesticides Spraying Technology, Guangzhou, Guangdong, China
| | - Mingchao Yang
- College of Horticulture, South China Agricultural University, Guangzhou, China
| |
Collapse
|
30
|
Ilyas T, Jin H, Siddique MI, Lee SJ, Kim H, Chua L. DIANA: A deep learning-based paprika plant disease and pest phenotyping system with disease severity analysis. FRONTIERS IN PLANT SCIENCE 2022; 13:983625. [PMID: 36275542 PMCID: PMC9582859 DOI: 10.3389/fpls.2022.983625] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Accepted: 09/15/2022] [Indexed: 06/16/2023]
Abstract
The emergence of deep neural networks has allowed the development of fully automated and efficient diagnostic systems for plant disease and pest phenotyping. Although previous approaches have proven to be promising, they are limited, especially in real-life scenarios, to properly diagnose and characterize the problem. In this work, we propose a framework which besides recognizing and localizing various plant abnormalities also informs the user about the severity of the diseases infecting the plant. By taking a single image as input, our algorithm is able to generate detailed descriptive phrases (user-defined) that display the location, severity stage, and visual attributes of all the abnormalities that are present in the image. Our framework is composed of three main components. One of them is a detector that accurately and efficiently recognizes and localizes the abnormalities in plants by extracting region-based anomaly features using a deep neural network-based feature extractor. The second one is an encoder-decoder network that performs pixel-level analysis to generate abnormality-specific severity levels. Lastly is an integration unit which aggregates the information of these units and assigns unique IDs to all the detected anomaly instances, thus generating descriptive sentences describing the location, severity, and class of anomalies infecting plants. We discuss two possible ways of utilizing the abovementioned units in a single framework. We evaluate and analyze the efficacy of both approaches on newly constructed diverse paprika disease and pest recognition datasets, comprising six anomaly categories along with 11 different severity levels. Our algorithm achieves mean average precision of 91.7% for the abnormality detection task and a mean panoptic quality score of 70.78% for severity level prediction. Our algorithm provides a practical and cost-efficient solution to farmers that facilitates proper handling of crops.
Collapse
Affiliation(s)
- Talha Ilyas
- Core Research Institute of Intelligent Robots, Jeonbuk National University, Jeonju-si, South Korea
- Division of Electronic and Information Engineering, Jeonbuk National University, Jeonju-si, South Korea
| | - Hyungjun Jin
- Core Research Institute of Intelligent Robots, Jeonbuk National University, Jeonju-si, South Korea
- Division of Electronic and Information Engineering, Jeonbuk National University, Jeonju-si, South Korea
| | - Muhammad Irfan Siddique
- Department of Plant Science and Plant Genomics and Breeding Institute, Seoul National University, Seoul, South Korea
- Department of Horticultural Science, North Carolina State University, Mountain Horticultural Crops Research and Extension Center, Mills River, United States
| | - Sang Jun Lee
- Division of Electronic and Information Engineering, Jeonbuk National University, Jeonju-si, South Korea
| | - Hyongsuk Kim
- Core Research Institute of Intelligent Robots, Jeonbuk National University, Jeonju-si, South Korea
- Division of Electronic and Information Engineering, Jeonbuk National University, Jeonju-si, South Korea
| | - Leon Chua
- Department of Electrical Engineering and Computer Sciences, University of California at Berkeley, Berkeley, CA, United States
| |
Collapse
|
31
|
An Improved Deep Residual Convolutional Neural Network for Plant Leaf Disease Detection. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:5102290. [PMID: 36156945 PMCID: PMC9492343 DOI: 10.1155/2022/5102290] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Revised: 08/15/2022] [Accepted: 08/16/2022] [Indexed: 11/22/2022]
Abstract
In this research, we proposed a novel deep residual convolutional neural network with 197 layers (ResNet197) for the detection of various plant leaf diseases. Six blocks of layers were used to develop ResNet197. ResNet197 was trained and tested using a combined plant leaf disease image dataset. Scaling, cropping, flipping, padding, rotation, affine transformation, saturation, and hue transformation techniques were used to create the augmentation data of the plant leaf disease image dataset. The dataset consisted of 103 diseased and healthy image classes of 22 plants and 154,500 images of healthy and diseased plant leaves. The evolutionary search technique was used to optimise the layers and hyperparameter values of ResNet197. ResNet197 was trained on the combined plant leaf disease image dataset using a graphics processing unit (GPU) environment for 1000 epochs. It produced a 99.58 percentage average classification accuracy on the test dataset. The experimental results were superior to existing ResNet architectures and recent transfer learning techniques.
Collapse
|
32
|
Peng Y, Wang Y. Leaf disease image retrieval with object detection and deep metric learning. FRONTIERS IN PLANT SCIENCE 2022; 13:963302. [PMID: 36176678 PMCID: PMC9513793 DOI: 10.3389/fpls.2022.963302] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Accepted: 08/18/2022] [Indexed: 05/27/2023]
Abstract
Rapid identification of plant diseases is essential for effective mitigation and control of their influence on plants. For plant disease automatic identification, classification of plant leaf images based on deep learning algorithms is currently the most accurate and popular method. Existing methods rely on the collection of large amounts of image annotation data and cannot flexibly adjust recognition categories, whereas we develop a new image retrieval system for automated detection, localization, and identification of individual leaf disease in an open setting, namely, where newly added disease types can be identified without retraining. In this paper, we first optimize the YOLOv5 algorithm, enhancing recognition ability in small objects, which helps to extract leaf objects more accurately; secondly, integrating classification recognition with metric learning, jointly learning categorizing images and similarity measurements, thus, capitalizing on prediction ability of available image classification models; and finally, constructing an efficient and nimble image retrieval system to quickly determine leaf disease type. We demonstrate detailed experimental results on three publicly available leaf disease datasets and prove the effectiveness of our system. This work lays the groundwork for promoting disease surveillance of plants applicable to intelligent agriculture and to crop research such as nutrition diagnosis, health status surveillance, and more.
Collapse
Affiliation(s)
- Yingshu Peng
- Lushan Botanical Garden, Chinese Academy of Sciences, Jiujiang, China
- College of Forestry, Nanjing Forestry University, Nanjing, China
| | - Yi Wang
- Jiangsu Wiscom Technology Co. Ltd., Nanjing, China
| |
Collapse
|
33
|
An Improved EfficientNetV2 Model Based on Visual Attention Mechanism: Application to Identification of Cassava Disease. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:1569911. [PMID: 36317074 PMCID: PMC9617697 DOI: 10.1155/2022/1569911] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/05/2022] [Revised: 06/15/2022] [Accepted: 06/17/2022] [Indexed: 12/03/2022]
Abstract
With the characteristic of high recognition rate and strong network robustness, convolutional neural network has now become the most mainstream method in the field of crop disease recognition. Aiming at the problems with insufficient numbers of labeled samples, complex backgrounds of sample images, and difficult extraction of useful feature information, a novel algorithm is proposed in this study based on attention mechanisms and convolutional neural networks for cassava leaf recognition. Specifically, a combined data augmentation strategy for datasets is used to prevent single distribution of image datasets, and then the PDRNet (plant disease recognition network) combining channel attention mechanism and spatial attention mechanism is proposed. The algorithm is designed as follows. Firstly, an attention module embedded in the network layer is deployed to establish remote dependence on each feature layer, strengthen the key feature information, and suppress the interference feature information, such as background noise. Secondly, a stochastic depth learning strategy is formulated to accelerate the training and inference of the network. And finally, a transfer learning method is adopted to load the pretrained weights into the model proposed in this study, with the recognition accuracy of the model enhanced by means of detailed parameter adjustments and dynamic changes in the learning rate. A large number of comparative experiments demonstrate that the proposed algorithm can deliver a recognition accuracy of 99.56% on the cassava disease image dataset, reaching the state-of-the-art level among CNN-based methods in terms of accuracy.
Collapse
|
34
|
Afzal MK, Adam JM, Afzal HR, Zang Y, Bello SA, Wang C, Li J. Discriminative feature abstraction by deep L2 hypersphere embedding for 3D mesh CNNs. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.05.104] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
35
|
Chen Y, Sun W, Jiu S, Wang L, Deng B, Chen Z, Jiang F, Hu M, Zhang C. Soluble Solids Content Binary Classification of Miyagawa Satsuma in Chongming Island Based on Near Infrared Spectroscopy. FRONTIERS IN PLANT SCIENCE 2022; 13:841452. [PMID: 35923875 PMCID: PMC9340214 DOI: 10.3389/fpls.2022.841452] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Accepted: 06/15/2022] [Indexed: 06/15/2023]
Abstract
Citrus is one of the most important fruits in China. Miyagawa Satsuma, one kind of citrus, is a nutritious agricultural product with regional characteristics of Chongming Island. Near-infrared Spectroscopy (NIR) is a proper method for studying the quality of fruits, because it is low-cost, efficient, non-destructive, and repeatable. Therefore, the NIR technique is used to detect citrus's soluble solid content (SSC) in this study. After obtaining the original spectral data, the first 70% of them are divided into the training set and 30% into the test set. Then, the Random Frog algorithm is chosen to select characteristic wavelengths, which reduces the dimension of the data and the complexity of the model, and accordingly makes the generalization of the classification model better. After comparing the performance of various classifiers (AdaBoost, KNN, LS-SVM, and Bayes) under different characteristic wavelength numbers, the AdaBoost classifier outperforms using 275 characteristic wavelengths for modeling eventually. The accuracy, precision, recall, and F 1-score are 78.3%, 80.5%, 78.3%, and 0.780, respectively and the ROC (Receiver Operating Characteristic Curve, ROC curve) is close to the upper left corner, suggesting that the classification model is acceptable. The results demonstrate that it is feasible to use the NIR technique to estimate whether the citrus is sweet or not. Furthermore, it is beneficial for us to apply the obtained models for identifying the quality of citrus correctly. For fruit traders, the model helps them to determine the growth cycle of citrus more scientifically, improve the level of citrus cultivation and management and the final fruit quality, and thus increase the economic income of fruit traders.
Collapse
Affiliation(s)
- Yuzhen Chen
- School of Agriculture and Biology, Shanghai Jiao Tong University, Shanghai, China
- Shanghai Key Laboratory of Multidimensional Information Processing, School of Communication and Electronic Engineering, East China Normal University, Shanghai, China
| | - Wanxia Sun
- School of Agriculture and Biology, Shanghai Jiao Tong University, Shanghai, China
| | - Songtao Jiu
- School of Agriculture and Biology, Shanghai Jiao Tong University, Shanghai, China
| | - Lei Wang
- School of Agriculture and Biology, Shanghai Jiao Tong University, Shanghai, China
| | - Bohan Deng
- School of Agriculture and Biology, Shanghai Jiao Tong University, Shanghai, China
| | - Zili Chen
- School of Agriculture and Biology, Shanghai Jiao Tong University, Shanghai, China
| | - Fei Jiang
- Shanghai Citrus Research Institute, Shanghai, China
| | - Menghan Hu
- School of Agriculture and Biology, Shanghai Jiao Tong University, Shanghai, China
- Shanghai Key Laboratory of Multidimensional Information Processing, School of Communication and Electronic Engineering, East China Normal University, Shanghai, China
| | - Caixi Zhang
- School of Agriculture and Biology, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
36
|
Zhang Q, Tian X, Chen W, Yang H, Lv P, Wu Y. Unsound wheat kernel recognition based on deep convolutional neural network transfer learning and feature fusion. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2022. [DOI: 10.3233/jifs-213195] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Unsound wheat kernel recognition is an important part of wheat quality inspection, and it is also a key indicator to measure wheat quality. Research on unsound wheat kernel recognition is of great significance to the correct evaluation of wheat quality. The existing researches on unsound wheat kernel recognition are mainly to directly optimize the classical classification networks, and the recognition effect is often unsatisfactory due to insufficient training data. Aiming at the problem that the recognition rate of unsound wheat kernels is not ideal due to the lack of training data, we propose a Transfer Learning Feature Fusion (TLFF) model. The model uses transfer learning and feature fusion to identify unsound wheat kernels. First, feature extraction is performed by deep Convolutional Neural Networks (CNNs) VGG-16 and VGG-19 pre-trained on the large public dataset ImageNet. Then, the features extracted by the pre-trained neural networks are fused and classified through the flattening layer, fully connected layer, Dropout layer, and Softmax layer. We conduct experiments on single model, two-model fusion, three-model fusion, and four-model fusion, and select the three-model fusion scheme to perform this task. Finally, we vote on the output results of the three best fusion models to further improve the recognition rate. The pre-trained models we use are trained on a large public dataset ImageNet. Since the scale of the dataset is very large, these pre-trained models also have good generalization performance for images other than ImageNet dataset. Therefore, although our dataset is small, we can still achieve good recognition results. Experimental results show that the recognition performance of the TLFF model is significantly better than the existing unsound wheat kernel recognition models.
Collapse
Affiliation(s)
- Qinghui Zhang
- Key Laboratory of Grain Information Processing and Control (Henan University of Technology), Ministry of Education, Zhengzhou, PR China
- Henan Key Laboratory of Grain Photoelectric Detection and Control (Henan University ofTechnology), Zhengzhou, PR China
| | - Xinxin Tian
- Key Laboratory of Grain Information Processing and Control (Henan University of Technology), Ministry of Education, Zhengzhou, PR China
| | - Weidong Chen
- Key Laboratory of Grain Information Processing and Control (Henan University of Technology), Ministry of Education, Zhengzhou, PR China
| | - Hongwei Yang
- Key Laboratory of Grain Information Processing and Control (Henan University of Technology), Ministry of Education, Zhengzhou, PR China
| | - Pengtao Lv
- Key Laboratory of Grain Information Processing and Control (Henan University of Technology), Ministry of Education, Zhengzhou, PR China
| | - Yong Wu
- Anhui Gaozhe Information Technology Co., Ltd
| |
Collapse
|
37
|
Liao T, Yang R, Zhao P, Zhou W, He M, Li L. MDAM-DRNet: Dual Channel Residual Network With Multi-Directional Attention Mechanism in Strawberry Leaf Diseases Detection. FRONTIERS IN PLANT SCIENCE 2022; 13:869524. [PMID: 35874000 PMCID: PMC9305473 DOI: 10.3389/fpls.2022.869524] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Accepted: 06/10/2022] [Indexed: 06/15/2023]
Abstract
The growth of strawberry plants is affected by a variety of strawberry leaf diseases. Yet, due to the complexity of these diseases' spots in terms of color and texture, their manual identification requires much time and energy. Developing a more efficient identification method could be imperative for improving the yield and quality of strawberry crops. To that end, here we proposed a detection framework for strawberry leaf diseases based on a dual-channel residual network with a multi-directional attention mechanism (MDAM-DRNet). (1) In order to fully extract the color features from images of diseased strawberry leaves, this paper constructed a color feature path at the front end of the network. The color feature information in the image was then extracted mainly through a color correlogram. (2) Likewise, to fully extract the texture features from images, a texture feature path at the front end of the network was built; it mainly extracts texture feature information by using an area compensation rotation invariant local binary pattern (ACRI-LBP). (3) To enhance the model's ability to extract detailed features, for the main frame, this paper proposed a multidirectional attention mechanism (MDAM). This MDAM can allocate weights in the horizontal, vertical, and diagonal directions, thereby reducing the loss of feature information. Finally, in order to solve the problems of gradient disappearance in the network, the ELU activation function was used in the main frame. Experiments were then carried out using a database we compiled. According to the results, the highest recognition accuracy by the network used in this paper for six types of strawberry leaf diseases and normal leaves is 95.79%, with an F1 score of 95.77%. This proves the introduced method is effective at detecting strawberry leaf diseases.
Collapse
Affiliation(s)
- Tingjing Liao
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, China
| | - Ruoli Yang
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, China
| | - Peirui Zhao
- College of Food Science and Engineering, Central South University of Forestry and Technology, Changsha, China
| | - Wenhua Zhou
- College of Food Science and Engineering, Central South University of Forestry and Technology, Changsha, China
| | - Mingfang He
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, China
| | - Liujun Li
- Department of Civil, Missouri University of Science and Technology, University of Missouri-Rolla, Rolla, MO, United States
| |
Collapse
|
38
|
Feng X, Zhao C, Wang C, Wu H, Miao Y, Zhang J. A Vegetable Leaf Disease Identification Model Based on Image-Text Cross-Modal Feature Fusion. FRONTIERS IN PLANT SCIENCE 2022; 13:918940. [PMID: 35812910 PMCID: PMC9263697 DOI: 10.3389/fpls.2022.918940] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Accepted: 05/30/2022] [Indexed: 06/15/2023]
Abstract
In view of the differences in appearance and the complex backgrounds of crop diseases, automatic identification of field diseases is an extremely challenging topic in smart agriculture. To address this challenge, a popular approach is to design a Deep Convolutional Neural Network (DCNN) model that extracts visual disease features in the images and then identifies the diseases based on the extracted features. This approach performs well under simple background conditions, but has low accuracy and poor robustness under complex backgrounds. In this paper, an end-to-end disease identification model composed of a disease-spot region detector and a disease classifier (YOLOv5s + BiCMT) was proposed. Specifically, the YOLOv5s network was used to detect the disease-spot regions so as to provide a regional attention mechanism to facilitate the disease identification task of the classifier. For the classifier, a Bidirectional Cross-Modal Transformer (BiCMT) model combining the image and text modal information was constructed, which utilizes the correlation and complementarity between the features of the two modalities to achieve the fusion and recognition of disease features. Meanwhile, the problem of inconsistent lengths among different modal data sequences was solved. Eventually, the YOLOv5s + BiCMT model achieved the optimal results on a small dataset. Its Accuracy, Precision, Sensitivity, and Specificity reached 99.23, 97.37, 97.54, and 99.54%, respectively. This paper proves that the bidirectional cross-modal feature fusion by combining disease images and texts is an effective method to identify vegetable diseases in field environments.
Collapse
Affiliation(s)
- Xuguang Feng
- School of Information Science and Technology, Hebei Agricultural University, Baoding, China
- National Engineering Research Center for Information Technology in Agriculture, Beijing, China
- Agriculture Key Laboratory of Digital Village, Ministry of Agriculture and Rural Affairs of the People’s Republic of China, Beijing, China
- Hebei Key Laboratory of Agricultural Big Data, Baoding, China
| | - Chunjiang Zhao
- National Engineering Research Center for Information Technology in Agriculture, Beijing, China
- Agriculture Key Laboratory of Digital Village, Ministry of Agriculture and Rural Affairs of the People’s Republic of China, Beijing, China
| | - Chunshan Wang
- School of Information Science and Technology, Hebei Agricultural University, Baoding, China
- National Engineering Research Center for Information Technology in Agriculture, Beijing, China
- Agriculture Key Laboratory of Digital Village, Ministry of Agriculture and Rural Affairs of the People’s Republic of China, Beijing, China
- Hebei Key Laboratory of Agricultural Big Data, Baoding, China
| | - Huarui Wu
- National Engineering Research Center for Information Technology in Agriculture, Beijing, China
- Agriculture Key Laboratory of Digital Village, Ministry of Agriculture and Rural Affairs of the People’s Republic of China, Beijing, China
| | - Yisheng Miao
- National Engineering Research Center for Information Technology in Agriculture, Beijing, China
- Agriculture Key Laboratory of Digital Village, Ministry of Agriculture and Rural Affairs of the People’s Republic of China, Beijing, China
| | - Jingjian Zhang
- Cangzhou Academy of Agriculture and Forestry Sciences, Cangzhou, China
| |
Collapse
|
39
|
Jia W, Liu M, Luo R, Wang C, Pan N, Yang X, Ge X. YOLOF-Snake: An Efficient Segmentation Model for Green Object Fruit. FRONTIERS IN PLANT SCIENCE 2022; 13:765523. [PMID: 35755692 PMCID: PMC9218684 DOI: 10.3389/fpls.2022.765523] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/27/2021] [Accepted: 04/29/2022] [Indexed: 06/03/2023]
Abstract
Accurate detection and segmentation of the object fruit is the key part of orchard production measurement and automated picking. Affected by light, weather, and operating angle, it brings new challenges to the efficient and accurate detection and segmentation of the green object fruit under complex orchard backgrounds. For the green fruit segmentation, an efficient YOLOF-snake segmentation model is proposed. First, the ResNet101 structure is adopted as the backbone network to achieve feature extraction of the green object fruit. Then, the C5 feature maps are expanded with receptive fields and the decoder is used for classification and regression. Besides, the center point in the regression box is employed to get a diamond-shaped structure and fed into an additional Deep-snake network, which is adjusted to the contours of the target fruit to achieve fast and accurate segmentation of green fruit. The experimental results show that YOLOF-snake is sensitive to the green fruit, and the segmentation accuracy and efficiency are significantly improved. The proposed model can effectively extend the application of agricultural equipment and provide theoretical references for other fruits and vegetable segmentation.
Collapse
Affiliation(s)
- Weikuan Jia
- School of Information Science and Engineering, Shandong Normal University, Jinan, China
- Key Laboratory of Facility Agriculture Measurement and Control Technology and Equipment of Machinery Industry, Zhenjiang, China
| | - Mengyuan Liu
- School of Information Science and Engineering, Shandong Normal University, Jinan, China
| | - Rong Luo
- School of Light Industry Science and Engineering, Qilu University of Technology, Shandong Academy of Sciences, Jinan, China
| | - Chongjing Wang
- China Academy of Information and Communications Technology, Beijing, China
| | - Ningning Pan
- School of Information Science and Engineering, Shandong Normal University, Jinan, China
| | - Xinbo Yang
- School of Information Science and Engineering, Shandong Normal University, Jinan, China
| | - Xinting Ge
- School of Information Science and Engineering, Shandong Normal University, Jinan, China
- School of Medical Imaging, Xuzhou Medical University, Xuzhou, China
| |
Collapse
|
40
|
Dogra V, Verma S, Kavita, Chatterjee P, Shafi J, Choi J, Ijaz MF. A Complete Process of Text Classification System Using State-of-the-Art NLP Models. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:1883698. [PMID: 35720939 PMCID: PMC9203176 DOI: 10.1155/2022/1883698] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Revised: 04/20/2022] [Accepted: 05/09/2022] [Indexed: 11/30/2022]
Abstract
With the rapid advancement of information technology, online information has been exponentially growing day by day, especially in the form of text documents such as news events, company reports, reviews on products, stocks-related reports, medical reports, tweets, and so on. Due to this, online monitoring and text mining has become a prominent task. During the past decade, significant efforts have been made on mining text documents using machine and deep learning models such as supervised, semisupervised, and unsupervised. Our area of the discussion covers state-of-the-art learning models for text mining or solving various challenging NLP (natural language processing) problems using the classification of texts. This paper summarizes several machine learning and deep learning algorithms used in text classification with their advantages and shortcomings. This paper would also help the readers understand various subtasks, along with old and recent literature, required during the process of text classification. We believe that readers would be able to find scope for further improvements in the area of text classification or to propose new techniques of text classification applicable in any domain of their interest.
Collapse
Affiliation(s)
- Varun Dogra
- School of Computer Science and Engineering, Lovely Professional University, Phagwara, Punjab, India
| | - Sahil Verma
- Department of Computer Science and Engineering, Chandigarh University, Mohali 140413, India
- Bio and Health Informatics Research Lab, Chandigarh University, Mohali 140413, India
| | - Kavita
- Department of Computer Science and Engineering, Chandigarh University, Mohali 140413, India
- Machine Learning and Data Science Research Lab, Chandigarh University, Mohali 140413, India
| | | | - Jana Shafi
- Department of Computer Science, College of Arts and Science, Prince Sattam Bin Abdul Aziz University, Wadi Ad-Dwasir 11991, Saudi Arabia
| | - Jaeyoung Choi
- School of Computing, Gachon University, Seongnam-si 13120, Republic of Korea
| | - Muhammad Fazal Ijaz
- Department of Intelligent Mechatronics Engineering, Sejong University, Seoul 05006, Republic of Korea
| |
Collapse
|
41
|
Cao M, Tang F, Ji P, Ma F. Improved Real-Time Semantic Segmentation Network Model for Crop Vision Navigation Line Detection. FRONTIERS IN PLANT SCIENCE 2022; 13:898131. [PMID: 35720554 PMCID: PMC9201824 DOI: 10.3389/fpls.2022.898131] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Accepted: 05/10/2022] [Indexed: 06/15/2023]
Abstract
Field crops are generally planted in rows to improve planting efficiency and facilitate field management. Therefore, automatic detection of crop planting rows is of great significance for achieving autonomous navigation and precise spraying in intelligent agricultural machinery and is an important part of smart agricultural management. To study the visual navigation line extraction technology of unmanned aerial vehicles (UAVs) in farmland environments and realize real-time precise farmland UAV operations, we propose an improved ENet semantic segmentation network model to perform row segmentation of farmland images. Considering the lightweight and low complexity requirements of the network for crop row detection, the traditional network is compressed and replaced by convolution. Based on the residual network, we designed a network structure of the shunting process, in which low-dimensional boundary information in the feature extraction process is passed backward using the residual stream, allowing efficient extraction of low-dimensional information and significantly improving the accuracy of boundary locations and row-to-row segmentation of farmland crops. According to the characteristics of the segmented image, an improved random sampling consensus algorithm is proposed to extract the navigation line, define a new model-scoring index, find the best point set, and use the least-squares method to fit the navigation line. The experimental results showed that the proposed algorithm allows accurate and efficient extraction of farmland navigation lines, and it has the technical advantages of strong robustness and high applicability. The algorithm can provide technical support for the subsequent quasi-flight of agricultural UAVs in farmland operations.
Collapse
|
42
|
Suo J, Zhan J, Zhou G, Chen A, Hu Y, Huang W, Cai W, Hu Y, Li L. CASM-AMFMNet: A Network Based on Coordinate Attention Shuffle Mechanism and Asymmetric Multi-Scale Fusion Module for Classification of Grape Leaf Diseases. FRONTIERS IN PLANT SCIENCE 2022; 13:846767. [PMID: 35685012 PMCID: PMC9171378 DOI: 10.3389/fpls.2022.846767] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/31/2021] [Accepted: 03/24/2022] [Indexed: 06/15/2023]
Abstract
Grape disease is a significant contributory factor to the decline in grape yield, typically affecting the leaves first. Efficient identification of grape leaf diseases remains a critical unmet need. To mitigate background interference in grape leaf feature extraction and improve the ability to extract small disease spots, by combining the characteristic features of grape leaf diseases, we developed a novel method for disease recognition and classification in this study. First, Gaussian filters Sobel smooth de-noising Laplace operator (GSSL) was employed to reduce image noise and enhance the texture of grape leaves. A novel network designated coordinated attention shuffle mechanism-asymmetric multi-scale fusion module net (CASM-AMFMNet) was subsequently applied for grape leaf disease identification. CoAtNet was employed as the network backbone to improve model learning and generalization capabilities, which alleviated the problem of gradient explosion to a certain extent. The CASM-AMFMNet was further utilized to capture and target grape leaf disease areas, therefore reducing background interference. Finally, Asymmetric multi-scale fusion module (AMFM) was employed to extract multi-scale features from small disease spots on grape leaves for accurate identification of small target diseases. The experimental results based on our self-made grape leaf image dataset showed that, compared to existing methods, CASM-AMFMNet achieved an accuracy of 95.95%, F1 score of 95.78%, and mAP of 90.27%. Overall, the model and methods proposed in this report could successfully identify different diseases of grape leaves and provide a feasible scheme for deep learning to correctly recognize grape diseases during agricultural production that may be used as a reference for other crops diseases.
Collapse
Affiliation(s)
- Jiayu Suo
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, China
| | - Jialei Zhan
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, China
| | - Guoxiong Zhou
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, China
| | - Aibin Chen
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, China
| | - Yaowen Hu
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, China
| | - Weiqi Huang
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, China
| | - Weiwei Cai
- College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha, China
| | - Yahui Hu
- Plant Protection Research Institute, Hunan Academy of Agricultural Sciences (HNAAS), Changsha, China
| | - Liujun Li
- Department of Civil, Architectural and Environmental Engineering, Missouri University of Science and Technology, Rolla, MO, United States
| |
Collapse
|
43
|
Fan X, Zhou R, Tjahjadi T, Das Choudhury S, Ye Q. A Segmentation-Guided Deep Learning Framework for Leaf Counting. FRONTIERS IN PLANT SCIENCE 2022; 13:844522. [PMID: 35665165 PMCID: PMC9161279 DOI: 10.3389/fpls.2022.844522] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Accepted: 04/19/2022] [Indexed: 06/15/2023]
Abstract
Deep learning-based methods have recently provided a means to rapidly and effectively extract various plant traits due to their powerful ability to depict a plant image across a variety of species and growth conditions. In this study, we focus on dealing with two fundamental tasks in plant phenotyping, i.e., plant segmentation and leaf counting, and propose a two-steam deep learning framework for segmenting plants and counting leaves with various size and shape from two-dimensional plant images. In the first stream, a multi-scale segmentation model using spatial pyramid is developed to extract leaves with different size and shape, where the fine-grained details of leaves are captured using deep feature extractor. In the second stream, a regression counting model is proposed to estimate the number of leaves without any pre-detection, where an auxiliary binary mask from segmentation stream is introduced to enhance the counting performance by effectively alleviating the influence of complex background. Extensive pot experiments are conducted CVPPP 2017 Leaf Counting Challenge dataset, which contains images of Arabidopsis and tobacco plants. The experimental results demonstrate that the proposed framework achieves a promising performance both in plant segmentation and leaf counting, providing a reference for the automatic analysis of plant phenotypes.
Collapse
Affiliation(s)
- Xijian Fan
- College of Information Science and Technology, Nanjing Forestry University, Nanjing, China
| | - Rui Zhou
- College of Information Science and Technology, Nanjing Forestry University, Nanjing, China
| | - Tardi Tjahjadi
- School of Engineering, University of Warwick, Coventry, United Kingdom
| | - Sruti Das Choudhury
- Department of Biological Systems Engineering, University of Nebraska-Lincoln, Lincoln, NE, United States
| | - Qiaolin Ye
- College of Information Science and Technology, Nanjing Forestry University, Nanjing, China
| |
Collapse
|
44
|
Li P, Jing R, Shi X. Apple Disease Recognition Based on Convolutional Neural Networks With Modified Softmax. FRONTIERS IN PLANT SCIENCE 2022; 13:820146. [PMID: 35592569 PMCID: PMC9111540 DOI: 10.3389/fpls.2022.820146] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/09/2021] [Accepted: 03/24/2022] [Indexed: 06/15/2023]
Abstract
Accurate and rapid identification of apple diseases is the basis for preventing and treating the apple diseases, and is very significant for assessing disease disaster. Apple disease recognition from its diseased leaf images is one of the interesting research areas in computer and agriculture field. An apple disease recognition method is proposed based on modified convolutional neural networks (MCNN). In MCNN, Inception is introduced into MCNN, global average pooling (GAP) operator is employed instead of several fully connected layers to speedup training model, and modified Softmax classifier is used in the output layer to improve the recognition performance. The modified Softmax classifier uses the modified linear element as the activation function in the hidden layer and adds the local response normalization in MCNN to avoid the gradient disappearance problem effectively. A series of experiments are conducted on two kinds of apple disease image datasets. The results show the feasibility of the algorithm.
Collapse
|
45
|
Qian X, Zhang C, Chen L, Li K. Deep Learning-Based Identification of Maize Leaf Diseases Is Improved by an Attention Mechanism: Self-Attention. FRONTIERS IN PLANT SCIENCE 2022; 13:864486. [PMID: 35574079 PMCID: PMC9096888 DOI: 10.3389/fpls.2022.864486] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/28/2022] [Accepted: 03/28/2022] [Indexed: 06/15/2023]
Abstract
Maize leaf diseases significantly reduce maize yield; therefore, monitoring and identifying the diseases during the growing season are crucial. Some of the current studies are based on images with simple backgrounds, and the realistic field settings are full of background noise, making this task challenging. We collected low-cost red, green, and blue (RGB) images from our experimental fields and public dataset, and they contain a total of four categories, namely, southern corn leaf blight (SCLB), gray leaf spot (GLS), southern corn rust (SR), and healthy (H). This article proposes a model different from convolutional neural networks (CNNs) based on transformer and self-attention. It represents visual information of local regions of images by tokens, calculates the correlation (called attention) of information between local regions with an attention mechanism, and finally integrates global information to make the classification. The results show that our model achieves the best performance compared to five mainstream CNNs at a meager computational cost, and the attention mechanism plays an extremely important role. The disease lesions information was effectively emphasized, and the background noise was suppressed. The proposed model is more suitable for fine-grained maize leaf disease identification in a complex background, and we demonstrated this idea from three perspectives, namely, theoretical, experimental, and visualization.
Collapse
Affiliation(s)
- Xiufeng Qian
- School of Information and Computer, Anhui Agricultural University, Hefei, China
- Anhui Provincial Engineering Laboratory for Beidou Precision Agriculture Information, Anhui Agricultural University, Hefei, China
- Information Materials and Intelligent Sensing Laboratory of Anhui Province, Anhui University, Hefei, China
| | - Chengqi Zhang
- School of Plant Protection, Anhui Agricultural University, Hefei, China
| | - Li Chen
- School of Plant Protection, Anhui Agricultural University, Hefei, China
| | - Ke Li
- School of Information and Computer, Anhui Agricultural University, Hefei, China
- Anhui Provincial Engineering Laboratory for Beidou Precision Agriculture Information, Anhui Agricultural University, Hefei, China
- Information Materials and Intelligent Sensing Laboratory of Anhui Province, Anhui University, Hefei, China
| |
Collapse
|
46
|
Haque MA, Marwaha S, Deb CK, Nigam S, Arora A, Hooda KS, Soujanya PL, Aggarwal SK, Lall B, Kumar M, Islam S, Panwar M, Kumar P, Agrawal RC. Deep learning-based approach for identification of diseases of maize crop. Sci Rep 2022; 12:6334. [PMID: 35428845 PMCID: PMC9012772 DOI: 10.1038/s41598-022-10140-z] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Accepted: 02/25/2022] [Indexed: 11/09/2022] Open
Abstract
In recent years, deep learning techniques have shown impressive performance in the field of identification of diseases of crops using digital images. In this work, a deep learning approach for identification of in-field diseased images of maize crop has been proposed. The images were captured from experimental fields of ICAR-IIMR, Ludhiana, India, targeted to three important diseases viz. Maydis Leaf Blight, Turcicum Leaf Blight and Banded Leaf and Sheath Blight in a non-destructive manner with varied backgrounds using digital cameras and smartphones. In order to solve the problem of class imbalance, artificial images were generated by rotation enhancement and brightness enhancement methods. In this study, three different architectures based on the framework of 'Inception-v3' network were trained with the collected diseased images of maize using baseline training approach. The best-performed model achieved an overall classification accuracy of 95.99% with average recall of 95.96% on the separate test dataset. Furthermore, we compared the performance of the best-performing model with some pre-trained state-of-the-art models and presented the comparative results in this manuscript. The results reported that best-performing model performed quite better than the pre-trained models. This demonstrates the applicability of baseline training approach of the proposed model for better feature extraction and learning. Overall performance analysis suggested that the best-performed model is efficient in recognizing diseases of maize from in-field images even with varied backgrounds.
Collapse
Affiliation(s)
- Md Ashraful Haque
- Division of Computer Applications, ICAR-Indian Agricultural Statistics Research Institute, New Delhi, 110012, India
| | - Sudeep Marwaha
- Division of Computer Applications, ICAR-Indian Agricultural Statistics Research Institute, New Delhi, 110012, India.
| | - Chandan Kumar Deb
- Division of Computer Applications, ICAR-Indian Agricultural Statistics Research Institute, New Delhi, 110012, India.
| | - Sapna Nigam
- Division of Computer Applications, ICAR-Indian Agricultural Statistics Research Institute, New Delhi, 110012, India
| | - Alka Arora
- Division of Computer Applications, ICAR-Indian Agricultural Statistics Research Institute, New Delhi, 110012, India
| | | | | | | | - Brejesh Lall
- Indian Institute of Technology Delhi, New Delhi, 110016, India
| | - Mukesh Kumar
- Division of Computer Applications, ICAR-Indian Agricultural Statistics Research Institute, New Delhi, 110012, India
| | - Shahnawazul Islam
- Division of Computer Applications, ICAR-Indian Agricultural Statistics Research Institute, New Delhi, 110012, India
| | - Mohit Panwar
- ICAR-Indian Institute of Maize Research, Ludhiana, 141004, India
| | - Prabhat Kumar
- National Agricultural Higher Education Project, Krishi Anusandhan Bhawan-II, New Delhi, 110012, India
| | - R C Agrawal
- National Agricultural Higher Education Project, Krishi Anusandhan Bhawan-II, New Delhi, 110012, India
| |
Collapse
|
47
|
Yang R, Liu L, Liu Q, Li X, Yin L, Hao X, Ma Y, Song Q. Validation of leaf area index measurement system based on wireless sensor network. Sci Rep 2022; 12:4668. [PMID: 35304515 PMCID: PMC8933413 DOI: 10.1038/s41598-022-08373-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2021] [Accepted: 02/28/2022] [Indexed: 11/16/2022] Open
Abstract
Accurate measurement of leaf area index (LAI) is important for agricultural analysis such as the estimation of crop yield, which makes its measurement work important. There are mainly two ways to obtain LAI: ground station measurement and remote sensing satellite monitoring. Recently, reliable progress has been made in long-term automatic LAI observation using wireless sensor network (WSN) technology under certain conditions. We developed and designed an LAI measurement system (LAIS) based on a wireless sensor network to select and improve the appropriate algorithm according to the image collected by the sensor, to get a more realistic leaf area index. The corn LAI was continuously observed from May 30 to July 16, 2015. Research on hardware has been published, this paper focuses on improved system algorithm and data verification. By improving the finite length average algorithm, the data validation results are as follows: (1) The slope of the fitting line between LAIS measurement data and the real value is 0.944, and the root means square error (RMSE) is 0.264 (absolute error ~ 0–0.6), which has high consistency with the real value. (2) The measurement error of LAIS is less than LAI2000, although the result of our measurement method will be higher than the actual value, it is due to the influence of weeds on the ground. (3) LAIS data can be used to support the retrieval of remote sensing products. We find a suitable application situation of our LAIS system data, and get our application value as ground monitoring data by the verification with remote sensing product data, which supports its application and promotion in similar research in the future.
Collapse
Affiliation(s)
- Rongjin Yang
- State Key Laboratory of Environmental Criteria and Risk Assessment, Chinese Research Academy of Environmental Sciences, No. 8, Da Yang Fang, An Wai, Chao Yang District, Beijing, 100012, China
| | - Lu Liu
- State Key Laboratory of Remote Sensing Science, College of Global Change and Earth System Science, Beijing Normal University, No.19, Xinjiekou Wai Street, Haidian District, Beijing, 100875, China
| | - Qiang Liu
- State Key Laboratory of Remote Sensing Science, College of Global Change and Earth System Science, Beijing Normal University, No.19, Xinjiekou Wai Street, Haidian District, Beijing, 100875, China
| | - Xiuhong Li
- State Key Laboratory of Remote Sensing Science, College of Global Change and Earth System Science, Beijing Normal University, No.19, Xinjiekou Wai Street, Haidian District, Beijing, 100875, China.
| | - Lizeyan Yin
- Higher Institute of Computer Modeling and Their Applications, Clermont Auvergne University, Clermont Auvergne, Clermont-Ferrand, France
| | - Xuejie Hao
- State Key Laboratory of Remote Sensing Science, College of Global Change and Earth System Science, Beijing Normal University, No.19, Xinjiekou Wai Street, Haidian District, Beijing, 100875, China
| | - Yushuang Ma
- State Key Laboratory of Remote Sensing Science, College of Global Change and Earth System Science, Beijing Normal University, No.19, Xinjiekou Wai Street, Haidian District, Beijing, 100875, China
| | - Qiao Song
- State Key Laboratory of Remote Sensing Science, College of Global Change and Earth System Science, Beijing Normal University, No.19, Xinjiekou Wai Street, Haidian District, Beijing, 100875, China
| |
Collapse
|
48
|
Recognition of Leaf Disease Using Hybrid Convolutional Neural Network by Applying Feature Reduction. SENSORS 2022; 22:s22020575. [PMID: 35062534 PMCID: PMC8779777 DOI: 10.3390/s22020575] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Revised: 01/06/2022] [Accepted: 01/11/2022] [Indexed: 01/27/2023]
Abstract
Agriculture is crucial to the economic prosperity and development of India. Plant diseases can have a devastating influence towards food safety and a considerable loss in the production of agricultural products. Disease identification on the plant is essential for long-term agriculture sustainability. Manually monitoring plant diseases is difficult due to time limitations and the diversity of diseases. In the realm of agricultural inputs, automatic characterization of plant diseases is widely required. Based on performance out of all image-processing methods, is better suited for solving this task. This work investigates plant diseases in grapevines. Leaf blight, Black rot, stable, and Black measles are the four types of diseases found in grape plants. Several earlier research proposals using machine learning algorithms were created to detect one or two diseases in grape plant leaves; no one offers a complete detection of all four diseases. The photos are taken from the plant village dataset in order to use transfer learning to retrain the EfficientNet B7 deep architecture. Following the transfer learning, the collected features are down-sampled using a Logistic Regression technique. Finally, the most discriminant traits are identified with the highest constant accuracy of 98.7% using state-of-the-art classifiers after 92 epochs. Based on the simulation findings, an appropriate classifier for this application is also suggested. The proposed technique’s effectiveness is confirmed by a fair comparison to existing procedures.
Collapse
|
49
|
Ensemble Averaging of Transfer Learning Models for Identification of Nutritional Deficiency in Rice Plant. ELECTRONICS 2022. [DOI: 10.3390/electronics11010148] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
Abstract
Computer vision-based automation has become popular in detecting and monitoring plants’ nutrient deficiencies in recent times. The predictive model developed by various researchers were so designed that it can be used in an embedded system, keeping in mind the availability of computational resources. Nevertheless, the enormous popularity of smart phone technology has opened the door of opportunity to common farmers to have access to high computing resources. To facilitate smart phone users, this study proposes a framework of hosting high end systems in the cloud where processing can be done, and farmers can interact with the cloud-based system. With the availability of high computational power, many studies have been focused on applying convolutional Neural Networks-based Deep Learning (CNN-based DL) architectures, including Transfer learning (TL) models on agricultural research. Ensembling of various TL architectures has the potential to improve the performance of predictive models by a great extent. In this work, six TL architectures viz. InceptionV3, ResNet152V2, Xception, DenseNet201, InceptionResNetV2, and VGG19 are considered, and their various ensemble models are used to carry out the task of deficiency diagnosis in rice plants. Two publicly available datasets from Mendeley and Kaggle are used in this study. The ensemble-based architecture enhanced the highest classification accuracy to 100% from 99.17% in the Mendeley dataset, while for the Kaggle dataset; it was enhanced to 92% from 90%.
Collapse
|
50
|
Qi C, Gao J, Chen K, Shu L, Pearson S. Tea Chrysanthemum Detection by Leveraging Generative Adversarial Networks and Edge Computing. FRONTIERS IN PLANT SCIENCE 2022; 13:850606. [PMID: 35463441 PMCID: PMC9021924 DOI: 10.3389/fpls.2022.850606] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/07/2022] [Accepted: 03/09/2022] [Indexed: 05/16/2023]
Abstract
A high resolution dataset is one of the prerequisites for tea chrysanthemum detection with deep learning algorithms. This is crucial for further developing a selective chrysanthemum harvesting robot. However, generating high resolution datasets of the tea chrysanthemum with complex unstructured environments is a challenge. In this context, we propose a novel tea chrysanthemum - generative adversarial network (TC-GAN) that attempts to deal with this challenge. First, we designed a non-linear mapping network for untangling the features of the underlying code. Then, a customized regularization method was used to provide fine-grained control over the image details. Finally, a gradient diversion design with multi-scale feature extraction capability was adopted to optimize the training process. The proposed TC-GAN was compared with 12 state-of-the-art generative adversarial networks, showing that an optimal average precision (AP) of 90.09% was achieved with the generated images (512 × 512) on the developed TC-YOLO object detection model under the NVIDIA Tesla P100 GPU environment. Moreover, the detection model was deployed into the embedded NVIDIA Jetson TX2 platform with 0.1 s inference time, and this edge computing device could be further developed into a perception system for selective chrysanthemum picking robots in the future.
Collapse
Affiliation(s)
- Chao Qi
- College of Engineering, Nanjing Agricultural University, Nanjing, China
| | - Junfeng Gao
- Lincoln Agri-Robotics Centre, Lincoln Institute for Agri-Food Technology, University of Lincoln, Lincoln, United Kingdom
| | - Kunjie Chen
- College of Engineering, Nanjing Agricultural University, Nanjing, China
- *Correspondence: Kunjie Chen,
| | - Lei Shu
- College of Engineering, Nanjing Agricultural University, Nanjing, China
- Lei Shu,
| | - Simon Pearson
- Lincoln Agri-Robotics Centre, Lincoln Institute for Agri-Food Technology, University of Lincoln, Lincoln, United Kingdom
| |
Collapse
|