1
|
Zhang B, Ou Y, Yu S, Liu Y, Liu Y, Qiu W. Gray mold and anthracnose disease detection on strawberry leaves using hyperspectral imaging. PLANT METHODS 2023; 19:148. [PMID: 38115023 PMCID: PMC10729489 DOI: 10.1186/s13007-023-01123-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/15/2022] [Accepted: 12/04/2023] [Indexed: 12/21/2023]
Abstract
BACKGROUND Gray mold and anthracnose are the main factors affecting strawberry quality and yield. Accurate and rapid early disease identification is of great significance to achieve precise targeted spraying to avoid large-scale spread of diseases and improve strawberry yield and quality. However, the characteristics between early disease infected and healthy leaves are very similar, making the early identification of strawberry gray mold and anthracnose still a challenge. RESULTS Based on hyperspectral imaging technology, this study explored the potential of combining spectral fingerprint features and vegetation indices (VIs) for early detection (24-h infected) of strawberry leaves diseases. The competitive adaptive reweighted sampling (CARS) algorithm and ReliefF algorithm were used for the extraction of spectral fingerprint features and VIs, respectively. Three machine learning models, Backpropagation Neural Network (BPNN), Support Vector Machine (SVM) and Random Forest (RF), were developed for the early identification of strawberry gray mold and anthracnose, using spectral fingerprint, VIs and their combined features as inputs respectively. The results showed that the combination of spectral fingerprint features and VIs had better recognition accuracy compared with individual features as inputs, and the accuracies of the three classifiers (BPNN, SVM and RF) were 97.78%, 94.44%, and 93.33%, respectively, which indicate that the fusion features approach proposed in this study can effectively improve the early detection performance of strawberry leaves diseases. CONCLUSIONS This study provided an accurate, rapid, and nondestructive recognition of strawberry gray mold and anthracnose disease in early stage.
Collapse
Affiliation(s)
- Baohua Zhang
- College of Engineering, Nanjing Agricultural University, No. 40, Dianjiangtai Road, Taishan Street, Pukou District, Nanjing, Jiangsu, 210031, P.R. China
- College of Artificial Intelligence, Nanjing Agricultural University, Nanjing, Jiangsu, P.R. China
| | - Yunmeng Ou
- College of Artificial Intelligence, Nanjing Agricultural University, Nanjing, Jiangsu, P.R. China
| | - Shuwan Yu
- College of Artificial Intelligence, Nanjing Agricultural University, Nanjing, Jiangsu, P.R. China
| | - Yuchen Liu
- College of Artificial Intelligence, Nanjing Agricultural University, Nanjing, Jiangsu, P.R. China
| | - Ying Liu
- College of Artificial Intelligence, Nanjing Agricultural University, Nanjing, Jiangsu, P.R. China
| | - Wei Qiu
- College of Engineering, Nanjing Agricultural University, No. 40, Dianjiangtai Road, Taishan Street, Pukou District, Nanjing, Jiangsu, 210031, P.R. China.
| |
Collapse
|
2
|
Yang Y, Liu Z, Huang M, Zhu Q, Zhao X. Automatic detection of multi-type defects on potatoes using multispectral imaging combined with a deep learning model. J FOOD ENG 2023. [DOI: 10.1016/j.jfoodeng.2022.111213] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
|
3
|
López-Maestresalas A, Lopez-Molina C, Oliva-Lobo GA, Jarén C, Ruiz de Galarreta JI, Peraza-Alemán CM, Arazuri S. Evaluation of near-infrared hyperspectral imaging for the assessment of potato processing aptitude. Front Nutr 2022; 9:999877. [PMID: 36324619 PMCID: PMC9618585 DOI: 10.3389/fnut.2022.999877] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Accepted: 09/30/2022] [Indexed: 12/02/2022] Open
Abstract
The potato (Solanum tuberosum L.) is the world’s fifth most important staple food with high socioeconomic relevance. Several potato cultivars obtained by selection and crossbreeding are currently on the market. This diversity causes tubers to exhibit different behaviors depending on the processing to which they are subjected. Therefore, it is interesting to identify cultivars with specific characteristics that best suit consumer preferences. In this work, we present a method to classify potatoes according to their cooking or frying as crisps aptitude using NIR hyperspectral imaging (HIS) combined with a Partial Least Squares Discriminant Analysis (PLS-DA). Two classification approaches were used in this study. First, a classification model using the mean spectra of a dataset composed of 80 tubers belonging to 10 different cultivars. Then, a pixel-wise classification using all the pixels of each sample of a small subset of samples comprised of 30 tubers. Hyperspectral images were acquired using fresh-cut potato slices as sample material placed on a mobile platform of a hyperspectral system in the NIR range from 900 to 1,700 nm. After image processing, PLS-DA models were built using different pre-processing combinations. Excellent accuracy rates were obtained for the models developed using the mean spectra of all samples with 90% of tubers correctly classified in the external dataset. Pixel-wise classification models achieved lower accuracy rates between 66.62 and 71.97% in the external validation datasets. Moreover, a forward interval PLS (iPLS) method was used to build pixel-wise PLS-DA models reaching accuracies above 80 and 71% in cross-validation and external validation datasets, respectively. Best classification result was obtained using a subset of 100 wavelengths (20 intervals) with 71.86% of pixels correctly classified in the validation dataset. Classification maps were generated showing that false negative pixels were mainly located at the edges of the fresh-cut slices while false positive were principally distributed at the central pith, which has singular characteristics.
Collapse
Affiliation(s)
- Ainara López-Maestresalas
- Department of Engineering, Institute on Innovation and Sustainable Development in Food Chain (IS-FOOD), Universidad Pública de Navarra (UPNA), Pamplona, Spain
- *Correspondence: Ainara López-Maestresalas,
| | - Carlos Lopez-Molina
- Department of Statistics, Computer Science and Mathematics, Universidad Pública de Navarra (UPNA), Pamplona, Spain
| | - Gil Alfonso Oliva-Lobo
- Department of Engineering, Institute on Innovation and Sustainable Development in Food Chain (IS-FOOD), Universidad Pública de Navarra (UPNA), Pamplona, Spain
| | - Carmen Jarén
- Department of Engineering, Institute on Innovation and Sustainable Development in Food Chain (IS-FOOD), Universidad Pública de Navarra (UPNA), Pamplona, Spain
| | - Jose Ignacio Ruiz de Galarreta
- Department of Plant Production, NEIKER-Basque Institute for Agricultural Research and Development, Basque Research and Technology Alliance (BRTA), Vitoria, Spain
| | - Carlos Miguel Peraza-Alemán
- Department of Engineering, Institute on Innovation and Sustainable Development in Food Chain (IS-FOOD), Universidad Pública de Navarra (UPNA), Pamplona, Spain
| | - Silvia Arazuri
- Department of Engineering, Institute on Innovation and Sustainable Development in Food Chain (IS-FOOD), Universidad Pública de Navarra (UPNA), Pamplona, Spain
| |
Collapse
|
4
|
Shen D, Zhang S, Ming W, He W, Zhang G, Xie Z. Development of a new machine vision algorithm to estimate potato's shape and size based on support vector machine. J FOOD PROCESS ENG 2022. [DOI: 10.1111/jfpe.13974] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Affiliation(s)
- Dili Shen
- School of Mechanical‐Electronic and Automobile Engineering Zhengzhou University of Technology Zhengzhou China
| | - Shengfei Zhang
- Department of Electromechanical Science and Engineering Zhengzhou University of Light Industry Zhengzhou China
| | - Wuyi Ming
- Department of Electromechanical Science and Engineering Zhengzhou University of Light Industry Zhengzhou China
| | - Wenbin He
- Department of Electromechanical Science and Engineering Zhengzhou University of Light Industry Zhengzhou China
| | - Guojun Zhang
- College of Urban Transportation and Logistics Shenzhen Technology University Shenzhen China
| | - Zhuobin Xie
- Department of Electromechanical Science and Engineering Zhengzhou University of Light Industry Zhengzhou China
| |
Collapse
|
5
|
Lapajne J, Knapič M, Žibrat U. Comparison of Selected Dimensionality Reduction Methods for Detection of Root-Knot Nematode Infestations in Potato Tubers Using Hyperspectral Imaging. SENSORS 2022; 22:s22010367. [PMID: 35009907 PMCID: PMC8749520 DOI: 10.3390/s22010367] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/30/2021] [Revised: 12/23/2021] [Accepted: 12/27/2021] [Indexed: 11/29/2022]
Abstract
Hyperspectral imaging is a popular tool used for non-invasive plant disease detection. Data acquired with it usually consist of many correlated features; hence most of the acquired information is redundant. Dimensionality reduction methods are used to transform the data sets from high-dimensional, to low-dimensional (in this study to one or a few features). We have chosen six dimensionality reduction methods (partial least squares, linear discriminant analysis, principal component analysis, RandomForest, ReliefF, and Extreme gradient boosting) and tested their efficacy on a hyperspectral data set of potato tubers. The extracted or selected features were pipelined to support vector machine classifier and evaluated. Tubers were divided into two groups, healthy and infested with Meloidogyne luci. The results show that all dimensionality reduction methods enabled successful identification of inoculated tubers. The best and most consistent results were obtained using linear discriminant analysis, with 100% accuracy in both potato tuber inside and outside images. Classification success was generally higher in the outside data set, than in the inside. Nevertheless, accuracy was in all cases above 0.6.
Collapse
|
6
|
Benouis M, Medus LD, Saban M, Ghemougui A, Rosado-Muñoz A. Food Tray Sealing Fault Detection in Multi-Spectral Images Using Data Fusion and Deep Learning Techniques. J Imaging 2021; 7:jimaging7090186. [PMID: 34564112 PMCID: PMC8470697 DOI: 10.3390/jimaging7090186] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2021] [Revised: 08/13/2021] [Accepted: 08/16/2021] [Indexed: 12/04/2022] Open
Abstract
A correct food tray sealing is required to preserve food properties and safety for consumers. Traditional food packaging inspections are made by human operators to detect seal defects. Recent advances in the field of food inspection have been related to the use of hyperspectral imaging technology and automated vision-based inspection systems. A deep learning-based approach for food tray sealing fault detection using hyperspectral images is described. Several pixel-based image fusion methods are proposed to obtain 2D images from the 3D hyperspectral image datacube, which feeds the deep learning (DL) algorithms. Instead of considering all spectral bands in region of interest around a contaminated or faulty seal area, only relevant bands are selected using data fusion. These techniques greatly improve the computation time while maintaining a high classification ratio, showing that the fused image contains enough information for checking a food tray sealing state (faulty or normal), avoiding feeding a large image datacube to the DL algorithms. Additionally, the proposed DL algorithms do not require any prior handcraft approach, i.e., no manual tuning of the parameters in the algorithms are required since the training process adjusts the algorithm. The experimental results, validated using an industrial dataset for food trays, along with different deep learning methods, demonstrate the effectiveness of the proposed approach. In the studied dataset, an accuracy of 88.7%, 88.3%, 89.3%, and 90.1% was achieved for Deep Belief Network (DBN), Extreme Learning Machine (ELM), Stacked Auto Encoder (SAE), and Convolutional Neural Network (CNN), respectively.
Collapse
Affiliation(s)
- Mohamed Benouis
- Laboratory of Informatics and Its Applications of M’sila (LIAM), Department of Computer Science, University of M’Sila, BP 166 Ichbilia, Msila 28000, Algeria;
- Correspondence:
| | - Leandro D. Medus
- Department of Electronic Engineering, ETSE, University Valencia, Av. Universitat, s/n-46100, Burjassot, 46100 Valencia, Spain; (L.D.M.); (M.S.); (A.R.-M.)
| | - Mohamed Saban
- Department of Electronic Engineering, ETSE, University Valencia, Av. Universitat, s/n-46100, Burjassot, 46100 Valencia, Spain; (L.D.M.); (M.S.); (A.R.-M.)
| | - Abdessattar Ghemougui
- Laboratory of Informatics and Its Applications of M’sila (LIAM), Department of Computer Science, University of M’Sila, BP 166 Ichbilia, Msila 28000, Algeria;
| | - Alfredo Rosado-Muñoz
- Department of Electronic Engineering, ETSE, University Valencia, Av. Universitat, s/n-46100, Burjassot, 46100 Valencia, Spain; (L.D.M.); (M.S.); (A.R.-M.)
| |
Collapse
|
7
|
Su WH, Xue H. Imaging Spectroscopy and Machine Learning for Intelligent Determination of Potato and Sweet Potato Quality. Foods 2021; 10:2146. [PMID: 34574253 PMCID: PMC8472741 DOI: 10.3390/foods10092146] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2021] [Revised: 08/30/2021] [Accepted: 09/07/2021] [Indexed: 11/16/2022] Open
Abstract
Imaging spectroscopy has emerged as a reliable analytical method for effectively characterizing and quantifying quality attributes of agricultural products. By providing spectral information relevant to food quality properties, imaging spectroscopy has been demonstrated to be a potential method for rapid and non-destructive classification, authentication, and prediction of quality parameters of various categories of tubers, including potato and sweet potato. The imaging technique has demonstrated great capacities for gaining rapid information about tuber physical properties (such as texture, water binding capacity, and specific gravity), chemical components (such as protein, starch, and total anthocyanin), varietal authentication, and defect aspects. This paper emphasizes how recent developments in spectral imaging with machine learning have enhanced overall capabilities to evaluate tubers. The machine learning algorithms coupled with feature variable identification approaches have obtained acceptable results. This review briefly introduces imaging spectroscopy and machine learning, then provides examples and discussions of these techniques in tuber quality determinations, and presents the challenges and future prospects of the technology. This review will be of great significance to the study of tubers using spectral imaging technology.
Collapse
Affiliation(s)
- Wen-Hao Su
- Department of Agricultural Engineering, College of Engineering, China Agricultural University, Beijing 100083, China;
| | - Huidan Xue
- School of Economics and Management, Beijing University of Technology, Beijing 100124, China
| |
Collapse
|
8
|
Ropelewska E. Effect of boiling on classification performance of potatoes determined by computer vision. Eur Food Res Technol 2021. [DOI: 10.1007/s00217-020-03664-z] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
AbstractThe aim of this study was to evaluate the effect of potato boiling on the correctness of cultivar discrimination. The research was performed in an objective, inexpensive and fast manner using the image analysis technique. The textures of the outer surface of slice images of raw and boiled potatoes were calculated. The discriminative models based on a set of textures selected from all color channels (R, G, B, L, a, b, X, Y, Z, U, V, S), textures selected for color spaces and textures selected for individual color channels were developed. In the case of discriminant analysis of raw potatoes of cultivars ‘Colomba’, ‘Irga’ and ‘Riviera’, the accuracies reached 94.33% for the model built based on a set of textures selected from all color channels, 94% for Lab and XYZ color spaces, 92% for color channel b and 92.33% for a set of combined textures selected from channels B, b, and Z. The processed potatoes were characterized by the accuracy of up to 98.67% for the model including the textures selected from all color channels, 98% for RGB color space, 95.33% for color channel b, 96.67% for the model combining the textures selected from channels B, b, and Z. In the case of raw and processed potatoes, the cultivar ‘Irga’ differed in 100% from other potato cultivars. The results revealed an increase in cultivar discrimination accuracy after the processing of potatoes. The textural features of the outer surface of slice images have proved useful for cultivar discrimination of raw and processed potatoes.
Collapse
|
9
|
Li M, Huang M, Zhu Q, Zhang M, Guo Y, Qin J. Pickled and dried mustard foreign matter detection using multispectral imaging system based on single shot method. J FOOD ENG 2020. [DOI: 10.1016/j.jfoodeng.2020.110106] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|