Identification of Rice Seed Varieties Based on Near-Infrared Hyperspectral Imaging Technology Combined with Deep Learning

Rapid and accurate identification of bakanae pathogens carried by rice seeds based on hyperspectral imaging and deep transfer learning

Bakanae disease is a common seed-borne disease of rice. Rapid and accurate detection of bakanae pathogens carried by rice seeds is essential for the health of rice germplasm resources and the safety of rice production. This study aims to propose a general framework for species identification of major bakanae pathogens carried by rice seeds based on hyperspectral imaging and deep transfer learning. Seven varieties of rice seeds and four kinds of bakanae pathogens were analyzed. One-dimensional deep convolution neural networks (DCNNs) were first constructed using complete datasets. They achieved accuracies larger than 96.5% on the testing sets of most datasets, exceeding the conventional SVM and PLS-DA models. Then the developed DCNNs were transferred to detect other complete training sets. Most of the deep transferred models achieved comparable or even better performance than the original DCNNs. Two smaller target training sets were further constructed by randomly selecting spectra from the complete training sets. As the size of the target training sets reduced, the accuracies of all models on the corresponding testing sets also decreased gradually. Visualization analysis were conducted using the t-distribution stochastic neighbor embedding (t-SNE) algorithm and a proposed gradient-weighted activation wavelength (Grad-AW) method. They all showed that deep transfer learning could utilize the representation patterns in the source datasets to improve the target tasks. The overall results indicated that the bakanae pathogens were all identified accurately under our proposed framework. Hyperspectral imaging combined with deep transfer learning provided a new idea for the quality detection of large-scale seeds in modern seed industry.

Exploring Deep Learning to Predict Coconut Milk Adulteration Using FT-NIR and Micro-NIR Spectroscopy

Accurately identifying adulterants in agriculture and food products is associated with preventing food safety and commercial fraud activities. However, a rapid, accurate, and robust prediction model for adulteration detection is hard to achieve in practice. Therefore, this study aimed to explore deep-learning algorithms as an approach to accurately identify the level of adulterated coconut milk using two types of NIR spectrophotometer, including benchtop FT-NIR and portable Micro-NIR. Coconut milk adulteration samples came from deliberate adulteration with corn flour and tapioca starch in the 1 to 50% range. A total of four types of deep-learning algorithm architecture that were self-modified to a one-dimensional framework were developed and tested to the NIR dataset, including simple CNN, S-AlexNET, ResNET, and GoogleNET. The results confirmed the feasibility of deep-learning algorithms for predicting the degree of coconut milk adulteration by corn flour and tapioca starch using NIR spectra with reliable performance (R2 of 0.886-0.999, RMSE of 0.370-6.108%, and Bias of -0.176-1.481). Furthermore, the ratio of percent deviation (RPD) of all algorithms with all types of NIR spectrophotometers indicates an excellent capability for quantitative predictions for any application (RPD > 8.1) except for case predicting tapioca starch, using FT-NIR by ResNET (RPD < 3.0). This study demonstrated the feasibility of using deep-learning algorithms and NIR spectral data as a rapid, accurate, robust, and non-destructive way to evaluate coconut milk adulterants. Last but not least, Micro-NIR is more promising than FT-NIR in predicting coconut milk adulteration from solid adulterants, and it is portable for in situ measurements in the future.

Identification and Classification of Coix seed Storage Years Based on Hyperspectral Imaging Technology Combined with Deep Learning

Developing a fast and non-destructive methodology to identify the storage years of Coix seed is important in safeguarding consumer well-being. This study employed the utilization of hyperspectral imaging (HSI) in conjunction with conventional machine learning techniques such as support vector machines (SVM), k-nearest neighbors (KNN), random forest (RF), extreme gradient boosting (XGBoost), as well as the deep learning method of residual neural network (ResNet), to establish identification models for Coix seed samples from different storage years. Under the fusion-based modeling approach, the model's classification accuracy surpasses that of visible to near infrared (VNIR) and short-wave infrared (SWIR) spectral modeling individually. The classification accuracy of the ResNet model and SVM exceeds that of other conventional machine learning models (KNN, RF, and XGBoost). Redundant variables were further diminished through competitive adaptive reweighted sampling feature wavelength screening, which had less impact on the model's accuracy. Upon validating the model's performance using an external validation set, the ResNet model yielded more satisfactory outcomes, exhibiting recognition accuracy exceeding 85%. In conclusion, the comprehensive results demonstrate that the integration of deep learning with HSI techniques effectively distinguishes Coix seed samples from different storage years.

Non-destructive identification of Pseudostellaria heterophylla from different geographical origins by Vis/NIR and SWIR hyperspectral imaging techniques

The composition of Pseudostellaria heterophylla (Tai-Zi-Shen, TZS) is greatly influenced by the growing area of the plants, making it significant to distinguish the origins of TZS. However, traditional methods for TZS origin identification are time-consuming, laborious, and destructive. To address this, two or three TZS accessions were selected from four different regions of China, with each of these resources including distinct quality grades of TZS samples. The visible near-infrared (Vis/NIR) and short-wave infrared (SWIR) hyperspectral information from these samples were then collected. Fast and high-precision methods to identify the origins of TZS were developed by combining various preprocessing algorithms, feature band extraction algorithms (CARS and SPA), traditional two-stage machine learning classifiers (PLS-DA, SVM, and RF), and an end-to-end deep learning classifier (DCNN). Specifically, SWIR hyperspectral information outperformed Vis/NIR hyperspectral information in detecting geographic origins of TZS. The SPA algorithm proved particularly effective in extracting SWIR information that was highly correlated with the origins of TZS. The corresponding FD-SPA-SVM model reduced the number of bands by 77.2% and improved the model accuracy from 97.6% to 98.1% compared to the full-band FD-SVM model. Overall, two sets of fast and high-precision models, SWIR-FD-SPA-SVM and SWIR-FD-DCNN, were established, achieving accuracies of 98.1% and 98.7% respectively. This work provides a potentially efficient alternative for rapidly detecting the origins of TZS during actual production.

Coal and Gangue Classification Based on Laser-Induced Breakdown Spectroscopy and Deep Learning

During the extraction and processing of coal, a large amount of solid waste, collectively known as gangue, is produced. This gangue has a low carbon content but a high ash content, accounting for approximately 15 to 20% of the total coal yield. Before coal is used, coal and gangue must be effectively separated to reduce the gangue content in the raw coal and improve the efficiency of coal utilization. This study introduces a classification method for coal and gangue based on a combination of laser-induced breakdown spectroscopy (LIBS) and deep learning. The method employs Gramian angular summation fields (GASF) to convert 1D spectral data into 2D time-series data, visualizing them as 2D images, before employing a novel deep learning model-GASF-CNN-for coal and gangue classification. GASF-CNN enhances model focus on critical features by introducing the SimAM attention mechanism, and additionally, the fusion of various levels of spectral features is achieved through the introduction of residual connectivity. GASF-CNN was trained and tested using a spectral data set containing coal and gangue. Comparative experimental results demonstrate that GASF-CNN outperforms other machine learning and deep learning models across four evaluation metrics. Specifically, it achieves 98.33, 97.06, 100, and 98.51% in the accuracy, recall, precision, and F1 score metrics, respectively, thereby achieving an accurate classification of coal and gangue.

Rice seed vigor detection based on near-infrared hyperspectral imaging and deep transfer learning

Vigor is one of the important factors that affects rice yield and quality. Rapid and accurate detection of rice seed vigor is of great importance for rice production. In this study, near-infrared hyperspectral imaging technique and transfer learning were combined to detect rice seed vigor. Four varieties of artificial-aged rice seeds (Yongyou12, Yongyou1540, Suxiangjing100, and Longjingyou1212) were studied. Different convolutional neural network (CNN) models were built to detect the vigor of the rice seeds. Two transfer strategies, fine-tuning and MixStyle, were used to transfer knowledge among different rice varieties for vigor detection. The experimental results showed that the convolutional neural network model of Yongyou12 classified the vigor of Yongyou1540, Suxiangjing100, and Longjingyou1212 through MixStyle transfer knowledge, and the accuracy reached 90.00%, 80.33%, and 85.00% in validation sets, respectively, which was better or close to the initial modeling performances of each variety. MixStyle statistics are based on probabilistic mixed instance-level features of cross-source domain training samples. When training instances, new domains can be synthesized, which increases the domain diversity of the source domain, thereby improving the generalization ability of the trained model. This study would help rapid and accurate detection of a large varieties of crop seeds.

Identification of geographical origins of Radix Paeoniae Alba using hyperspectral imaging with deep learning-based fusion approaches

The Radix Paeoniae Alba (Baishao) is a traditional Chinese medicine (TCM) with numerous clinical and nutritional benefits. Rapid and accurate identification of the geographical origins of Baishao is crucial for planters, traders and consumers. Hyperspectral imaging (HSI) was used in this study to acquire spectral images of Baishao samples from its two sides. Convolutional neural network (CNN) and attention mechanism was used to distinguish the origins of Baishao using spectra extracted from one side. The data-level and feature-level deep fusion models were proposed using information from both sides of the samples. CNN models outperformed the conventional machine learning methods in classifying Baishao origins. The generalized Gradient-weighted Class Activation Mapping (Grad-CAM++) was utilized to visualize and identify important wavelengths that significantly contribute to model performance. The overall results illustrated that HSI combined with deep learning strategies was effective in identifying the geographical origins of Baishao, having good prospects of real-world applications.

Continuous Monitoring Analysis of Rice Quality in Southern China Based on Random Forest

Rice quality has received more attention, so monitoring and analysis are of great significance to rice quality. General quality indexes of rice in southern China from 2011 to 2020 were determined, including processing quality (brown rice yield, milled rice recovery, head rice yield), appearance quality (grain length, length-width ratio, chalky rice percentage, chalkiness degree, transparency), and cooking quality (alkali spreading value, gel consistency, amylose). Principal component analysis was used to distinguish the regional quality of southern rice. The results showed that amylose and chalkiness were the main contributory quality indexes of rice in South China, the upper reaches of the Yangtze River, and the middle and lower reaches of the Yangtze River. In the past decade, the total high-quality rate of rice in the South has improved. The random forest was used to determine the important influence index of rice quality. The results showed that chalkiness degree, alkali spreading value, and gel consistency were important indexes affecting the quality of southern rice, and random forest could be used as an effective approach for continuous monitoring and analysis of rice quality.

Deep Learning Combined with Hyperspectral Imaging Technology for Variety Discrimination of Fritillaria thunbergii

Traditional Chinese herbal medicine (TCHM) plays an essential role in the international pharmaceutical industry due to its rich resources and unique curative properties. The flowers, stems, and leaves of Fritillaria contain a wide range of phytochemical compounds, including flavonoids, essential oils, saponins, and alkaloids, which may be useful for medicinal purposes. Fritillaria thunbergii Miq. Bulbs are commonly used in traditional Chinese medicine as expectorants and antitussives. In this paper, a feasibility study is presented that examines the use of hyperspectral imaging integrated with convolutional neural networks (CNN) to distinguish twelve (12) Fritillaria varieties (n = 360). The performance of support vector machines (SVM) and partial least squares-discriminant analysis (PLS-DA) was compared with that of convolutional neural network (CNN). Principal component analysis (PCA) was used to assess the presence of cluster trends in the spectral data. To optimize the performance of the models, cross-validation was used. Among all the discriminant models, CNN was the most accurate with 98.88%, 88.89% in training and test sets, followed by PLS-DA and SVM with 92.59%, 81.94% and 99.65%, 79.17%, respectively. The results obtained in the present study revealed that application of HSI in conjunction with the deep learning technique can be used for classification of Fritillaria thunbergii varieties rapidly and non-destructively.

A model for genuineness detection in genetically and phenotypically similar maize variety seeds based on hyperspectral imaging and machine learning

BACKGROUND

Variety genuineness and purity are essential indices of maize seed quality that affect yield. However, detection methods for variety genuineness are time-consuming, expensive, require extensive training, or destroy the seeds in the process. Here, we present an accurate, high-throughput, cost-effective, and non-destructive method for screening variety genuineness that uses seed phenotype data with machine learning to distinguish between genetically and phenotypically similar seed varieties. Specifically, we obtained image data of seed morphology and hyperspectral reflectance for Jingke 968 and nine other closely-related varieties (non-Jingke 968). We then compared the robustness of three common machine learning algorithms in distinguishing these varieties based on the phenotypic imaging data.

RESULTS

Our results showed that hyperspectral imaging (HSI) combined with a multilayer perceptron (MLP) or support vector machine (SVM) model could distinguish Jingke 968 from varieties that differed by as few as two loci, with a 99% or higher accuracy, while machine vision imaging provided  ~ 90% accuracy. Through model validation and updating with varieties not included in the training data, we developed a genuineness detection model for Jingke 968 that effectively discriminated between genetically similar and distant varieties.

CONCLUSIONS

This strategy has potential for wide adoption in large-scale variety genuineness detection operations for internal quality control or governmental regulatory agencies, or for accelerating the breeding of new varieties. Besides, it could easily be extended to other target varieties and other crops.

Detection of Pesticide Residue Level in Grape Using Hyperspectral Imaging with Machine Learning

Rapid and accurate detection of pesticide residue levels can help to prevent the harm of pesticide residue. This study used visible/near-infrared (Vis-NIR) (376–1044 nm) and near-infrared (NIR) (915–1699 nm) hyperspectral imaging systems (HISs) to detect the level of pesticide residues. Three different varieties of grapes were sprayed with four levels of pesticides. Logistic regression (LR), support vector machine (SVM), random forest (RF), convolutional neural network (CNN), and residual neural network (ResNet) models were used to build classification models for pesticide residue levels. The saliency maps of CNN and ResNet were conducted to visualize the contribution of wavelengths. Overall, the results of NIR spectra performed better than those of Vis-NIR spectra. For Vis-NIR spectra, the best model was ResNet, with the accuracy of over 93%. For NIR spectra, LR was the best, with the accuracy of over 97%, but SVM, CNN, and ResNet also showed closed and fine results. The saliency map of CNN and ResNet presented similar and closed ranges of crucial wavelengths. Overall results indicated deep learning performed better than conventional machine learning. The study showed that the use of hyperspectral imaging technology combined with machine learning can effectively detect the level of pesticide residues in grapes.