Removing the moisture effect in soil organic matter determination using NIR spectroscopy and PLSR with external parameter orthogonalization

An effective moisture interference correction method for maize powder NIR spectra analysis

The detection of maize starch content is of great significance for maize processing industry and near-infrared spectroscopy (NIRS) is an ideal rapid detection technology. However, the interference of moisture in maize is a bottleneck problem that affects the accuracy of NIRS quantitative analysis. In this study, we proposed methods based on external parameter orthogonalization (EPO) combined with wavelength selection algorithms to bring more accurate analytical results. Two groups of maize starch samples with different moisture content distributions were investigated to compare the predictive performance of NIRS models. The results showed that the model built using EPO combined with the synergy interval partial least squares (EPO-siPLS) algorithm exhibited the superior prediction accuracy, whose RMSEP/RMSEPck is improved by 9.7 % compared with that of siPLS model, 25.3 % compared with that of EPO-PLS, and 45.8 % compared with that of the PLS model. This study provides a more accurate and robust new method for rapid detection of maize starch and offers new insights for its application.

Protected Geographical Indication Discrimination of Zhejiang and Non-Zhejiang Ophiopogonis japonicus by Near-Infrared (NIR) Spectroscopy Combined with Chemometrics: The Influence of Different Stoichiometric and Spectrogram Pretreatment Methods

This paper presents a method for the protected geographical indication discrimination of Ophiopogon japonicus from Zhejiang and elsewhere using near-infrared (NIR) spectroscopy combined with chemometrics. A total of 3657 Ophiopogon japonicus samples from five major production areas in China were analyzed by NIR spectroscopy, and divided into 2127 from Zhejiang and 1530 from other areas ('non-Zhejiang'). Principal component analysis (PCA) was selected to screen outliers and eliminate them. Monte Carlo cross validation (MCCV) was introduced to divide the training set and test set according to a ratio of 3:7. The raw spectra were preprocessed by nine single and partial combination methods such as the standard normal variable (SNV) and derivative, and then modeled by partial least squares regression (PLSR), a support vector machine (SVM), and soft independent modeling of class analogies (SIMCA). The effects of different pretreatment and chemometrics methods on the model are discussed. The results showed that the three pattern recognition methods were effective in geographical origin tracing, and selecting the appropriate preprocessing method could improve the traceability accuracy. The accuracy of PLSR after the standard normal variable was better, with R² reaching 0.9979, while that of the second derivative was the lowest with an R² of 0.9656. After the SNV pretreatment, the accuracy of the training set and test set of SVM reached the highest values, which were 99.73% and 98.40%, respectively. The accuracy of SIMCA pretreated with SNV and MSC was the highest for the origin traceability of Ophiopogon japonicus, which could reach 100%. The distance between the two classification models of SIMCA-SNV and SIMCA-MSC is greater than 3, indicating that the SIMCA model has good performance.

External parameter orthogonalization-support vector machine for processing of attenuated total reflectance-mid-infrared spectra: A solution for saffron authenticity problem

In the present work, a new approach based on external parameter orthogonalization combined with support vector machine (EPO-SVM) is proposed for processing of attenuated total reflectance-Fourier transform mid-infrared (ATR-FT-MIR) spectra with the goal of solving authentication problem in saffron, the most expensive spice in the world. First, one-hundred authentic saffron samples are clustered by principal component analysis (PCA) with EPO as the best preprocessing strategy. Then, EPO-SVM is used for the detection of four commonly used plant-derived adulterants (i.e. safflower, calendula, rubia, and style) in binary mixtures (saffron and each of plant adulterants) and its performance is compared with other common classification methods. The obtained results showed that the EPO-SVM approach has a much better classification accuracy (>95%) than other methods (accuracy<89.2%). Finally, two different sample sets including mixture of saffron and four plant adulterants and commercial saffron samples are used for validation of the developed EPO-SVM model. In this regard, classification figures of merit in terms of sensitivity, specificity and accuracy were respectively 96.6%, 97.1%, and 96.8% which showed good classification performance. It is concluded that the proposed EPO-PCA and EPO-SVM approaches can be considered as reliable tools for authentication and adulteration detection in saffron samples.

Evaluation of Minimum Preparation Sampling Strategies for Sugarcane Quality Prediction by vis-NIR Spectroscopy

Proximal sensing for assessing sugarcane quality information during harvest can be affected by various factors, including the type of sample preparation. The objective of this study was to determine the best sugarcane sample type and analyze the spectral response for the prediction of quality parameters of sugarcane from visible and near-infrared (vis-NIR) spectroscopy. The sampling and spectral data acquisition were performed during the analysis of samples by conventional methods in a sugar mill laboratory. Samples of billets were collected and four modes of scanning and sample preparation were evaluated: outer-surface (‘skin’) (SS), cross-sectional scanning (CSS), defibrated cane (DF), and raw juice (RJ) to analyze the parameters soluble solids content (Brix), saccharose (Pol), fibre, pol of cane and total recoverable sugars (TRS). Predictive models based on Partial Least Square Regression (PLSR) were built with the vis-NIR spectral measurements. There was no significant difference (p-value > 0.05) between the accuracy SS and CSS samples compared to DF and RJ samples for all prediction models. However, DF samples presented the best predictive performance values for the main sugarcane quality parameters, and required only minimal sample preparation. The results contribute to advancing the development of on-board quality monitoring in sugarcane, indicating better sampling strategies.

Prediction of the Soil Organic Matter (SOM) Content from Moist Soil Using Synchronous Two-Dimensional Correlation Spectroscopy (2D-COS) Analysis

This paper illustrates a simple yet effective spectroscopic technique for the prediction of soil organic matter (SOM) from moist soil through the synchronous 2D correlation spectroscopy (2D-COS) analysis. In the moist soil system, the strong overlap between the water absorption peaks and the SOM characteristic features in the visible-near infrared (Vis-NIR) spectral region have long been recognised as one of the main factors that causes significant errors in the prediction of the SOM content. The aim of the paper is to illustrate how the tangling effects due to the moisture and the SOM can be unveiled under 2D-COS through a sequential correlogram analysis of the two perturbation variables (i.e., the moisture and the SOM) independently. The main outcome from the 2D-COS analysis is the discovery of SOM-related bands at the 597 nm, 1646 nm and 2138 nm, together with the predominant water absorbance feature at the 1934 nm and the relatively less important ones at 1447 nm and 2210 nm. This information is then utilised to build partial least square regression (PLSR) models for the prediction of the SOM content. The experiment has shown that by discarding noisy bands adjacent to the SOM features, and the removal of the water absorption bands, the determination coefficient of prediction (R_p²) and the ratio of prediction to deviation (RPD) for the prediction of SOM from moist soil have achieved R_p² = 0.92 and the RPD = 3.19, both of which are about 5% better than that of using all bands for building the PLSR model. The very high RPD (=3.19) obtained in this study may suggest that the 2D-COS technique is effective for the analysis of complex system like the prediction of SOM from moist soil.

From Laboratory to Proximal Sensing Spectroscopy for Soil Organic Carbon Estimation—A Review

Rapid and cost-effective soil properties estimations are considered imperative for the monitoring and recording of agricultural soil condition for the implementation of site-specific management practices. Conventional laboratory measurements are costly and time-consuming, and, therefore, cannot be considered appropriate for large datasets. This article reviews laboratory and proximal sensing spectroscopy in the visible and near infrared (VNIR)–short wave infrared (SWIR) wavelength region for soil organic carbon and soil organic matter estimation as an alternative to analytical chemistry measurements. The aim of this work is to report the progress made in the last decade on data preprocessing, calibration approaches, and system configurations used for VNIR-SWIR spectroscopy of soil organic carbon and soil organic matter estimation. We present and compare the results of over fifty selective studies and discuss the factors that affect the accuracy of spectroscopic measurements for both laboratory and in situ applications.