Water-based measured-value fuzzification improves the estimation accuracy of soil organic matter by visible and near-infrared spectroscopy

Identification and quantitative detection of illegal additives in wheat flour based on near-infrared spectroscopy combined with chemometrics

As a common food raw material in daily life, the quality and safety of wheat flour are directly related to people's health. In this study, a model was developed for the rapid identification and detection of three illegal additives in flour, namely azodicarbonamide (ADA), talcum powder, and gypsum powder. This model utilized a combination of near-infrared spectroscopy with chemometric methods. A one-dimensional convolutional neural network was used to reduce data dimensionality, while a support vector machine was applied for non-linear classification to identify illegal additives in flour. The model achieved a calibration set F1 score of 99.38% and accuracy of 99.63%, with a validation set F1 score of 98.81% and accuracy of 98.89%. Two cascaded wavelength selection methods were introduced: The first method involved backward interval partial least squares (BiPLS) combined with an improved binary particle swarm optimization algorithm (IBPSO). The second method utilized the CARS-IBPSO algorithm, which integrated competitive adaptive reweighted sampling (CARS) with IBPSO. The two cascade wavelength selection methods were used to select feature wavelengths associated with additives and construct partial least squares quantitative detection models. The models constructed using CARS-IBPSO selected feature wavelengths for detecting ADA, talcum powder, and gypsum powder exhibited the highest overall performance. The model achieved validation set determination coefficients of 0.9786, 0.9102, and 0.9226, with corresponding to root mean square errors of 0.0024%, 1.3693%, and 1.6506% and residual predictive deviations of 6.8368, 3.5852, and 3.9253, respectively. Near-infrared spectroscopy in combination with convolutional neural network dimensionality reduction and support vector machine classification enabled rapid identification of various illegal additives. The combination of CARS-IBPSO feature wavelength selection and partial least squares regression models facilitated rapid quantitative detection of these additives. This study introduces a new approach for rapidly and accurately identifying and detecting illegal additives in flour.

Monitoring of volatile fatty acids during anaerobic digestion of olive pomace by means of a hand held near infrared spectrometer

The accumulation of volatile fatty acids (VFAs) over anaerobic digestion (AD) leads to malfunctioning of industrial reactors, hence decreasing biogas production. Real-time monitoring of VFAs is a challenge due to the complexity and high cost of current methods for their quantification. For this reason, this research evaluated the application of near infrared (NIR) spectroscopy to quantify volatile fatty acids as a tool for AD reactors monitoring. To do that, 129 samples from various AD reactors fed with olive oil pomace were taken and their NIR spectra were acquired with a hand-held spectrometer. After performing grid search, three spectral variable selection methods, namely competitive adaptive reweighted sampling, uninformative variable elimination (UVE) and successive projections algorithm, were assayed before developing PLRS models to correlate the NIR light transmittance through the samples at the wavelengths selected by those methods with their VFAs concentrations. UVE led to the best performance for all the VFAs assayed. Thus, R2 of validation of UVE-PLSR models for acetic, propionic, butyric, valeric and total VFAs were 0.895, 0.622, 0.866, 0.898 and 0.871, respectively. The predictive model for total VFAs achieved the highest accuracy (RMSEV = 539.5 mg/L), explained by the correlation between the light absorption at the wavelengths selected by UVE and the chemical characteristics of VFAs. All in all, the prediction errors achieved suggest that a portable near infrared spectrometer can be used for monitoring VFAs in AD processes.

Rapid determination of the main components of corn based on near-infrared spectroscopy and a BiPLS-PCA-ELM model

To evaluate corn quality quickly, the feasibility of near-infrared spectroscopy (NIRS) coupled with chemometrics was analyzed to detect the moisture, oil, protein, and starch content in corn. A backward interval partial least squares (BiPLS)-principal component analysis (PCA)-extreme learning machine (ELM) quantitative analysis model was constructed based on BiPLS in conjunction with PCA and the ELM. The selection of characteristic spectral intervals was accomplished by BiPLS. The best principal components were determined by the prediction residual error sum of squares of Monte Carlo cross validation. In addition, a genetic simulated annealing algorithm was utilized to optimize the parameters of the ELM regression model. The established regression models for moisture, oil, protein, and starch can meet the demand for corn component detection with the prediction determination coefficients of 0.996, 0.990, 0.974, and 0.976; the prediction root means square errors of 0.018, 0.016, 0.067, and 0.109; and the residual prediction deviations of 15.704, 9.741, 6.330, and 6.236, respectively. The results show that the NIRS rapid detection model has higher robustness and accuracy based on the selection of characteristic spectral intervals in conjunction with spectral data dimensionality reduction and nonlinear modeling and can be used as an alternative strategy to detect multiple components in corn rapidly.

Fast detection of volatile fatty acids in biogas slurry using NIR spectroscopy combined with feature wavelength selection

To analyze the state of anaerobic digestion (AD), fast detection models of volatile fatty acids (VFAs) were constructed using near-infrared transmission spectroscopy combined with partial least squares regression to measure concentrations of the acetic acid (AA), propionic acid (PA) and total acid (TA) in biogas slurry. CARS-SA-BPSO algorithm was proposed based on competitive adaptive reweighted sampling (CARS) and simulated annealing binary particle swarm optimization algorithm (SA-BPSO) for selecting feature wavelengths of the AA, PA and TA. Regression models were established with the determination coefficient of prediction (R_p²) of 0.989, root mean squared error of prediction (RMSEP) of 0.111 and residual predictive deviation (RPD) of 9.706 for AA; R_p² of 0.932, RMSEP of 0.116 and RPD of 3.799 for PA; R_p² of 0.895, RMSEP of 0.689 and RPD of 3.676 for TA. It is sufficient to meet the fast detection needs of the AA and PA concentrations in biogas slurry, and basically meet the measuring demand of the TA concentration. CARS-SA-BPSO effectively improves the performance of the calibration model using sensitive wavelength selections, which provides theoretical support for establishing the spectral quantitative regression model to meet the requirements of practical application.

Estimation of chemical oxygen demand in different water systems by near-infrared spectroscopy

To monitor environmental water pollution effectively and meet human water needs, it is crucial to develop a fast, simple, and accurate method for monitoring chemical oxygen demand (COD) in various water systems. In this study, COD prediction models for different water systems were developed by combining near-infrared (NIR) spectroscopy with partial least squares regression (PLSR). Samples of wastewater, surface water, and seawater were collected from Guangzhou, Guangdong Province, China. Three pretreatment methods were used to preprocess the spectra in order to improve the accuracy and minimalism of the model. We investigate the performance of two variable selection algorithms, namely, binary gray wolf optimization (BGWO) and competitive adaptive reweighting sampling (CARS). The results show that both BGWO and CARS improved the performance of the model in terms of higher accuracy and less wavelength input; both of the combined model performances were better than that of PLSR alone, and CARS-PLSR achieved the best results. Using CARS-PLSR, surface water, wastewater, and seawater model inputs were reduced by 96 %, 96 %, and 82 % as compared to the PLSR results, respectively, and the testing sets R² reached 0.860, 0.815, and 0.692, respectively. The spectral variable selection algorithm could identify the important spectral variables between COD content and NIR spectra in three water systems, thereby improving the accuracy and simplicity of the PLSR model for COD prediction. Our results have important practical value for predicting COD content in different water systems by NIR spectroscopy.

Evaluating Calibration and Spectral Variable Selection Methods for Predicting Three Soil Nutrients Using Vis-NIR Spectroscopy

Soil nutrients, including soil available potassium (SAK), soil available phosphorous (SAP), and soil organic matter (SOM), play an important role in farmland soil productivity, food security, and agricultural management. Spectroscopic analysis has proven to be a rapid, nondestructive, and effective technique for predicting soil properties in general and potassium, phosphorous, and organic matter in particular. However, the successful estimation of soil nutrient content by visible and near-infrared (Vis-NIR) reflectance spectroscopy depends on proper calibration methods (including preprocessing transformation methods and multivariate methods for regression analysis) and the selection of appropriate variable selection techniques. In this study, raw spectrum and 13 preprocessing transformations combined with 2 variable selection methods (competitive adaptive reweighted sampling (CARS) and the successive projections algorithm (SPA)) and 2 regression algorithms (support vector machine (SVM) and partial least squares regression (PLSR)), for a total of 56 calibration methods, were investigated for modeling and predicting the above three soil nutrients using hyperspectral Vis-NIR data (400–2450 nm). The results show that first-order derivatives based on logarithmic and inverse transformations (FD-LGRs) can provide better predictions of soil available potassium and phosphorous, and the best form of soil organic matter transformation is SG+MSC. CARS was superior to the SPA in selecting effective variables, and the PLSR model outperformed the SVM models. The best estimation accuracies (R2, RMSE) for soil available potassium, phosphorous, and organic matter were 0.7532, 32.3090 mg/kg; 0.7440, 6.6910 mg/kg; and 0.9009, 3.2103 g/kg, respectively, and their corresponding calibration methods were (FD-LGR)/SPA/PLSR, (FD-LGR)/SPA/PLSR, and SG+MSC/CARS/SVM, respectively. Overall, for the prediction of the soil nutrient content, organic matter was superior to available phosphorous, followed by available potassium. It was concluded that the application of hyperspectral images (Vis-NIR data) was an efficient method for mapping and monitoring soil nutrients at the regional scale, thus contributing to the development of precision agriculture.

Water-absorption-trough dewatering machine for estimation of organic carbon in moist soil

Quantitative estimation of soil organic carbon (SOC) is essential for the study of the C cycle and global C storage. Soil spectroscopic technology provides a cost-effective and time-efficient method for SOC quantification and has been successfully used to determine SOC storage. However, the SOC estimation accuracy remains limited by other soil properties, particularly soil water. In this study, we proposed a new deep learning algorithm named the Water Absorption Trough Dewatering Machine (WATDM) to improve estimations of SOC from soil reflectance spectra and reduce the effect of soil water. Soil water and reflectance spectral data of soil samples were measured using spectrometry. Based on the soil water contents derived from the water absorption troughs around 1900 nm, the optimal WATDM model was obtained and treated as the final model of the WATDM method, which performed better than a multiple linear regression model based on moist soil samples. The findings of this study indicate that the WATDM method can improve the estimation accuracy of SOC content by reducing the effect of soil water and can be used as a valuable new methodology within the spectroscopic estimation of soil properties.