1
|
Wan Q, Zhu H, Yang C, Cheng F, Yuan J, Zhou C, Lan L. A multi-component concentration spectral modeling method with parallel drift resistance based on disorderly difference. Talanta 2025; 292:127943. [PMID: 40090247 DOI: 10.1016/j.talanta.2025.127943] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2025] [Revised: 03/11/2025] [Accepted: 03/12/2025] [Indexed: 03/18/2025]
Abstract
Spectral detection based on spectrophotometry is an important multi-component concentration detection method. At present, commonly used machine learning methods in the field of spectral analysis can only be used for prediction and cannot analyze how the concentration of each component affects the spectrum. In addition, for common spectral parallel drift in spectrophotometry, traditional derivative preprocessing methods are susceptible to noise and cannot reverse restore the original spectrum. These issues are not conducive to obtaining accurate interpretable spectral models and limits further improvement in detection accuracy. To solve the above problems, we applied mathematical methods to establish a basic model of absorbance spectra for multi-component mixed solutions, and analyzed the influence of spectral parallel drift on it. Then, we proposed an anti-drift modeling method based on the adjacent difference method. This method not only eliminates drift in the spectrum, but also achieves reverse optimization estimation of the original spectral model. In addition, in response to the phenomenon that the adjacent difference method amplifies spectral noise, we analyzed its reasons and proposed a disorderly difference method that can perfectly balance the advantages of adjacent difference method and span difference method. This method has better performance when applied to anti-drift modeling. Finally, the effectiveness of the method and improvement measures was validated by applying them on cobalt ion spectral dataset with different concentrations of iron and copper ions in zinc hydrometallurgy.
Collapse
Affiliation(s)
- Qilong Wan
- School of Automation, Central South University, Changsha, 410083, China
| | - Hongqiu Zhu
- School of Automation, Central South University, Changsha, 410083, China
| | - Chunhua Yang
- School of Automation, Central South University, Changsha, 410083, China
| | - Fei Cheng
- School of Internet of Things Engineering, Jiangnan University, Wuxi, 214122, China
| | - Jianqiang Yuan
- School of Automation, Central South University, Changsha, 410083, China
| | - Can Zhou
- School of Automation, Central South University, Changsha, 410083, China
| | - Lijuan Lan
- School of Automation, Central South University, Changsha, 410083, China.
| |
Collapse
|
2
|
Meng Y, Xu Q, Chen G, Liu J, Zhou S, Zhang Y, Wang A, Wang J, Yan D, Cai X, Li J, Chen X, Li Q, Zeng Q, Guo W, Wang Y. Regression prediction of tobacco chemical components during curing based on color quantification and machine learning. Sci Rep 2024; 14:27080. [PMID: 39511398 PMCID: PMC11543802 DOI: 10.1038/s41598-024-78426-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2024] [Accepted: 10/30/2024] [Indexed: 11/15/2024] Open
Abstract
Color is one of the most important indicators to characteristic the quality of tobacco, which is strongly related to the variations of chemical components. In order to clarify the relationship between the changes of tobacco color and chemical components, here we established several prediction models of chemical components with the color values of tobacco based on machine learning algorithms. The results of correlation analysis showed that tobacco moisture content was highly significantly correlated with the parameters such as a*, H* and H°, the reducing sugar and total sugar content of tobacco was significantly correlated with the color values, and the starch content was highly significantly correlated with the color values except for b* and C*. The random forest models performed best in predicting tobacco moisture, reducing sugar, total sugar and starch constructed with the R2 of the model validation set was higher than 0.90, and the RPD value was greater than 2.0. The consistent between the predictions and measurements verified the availability and feasibility using color values to predict some chemical components of the tobacco leaves with high accuracy, and which has distinct advantages and potential application to realize the real-time monitoring of some chemical components in the tobacco curing process.
Collapse
Affiliation(s)
- Yang Meng
- Zhengzhou Tobacco Research Institute of CNTC, Zhengzhou, 450001, China
| | - Qiang Xu
- Zhengzhou Tobacco Research Institute of CNTC, Zhengzhou, 450001, China
| | - Guangqing Chen
- Henan Provincial Tobacco Company, Zhengzhou, 450001, China
| | - Jianjun Liu
- Henan Provincial Tobacco Company, Zhengzhou, 450001, China
| | - Shuoye Zhou
- Henan Provincial Tobacco Company, Zhengzhou, 450001, China
| | - Yanling Zhang
- Zhengzhou Tobacco Research Institute of CNTC, Zhengzhou, 450001, China
| | - Aiguo Wang
- Zhengzhou Tobacco Research Institute of CNTC, Zhengzhou, 450001, China
| | - Jianwei Wang
- Zhengzhou Tobacco Research Institute of CNTC, Zhengzhou, 450001, China
| | - Ding Yan
- Shanghai Tobacco Company, 200000, Shanghai, China
| | - Xianjie Cai
- Shanghai Tobacco Company, 200000, Shanghai, China
| | - Junying Li
- Pingdingshan Branch of Henan Provincial Tobacco Company, Henan, 467000, China
| | - Xuchu Chen
- Pingdingshan Branch of Henan Provincial Tobacco Company, Henan, 467000, China
| | - Qiuying Li
- Nanping Branch of Fujian Provincial Tobacco Company, Nanping, 353000, China
| | - Qiang Zeng
- Nanping Branch of Fujian Provincial Tobacco Company, Nanping, 353000, China
| | - Weimin Guo
- Zhengzhou Tobacco Research Institute of CNTC, Zhengzhou, 450001, China.
- , No. 2 Fengyang Street, Zhengzhou, China.
- Tobacco Research Institute of CNTC, Zhengzhou, 450001, China.
| | - Yuanhui Wang
- College of Food Science and Engineering, Henan University of Technology, Zhengzhou, 450001, China.
- , No. 2 Fengyang Street, Zhengzhou, China.
- Tobacco Research Institute of CNTC, Zhengzhou, 450001, China.
| |
Collapse
|
3
|
Zong X, Zhou X, Cao X, Gao S, Zhang D, Zhang H, Qiu R, Wang Y, Wu J, Li L. Quantitative modelling of Plato and total flavonoids in Qingke wort at mashing and boiling stages based on FT-IR combined with deep learning and chemometrics. Food Chem X 2024; 23:101673. [PMID: 39148529 PMCID: PMC11324842 DOI: 10.1016/j.fochx.2024.101673] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2024] [Revised: 06/29/2024] [Accepted: 07/17/2024] [Indexed: 08/17/2024] Open
Abstract
Craft beer brewers need to learn process control strategies from traditional industrial production to ensure the consistent quality of the finished product. In this study, FT-IR combined with deep learning was used for the first time to model and analyze the Plato degree and total flavonoid content of Qingke beer during the mashing and boiling stages and to compare the effectiveness with traditional chemometrics methods. Two deep learning neural networks were designed, the effect of variable input methods on the effectiveness of the models was discussed. The experimental results showed that the CARS-LSTM model had the best predictive performance, not only as the best quantitative model for Plato in the mashing (R2p = 0.9368) and boiling (R2p = 0.9398) phases but also as the best model for TFC in the boiling phase (R2p = 0.9154). This study demonstrates the great potential of deep learning and provides a new approach to quality control analysis in beer brewing.
Collapse
Affiliation(s)
- Xuyan Zong
- Liquor Brewing Biotechnology and Application Key Laboratory of Sichuan Province, Sichuan University of Science and Engineering, Yibin, 644000, Sichuan, China
- College of Bioengineering, Sichuan University of Science and Engineering, Yibin, 644000, Sichuan, China
| | - Xianjiang Zhou
- Liquor Brewing Biotechnology and Application Key Laboratory of Sichuan Province, Sichuan University of Science and Engineering, Yibin, 644000, Sichuan, China
- College of Bioengineering, Sichuan University of Science and Engineering, Yibin, 644000, Sichuan, China
| | - Xinyue Cao
- Liquor Brewing Biotechnology and Application Key Laboratory of Sichuan Province, Sichuan University of Science and Engineering, Yibin, 644000, Sichuan, China
- College of Bioengineering, Sichuan University of Science and Engineering, Yibin, 644000, Sichuan, China
| | - Shun Gao
- Liquor Brewing Biotechnology and Application Key Laboratory of Sichuan Province, Sichuan University of Science and Engineering, Yibin, 644000, Sichuan, China
- College of Bioengineering, Sichuan University of Science and Engineering, Yibin, 644000, Sichuan, China
| | - Dongyang Zhang
- Liquor Brewing Biotechnology and Application Key Laboratory of Sichuan Province, Sichuan University of Science and Engineering, Yibin, 644000, Sichuan, China
- College of Bioengineering, Sichuan University of Science and Engineering, Yibin, 644000, Sichuan, China
| | - Haoran Zhang
- Liquor Brewing Biotechnology and Application Key Laboratory of Sichuan Province, Sichuan University of Science and Engineering, Yibin, 644000, Sichuan, China
- College of Bioengineering, Sichuan University of Science and Engineering, Yibin, 644000, Sichuan, China
| | - Ran Qiu
- China Resources Snow Breweries Co., Ltd, Beijing, 100000, China
| | - Yi Wang
- Wuliangye Group Co., Ltd, Yibin, 644000, Sichuan, China
| | - Jianhang Wu
- Liquor Brewing Biotechnology and Application Key Laboratory of Sichuan Province, Sichuan University of Science and Engineering, Yibin, 644000, Sichuan, China
- College of Bioengineering, Sichuan University of Science and Engineering, Yibin, 644000, Sichuan, China
| | - Li Li
- Liquor Brewing Biotechnology and Application Key Laboratory of Sichuan Province, Sichuan University of Science and Engineering, Yibin, 644000, Sichuan, China
- College of Bioengineering, Sichuan University of Science and Engineering, Yibin, 644000, Sichuan, China
| |
Collapse
|
4
|
Khadem H, Nemat H, Elliott J, Benaissa M. In Vitro Glucose Measurement from NIR and MIR Spectroscopy: Comprehensive Benchmark of Machine Learning and Filtering Chemometrics. Heliyon 2024; 10:e30981. [PMID: 38778952 PMCID: PMC11108977 DOI: 10.1016/j.heliyon.2024.e30981] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2024] [Revised: 05/08/2024] [Accepted: 05/08/2024] [Indexed: 05/25/2024] Open
Abstract
The quantitative analysis of glucose using spectroscopy is a topic of great significance and interest in science and industry. One conundrum in this area is deploying appropriate preprocessing and regression tools. To contribute to addressing this challenge, in this study, we conducted a comprehensive and novel comparative analysis of various machine learning and preprocessing filtering techniques applied to near-infrared, mid-infrared, and a combination of near-infrared and mid-infrared spectroscopy for glucose assay. Our objective was to evaluate the effectiveness of these techniques in accurately predicting glucose levels and to determine which approach was most optimal. Our investigation involved the acquisition of spectral data from samples of glucose solutions using the three aforementioned spectroscopy techniques. The data was subjected to several preprocessing filtering methods, including convolutional moving average, Savitzky-Golay, multiplicative scatter correction, and normalisation. We then applied representative machine learning algorithms from three categories: linear modelling, traditional nonlinear modelling, and artificial neural networks. The evaluation results revealed that linear models exhibited higher predictive accuracy than nonlinear models, whereas artificial neural network models demonstrated comparable performance. Additionally, the comparative analysis of various filtering methods demonstrated that the convolutional moving average and Savitzky-Golay filters yielded the most precise outcomes overall. In conclusion, our study provides valuable insights into the efficacy of different machine learning techniques for glucose measurement and highlights the importance of applying appropriate filtering methods in enhancing predictive accuracy. These findings have important implications for the development of new and improved glucose quantification technologies.
Collapse
Affiliation(s)
- Heydar Khadem
- Department of Electronic and Electrical Engineering, University of Sheffield, UK
- Department of Computer Science, University of Manchester, Manchester, UK
- Artificial Intelligence & Machine Learning Team, KultraLab, London, UK
| | - Hoda Nemat
- Department of Electronic and Electrical Engineering, University of Sheffield, UK
| | - Jackie Elliott
- Department of Oncology and Metabolism, University of Sheffield, UK
- Sheffield Teaching Hospitals, Diabetes and Endocrine Centre, Northern General Hospital, Sheffield, UK
| | - Mohammed Benaissa
- Department of Electronic and Electrical Engineering, University of Sheffield, UK
| |
Collapse
|
5
|
Liu S, Wang S, Hu C, Kong D, Yuan Y. Series fusion of scatter correction techniques coupled with deep convolution neural network as a promising approach for NIR modeling. SPECTROCHIMICA ACTA. PART A, MOLECULAR AND BIOMOLECULAR SPECTROSCOPY 2023; 291:122371. [PMID: 36669242 DOI: 10.1016/j.saa.2023.122371] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/28/2022] [Revised: 01/09/2023] [Accepted: 01/11/2023] [Indexed: 06/17/2023]
Abstract
Deep convolution neural network (CNN) with one-dimensional (1D) convolution structure is a potential and effective nonlinear method for near infrared (NIR) spectroscopy analysis. However, it is also a challenge to build a reliable CNN calibration model since industrial NIR data present serious scattering effect which will seriously interfere with important information. Thus, this paper proposed a promising approach, namely series fusion of scatter correction technologies (SCSF), where CNN built on the series splicing data of normalized raw spectra, standard normal variable (SNV) spectra and first derivative (1d) spectra. Two real NIR cases (one is the identification of alcohols/diesel blends and the other is the prediction of methanol and ethanol content in alcohols/diesel blends) were introduced to explore the feasibility and effectiveness of the presented model. Through the comparative analysis with CNN based on raw spectra, SNV spectra and 1d spectra, as well as common support vector machine (SVM) and BP neural network, the proposed SCSF coupled with CNN cannot only achieve 97.73 % recognition rate for three types of diesel, but also significantly improve the prediction accuracy of methanol and ethanol. Satisfactory results show that SCSF approach can be regarded as series boosting of multiple scatter correction technologies to improve overall performance without mastering data prior information and professional knowledge. Further, the proposed SCSF applied to CNN deep learning is simple and efficient, and can be recommended for actual implementation in industrial NIR applications.
Collapse
Affiliation(s)
- Shiyu Liu
- Measurement Technology and Instrumentation Key Lab of Hebei Province, Yanshan University, Qinhuangdao, Hebei 066004, China
| | - Shutao Wang
- Measurement Technology and Instrumentation Key Lab of Hebei Province, Yanshan University, Qinhuangdao, Hebei 066004, China.
| | - Chunhai Hu
- Measurement Technology and Instrumentation Key Lab of Hebei Province, Yanshan University, Qinhuangdao, Hebei 066004, China
| | - Deming Kong
- Measurement Technology and Instrumentation Key Lab of Hebei Province, Yanshan University, Qinhuangdao, Hebei 066004, China
| | - Yuanyuan Yuan
- School of Electrical Engineering, Hebei University of Science and Technology, Shijiazhuang, Hebei 050018, China
| |
Collapse
|
6
|
Peng Y, Bi Y, Dai L, Li H, Cao D, Qi Q, Liao F, Zhang K, Shen Y, Du F, Wang H. Quantitative Analysis of Routine Chemical Constituents of Tobacco Based on Thermogravimetric Analysis. ACS OMEGA 2022; 7:26407-26415. [PMID: 35936416 PMCID: PMC9352168 DOI: 10.1021/acsomega.2c02243] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/11/2022] [Accepted: 07/01/2022] [Indexed: 06/15/2023]
Abstract
As the most basic indexes to evaluate the quality of tobacco, the contents of routine chemical constituents in tobacco are mainly detected by continuous-flow analysis at present. However, this method suffers from complex operation, time consumption, and environmental pollution. Thus, it is necessary to establish a rapid accurate detection method. Herein, different from the ongoing research studies that mainly chose near-infrared spectroscopy as the information source for quantitative analysis of chemical components in tobacco, we proposed for the first time to use the thermogravimetric (TG) curve to characterize the chemical composition of tobacco. The quantitative analysis models of six routine chemical constituents in tobacco, including total sugar, reducing sugar, total nitrogen, total alkaloids, chlorine, and potassium, were established by the combination of TG curve and partial least squares algorithm. The accuracy of the model was confirmed by the value of root mean square error for prediction. The models can be used for the rapid accurate analysis of compound contents. Moreover, we performed an in-depth analysis of the chemical mechanism revealed by the result of the quantitative model, namely, the regression coefficient, which reflected the correlation degree between the six chemicals and different stages of the tobacco thermal decomposition process.
Collapse
Affiliation(s)
- Yuhan Peng
- Technology
Center, China Tobacco Zhejiang Industrial
Co., Ltd., Hangzhou 310012, China
| | - Yiming Bi
- Technology
Center, China Tobacco Zhejiang Industrial
Co., Ltd., Hangzhou 310012, China
| | - Lu Dai
- Technology
Center, China Tobacco Zhejiang Industrial
Co., Ltd., Hangzhou 310012, China
| | - Haifeng Li
- Technology
Center, China Tobacco Zhejiang Industrial
Co., Ltd., Hangzhou 310012, China
| | - Depo Cao
- Technology
Center, China Tobacco Zhejiang Industrial
Co., Ltd., Hangzhou 310012, China
| | - Qijie Qi
- Technology
Center, China Tobacco Zhejiang Industrial
Co., Ltd., Hangzhou 310012, China
| | - Fu Liao
- Technology
Center, China Tobacco Zhejiang Industrial
Co., Ltd., Hangzhou 310012, China
| | - Ke Zhang
- Zhengzhou
Tobacco Research Institute of CNTC, Zhengzhou 450001, China
| | - Yudong Shen
- Technology
Center, China Tobacco Zhejiang Industrial
Co., Ltd., Hangzhou 310012, China
| | - Fangqi Du
- Technology
Center, China Tobacco Zhejiang Industrial
Co., Ltd., Hangzhou 310012, China
| | - Hui Wang
- Technology
Center, China Tobacco Zhejiang Industrial
Co., Ltd., Hangzhou 310012, China
| |
Collapse
|