Probing 1D convolutional neural network adapted to near-infrared spectroscopy for efficient classification of mixed fish

Enhancing Food Quality Analysis: The Transformative Role of Artificial Neural Networks in Modern Analytical Techniques

BACKGROUND

Consumers have always anticipated and requested high-quality and safe food items, which is why food quality analyses and mandatory product inspections were introduced. Various novel techniques and analytical breakthroughs have emerged to cater to the problem of food authenticity. It is difficult to interpret and analyze large and complex data with traditional machine learning algorithms. Its effectiveness is constrained when dealing with non-linearity, high-dimension data, and intricate data relationships, and it is frequently faced with struggles to capture the latent patterns and structures within such data. However, using deep learning artificial neural networks has provided solutions to these challenges. Artificial neural networks (ANNs) have propelled breakthroughs across several research areas and have continually been applied in the area of food analysis, quality, and safety. ANNs are pooled along with various analytical techniques for making food quality predictions with fast response time and short computation time.

SCOPE AND APPROACH

Details of the latest ANN models and their contribution in food quality predictions, have been presented in this review. This systematic review has also firmly focused on various types of analytical techniques and recent applications of advanced analytical techniques combining various ANNs in food authentication. Various traditional chemometrics method and their key limitations are also discussed.

KEY FINDINGS AND CONCLUSIONS

ANNs when combined with analytical techniques, provide solutions to the problem of food authenticity and quality analyses can learn representational features from the data-set during the training process and demonstrate stronger ability than traditional chemometric methods. The fusion of different types of ANNs and the development of miniaturized and portable spectrometers are becoming increasingly essential and potential candidates for future research.

Prediction of surface water pollution using wavelet transform and 1D-CNN

Permanganate index (CODMn), total nitrogen, and ammonia nitrogen are important indicators that represent the degree of pollution of surface water. This study combined ultraviolet-visible (UV-vis) spectroscopy with a one-dimensional convolutional neural network (1D-CNN) to spectrally analyze 708 samples with different concentrations. The wavelet transform was used to preprocess the spectra to improve the model's accuracy. The results show the best prediction results using a fixed threshold (sqtwolog) of wavelets in combination with 1D-CNN, and the coefficient of determination (R2) values of the models on the test dataset all reached more than 0.98. A comparison between the backpropagation neural network model and the extreme learning machine model reveals that the 1D-CNN model has better prediction accuracy and robustness. The experimental results show the strong practical value of using 1D-CNN to predict the levels of different compounds in surface water.

Geographical Origin Traceability of Navel Oranges Based on Near-Infrared Spectroscopy Combined with Deep Learning

The quality and price of navel oranges vary depending on their geographical origin, thus providing a financial incentive for origin fraud. To prevent this phenomenon, it is necessary to explore a fast, non-destructive, and precise method for tracing the origin of navel oranges. In this study, a total of 490 Newhall navel oranges were selected from five major production regions in China, and the diffuse reflectance near-infrared spectrum in 4000-10,000 cm-1 were non-invasively collected. We examined seven preprocessing techniques for the spectra, including Savitzky-Golay (SG) smoothing, first derivative (FD), multiplicative scattering correction (MSC), combinations of SG with MSC (SG+MSC), SG with FD (SG+FD), MSC with FD (MSC+FD), and three combined (SG+MSC+FD). A one-dimensional convolutional neural network (1DCNN) deep learning model for geographical origin tracing of navel orange was established, and five machine learning algorithms, i.e., partial least squares discriminant analysis (PLS-DA), linear discriminant analysis (LDA), support vector machine (SVM), random forest (RF), and back-propagation neural network (BPNN), were compared with 1DCNN. The results show that the 1DCNN model based on the SG+FD preprocessing method achieved the optimal performance for the testing set, with prediction accuracy, precision, recall, and F1-score of 97.92%, 98%, 97.95%, and 97.90%, respectively. Therefore, NIRS combined with deep learning has a significant research and application value in the rapid, nondestructive, and accurate geographical origin traceability of agricultural products.

Analyzing TVB-N in snakehead by Bayesian-optimized 1D-CNN using molecular vibrational spectroscopic techniques: Near-infrared and Raman spectroscopy

Total volatile basic nitrogen (TVB-N) is one of the key indicators for assessing fish freshness. This research employed near-infrared (NIR) and Raman spectroscopy methods to detect the TVB-N content in snakehead fillets. We extracted feature variables associated with TVB-N from NIR and Raman spectroscopy using Variable Crossover Point Arithmetic - Improved Reduced-Input Vector (VCPA-IRIV). Using these features, we established partial least squares (PLS) and One-dimensional Convolutional Neural Network (1D-CNN) models. Subsequently, data fusion strategies were employed to predict the TVB-N content. Notably, feature-level fusion in conjunction with Bayesian-optimized 1D-CNN, reached the best results, as evidenced by calibration and predictive correlation coefficients of 0.9677 and 0.9676 for TVB-N. These findings underscore the effectiveness of both NIR and Raman spectroscopy in evaluating fish freshness. The fusion of these two vibrational spectroscopy techniques enables a more rapid, efficient and comprehensive quantification of fish freshness.

Disentangled global and local features of multi-source data variational autoencoder: An interpretable model for diagnosing IgAN via multi-source Raman spectral fusion techniques

A single Raman spectrum reflects limited molecular information. Effective fusion of the Raman spectra of serum and urine source domains helps to obtain richer feature information. However, most of the current studies on immunoglobulin A nephropathy (IgAN) based on Raman spectroscopy are based on small sample data and low signal-to-noise ratio. If a multi-source data fusion strategy is directly adopted, it may even reduce the accuracy of disease diagnosis. To this end, this paper proposes a data enhancement and spectral optimization method based on variational autoencoders to obtain reconstructed Raman spectra with doubled sample size and improved signal-to-noise ratio. In the diagnosis of IgAN in multi-source domain Raman spectra, this paper builds a global and local feature decoupled variational autoencoder (DMSGL-VAE) model based on multi-source data. First, the statistical features after spectral segmentation are extracted, and the latent variables obtained by the variational encoder are decoupled through the decoupling module. The global representation and local representation obtained represent the global shared information and local unique information of the serum and urine source domains, respectively. Then, the cross-source reconstruction loss and decoupling loss are used to constrain the decoupling, and the effectiveness of the decoupling is proved quantitatively and qualitatively. Finally, the features of different source domains were integrated to diagnose IgAN, and the results were analyzed for important features using the SHapley Additive exPlanations algorithm. The experimental results showed that the AUC value of the DMSGL-VAE model for diagnosing IgAN on the test set was as high as 0.9958. The SHAP algorithm was used to further prove that proteins, hydroxybutyrate, and guanine are likely to be common biological fingerprint substances for the diagnosis of IgAN by serum and urine Raman spectroscopy. In summary, the DMSGL-VAE model designed based on Raman spectroscopy in this paper can achieve rapid, non-invasive, and accurate screening of IgAN in terms of classification performance. And interpretable analysis may help doctors further understand IgAN and make more efficient diagnostic measures in the future.

CVAE-DF: A hybrid deep learning framework for fertilization status detection of pre-incubation duck eggs based on VIS/NIR spectroscopy

Unfertilized duck eggs not removed prior to incubation will deteriorate quickly, posing a risk of contaminating the normally fertilized duck eggs. Thus, detecting the fertilization status of breeding duck eggs as early as possible is a meaningful and challenging task. Most existing work usually focus on the characteristics of chicken eggs during mid-term hatching. However, little attention has been paid to the detection for duck eggs prior to incubation. In this paper, we present a novel hybrid deep learning detection framework for the fertilization status of pre-incubation duck eggs, termed CVAE-DF, based on visible/near-infrared (VIS/NIR) transmittance spectroscopy. The framework comprises the encoder of a convolutional variational autoencoder (CVAE) and an improved deep forest (DF) model. More specifically, we first collected transmittance spectral data (400-1000 nm) of 255 duck eggs before hatching. The multiplicative scatter correction (MSC) method was then used to eliminate noise and extraneous information of the raw spectral data. Two efficient data augmentation methods were adopted to provide sufficient data. After that, CVAE was applied to extract representative features and reduce the feature dimension for the detection task. Finally, an improved DF model was employed to build the classification model on the enhanced feature set. The CVAE-DF model achieved an overall accuracy of 95.94 % on the test dataset. These experimental results in terms of four metrics demonstrate that our CVAE-DF method outperforms the traditional methods by a significant margin. Furthermore, the results also indicate that CVAE holds great promise as a novel feature extraction method for the VIS/NIR spectral analysis of other agricultural products. It is extremely beneficial to practical engineering.

Precision in wheat flour classification: Harnessing the power of deep learning and two-dimensional correlation spectrum (2DCOS)

Wheat flour is a ubiquitous food ingredient, yet discerning its various types can prove challenging. A practical approach for identifying wheat flour types involves analyzing one-dimensional near-infrared spectroscopy (NIRS) data. This paper introduces an innovative method for wheat flour recognition, combining deep learning (DL) with Two-dimensional correlation spectrum (2DCOS). In this investigation, 316 samples from four distinct types of wheat flour were collected using a near-infrared (NIR) spectrometer, and the raw spectra of each sample underwent preprocessing employing diverse methods. The discrete generalized 2DCOS algorithm was applied to generate 3792 2DCOS images from the preprocessed spectral data. We trained a deep learning model tailored for flour 2DCOS images - EfficientNet. Ultimately, this DL model achieved 100% accuracy in identifying wheat flour within the test set. The findings demonstrate the viability of directly transforming spectra into two-dimensional images for species recognition using 2DCOS and DL. Compared to the traditional stoichiometric method Partial Least Squares Discriminant Analysis (PLS_DA), machine learning methods Support Vector Machines (SVM) and K-Nearest Neighbors (KNN), and deep learning methods one-dimensional convolutional neural network (1DCNN) and residual neural network (ResNet), the model proposed in this paper is better suited for wheat flour identification, boasting the highest accuracy. This study offers a fresh perspective on wheat flour type identification and successfully integrates the latest advancements in deep learning with 2DCOS for spectral type identification. Furthermore, this approach can be extended to the spectral identification of other products, presenting a novel avenue for future research in the field.

A Novel Machine-Learning Framework Based on a Hierarchy of Dispute Models for the Identification of Fish Species Using Multi-Mode Spectroscopy

Seafood mislabeling rates of approximately 20% have been reported globally. Traditional methods for fish species identification, such as DNA analysis and polymerase chain reaction (PCR), are expensive and time-consuming, and require skilled technicians and specialized equipment. The combination of spectroscopy and machine learning presents a promising approach to overcome these challenges. In our study, we took a comprehensive approach by considering a total of 43 different fish species and employing three modes of spectroscopy: fluorescence (Fluor), and reflectance in the visible near-infrared (VNIR) and short-wave near-infrared (SWIR). To achieve higher accuracies, we developed a novel machine-learning framework, where groups of similar fish types were identified and specialized classifiers were trained for each group. The incorporation of global (single artificial intelligence for all species) and dispute classification models created a hierarchical decision process, yielding higher performances. For Fluor, VNIR, and SWIR, accuracies increased from 80%, 75%, and 49% to 83%, 81%, and 58%, respectively. Furthermore, certain species witnessed remarkable performance enhancements of up to 40% in single-mode identification. The fusion of all three spectroscopic modes further boosted the performance of the best single mode, averaged over all species, by 9%. Fish species mislabeling not only poses health-related risks due to contaminants, toxins, and allergens that could be life-threatening, but also gives rise to economic and environmental hazards and loss of nutritional benefits. Our proposed method can detect fish fraud as a real-time alternative to DNA barcoding and other standard methods. The hierarchical system of dispute models proposed in this work is a novel machine-learning tool not limited to this application, and can improve accuracy in any classification problem which contains a large number of classes.

Microbiological Quality Estimation of Meat Using Deep CNNs on Embedded Hardware Systems

Spectroscopic sensor imaging of food samples meta-processed by deep machine learning models can be used to assess the quality of the sample. This article presents an architecture for estimating microbial populations in meat samples using multispectral imaging and deep convolutional neural networks. The deep learning models operate on embedded platforms and not offline on a separate computer or a cloud server. Different storage conditions of the meat samples were used, and various deep learning models and embedded platforms were evaluated. In addition, the hardware boards were evaluated in terms of latency, throughput, efficiency and value on different data pre-processing and imaging-type setups. The experimental results showed the advantage of the XavierNX platform in terms of latency and throughput and the advantage of Nano and RP4 in terms of efficiency and value, respectively.

A novel fast method for identifying the origin of Maojian using NIR spectroscopy with deep learning algorithms

Maojian is one of China's traditional famous teas. There are many Maojian-producing areas in China. Because of different producing areas and production processes, different Maojian have different market prices. Many merchants will mix Maojian in different regions for profit, seriously disrupting the healthy tea market. Due to the similar appearance of Maojian produced in different regions, it is impossible to make a quick and objective distinction. It often requires experienced experts to identify them through multiple steps. Therefore, it is of great significance to develop a rapid and accurate method to identify different regions of Maojian to promote the standardization of the Maojian market and the development of detection technology. In this study, we propose a new method based on Near infra-red (NIR) with deep learning algorithms to distinguish different origins of Maojian. In this experiment, the NIR spectral data of Maojian from different origins are combined with the back propagation neural network (BPNN), improved AlexNet, and improved RepSet models for classification. Among them, improved RepSet has the highest accuracy of 99.30%, which is 8.67% and 0.70% higher than BPNN and improved AlexNet, respectively. The overall results show that it is feasible to use NIR and deep learning methods to quickly and accurately identify Maojian from different origins and prove an effective alternative method to discriminate different origins of Maojian.

Discrimination of Minced Mutton Adulteration Based on Sized-Adaptive Online NIRS Information and 2D Conventional Neural Network

Single-probe near-infrared spectroscopy (NIRS) usually uses different spectral information for modelling, but there are few reports about its influence on model performance. Based on sized-adaptive online NIRS information and the 2D conventional neural network (CNN), minced samples of pure mutton, pork, duck, and adulterated mutton with pork/duck were classified in this study. The influence of spectral information, convolution kernel sizes, and classifiers on model performance was separately explored. The results showed that spectral information had a great influence on model accuracy, of which the maximum difference could reach up to 12.06% for the same validation set. The convolution kernel sizes and classifiers had little effect on model accuracy but had significant influence on classification speed. For all datasets, the accuracy of the CNN model with mean spectral information per direction, extreme learning machine (ELM) classifier, and 7 × 7 convolution kernel was higher than 99.56%. Considering the rapidity and practicality, this study provides a fast and accurate method for online classification of adulterated mutton.