Automatic recognition of pleasant content of odours through ElectroEncephaloGraphic activity analysis

TASA: Temporal Attention With Spatial Autoencoder Network for Odor-Induced Emotion Classification Using EEG

The olfactory system enables humans to smell different odors, which are closely related to emotions. The high temporal resolution and non-invasiveness of Electroencephalogram (EEG) make it suitable to objectively study human preferences for odors. Effectively learning the temporal dynamics and spatial information from EEG is crucial for detecting odor-induced emotional valence. In this paper, we propose a deep learning architecture called Temporal Attention with Spatial Autoencoder Network (TASA) for predicting odor-induced emotions using EEG. TASA consists of a filter-bank layer, a spatial encoder, a time segmentation layer, a Long Short-Term Memory (LSTM) module, a multi-head self-attention (MSA) layer, and a fully connected layer. We improve upon the previous work by utilizing a two-phase learning framework, using the autoencoder module to learn the spatial information among electrodes by reconstructing the given input with a latent representation in the spatial dimension, which aims to minimize information loss compared to spatial filtering with CNN. The second improvement is inspired by the continuous nature of the olfactory process; we propose to use LSTM-MSA in TASA to capture its temporal dynamics by learning the intercorrelation among the time segments of the EEG. TASA is evaluated on an existing olfactory EEG dataset and compared with several existing deep learning architectures to demonstrate its effectiveness in predicting olfactory-triggered emotional responses. Interpretability analyses with DeepLIFT also suggest that TASA learns spatial-spectral features that are relevant to olfactory-induced emotion recognition.

Pleasantness Recognition Induced by Different Odor Concentrations Using Olfactory Electroencephalogram Signals

Olfactory-induced emotion plays an important role in communication, decision-making, multimedia, and disorder treatment. Using electroencephalogram (EEG) technology, this paper focuses on (1) exploring the possibility of recognizing pleasantness induced by different concentrations of odors, (2) finding the EEG rhythm wave that is most suitable for the recognition of different odor concentrations, (3) analyzing recognition accuracies with concentration changes, and (4) selecting a suitable classifier for this classification task. To explore these issues, first, emotions induced by five different concentrations of rose or rotten odors are divided into five kinds of pleasantness by averaging subjective evaluation scores. Then, the power spectral density features of EEG signals and support vector machine (SVM) are used for classification tasks. Classification results on the EEG signals collected from 13 participants show that for pleasantness recognition induced by pleasant or disgusting odor concentrations, considerable average classification accuracies of 93.5% or 92.2% are obtained, respectively. The results indicate that (1) using EEG technology, pleasantness recognition induced by different odor concentrations is possible; (2) gamma frequency band outperformed other EEG rhythm-based frequency bands in terms of classification accuracy, and as the maximum frequency of the EEG spectrum increases, the pleasantness classification accuracy gradually increases; (3) for both rose and rotten odors, the highest concentration obtains the best classification accuracy, followed by the lowest concentration.

Olfactory EEG Signal Classification Using a Trapezoid Difference-Based Electrode Sequence Hashing Approach

Olfactory-induced electroencephalogram (EEG) signal classification is of great significance in a variety of fields, such as disorder treatment, neuroscience research, multimedia applications and brain-computer interface. In this paper, a trapezoid difference-based electrode sequence hashing method is proposed for olfactory EEG signal classification. First, an N-layer trapezoid feature set whose size ratio of the top, bottom and height is 1:2:1 is constructed for each frequency band of each EEG sample. This construction is based on N optimized power-spectral-density features extracted from N real electrodes and N nonreal electrode's features. Subsequently, the N real electrodes' sequence (ES) codes of each layer of the constructed trapezoid feature set are obtained by arranging the feature values in ascending order. Finally, the nearest neighbor classification is used to find a class whose ES codes are the most similar to those of the testing sample. Thirteen-class olfactory EEG signals collected from 11 subjects are used to compare the classification performance of the proposed method with six traditional classification methods. The comparison shows that the proposed method gives average accuracy of 94.3%, Cohen's kappa value of 0.94, precision of 95.0%, and F1-measure of 94.6%, which are higher than those of the existing methods.

Machine Learning in Human Olfactory Research

The complexity of the human sense of smell is increasingly reflected in complex and high-dimensional data, which opens opportunities for data-driven approaches that complement hypothesis-driven research. Contemporary developments in computational and data science, with its currently most popular implementation as machine learning, facilitate complex data-driven research approaches. The use of machine learning in human olfactory research included major approaches comprising 1) the study of the physiology of pattern-based odor detection and recognition processes, 2) pattern recognition in olfactory phenotypes, 3) the development of complex disease biomarkers including olfactory features, 4) odor prediction from physico-chemical properties of volatile molecules, and 5) knowledge discovery in publicly available big databases. A limited set of unsupervised and supervised machine-learned methods has been used in these projects, however, the increasing use of contemporary methods of computational science is reflected in a growing number of reports employing machine learning for human olfactory research. This review provides key concepts of machine learning and summarizes current applications on human olfactory data.