1
|
Goshvarpour A, Goshvarpour A. Innovative Poincare's plot asymmetry descriptors for EEG emotion recognition. Cogn Neurodyn 2022; 16:545-559. [PMID: 35603058 PMCID: PMC9120274 DOI: 10.1007/s11571-021-09735-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2021] [Revised: 09/18/2021] [Accepted: 10/13/2021] [Indexed: 10/20/2022] Open
Abstract
Given the importance of emotion recognition in both medical and non-medical applications, designing an automatic system has captured the attention of several scholars. Currently, EEG-based emotion recognition has a special position, which has not fulfilled the desired accuracy rates yet. This experiment intended to provide novel EEG asymmetry measures to improve emotion recognition rates. Four emotional states have been classified using the k-nearest neighbor (kNN), support vector machine, and Naïve Bayes. Feature selection has been performed, and the role of employing a different number of top-ranked features on emotion recognition rates has been assessed. To validate the efficiency of the proposed scheme, two public databases, including the SJTU Emotion EEG Dataset-IV (SEED-IV) and a Database for Emotion Analysis using Physiological signals (DEAP) were evaluated. The experimental results indicated that kNN outperformed the other classifiers with a maximum accuracy of 95.49 and 98.63% using SEED-IV and DEAP datasets, respectively. In conclusion, the results of the proposed novel EEG-asymmetry measures make the framework a superior one compared to the state-of-art EEG emotion recognition approaches.
Collapse
Affiliation(s)
- Atefeh Goshvarpour
- Department of Biomedical Engineering, Faculty of Electrical Engineering, Sahand University of Technology, Tabriz, Iran
| | - Ateke Goshvarpour
- Department of Biomedical Engineering, Imam Reza International University, Rezvan Campus, Phalestine Sq., Mashhad, Razavi Khorasan Iran
| |
Collapse
|
2
|
Goshvarpour A, Goshvarpour A. Verhulst map measures: new biomarkers for heart rate classification. Phys Eng Sci Med 2022; 45:513-523. [PMID: 35303265 DOI: 10.1007/s13246-022-01117-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2021] [Accepted: 03/08/2022] [Indexed: 12/16/2022]
Abstract
Recording, monitoring, and analyzing biological signals has received significant attention in medicine. A fundamental phase for understanding a bio-system under various conditions is to process the corresponding bio-signal appropriately. To this effect, different conventional and nonlinear approaches have been proposed. However, since the non-stationary properties of the bio-signals are not revealed by traditional linear methods, nonlinear dynamical techniques play a crucial role in examining the behavior of a bio-system. This work proposes new bio-markers based on the chaotic nature of the biomedical signals. These measures were introduced using the Verhulst map, a simple tool for characterizing the morphology of the reconstructed phase space. For this purpose, we extracted the features from the heart rate (HR) signals of six groups of meditators and non-meditators. For a typical classification problem, the performance of some conventional classifiers, including the k-nearest neighbor, support vector machine, and Naïve Bayes, was appraised separately. In addition, the competence of a hybrid classification strategy was inspected using majority voting. The results indicated a maximum accuracy, F1-score, and sensitivity of 100%. These findings reveal that the proposed framework is eminently capable of analyzing and classifying the HR signals of the groups. In conclusion, the Verhulst diagram-based measures are simple and based on the dynamics of the bio-signals, which can be served for quantifying different signals in medical systems.
Collapse
Affiliation(s)
- Atefeh Goshvarpour
- Department of Biomedical Engineering, Faculty of Electrical Engineering, Sahand University of Technology, Tabriz, Iran
| | - Ateke Goshvarpour
- Department of Biomedical Engineering, Imam Reza International University, Mashhad, Razavi Khorasan, Iran. .,Health Technology Research Center, Imam Reza International University, Mashhad, Razavi Khorasan, Iran.
| |
Collapse
|
3
|
Goshvarpour A, Goshvarpour A. Schizophrenia diagnosis using innovative EEG feature-level fusion schemes. AUSTRALASIAN PHYSICAL & ENGINEERING SCIENCES IN MEDICINE 2020; 43:10.1007/s13246-019-00839-1. [PMID: 31898243 DOI: 10.1007/s13246-019-00839-1] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/28/2019] [Accepted: 12/21/2019] [Indexed: 11/25/2022]
Abstract
Electroencephalogram (EEG) has become a practical tool for monitoring and diagnosing pathological/psychological brain states. To date, an increasing number of investigations considered differences between brain dynamic of patients with schizophrenia and healthy controls. However, insufficient studies have been performed to provide an intelligent and accurate system that detects the schizophrenia using EEG signals. This paper concerns this issue by providing new feature-level fusion algorithms. Firstly, we analyze EEG dynamics using three well-known nonlinear measures, including complexity (Cx), Higuchi fractal dimension (HFD), and Lyapunov exponents (Lya). Next, we propose some innovative feature-level fusion strategies to combine the information of these indices. We evaluate the effect of the classifier parameter (σ) adjustment and the cross-validation partitioning criteria on classification accuracy. The performance of EEG classification using combined features was compared with the non-combined attributes. Experimental results showed higher classification accuracy when feature-level features were utilized, compared to when each feature was used individually or all fed to the classifier simultaneously. Using the proposed algorithm, the classification accuracy increased up to 100%. These results establish the suggested framework as a superior scheme compared to the state-of-the-art EEG schizophrenia diagnosis tool.
Collapse
Affiliation(s)
- Atefeh Goshvarpour
- Department of Biomedical Engineering, Faculty of Electrical Engineering, Sahand University of Technology, Tabriz, Iran
| | - Ateke Goshvarpour
- Department of Biomedical Engineering, Imam Reza International University, PO. BOX: 91735-553, Rezvan Campus (Female Students), Phalestine Sq., Mashhad, Razavi Khorasan, Iran.
| |
Collapse
|
4
|
Goshvarpour A, Goshvarpour A. The potential of photoplethysmogram and galvanic skin response in emotion recognition using nonlinear features. AUSTRALASIAN PHYSICAL & ENGINEERING SCIENCES IN MEDICINE 2019; 43:10.1007/s13246-019-00825-7. [PMID: 31776972 DOI: 10.1007/s13246-019-00825-7] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/22/2019] [Accepted: 11/20/2019] [Indexed: 12/15/2022]
Abstract
Recently, developing an accurate automatic emotion recognition system using a minimum number of bio-signals has become a challenging issue in "affective computing." This study aimed to propose a reliable system by examining nonlinear dynamics of photoplethysmogram (PPG) and galvanic skin response (GSR). To address this goal, two strategies were adopted. First, the efficiency of each signal in valence/arousal based emotion categorization was examined. Then, the proficiency of a hybrid feature, by combining both GSR and PPG features was studied. Lyapunov exponents, lagged Poincare's measures, and approximate entropy were extracted to characterize the irregularity and chaotic behavior of the phase space. To discriminate two levels of arousal and two levels of the valence, a probabilistic neural network (PNN) with different sigma adjustment parameter was examined. The results showed that the phase space geometry and consequently, the signal dynamics are influenced by the emotional music video. Additionally, distinctive patterns of the phase space behavior were observed under the influence of different lags. For both signals, the most irregularity was observed during the high valence, and the least irregularity was seen during the low valence. Consequently, signals' irregularity is affected by the valence dimension. The results showed that the fusion has more potential for emotion recognition than that of using each signal separately. For sigma = 0.1, the highest recognition rate was 100% in a subject-dependent mode. In a subject-independent mode, the maximum accuracies of 88.57 and 86.8% were obtained for arousal and valence dimensions, respectively.
Collapse
Affiliation(s)
- Atefeh Goshvarpour
- Department of Biomedical Engineering, Faculty of Electrical Engineering, Sahand University of Technology, Tabriz, Iran
| | - Ateke Goshvarpour
- Department of Biomedical Engineering, Imam Reza International University, Mashhad, Razavi Khorasan, Iran.
- Imam Reza International University, Rezvan Campus (Female Students), Phalestine Sq., PO. BOX 91735-553, Mashhad, Razavi Khorasan, Iran.
| |
Collapse
|
5
|
Idrobo-Ávila EH, Loaiza-Correa H, van Noorden L, Muñoz-Bolaños FG, Vargas-Cañas R. Different Types of Sounds and Their Relationship With the Electrocardiographic Signals and the Cardiovascular System - Review. Front Physiol 2018; 9:525. [PMID: 29872400 PMCID: PMC5972278 DOI: 10.3389/fphys.2018.00525] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2017] [Accepted: 04/24/2018] [Indexed: 01/11/2023] Open
Abstract
Background: For some time now, the effects of sound, noise, and music on the human body have been studied. However, despite research done through time, it is still not completely clear what influence, interaction, and effects sounds have on human body. That is why it is necessary to conduct new research on this topic. Thus, in this paper, a systematic review is undertaken in order to integrate research related to several types of sound, both pleasant and unpleasant, specifically noise and music. In addition, it includes as much research as possible to give stakeholders a more general vision about relevant elements regarding methodologies, study subjects, stimulus, analysis, and experimental designs in general. This study has been conducted in order to make a genuine contribution to this area and to perhaps to raise the quality of future research about sound and its effects over ECG signals. Methods: This review was carried out by independent researchers, through three search equations, in four different databases, including: engineering, medicine, and psychology. Inclusion and exclusion criteria were applied and studies published between 1999 and 2017 were considered. The selected documents were read and analyzed independently by each group of researchers and subsequently conclusions were established between all of them. Results: Despite the differences between the outcomes of selected studies, some common factors were found among them. Thus, in noise studies where both BP and HR increased or tended to increase, it was noted that HRV (HF and LF/HF) changes with both sound and noise stimuli, whereas GSR changes with sound and musical stimuli. Furthermore, LF also showed changes with exposure to noise. Conclusion: In many cases, samples displayed a limitation in experimental design, and in diverse studies, there was a lack of a control group. There was a lot of variability in the presented stimuli providing a wide overview of the effects they could produce in humans. In the listening sessions, there were numerous examples of good practice in experimental design, such as the use of headphones and comfortable positions for study subjects, while the listening sessions lasted 20 min in most of the studies.
Collapse
Affiliation(s)
- Ennio H. Idrobo-Ávila
- Percepción y Sistemas Inteligentes, Escuela de Ingeniería Eléctrica y Electrónica, Universidad del Valle, Cali, Colombia
| | - Humberto Loaiza-Correa
- Percepción y Sistemas Inteligentes, Escuela de Ingeniería Eléctrica y Electrónica, Universidad del Valle, Cali, Colombia
| | - Leon van Noorden
- Institute of Psychoacoustics and Electronic Music for Systematic Musicology, Department of Art, Music and Theatre Sciences, Ghent University, Ghent, Belgium
| | - Flavio G. Muñoz-Bolaños
- Ciencias Fisiológicas Experimentales, Departamento de Ciencias Fisiológicas, Universidad del Cauca, Popayán, Colombia
| | - Rubiel Vargas-Cañas
- Sistemas Dinámicos de Instrumentación y Control, Departamento de Física, Universidad del Cauca, Popayán, Colombia
| |
Collapse
|
6
|
A Novel Feature Level Fusion for Heart Rate Variability Classification Using Correntropy and Cauchy-Schwarz Divergence. J Med Syst 2018; 42:109. [DOI: 10.1007/s10916-018-0961-2] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2018] [Accepted: 04/16/2018] [Indexed: 10/17/2022]
|
7
|
Goshvarpour A, Abbasi A, Goshvarpour A. Do men and women have different ECG responses to sad pictures? Biomed Signal Process Control 2017. [DOI: 10.1016/j.bspc.2017.05.006] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
8
|
Goshvarpour A, Abbasi A, Goshvarpour A. Fusion of heart rate variability and pulse rate variability for emotion recognition using lagged poincare plots. AUSTRALASIAN PHYSICAL & ENGINEERING SCIENCES IN MEDICINE 2017; 40:617-629. [PMID: 28717902 DOI: 10.1007/s13246-017-0571-1] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/13/2017] [Accepted: 07/04/2017] [Indexed: 01/01/2023]
Abstract
Designing an efficient automatic emotion recognition system based on physiological signals has attracted great interests within the research of human-machine interactions. This study was aimed to classify emotional responses by means of a simple dynamic signal processing technique and fusion frameworks. The electrocardiogram and finger pulse activity of 35 participants were recorded during rest condition and when subjects were listening to music intended to stimulate certain emotions. Four emotion categories, including happiness, sadness, peacefulness, and fear were chosen. Estimating heart rate variability (HRV) and pulse rate variability (PRV), 4 Poincare indices in 10 lags were extracted. The support vector machine classifier was used for emotion classification. Both feature level (FL) and decision level (DL) fusion schemes were examined. Significant differences have been observed between lag 1 Poincare plot indices and the other lagged measures. The mean accuracies of 84.1, 82.9, 79.68, and 76.05% were obtained for PRV, DL, FL, and HRV measures, respectively. However, DL outperformed others in discriminating sadness and peacefulness, using SD1 and total features, correspondingly. In both cases, the classification rates improved up to 92% (with the sensitivity of 95% and specificity of 83.33%). Totally, DL resulted in better performances compared to FL. In addition, the impact of the fusion rules on the classification performances has been confirmed.
Collapse
Affiliation(s)
- Atefeh Goshvarpour
- Computational Neuroscience Laboratory, Department of Biomedical Engineering, Faculty of Electrical Engineering, Sahand University of Technology, New Sahand Town, P. O. BOX 51335/1996, Tabriz, Iran
| | - Ataollah Abbasi
- Computational Neuroscience Laboratory, Department of Biomedical Engineering, Faculty of Electrical Engineering, Sahand University of Technology, New Sahand Town, P. O. BOX 51335/1996, Tabriz, Iran.
| | - Ateke Goshvarpour
- Computational Neuroscience Laboratory, Department of Biomedical Engineering, Faculty of Electrical Engineering, Sahand University of Technology, New Sahand Town, P. O. BOX 51335/1996, Tabriz, Iran
| |
Collapse
|