1
|
Alshehri H, Al-Nafjan A, Aldayel M. Decoding Pain: A Comprehensive Review of Computational Intelligence Methods in Electroencephalography-Based Brain-Computer Interfaces. Diagnostics (Basel) 2025; 15:300. [PMID: 39941230 PMCID: PMC11816796 DOI: 10.3390/diagnostics15030300] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2024] [Revised: 01/18/2025] [Accepted: 01/23/2025] [Indexed: 02/16/2025] Open
Abstract
Objective pain evaluation is crucial for determining appropriate treatment strategies in clinical settings. Studies have demonstrated the potential of using brain-computer interface (BCI) technology for pain classification and detection. Collating knowledge and insights from prior studies, this review explores the extensive work on pain detection based on electroencephalography (EEG) signals. It presents the findings, methodologies, and advancements reported in 20 peer-reviewed articles that utilize machine learning and deep learning (DL) approaches for EEG-based pain detection. We analyze various ML and DL techniques, support vector machines, random forests, k-nearest neighbors, and convolution neural network recurrent neural networks and transformers, and their effectiveness in decoding pain neural signals. The motivation for combining AI with BCI technology lies in the potential for significant advancements in the real-time responsiveness and adaptability of these systems. We reveal that DL techniques effectively analyze EEG signals and recognize pain-related patterns. Moreover, we discuss advancements and challenges associated with EEG-based pain detection, focusing on BCI applications in clinical settings and functional requirements for effective pain classification systems. By evaluating the current research landscape, we identify gaps and opportunities for future research to provide valuable insights for researchers and practitioners.
Collapse
Affiliation(s)
- Hadeel Alshehri
- Computer Science Department, College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia
| | - Abeer Al-Nafjan
- Computer Science Department, College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia
| | - Mashael Aldayel
- Information Technology Department, College of Computer and Information Sciences, King Saud University, Riyadh 11543, Saudi Arabia
| |
Collapse
|
2
|
Skaramagkas V, Kyprakis I, Karanasiou GS, Fotiadis DI, Tsiknakis M. A Review on Deep Learning for Quality of Life Assessment Through the Use of Wearable Data. IEEE OPEN JOURNAL OF ENGINEERING IN MEDICINE AND BIOLOGY 2025; 6:261-268. [PMID: 39906266 PMCID: PMC11793860 DOI: 10.1109/ojemb.2025.3526457] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2024] [Revised: 11/26/2024] [Accepted: 01/02/2025] [Indexed: 02/06/2025] Open
Abstract
Quality of Life (QoL) assessment has evolved over time, encompassing diverse aspects of human existence beyond just health. This paper presents a comprehensive review of the integration of Deep Learning (DL) techniques in QoL assessment, focusing on the analysis of wearable data. QoL, as defined by the World Health Organisation, encompasses physical, mental, and social well-being, making it a multifaceted concept. Traditional QoL assessment methods, often reliant on subjective reports or informal questioning, face challenges in quantification and standardization. To address these challenges, DL, a branch of machine learning inspired by the human brain, has emerged as a promising tool. DL models can analyze vast and complex datasets, including patient-reported outcomes, medical images, and physiological signals, enabling a deeper understanding of factors influencing an individual's QoL. Notably, wearable sensory devices have gained prominence, offering real-time data on vital signs and enabling remote healthcare monitoring. This review critically examines DL's role in QoL assessment through the use of wearable data, with particular emphasis on the subdomains of physical and psychological well-being. By synthesizing current research and identifying knowledge gaps, this review provides valuable insights for researchers, clinicians, and policymakers aiming to enhance QoL assessment with DL. Ultimately, the paper contributes to the adoption of advanced technologies to improve the well-being and QoL of individuals from diverse backgrounds.
Collapse
Affiliation(s)
- Vasileios Skaramagkas
- Biomedical Informatics and eHealth LaboratoryDepartment of Electrical and Computer EngineeringHellenic Mediterranean University71410HeraklionGreece
- Institute of Computer ScienceFoundation for Research and Technology Hellas (FORTH)70013HeraklionGreece
| | - Ioannis Kyprakis
- Biomedical Informatics and eHealth LaboratoryDepartment of Electrical and Computer EngineeringHellenic Mediterranean University71410HeraklionGreece
- Institute of Computer ScienceFoundation for Research and Technology Hellas (FORTH)70013HeraklionGreece
- Department of Science et TechniquesUniversity of Burgundy21000DijonFrance
| | - Georgia S. Karanasiou
- Unit of Medical Technology Intelligent Information SystemsUniversity of Ioannina45110IoanninaGreece
- Biomedical Research InstituteFORTH45110IoanninaGreece
| | - Dimitris I. Fotiadis
- Unit of Medical Technology Intelligent Information SystemsUniversity of Ioannina45110IoanninaGreece
- Biomedical Research InstituteFORTH45110IoanninaGreece
| | - Manolis Tsiknakis
- Biomedical Informatics and eHealth LaboratoryDepartment of Electrical and Computer EngineeringHellenic Mediterranean University71410HeraklionGreece
- Institute of Computer ScienceFoundation for Research and Technology Hellas (FORTH)70013HeraklionGreece
| |
Collapse
|
3
|
Shafiee R, Daliri MR. Decoding of pain during heel lancing in human neonates with EEG signal and machine learning approach. Sci Rep 2024; 14:31244. [PMID: 39732802 DOI: 10.1038/s41598-024-82631-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2024] [Accepted: 12/06/2024] [Indexed: 12/30/2024] Open
Abstract
Currently, pain assessment using electroencephalogram signals and machine learning methods in clinical studies is of great importance, especially for those who cannot express their pain. Since newborns are among the high-risk group and always experience pain at the beginning of birth, in this research, the severity of newborns has been investigated and evaluated. Other studies related to the annoyance of newborns have used the EEG signal of newborns alone; therefore, in this study, the intensity of newborn pain was measured using the electroencephalogram signal of 107 infants who were stimulated by the heel lance in three levels: no pain, low pain and moderate pain were recorded as a single trial and evaluated. The support vector machine (SVM), K-Nearest Neighbors (KNN) and Ensemble bagging classifiers were trained using the K-fold cross-validation method and features of the brain's time-frequency domain. The results were obtained with accuracies of 72.8 ± 2, 84.4 ± 1.3 and 82.9 ± 1.6%, respectively. Also, in examining the problem of distinguishing pain and no pain, the electroencephalogram signal of 74 infants was evaluated, and similar to the three-class mode, with the 10-fold validation method, we reached the highest accuracy of 100% in Bagging classifier and 98.6 ± 0.1 accuracy in KNN and SVM classifiers.
Collapse
Affiliation(s)
- Reyhane Shafiee
- Neuroscience & Neuroengineering Research Lab, Biomedical Engineering Department, School of Electrical Engineering, Iran University of Science & Technology (IUST), Narmak, Tehran, Iran
| | - Mohammad Reza Daliri
- Neuroscience & Neuroengineering Research Lab, Biomedical Engineering Department, School of Electrical Engineering, Iran University of Science & Technology (IUST), Narmak, Tehran, Iran.
| |
Collapse
|
4
|
Xia X, Shi Y, Li P, Liu X, Liu J, Men H. FBANet: An Effective Data Mining Method for Food Olfactory EEG Recognition. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:13550-13560. [PMID: 37220050 DOI: 10.1109/tnnls.2023.3269949] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/25/2023]
Abstract
At present, the sensory evaluation of food mostly depends on artificial sensory evaluation and machine perception, but artificial sensory evaluation is greatly interfered with by subjective factors, and machine perception is difficult to reflect human feelings. In this article, a frequency band attention network (FBANet) for olfactory electroencephalogram (EEG) was proposed to distinguish the difference in food odor. First, the olfactory EEG evoked experiment was designed to collect the olfactory EEG, and the preprocessing of olfactory EEG, such as frequency division, was completed. Second, the FBANet consisted of frequency band feature mining and frequency band feature self-attention, in which frequency band feature mining can effectively mine multiband features of olfactory EEG with different scales, and frequency band feature self-attention can integrate the extracted multiband features and realize classification. Finally, compared with other advanced models, the performance of the FBANet was evaluated. The results show that FBANet was better than the state-of-the-art techniques. In conclusion, FBANet effectively mined the olfactory EEG data information and distinguished the differences between the eight food odors, which proposed a new idea for food sensory evaluation based on multiband olfactory EEG analysis.
Collapse
|
5
|
Fu Z, Zhu H, Zhang Y, Huan R, Chen S, Pan Y. A Spatiotemporal Deep Learning Framework for Scalp EEG-Based Automated Pain Assessment in Children. IEEE Trans Biomed Eng 2024; 71:1889-1900. [PMID: 38231823 DOI: 10.1109/tbme.2024.3355215] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/19/2024]
Abstract
OBJECTIVE Common pain assessment approaches such as self-evaluation and observation scales are inappropriate for children as they require patients to have reasonable communication ability. Subjective, inconsistent, and discontinuous pain assessment in children may reduce therapeutic effectiveness and thus affect their later life. METHODS To address the need for suitable assessment measures, this paper proposes a spatiotemporal deep learning framework for scalp electroencephalogram (EEG)-based automated pain assessment in children. The dataset comprises scalp EEG data recorded from 33 pediatric patients with an arterial puncture as a pain stimulus. Two electrode reduction plans in line with clinical findings are proposed. Combining three-dimensional hand-crafted features and preprocessed raw signals, the proposed transformer-based pain assessment network (STPA-Net) integrates both spatial and temporal information. RESULTS STPA-Net achieves superior performance with a subject-independent accuracy of 87.83% for pain recognition, and outperforms other state-of-the-art approaches. The effectiveness of electrode combinations is explored to analyze pain-related cortical activities and correspondingly reduce cost. The two proposed electrode reduction plans both demonstrate competitive pain assessment performance qualitatively and quantitatively. CONCLUSION AND SIGNIFICANCE This study is the first to develop a scalp EEG-based automated pain assessment for children adopting a method that is objective, standardized, and consistent. The findings provide a potential reference for future clinical research.
Collapse
|
6
|
Han Y, Valentini E, Halder S. Validation of Cross-Individual Pain Assessment with Individual Recognition Model from Electroencephalogram. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38083495 DOI: 10.1109/embc40787.2023.10340607] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Cross-individual pain assessment models based on electroencephalography (EEG) allow pain assessment in individuals who cannot report pain (e.g., unresponsive patients). The main obstacle to the generalisation of pain assessment models is the individual variation of brain responses to pain. Hence, we took the individual variation into account in cross-individual model development. We developed two convolutional neural networks (CNN) sharing an encoder architecture. One CNN predicts pain, while the other predicts the identity of an individual. We performed a leave-one-out (LOO) test with the exclusion of each subject and applied evidence accumulation to it for validating the pain prediction model's performance, where the binary classifier involves the states of pain (Hot) and resting state (Eyes-open). The mean accuracy produced by the LOO tests was 57.81% (max: 73.33%), and the mean accuracy of evidence accumulation achieved 69.75% (max: 100.00%). The individual recognition model achieved an accuracy of 99.63%. Nevertheless, when we acquired the most similar subject to a novel subject using the individual recognition model, where the most similar subject was used to train a subject-wise pain prediction model. The accuracy of predicting the pain-related conditions of the novel subject by the subject-wise model was only 53.73% (max: 79.50%). Therefore, the approach to utilising the features related to individual variation extracted by the CNN model needs more investigation for improving cross-individual pain assessment.Clinical relevance- This model can be applied to assess pain from EEG signals at the bedside with future improvement, which can help caretakers of unresponsive patients.
Collapse
|
7
|
Gkikas S, Tsiknakis M. Automatic assessment of pain based on deep learning methods: A systematic review. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 231:107365. [PMID: 36764062 DOI: 10.1016/j.cmpb.2023.107365] [Citation(s) in RCA: 22] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Revised: 01/06/2023] [Accepted: 01/21/2023] [Indexed: 06/18/2023]
Abstract
BACKGROUND AND OBJECTIVE The automatic assessment of pain is vital in designing optimal pain management interventions focused on reducing suffering and preventing the functional decline of patients. In recent years, there has been a surge in the adoption of deep learning algorithms by researchers attempting to encode the multidimensional nature of pain into meaningful features. This systematic review aims to discuss the models, the methods, and the types of data employed in establishing the foundation of a deep learning-based automatic pain assessment system. METHODS The systematic review was conducted by identifying original studies searching digital libraries, namely Scopus, IEEE Xplore, and ACM Digital Library. Inclusion and exclusion criteria were applied to retrieve and select those of interest, published until December 2021. RESULTS A total of one hundred and ten publications were identified and categorized by the number of information channels used (unimodal versus multimodal approaches) and whether the temporal dimension was also used. CONCLUSIONS This review demonstrates the importance of multimodal approaches for automatic pain estimation, especially in clinical settings, and also reveals that significant improvements are observed when the temporal exploitation of modalities is included. It provides suggestions regarding better-performing deep architectures and learning methods. Also, it provides suggestions for adopting robust evaluation protocols and interpretation methods to provide objective and comprehensible results. Furthermore, the review presents the limitations of the available pain databases for optimally supporting deep learning model development, validation, and application as decision-support tools in real-life scenarios.
Collapse
Affiliation(s)
- Stefanos Gkikas
- Department of Electrical and Computer Engineering, Hellenic Mediterranean University, Estavromenos, Heraklion, 71410, Greece; Computational BioMedicine Laboratory, Institute of Computer Science, Foundation for Research & Technology-Hellas, Vassilika Vouton, Heraklion, 70013, Greece.
| | - Manolis Tsiknakis
- Department of Electrical and Computer Engineering, Hellenic Mediterranean University, Estavromenos, Heraklion, 71410, Greece; Computational BioMedicine Laboratory, Institute of Computer Science, Foundation for Research & Technology-Hellas, Vassilika Vouton, Heraklion, 70013, Greece.
| |
Collapse
|
8
|
Pouromran F, Lin Y, Kamarthi S. Personalized Deep Bi-LSTM RNN Based Model for Pain Intensity Classification Using EDA Signal. SENSORS (BASEL, SWITZERLAND) 2022; 22:8087. [PMID: 36365785 PMCID: PMC9654781 DOI: 10.3390/s22218087] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/13/2022] [Revised: 10/11/2022] [Accepted: 10/12/2022] [Indexed: 06/16/2023]
Abstract
Automatic pain intensity assessment from physiological signals has become an appealing approach, but it remains a largely unexplored research topic. Most studies have used machine learning approaches built on carefully designed features based on the domain knowledge available in the literature on the time series of physiological signals. However, a deep learning framework can automate the feature engineering step, enabling the model to directly deal with the raw input signals for real-time pain monitoring. We investigated a personalized Bidirectional Long short-term memory Recurrent Neural Networks (BiLSTM RNN), and an ensemble of BiLSTM RNN and Extreme Gradient Boosting Decision Trees (XGB) for four-category pain intensity classification. We recorded Electrodermal Activity (EDA) signals from 29 subjects during the cold pressor test. We decomposed EDA signals into tonic and phasic components and augmented them to original signals. The BiLSTM-XGB model outperformed the BiLSTM classification performance and achieved an average F1-score of 0.81 and an Area Under the Receiver Operating Characteristic curve (AUROC) of 0.93 over four pain states: no pain, low pain, medium pain, and high pain. We also explored a concatenation of the deep-learning feature representations and a set of fourteen knowledge-based features extracted from EDA signals. The XGB model trained on this fused feature set showed better performance than when it was trained on component feature sets individually. This study showed that deep learning could let us go beyond expert knowledge and benefit from the generated deep representations of physiological signals for pain assessment.
Collapse
Affiliation(s)
| | | | - Sagar Kamarthi
- Department of Mechanical and Industrial Engineering, Northeastern University, Boston, MA 02115, USA
| |
Collapse
|
9
|
Han Y, Valentini E, Halder S. Classification of Tonic Pain Experience based on Phase Connectivity in the Alpha Frequency Band of the Electroencephalogram using Convolutional Neural Networks. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:3542-3545. [PMID: 36086245 DOI: 10.1109/embc48229.2022.9871353] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
The complexity of brain activity involved in the generation of the experience of pain makes it hard to identify neural markers able to predict pain states. The within and between subjects variability of pain hinders the predictive potential of machine learning models trained across participants. This challenge can be tackled by implementing deep learning classifiers based on convolutional neural networks (CNNs). We targeted phase-based connectivity in the alpha band recorded with electroencephalography (EEG) during resting states and sensory conditions (eyes open [O] and closed [C] as resting states, and warm [W] and hot [H] water as sensory conditions). Connectivity features were extracted and re-organized as square matrices, because CNNs are effective in detecting the patterns from 2D data. To assess the classifier performance we implemented two complementary approaches: we 1) trained and tested the classifier with data from all participants, and 2) using a leave-one-out approach, that is excluding one participant at a time during training while using their data as a test set. The accuracy of binary classification between pain condition (H) and eyes open resting state (O) was 94.16% with the first approach, and 61.01 % with the leave-one-out approach. Clinical relevance-Further validation of the CNN classifier may help caregivers track the rehabilitation of chronic pain patients and dynamically modify the therapy. Further refinement of the model may allow its application in critical care setting with unresponsive patients to identify pain-like states otherwise incommunicable to medical personnel.
Collapse
|
10
|
Savignac C, Ocay DD, Mahdid Y, Blain-Moraes S, Ferland CE. Clinical use of Electroencephalography in the Assessment of Acute Thermal Pain: A Narrative Review Based on Articles From 2009 to 2019. Clin EEG Neurosci 2022; 53:124-132. [PMID: 34133245 DOI: 10.1177/15500594211026280] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
Nowadays, no practical system has successfully been able to decode and predict pain in clinical settings. The inability of some patients to verbally express their pain creates the need for a tool that could objectively assess pain in these individuals. Neuroimaging techniques combined with machine learning are seen as possible candidates for the identification of pain biomarkers. This review aimed to address the potential use of electroencephalographic features as predictors of acute experimental pain. Twenty-six studies using only thermal stimulations were identified using a PubMed and Scopus search. Combinations of the following terms were used: "EEG," "Electroencephalography," "Acute," "Pain," "Tonic," "Noxious," "Thermal," "Stimulation," "Brain," "Activity," "Cold," "Subjective," and "Perception." Results revealed that contact-heat-evoked potentials have been widely recorded over central areas during noxious heat stimulations. Furthermore, a decrease in alpha power over central regions was revealed, as well as increased theta and gamma powers over frontal areas. Gamma and theta rhythms were associated with connectivity between sensory and affective regions involved in pain processing. A machine learning analysis revealed that the gamma band is a predominant predictor of acute thermal pain. This review also addressed the need of supplementing current spectral features with techniques that allow the investigation of network dynamics.
Collapse
Affiliation(s)
- Chloé Savignac
- 5620McGill University, Montreal, Quebec, Canada.,70357Shriners Hospitals for Children-Canada, Montreal, Quebec, Canada
| | - Don Daniel Ocay
- 5620McGill University, Montreal, Quebec, Canada.,70357Shriners Hospitals for Children-Canada, Montreal, Quebec, Canada
| | | | | | - Catherine E Ferland
- 5620McGill University, Montreal, Quebec, Canada.,70357Shriners Hospitals for Children-Canada, Montreal, Quebec, Canada.,Research Institute-McGill University Health Centre, Montreal, Quebec, Canada
| |
Collapse
|
11
|
Lin Y, Xiao Y, Wang L, Guo Y, Zhu W, Dalip B, Kamarthi S, Schreiber KL, Edwards RR, Urman RD. Experimental Exploration of Objective Human Pain Assessment Using Multimodal Sensing Signals. Front Neurosci 2022; 16:831627. [PMID: 35221908 PMCID: PMC8874020 DOI: 10.3389/fnins.2022.831627] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2021] [Accepted: 01/07/2022] [Indexed: 11/17/2022] Open
Abstract
Optimization of pain assessment and treatment is an active area of research in healthcare. The purpose of this research is to create an objective pain intensity estimation system based on multimodal sensing signals through experimental studies. Twenty eight healthy subjects were recruited at Northeastern University. Nine physiological modalities were utilized in this research, namely facial expressions (FE), electroencephalography (EEG), eye movement (EM), skin conductance (SC), and blood volume pulse (BVP), electromyography (EMG), respiration rate (RR), skin temperature (ST), blood pressure (BP). Statistical analysis and machine learning algorithms were deployed to analyze the physiological data. FE, EEG, SC, BVP, and BP proved to be able to detect different pain states from healthy subjects. Multi-modalities proved to be promising in detecting different levels of painful states. A decision-level multi-modal fusion also proved to be efficient and accurate in classifying painful states.
Collapse
Affiliation(s)
- Yingzi Lin
- Intelligent Human Machine Systems Laboratory, College of Engineering, Northeastern University, Boston, MA, United States
- *Correspondence: Yingzi Lin,
| | - Yan Xiao
- College of Nursing and Health Innovation, University of Texas at Arlington, Arlington, TX, United States
| | - Li Wang
- Intelligent Human Machine Systems Laboratory, College of Engineering, Northeastern University, Boston, MA, United States
| | - Yikang Guo
- Intelligent Human Machine Systems Laboratory, College of Engineering, Northeastern University, Boston, MA, United States
| | - Wenchao Zhu
- Intelligent Human Machine Systems Laboratory, College of Engineering, Northeastern University, Boston, MA, United States
| | - Biren Dalip
- Intelligent Human Machine Systems Laboratory, College of Engineering, Northeastern University, Boston, MA, United States
| | - Sagar Kamarthi
- Intelligent Human Machine Systems Laboratory, College of Engineering, Northeastern University, Boston, MA, United States
| | - Kristin L. Schreiber
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women’s Hospital, Harvard University, Boston, MA, United States
| | - Robert R. Edwards
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women’s Hospital, Harvard University, Boston, MA, United States
| | - Richard D. Urman
- Department of Anesthesiology, Perioperative and Pain Medicine, Brigham and Women’s Hospital, Harvard University, Boston, MA, United States
| |
Collapse
|
12
|
Guo Y, Wang L, Xiao Y, Lin Y. A Personalized Spatial-Temporal Cold Pain Intensity Estimation Model Based on Facial Expression. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2021; 9:4901008. [PMID: 34650836 PMCID: PMC8500272 DOI: 10.1109/jtehm.2021.3116867] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/24/2021] [Revised: 07/07/2021] [Accepted: 08/30/2021] [Indexed: 11/10/2022]
Abstract
OBJECTIVE Pain assessment is of great importance in both clinical research and patient care. Facial expression analysis is becoming a key part of pain detection because it is convenient, automatic, and real-time. The aim of this study is to present a cold pain intensity estimation experiment, investigate the importance of the spatial-temporal information on facial expression based cold pain, and study the performance of the personalized model as well as the generalized model. METHODS A cold pain experiment was carried out and facial expressions from 29 subjects were extracted. Three different architectures (Inception V3, VGG-LSTM, and Convolutional LSTM) were used to estimate three intensities of cold pain: No pain, Moderate pain, and Severe Pain. Architectures with Sequential information were compared with single-frame architecture, showing the importance of spatial-temporal information on pain estimation. The performances of the personalized model and the generalized model were also compared. RESULTS A mean F1 score of 79.48% was achieved using Convolutional LSTM based on the personalized model. CONCLUSION This study demonstrates the potential for the estimation of cold pain intensity from facial expression analysis and shows that the personalized spatial-temporal framework has better performance in cold pain intensity estimation. SIGNIFICANCE This cold pain intensity estimator could allow convenient, automatic, and real-time use to provide continuous objective pain intensity estimations of subjects and patients.
Collapse
Affiliation(s)
- Yikang Guo
- Intelligent Human-Machine Systems LabMechanical and Industrial Engineering DepartmentCollege of Engineering, Northeastern UniversityBostonMA02115USA
| | - Li Wang
- Intelligent Human-Machine Systems LabMechanical and Industrial Engineering DepartmentCollege of Engineering, Northeastern UniversityBostonMA02115USA
| | - Yan Xiao
- College of Nursing and Health InnovationUniversity of Texas at ArlingtonArlingtonTX76019USA
| | - Yingzi Lin
- Intelligent Human-Machine Systems LabMechanical and Industrial Engineering DepartmentCollege of Engineering, Northeastern UniversityBostonMA02115USA
| |
Collapse
|
13
|
Mari T, Henderson J, Maden M, Nevitt S, Duarte R, Fallon N. Systematic Review of the Effectiveness of Machine Learning Algorithms for Classifying Pain Intensity, Phenotype or Treatment Outcomes Using Electroencephalogram Data. THE JOURNAL OF PAIN 2021; 23:349-369. [PMID: 34425248 DOI: 10.1016/j.jpain.2021.07.011] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/15/2021] [Revised: 06/25/2021] [Accepted: 07/27/2021] [Indexed: 11/17/2022]
Abstract
Recent attempts to utilize machine learning (ML) to predict pain-related outcomes from Electroencephalogram (EEG) data demonstrate promising results. The primary aim of this review was to evaluate the effectiveness of ML algorithms for predicting pain intensity, phenotypes or treatment response from EEG. Electronic databases MEDLINE, EMBASE, Web of Science, PsycINFO and The Cochrane Library were searched. A total of 44 eligible studies were identified, with 22 presenting attempts to predict pain intensity, 15 investigating the prediction of pain phenotypes and seven assessing the prediction of treatment response. A meta-analysis was not considered appropriate for this review due to heterogenos methods and reporting. Consequently, data were narratively synthesized. The results demonstrate that the best performing model of the individual studies allows for the prediction of pain intensity, phenotypes and treatment response with accuracies ranging between 62 to 100%, 57 to 99% and 65 to 95.24%, respectively. The results suggest that ML has the potential to effectively predict pain outcomes, which may eventually be used to assist clinical care. However, inadequate reporting and potential bias reduce confidence in the results. Future research should improve reporting standards and externally validate models to decrease bias, which would increase the feasibility of clinical translation. PERSPECTIVE: This systematic review explores the state-of-the-art machine learning methods for predicting pain intensity, phenotype or treatmentresponse from EEG data. Results suggest that machine learning may demonstrate clinical utility, pending further research and development. Areas for improvement, including standardized processing, reporting and the need for better methodological assessment tools, are discussed.
Collapse
Affiliation(s)
- Tyler Mari
- Department of Psychology, University of Liverpool, Liverpool, UK.
| | | | - Michelle Maden
- Department of Health Data Science, Liverpool Reviews and Implementation Group, University of Liverpool, Liverpool, UK
| | - Sarah Nevitt
- Department of Health Data Science, Liverpool Reviews and Implementation Group, University of Liverpool, Liverpool, UK
| | - Rui Duarte
- Department of Health Data Science, Liverpool Reviews and Implementation Group, University of Liverpool, Liverpool, UK
| | - Nicholas Fallon
- Department of Psychology, University of Liverpool, Liverpool, UK
| |
Collapse
|
14
|
Exploration of physiological sensors, features, and machine learning models for pain intensity estimation. PLoS One 2021; 16:e0254108. [PMID: 34242325 PMCID: PMC8270203 DOI: 10.1371/journal.pone.0254108] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2020] [Accepted: 06/20/2021] [Indexed: 11/19/2022] Open
Abstract
In current clinical settings, typically pain is measured by a patient’s self-reported information. This subjective pain assessment results in suboptimal treatment plans, over-prescription of opioids, and drug-seeking behavior among patients. In the present study, we explored automatic objective pain intensity estimation machine learning models using inputs from physiological sensors. This study uses BioVid Heat Pain Dataset. We extracted features from Electrodermal Activity (EDA), Electrocardiogram (ECG), Electromyogram (EMG) signals collected from study participants subjected to heat pain. We built different machine learning models, including Linear Regression, Support Vector Regression (SVR), Neural Networks and Extreme Gradient Boosting for continuous value pain intensity estimation. Then we identified the physiological sensor, feature set and machine learning model that give the best predictive performance. We found that EDA is the most information-rich sensor for continuous pain intensity prediction. A set of only 3 features from EDA signals using SVR model gave an average performance of 0.93 mean absolute error (MAE) and 1.16 root means square error (RMSE) for the subject-independent model and of 0.92 MAE and 1.13 RMSE for subject-dependent. The MAE achieved with signal-feature-model combination is less than 1 unit on 0 to 4 continues pain scale, which is smaller than the MAE achieved by the methods reported in the literature. These results demonstrate that it is possible to estimate pain intensity of a patient using a computationally inexpensive machine learning model with 3 statistical features from EDA signal which can be collected from a wrist biosensor. This method paves a way to developing a wearable pain measurement device.
Collapse
|
15
|
An experimental study of objective pain measurement using pupillary response based on genetic algorithm and artificial neural network. APPL INTELL 2021. [DOI: 10.1007/s10489-021-02458-4] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
|
16
|
Gong S, Xing K, Cichocki A, Li J. Deep Learning in EEG: Advance of the Last Ten-Year Critical Period. IEEE Trans Cogn Dev Syst 2021. [DOI: 10.1109/tcds.2021.3079712] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
17
|
Abstract
Neural oscillations play an important role in the integration and segregation of brain regions that are important for brain functions, including pain. Disturbances in oscillatory activity are associated with several disease states, including chronic pain. Studies of neural oscillations related to pain have identified several functional bands, especially alpha, beta, and gamma bands, implicated in nociceptive processing. In this review, we introduce several properties of neural oscillations that are important to understand the role of brain oscillations in nociceptive processing. We also discuss the role of neural oscillations in the maintenance of efficient communication in the brain. Finally, we discuss the role of neural oscillations in healthy and chronic pain nociceptive processing. These data and concepts illustrate the key role of regional and interregional neural oscillations in nociceptive processing underlying acute and chronic pains.
Collapse
Affiliation(s)
- Junseok A. Kim
- Division of Brain, Imaging and Behaviour, Krembil Brain Institute, Krembil Research Institute, University Health Network, Toronto, Ontario, Canada
- Institute of Medical Science, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Karen D. Davis
- Division of Brain, Imaging and Behaviour, Krembil Brain Institute, Krembil Research Institute, University Health Network, Toronto, Ontario, Canada
- Institute of Medical Science, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
- Department of Surgery, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
18
|
Tripanpitak K, Viriyavit W, Huang SY, Yu W. Classification of Pain Event Related Potential for Evaluation of Pain Perception Induced by Electrical Stimulation. SENSORS (BASEL, SWITZERLAND) 2020; 20:E1491. [PMID: 32182766 PMCID: PMC7085779 DOI: 10.3390/s20051491] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/19/2019] [Revised: 12/30/2019] [Accepted: 01/04/2020] [Indexed: 12/11/2022]
Abstract
Variability in individual pain sensitivity is a major problem in pain assessment. There have been studies reported using pain-event related potential (pain-ERP) for evaluating pain perception. However, none of them has achieved high accuracy in estimating multiple pain perception levels. A major reason lies in the lack of investigation of feature extraction. The goal of this study is to assess four different pain perception levels through classification of pain-ERP, elicited by transcutaneous electrical stimulation on healthy subjects. Nonlinear methods: Higuchi's fractal dimension, Grassberger-Procaccia correlation dimension, with auto-correlation, and moving variance functions were introduced into the feature extraction. Fisher score was used to select the most discriminative channels and features. As a result, the correlation dimension with a moving variance without channel selection achieved the best accuracies of 100% for both the two-level and the three-level classification but degraded to 75% for the four-level classification. The best combined feature group is the variance-based one, which achieved accuracy of 87.5% and 100% for the four-level and three-level classification, respectively. Moreover, the features extracted from less than 20 trials could not achieve sensible accuracy, which makes it difficult for an instantaneous pain perception levels evaluation. These results show strong evidence on the possibility of objective pain assessment using nonlinear feature-based classification of pain-ERP.
Collapse
Affiliation(s)
- Kornkanok Tripanpitak
- Department of Medical Engineering, Graduate School of Science and Engineering, Chiba University, Chiba 263-8522, Japan; (K.T.); (W.V.)
| | - Waranrach Viriyavit
- Department of Medical Engineering, Graduate School of Science and Engineering, Chiba University, Chiba 263-8522, Japan; (K.T.); (W.V.)
- School of ICT, Sirindhorn International Institute of Technology, Thammasat University, Pathum Thani 12120, Thailand
| | - Shao Ying Huang
- Engineering Product Design, Singapore University of Technology and Design, 8 Somapah Road, Singapore 487372, Singapore;
| | - Wenwei Yu
- Department of Medical Engineering, Graduate School of Science and Engineering, Chiba University, Chiba 263-8522, Japan; (K.T.); (W.V.)
- Center for Frontier Medical Engineering, Chiba University, Chiba 263-8522, Japan
| |
Collapse
|
19
|
Naranjo-Hernández D, Reina-Tosina J, Roa LM. Sensor Technologies to Manage the Physiological Traits of Chronic Pain: A Review. SENSORS (BASEL, SWITZERLAND) 2020; 20:E365. [PMID: 31936420 PMCID: PMC7014460 DOI: 10.3390/s20020365] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/31/2019] [Revised: 01/03/2020] [Accepted: 01/05/2020] [Indexed: 12/15/2022]
Abstract
Non-oncologic chronic pain is a common high-morbidity impairment worldwide and acknowledged as a condition with significant incidence on quality of life. Pain intensity is largely perceived as a subjective experience, what makes challenging its objective measurement. However, the physiological traces of pain make possible its correlation with vital signs, such as heart rate variability, skin conductance, electromyogram, etc., or health performance metrics derived from daily activity monitoring or facial expressions, which can be acquired with diverse sensor technologies and multisensory approaches. As the assessment and management of pain are essential issues for a wide range of clinical disorders and treatments, this paper reviews different sensor-based approaches applied to the objective evaluation of non-oncological chronic pain. The space of available technologies and resources aimed at pain assessment represent a diversified set of alternatives that can be exploited to address the multidimensional nature of pain.
Collapse
Affiliation(s)
- David Naranjo-Hernández
- Biomedical Engineering Group, University of Seville, 41092 Seville, Spain; (J.R.-T.); (L.M.R.)
| | | | | |
Collapse
|