1
|
Yasemin M, Cruz A, Nunes UJ, Pires G. Single trial detection of error-related potentials in brain-machine interfaces: a survey and comparison of methods. J Neural Eng 2023; 20. [PMID: 36595316 DOI: 10.1088/1741-2552/acabe9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Accepted: 12/15/2022] [Indexed: 12/23/2022]
Abstract
Objective.Error-related potential (ErrP) is a potential elicited in the brain when humans perceive an error. ErrPs have been researched in a variety of contexts, such as to increase the reliability of brain-computer interfaces (BCIs), increase the naturalness of human-machine interaction systems, teach systems, as well as study clinical conditions. Still, there is a significant challenge in detecting ErrP from a single trial, which may hamper its effective use. The literature presents ErrP detection accuracies quite variable across studies, which raises the question of whether this variability depends more on classification pipelines or on the quality of elicited ErrPs (mostly directly related to the underlying paradigms).Approach.With this purpose, 11 datasets have been used to compare several classification pipelines which were selected according to the studies that reported online performance above 75%. We also analyze the effects of different steps of the pipelines, such as resampling, window selection, augmentation, feature extraction, and classification.Main results.From our analysis, we have found that shrinkage-regularized linear discriminant analysis is the most robust method for classification, and for feature extraction, using Fisher criterion beamformer spatial features and overlapped window averages result in better classification performance. The overall experimental results suggest that classification accuracy is highly dependent on user tasks in BCI experiments and on signal quality (in terms of ErrP morphology, signal-to-noise ratio (SNR), and discrimination).Significance.This study contributes to the BCI research field by responding to the need for a guideline that can direct researchers in designing ErrP-based BCI tasks by accelerating the design steps.
Collapse
Affiliation(s)
- Mine Yasemin
- Institute of Systems and Robotics (ISR-UC), University of Coimbra, Coimbra, Portugal.,Department of Electrical and Computer Engineering, University of Coimbra, Coimbra, Portugal
| | - Aniana Cruz
- Institute of Systems and Robotics (ISR-UC), University of Coimbra, Coimbra, Portugal
| | - Urbano J Nunes
- Institute of Systems and Robotics (ISR-UC), University of Coimbra, Coimbra, Portugal.,Department of Electrical and Computer Engineering, University of Coimbra, Coimbra, Portugal
| | - Gabriel Pires
- Institute of Systems and Robotics (ISR-UC), University of Coimbra, Coimbra, Portugal.,Engineering Department, Polytechnic Institute of Tomar, Tomar, Portugal
| |
Collapse
|
2
|
Iliadou V, Kakkos I, Karaiskos P, Kouloulias V, Platoni K, Zygogianni A, Matsopoulos GK. Early Prediction of Planning Adaptation Requirement Indication Due to Volumetric Alterations in Head and Neck Cancer Radiotherapy: A Machine Learning Approach. Cancers (Basel) 2022; 14:cancers14153573. [PMID: 35892831 PMCID: PMC9331795 DOI: 10.3390/cancers14153573] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2022] [Revised: 07/14/2022] [Accepted: 07/20/2022] [Indexed: 11/16/2022] Open
Abstract
Background: During RT cycles, the tumor response pattern could affect tumor coverage and may lead to organs at risk of overdose. As such, early prediction of significant volumetric changes could therefore reduce potential radiation-related adverse effects. Nevertheless, effective machine learning approaches based on the radiomic features of the clinically used CBCT images to determine the tumor volume variations due to RT not having been implemented so far. Methods: CBCT images from 40 HN cancer patients were collected weekly during RT treatment. From the obtained images, the Clinical Target Volume (CTV) and Parotid Glands (PG) regions of interest were utilized to calculate 104 delta-radiomics features. These features were fed on a feature selection and classification procedure for the early prediction of significant volumetric alterations. Results: The proposed framework was able to achieve 0.90 classification performance accuracy while detecting a small subset of discriminative characteristics from the 1st week of RT. The selected features were further analyzed regarding their effects on temporal changes in anatomy and tumor response modeling. Conclusion: The use of machine learning algorithms offers promising perspectives for fast and reliable early prediction of large volumetric deviations as a result of RT treatment, exploiting hidden patterns in the overall anatomical characteristics.
Collapse
Affiliation(s)
- Vasiliki Iliadou
- School of Electrical and Computer Engineering, National Technical University of Athens, 157 73 Athens, Greece; (I.K.); (G.K.M.)
- Correspondence: ; Tel.: +30-21-0772-3577
| | - Ioannis Kakkos
- School of Electrical and Computer Engineering, National Technical University of Athens, 157 73 Athens, Greece; (I.K.); (G.K.M.)
- Department of Biomedical Engineering, University of West Attica, 122 43 Athens, Greece
| | - Pantelis Karaiskos
- Medical Physics Laboratory, Medical School, National and Kapodistrian University of Athens, 115 27 Athens, Greece;
| | - Vassilis Kouloulias
- 2nd Department of Radiology, Radiotherapy Unit, ATTIKON University Hospital, 124 62 Athens, Greece; (V.K.); (K.P.)
| | - Kalliopi Platoni
- 2nd Department of Radiology, Radiotherapy Unit, ATTIKON University Hospital, 124 62 Athens, Greece; (V.K.); (K.P.)
| | - Anna Zygogianni
- 1st Department of Radiology, Radiotherapy Unit, ARETAIEION University Hospital, 115 28 Athens, Greece;
| | - George K. Matsopoulos
- School of Electrical and Computer Engineering, National Technical University of Athens, 157 73 Athens, Greece; (I.K.); (G.K.M.)
| |
Collapse
|
3
|
Tang Y, Zhang JJ, Corballis PM, Hallum LE. Towards the Classification of Error-Related Potentials using Riemannian Geometry. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:5905-5908. [PMID: 34892463 DOI: 10.1109/embc46164.2021.9629583] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The error-related potential (ErrP) is an event-related potential (ERP) evoked by an experimental participant's recognition of an error during task performance. ErrPs, originally described by cognitive psychologists, have been adopted for use in brain-computer interfaces (BCIs) for the detection and correction of errors, and the online refinement of decoding algorithms. Riemannian geometry-based feature extraction and classification is a new approach to BCI which shows good performance in a range of experimental paradigms, but has yet to be applied to the classification of ErrPs. Here, we describe an experiment that elicited ErrPs in seven normal participants performing a visual discrimination task. Audio feedback was provided on each trial. We used multi-channel electroencephalogram (EEG) recordings to classify ErrPs (success/failure), comparing a Riemannian geometry-based method to a traditional approach that computes time-point features. Overall, the Riemannian approach outperformed the traditional approach (78.2% versus 75.9% accuracy, p <0.05); this difference was statistically significant (p <0.05) in three of seven participants. These results indicate that the Riemannian approach better captured the features from feedback-elicited ErrPs, and may have application in BCI for error detection and correction.
Collapse
|
4
|
Usama N, Niazi IK, Dremstrup K, Jochumsen M. Detection of Error-Related Potentials in Stroke Patients from EEG Using an Artificial Neural Network. SENSORS 2021; 21:s21186274. [PMID: 34577481 PMCID: PMC8472485 DOI: 10.3390/s21186274] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/07/2021] [Revised: 09/14/2021] [Accepted: 09/17/2021] [Indexed: 11/26/2022]
Abstract
Error-related potentials (ErrPs) have been proposed as a means for improving brain-computer interface (BCI) performance by either correcting an incorrect action performed by the BCI or label data for continuous adaptation of the BCI to improve the performance. The latter approach could be relevant within stroke rehabilitation where BCI calibration time could be minimized by using a generalized classifier that is continuously being individualized throughout the rehabilitation session. This may be achieved if data are correctly labelled. Therefore, the aims of this study were: (1) classify single-trial ErrPs produced by individuals with stroke, (2) investigate test-retest reliability, and (3) compare different classifier calibration schemes with different classification methods (artificial neural network, ANN, and linear discriminant analysis, LDA) with waveform features as input for meaningful physiological interpretability. Twenty-five individuals with stroke operated a sham BCI on two separate days where they attempted to perform a movement after which they received feedback (error/correct) while continuous EEG was recorded. The EEG was divided into epochs: ErrPs and NonErrPs. The epochs were classified with a multi-layer perceptron ANN based on temporal features or the entire epoch. Additionally, the features were classified with shrinkage LDA. The features were waveforms of the ErrPs and NonErrPs from the sensorimotor cortex to improve the explainability and interpretation of the output of the classifiers. Three calibration schemes were tested: within-day, between-day, and across-participant. Using within-day calibration, 90% of the data were correctly classified with the entire epoch as input to the ANN; it decreased to 86% and 69% when using temporal features as input to ANN and LDA, respectively. There was poor test-retest reliability between the two days, and the other calibration schemes led to accuracies in the range of 63-72% with LDA performing the best. There was no association between the individuals' impairment level and classification accuracies. The results show that ErrPs can be classified in individuals with stroke, but that user- and session-specific calibration is needed for optimal ErrP decoding with this approach. The use of ErrP/NonErrP waveform features makes it possible to have a physiological meaningful interpretation of the output of the classifiers. The results may have implications for labelling data continuously in BCIs for stroke rehabilitation and thus potentially improve the BCI performance.
Collapse
Affiliation(s)
- Nayab Usama
- Department of Health Science and Technology, Aalborg University, 9000 Aalborg, Denmark; (N.U.); (K.D.); (M.J.)
| | - Imran Khan Niazi
- Department of Health Science and Technology, Aalborg University, 9000 Aalborg, Denmark; (N.U.); (K.D.); (M.J.)
- Centre for Chiropractic Research, New Zealand College of Chiropractic, Auckland 1060, New Zealand
- Health and Rehabilitation Research Institute, AUT University, Auckland 0627, New Zealand
- Correspondence: ; Tel.: +64-9-526-6789
| | - Kim Dremstrup
- Department of Health Science and Technology, Aalborg University, 9000 Aalborg, Denmark; (N.U.); (K.D.); (M.J.)
| | - Mads Jochumsen
- Department of Health Science and Technology, Aalborg University, 9000 Aalborg, Denmark; (N.U.); (K.D.); (M.J.)
| |
Collapse
|
5
|
Wang H, Liu X, Li J, Xu T, Bezerianos A, Sun Y, Wan F. Driving Fatigue Recognition With Functional Connectivity Based on Phase Synchronization. IEEE Trans Cogn Dev Syst 2021. [DOI: 10.1109/tcds.2020.2985539] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
6
|
Xu R, Wang Y, Shi X, Wang N, Ming D. The Effect of Static and Dynamic Visual Stimulations on Error Detection Based on Error-Evoked Brain Responses. SENSORS 2020; 20:s20164475. [PMID: 32785187 PMCID: PMC7472474 DOI: 10.3390/s20164475] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/15/2020] [Revised: 07/13/2020] [Accepted: 07/30/2020] [Indexed: 12/03/2022]
Abstract
Error-related potentials (ErrPs) have provided technical support for the brain-computer interface. However, different visual stimulations may affect the ErrPs, and furthermore, affect the error recognition based on ErrPs. Therefore, the study aimed to investigate how people respond to different visual stimulations (static and dynamic) and find the best time window for different stimulation. Nineteen participants were recruited in the ErrPs-based tasks with static and dynamic visual stimulations. Five ErrPs were statistically compared, and the classification accuracies were obtained through linear discriminant analysis (LDA) with nine different time windows. The results showed that the P3, N6, and P8 with correctness were significantly different from those with error in both stimulations, while N1 only existed in static. The differences between dynamic and static errors existed in N1 and P2. The highest accuracy was obtained in the time window related to N1, P3, N6, and P8 for the static condition, and in the time window related to P3, N6, and P8 for the dynamic. In conclusion, the early components of ErrPs may be affected by stimulation modes, and the late components are more sensitive to errors. The error recognition with static stimulation requires information from the entire epoch, while the late windows should be focused more within the dynamic case.
Collapse
Affiliation(s)
- Rui Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, China; (R.X.); (Y.W.)
- Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China; (X.S.); (N.W.)
| | - Yaoyao Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, China; (R.X.); (Y.W.)
| | - Xianle Shi
- Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China; (X.S.); (N.W.)
| | - Ningning Wang
- Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China; (X.S.); (N.W.)
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, China; (R.X.); (Y.W.)
- Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China; (X.S.); (N.W.)
- Correspondence:
| |
Collapse
|