1
|
Falach R, Belonosov G, Schmidig JF, Aderka M, Zhelezniakov V, Shani-Hershkovich R, Bar E, Nir Y. SleepEEGpy: a Python-based software integration package to organize preprocessing, analysis, and visualization of sleep EEG data. Comput Biol Med 2025; 192:110232. [PMID: 40288293 DOI: 10.1016/j.compbiomed.2025.110232] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2024] [Revised: 04/14/2025] [Accepted: 04/16/2025] [Indexed: 04/29/2025]
Abstract
Sleep research uses electroencephalography (EEG) to infer brain activity in health and disease. Beyond standard sleep scoring, there is growing interest in advanced EEG analysis that requires extensive preprocessing to improve the signal-to-noise ratio and specialized analysis algorithms. While many EEG software packages exist, sleep research has unique needs (e.g., specific artifacts, event detection). Currently, sleep investigators use different libraries for specific tasks in a 'fragmented' configuration that is inefficient, prone to errors, and requires the learning of multiple software environments. This complexity creates a barrier for beginners. Here, we present SleepEEGpy, an open-source Python package that simplifies sleep EEG preprocessing and analysis. SleepEEGpy builds on MNE-Python, PyPREP, YASA, and SpecParam to offer an all-in-one, beginner-friendly package for comprehensive sleep EEG research, including (i) cleaning, (ii) independent component analysis, (iii) sleep event detection, (iv) spectral feature analysis, and visualization tools. A dedicated dashboard provides an overview to evaluate data and preprocessing, serving as an initial step prior to detailed analysis. We demonstrate SleepEEGpy's functionalities using overnight high-density EEG data from healthy participants, revealing characteristic activity signatures typical of each vigilance state: alpha oscillations in wakefulness, spindles and slow waves in NREM sleep, and theta activity in REM sleep. We hope that this software will be adopted and further developed by the sleep research community, and constitute a useful entry point tool for beginners in sleep EEG research.
Collapse
Affiliation(s)
- R Falach
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
| | - G Belonosov
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
| | - J F Schmidig
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel; Department of Physiology and Pharmacology, Faculty of Medical and Health Sciences, Tel Aviv University, Tel Aviv, Israel
| | - M Aderka
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
| | - V Zhelezniakov
- Department of Physiology and Pharmacology, Faculty of Medical and Health Sciences, Tel Aviv University, Tel Aviv, Israel
| | - R Shani-Hershkovich
- The Sieratzki-Sagol Center for Sleep Medicine, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
| | - E Bar
- Department of Physiology and Pharmacology, Faculty of Medical and Health Sciences, Tel Aviv University, Tel Aviv, Israel; Department of Brain Sciences, Weizmann Institute of Science, Rehovot, Israel
| | - Y Nir
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel; Department of Physiology and Pharmacology, Faculty of Medical and Health Sciences, Tel Aviv University, Tel Aviv, Israel; The Sieratzki-Sagol Center for Sleep Medicine, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel; Department of Biomedical Engineering, Faculty of Engineering, Tel Aviv University, Tel Aviv, Israel; Sagol Brain Institute, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel.
| |
Collapse
|
2
|
He J, Karel JMH, Janssen MLF, Gommer ED, Vossen CJ, Hortal E. Predicting Intraoperative Burst Suppression Using Preoperative EEG and Patient Characteristics. Int J Neural Syst 2025:2550033. [PMID: 40230258 DOI: 10.1142/s0129065725500339] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/16/2025]
Abstract
Burst suppression (BS) is an electroencephalogram (EEG) pattern observed in patients undergoing general anesthesia. The occurrence of BS is associated with adverse outcomes such as postoperative delirium, extended recovery time, and increased postoperative mortality. The detection and prediction of BS can help expedite the evaluation of patient conditions, optimize anesthesia administration, and improve patient safety. This study explores the potential for automatic BS detection using intraoperative EEG and BS prediction using preoperative EEG signals and patient characteristics. A dataset comprising 287 patients who underwent carotid endarterectomy procedures at Maastricht University Medical Center+ was analyzed. An EEG toolbox developed by T. Zhan at the Massachusetts Institute of Technology was utilized for the automatic detection/annotation of BS, while five machine learning classifiers were employed to predict BS occurrence using preoperative data. Based on the 160 patients manually annotated by EEG experts (regarding the presence or absence of BS), the automatic detection tool demonstrated an accuracy of 0.75. For the BS prediction task, an initial subset of 120 patients was evaluated, showing modest performance, with the K-nearest neighbors ([Formula: see text]) classifier achieving the best results, with an accuracy of 0.72. Subsequent experiments indicated that increasing the number of patients (by using Zhan's Toolbox to annotate the unlabeled instances), applying SMOTE to balance the training set, and enriching the feature set was beneficial. The final experiment demonstrated a significant improvement, with Random Forest and Gradient Boosting outperforming other classifiers, achieving an accuracy of 0.86 and ROC-AUC of 0.94. Patient characteristics, including type of anesthetic agents, symptoms, age, mean absolute delta power, mean absolute theta power, and cognitive impairment, were identified by an xAI method as important features potentially indicating the predisposition to experience BS.
Collapse
Affiliation(s)
- Jingyi He
- Department of Advanced Computing Sciences, Maastricht University, 6211 LK Maastricht, The Netherlands
| | - Joël M H Karel
- Department of Advanced Computing Sciences, Maastricht University, 6211 LK Maastricht, The Netherlands
| | - Marcus L F Janssen
- Department of Clinical Neurophysiology, Maastricht University Medical Center, 6229 HX Maastricht, The Netherlands
| | - Erik D Gommer
- Department of Clinical Neurophysiology, Maastricht University Medical Center, 6229 HX Maastricht, The Netherlands
| | - Catherine J Vossen
- Department of Anesthesiology and Pain Medicine, Maastricht University Medical Center, 6229 HX Maastricht, The Netherlands
| | - Enrique Hortal
- Department of Advanced Computing Sciences, Maastricht University, 6211 LK Maastricht, The Netherlands
| |
Collapse
|
3
|
Meng M, Chen G, Chen S, Ma Y, Gao Y, Luo Z. DGPDR: discriminative geometric perception dimensionality reduction of SPD matrices on Riemannian manifold for EEG classification. Comput Methods Biomech Biomed Engin 2025:1-11. [PMID: 40083123 DOI: 10.1080/10255842.2025.2476184] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2024] [Revised: 02/03/2025] [Accepted: 02/28/2025] [Indexed: 03/16/2025]
Abstract
Manifold learning with Symmetric Positive Definite (SPD) matrices has demonstrated potential for classifying Electroencephalography (EEG) in Brain-Computer Interface (BCI) applications. However, SPD matrices may lead to crucial information loss of EEG signals. This paper proposes a dimensionality reduction method based on discriminative geometric perception on the Riemannian manifold to enhance SPD matrix discriminability. Experiments on BCI Competition IV Dataset 1 and Dataset 2a show the proposed method improves accuracy by 5.0% and 19.38% respectively, demonstrating that applying discriminative geometric perception can effectively maintain robust performance associated with the dimensionality-reduced SPD matrix.
Collapse
Affiliation(s)
- Ming Meng
- International Joint Research Laboratory for Autonomous Robotic Systems, Hangzhou Dianzi University, Hangzhou, Zhejiang, China
- School of Automation, Hangzhou Dianzi University, Hangzhou, China
| | - Guanzhen Chen
- School of Automation, Hangzhou Dianzi University, Hangzhou, China
| | - Siqi Chen
- School of Automation, Hangzhou Dianzi University, Hangzhou, China
| | - Yuliang Ma
- International Joint Research Laboratory for Autonomous Robotic Systems, Hangzhou Dianzi University, Hangzhou, Zhejiang, China
- School of Automation, Hangzhou Dianzi University, Hangzhou, China
| | - Yunyuan Gao
- International Joint Research Laboratory for Autonomous Robotic Systems, Hangzhou Dianzi University, Hangzhou, Zhejiang, China
- School of Automation, Hangzhou Dianzi University, Hangzhou, China
| | - Zhizeng Luo
- School of Automation, Hangzhou Dianzi University, Hangzhou, China
| |
Collapse
|
4
|
Scanlon JEM, Küppers D, Büürma A, Winneke AH. Mind the road: attention related neuromarkers during automated and manual simulated driving captured with a new mobile EEG sensor system. FRONTIERS IN NEUROERGONOMICS 2025; 6:1542379. [PMID: 40144305 PMCID: PMC11937089 DOI: 10.3389/fnrgo.2025.1542379] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/09/2024] [Accepted: 02/21/2025] [Indexed: 03/28/2025]
Abstract
Background Decline in vigilance due to fatigue is a common concern in traffic safety. Partially automated driving (PAD) systems can aid driving but decrease the driver's vigilance over time, due to reduced task engagement. Mobile EEG solutions can obtain neural information while operating a vehicle. The purpose of this study was to investigate how the behavior and brain activity associated with vigilance (i.e., alpha, beta and theta power) differs between PAD and manual driving, as well as changes over time, and how these effects can be detected using two different EEG systems. Methods Twenty-eight participants performed two 1-h simulated driving tasks, while wearing both a standard 24 channel EEG cap and a newly developed, unobtrusive and easy to apply 10 channel mobile EEG sensor-grid system. One scenario required manual control of the vehicle (manual) while the other required only monitoring the vehicle (PAD). Additionally, lane deviation, percentage eye-closure (PERCLOS) and subjective ratings of workload, fatigue and stress were obtained. Results Alpha, beta and theta power of the EEG as well as PERCLOS were higher in the PAD condition and increased over time in both conditions. The same spectral EEG effects were evident in both EEG systems. Lane deviation as an index of driving performance in the manual driving condition increased over time. Conclusion These effects indicate significant increases in fatigue and vigilance decrement over time while driving, and overall higher levels of fatigue and vigilance decrement associated with PAD. The EEG measures revealed significant effects earlier than the behavioral measures, demonstrating that EEG might allow faster detection of decreased vigilance than behavioral driving measures. This new, mobile EEG-grid system could be used to evaluate and improve driver monitoring systems in the field or even be used in the future as additional sensor to inform drivers of critical changes in their level of vigilance. In addition to driving, further areas of application for this EEG-sensor grid are safety critical work environments where vigilance monitoring is pivotal.
Collapse
Affiliation(s)
| | - Daniel Küppers
- Fraunhofer Institute for Digital Media Technology, Branch Hearing, Speech and Audio Technology, Oldenburg, Germany
| | - Anneke Büürma
- Fraunhofer Institute for Digital Media Technology, Branch Hearing, Speech and Audio Technology, Oldenburg, Germany
- Institute of Cognitive Science, University of Osnabrück, Osnabrück, Germany
| | - Axel Heinrich Winneke
- Fraunhofer Institute for Digital Media Technology, Branch Hearing, Speech and Audio Technology, Oldenburg, Germany
| |
Collapse
|
5
|
Wang X, Hu R, Wang T, Chang Y, Liu X, Li M, Gao Y, Liu S, Ming D. Resting-State Electroencephalographic Signatures Predict Treatment Efficacy of tACS for Refractory Auditory Hallucinations in Schizophrenic Patients. IEEE J Biomed Health Inform 2025; 29:1886-1896. [PMID: 40030555 DOI: 10.1109/jbhi.2024.3509438] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/05/2025]
Abstract
Transcranial alternating current stimulation (tACS) has been reported to treat refractory auditory hallucinations in schizophrenia. Despite diligent efforts, it is imperative to underscore that tACS does not uniformly demonstrate efficacy across all patients as with all treatments currently employed in clinical practice. The study aims to find biomarkers predicting individual responses to tACS, guiding treatment decisions, and preventing healthcare resource wastage. We divided 17 schizophrenic patients with refractory auditory hallucinations into responsive(RE) and non-responsive(NR) groups based on their auditory hallucination symptom reduction rates after one month of tACS treatment. The pre-treatment resting-state electroencephalogram(rsEEG) was recorded and then computed absolute power spectral density (PSD), Hjorth parameters (HPs, Hjorth activity (HA), Hjorth mobility (HM), and Hjorth complexity (HC) included) from different frequency bands to portray the brain oscillations. The results demonstrated that statistically significant differences localized within the high gamma frequency bands of the right brain hemisphere. Immediately, we input the significant dissociable features into popular machine learning algorithms, the Cascade Forward Neural Network achieved the best recognition accuracy of 93.87%. These findings preliminarily imply that high gamma oscillations in the right brain hemisphere may be the main influencing factor leading to different responses to tACS treatment, and incorporating rsEEG signatures could improve personalized decisions for integrating tACS in clinical treatment.
Collapse
|
6
|
Wang X, Zhang X, Chang Y, Liao J, Liu S, Ming D. Double-blind, randomized, placebo-controlled pilot clinical trial with gamma-band transcranial alternating current stimulation for the treatment of schizophrenia refractory auditory hallucinations. Transl Psychiatry 2025; 15:36. [PMID: 39885141 PMCID: PMC11782534 DOI: 10.1038/s41398-025-03256-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Revised: 12/15/2024] [Accepted: 01/23/2025] [Indexed: 02/01/2025] Open
Abstract
Gamma oscillations are essential for brain communication. The 40 Hz neural oscillation deficits in schizophrenia impair left frontotemporal connectivity and information communication, causing auditory hallucinations. Transcranial alternating current stimulation is thought to enhance connectivity between different brain regions by modulating brain oscillations. In this work, we applied a frontal-temporal-parietal 40 Hz-tACS stimulation strategy for treating auditory hallucinations and further explored the effect of tACS on functional connectivity of brain networks. 32 schizophrenia patients with refractory auditory hallucinations received 20daily 20-min, 40 Hz, 1 mA sessions of active or sham tACS on weekdays for 4 consecutive weeks, followed by a 2-week follow-up period without stimulation. Auditory hallucination symptom scores and 64-channel electroencephalograms were measured at baseline, week2, week4 and follow-up. For clinical symptom score, we observed a significant interaction between group and time for auditory hallucinations symptoms (F(3,90) = 26.964, p < 0.001), and subsequent analysis showed that the 40Hz-tACS group had a higher symptom reduction rate than the sham group at week4 (p = 0.036) and follow-up (p = 0.047). Multiple comparisons of corrected EEG results showed that the 40Hz-tACS group had higher functional connectivity in the right frontal to parietal (F (1,30) = 7.24, p = 0.012) and right frontal to occipital (F (1,30) = 7.98, p = 0.008) than the sham group at week4. Further, functional brain network controllability outcomes showed that the 40Hz-tACS group had increased average controllability (F (1,30) = 6.26, p = 0.018) and decreased modality controllability (F (1,30) = 6.50, p = 0.016) in the right frontal lobe compared to the sham group. Our polit study indicates that 40Hz-tACS combined with medicine may be an effective treatment for targeting symptoms specific to auditory hallucinations and altering functional connectivity and controllability at the network level.
Collapse
Affiliation(s)
- Xiaojuan Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Xiaochen Zhang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Yuan Chang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Jingmeng Liao
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Shuang Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China.
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| |
Collapse
|
7
|
Wu CS, Lin TX, Lo YH, Ke SC, Sahu PP, Tseng P. Single-session gamma sensory stimulation entrains real-time electroencephalography but does not enhance perception, attention, short-term memory, or long-term memory. J Alzheimers Dis Rep 2025; 9:25424823241311927. [PMID: 40034515 PMCID: PMC11864247 DOI: 10.1177/25424823241311927] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2024] [Accepted: 11/26/2024] [Indexed: 03/05/2025] Open
Abstract
Background Studies have shown that gamma (40 Hz) audiovisual stimulation can enhance gamma oscillations and improve cognitive functioning in patients with Alzheimer's disease. However, despite promising long-term results, the efficacy of short-duration or single-session 40 Hz entrainment in humans has been questioned by behavioral studies that fail to find observable cognitive aftereffects, for two possible reasons: 1) lack of validated gamma entrainment, as most studies lacked concurrent electroencephalography (EEG) data to verify that gamma neural entrainment did take place, and 2) lack of diverse cognitive tests, as most studies did not test a wide range of cognitive factors. Objective This study aimed to increase sensitivity for detecting single-session gamma entrainment. We employed 1) mid- and post-stimulation EEG monitoring to ensure entrainment worked, and 2) a comprehensive cognitive battery that probes perception, attention, working memory, and long-term memory. Methods Participants received 30 min of synchronized 40 Hz light and sound stimulation, followed by a visual perceptual task, attentional network task, change detection working memory task, and long-term picture memory task, with concurrent EEG. Results We observed robust 40 Hz EEG entrainment during stimulation but no significant 40 Hz oscillation after stimulation, and no significant cognitive improvements. Conclusions Despite robust 40 Hz online entrainment, gamma sensory entrainment requires consistent long-term exposure to induce cognitive and neurological changes. Future research should determine the optimal duration and frequency of 40 Hz stimulation to maximize its therapeutic potential.
Collapse
Affiliation(s)
- Cai-Syuan Wu
- School of Medicine, Taipei Medical University, Taipei, Taiwan
| | - Ting-Xuan Lin
- School of Medicine, Taipei Medical University, Taipei, Taiwan
| | - Yu-Hui Lo
- Department of Psychology, National Taiwan University, Taipei, Taiwan
| | - Shih-Chiang Ke
- Department of General Medicine, Taipei Medical University Hospital, Taipei, Taiwan
| | - Prangya Parimita Sahu
- Graduate Institute of Mind, Brain and Consciousness, Taipei Medical University, Taipei, Taiwan
| | - Philip Tseng
- Department of Psychology, National Taiwan University, Taipei, Taiwan
| |
Collapse
|
8
|
Hazarika D, Vishnu KN, Ransing R, Gupta CN. Dynamical Embedding of Single-Channel Electroencephalogram for Artifact Subspace Reconstruction. SENSORS (BASEL, SWITZERLAND) 2024; 24:6734. [PMID: 39460214 PMCID: PMC11510769 DOI: 10.3390/s24206734] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/30/2024] [Revised: 10/07/2024] [Accepted: 10/12/2024] [Indexed: 10/28/2024]
Abstract
This study introduces a novel framework to apply the artifact subspace reconstruction (ASR) algorithm on single-channel electroencephalogram (EEG) data. ASR is known for its ability to remove artifacts like eye-blinks and movement but traditionally relies on multiple channels. Embedded ASR (E-ASR) addresses this by incorporating a dynamical embedding approach. In this method, an embedded matrix is created from single-channel EEG data using delay vectors, followed by ASR application and reconstruction of the cleaned signal. Data from four subjects with eyes open were collected using Fp1 and Fp2 electrodes via the CameraEEG android app. The E-ASR algorithm was evaluated using metrics like relative root mean square error (RRMSE), correlation coefficient (CC), and average power ratio. The number of eye-blinks with and without the E-ASR approach was also estimated. E-ASR achieved an RRMSE of 43.87% and had a CC of 0.91 on semi-simulated data and effectively reduced artifacts in real EEG data, with eye-blink counts validated against ground truth video data. This framework shows potential for smartphone-based EEG applications in natural environments with minimal electrodes.
Collapse
Affiliation(s)
- Doli Hazarika
- Neural Engineering Lab, Department of Biosciences and Bioengineering, Indian Institute of Technology, Guwahati 781039, India; (D.H.); (K.N.V.)
| | - K. N. Vishnu
- Neural Engineering Lab, Department of Biosciences and Bioengineering, Indian Institute of Technology, Guwahati 781039, India; (D.H.); (K.N.V.)
| | - Ramdas Ransing
- Department of Psychiatry, Clinical Neurosciences, and Addiction Medicine, All India Institute of Medical Sciences, Guwahati 781101, India;
| | - Cota Navin Gupta
- Neural Engineering Lab, Department of Biosciences and Bioengineering, Indian Institute of Technology, Guwahati 781039, India; (D.H.); (K.N.V.)
| |
Collapse
|
9
|
Ronca V, Capotorto R, Di Flumeri G, Giorgi A, Vozzi A, Germano D, Virgilio VD, Borghini G, Cartocci G, Rossi D, Inguscio BMS, Babiloni F, Aricò P. Optimizing EEG Signal Integrity: A Comprehensive Guide to Ocular Artifact Correction. Bioengineering (Basel) 2024; 11:1018. [PMID: 39451394 PMCID: PMC11505294 DOI: 10.3390/bioengineering11101018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2024] [Revised: 09/30/2024] [Accepted: 10/08/2024] [Indexed: 10/26/2024] Open
Abstract
Ocular artifacts, including blinks and saccades, pose significant challenges in the analysis of electroencephalographic (EEG) data, often obscuring crucial neural signals. This tutorial provides a comprehensive guide to the most effective methods for correcting these artifacts, with a focus on algorithms designed for both laboratory and real-world settings. We review traditional approaches, such as regression-based techniques and Independent Component Analysis (ICA), alongside more advanced methods like Artifact Subspace Reconstruction (ASR) and deep learning-based algorithms. Through detailed step-by-step instructions and comparative analysis, this tutorial equips researchers with the tools necessary to maintain the integrity of EEG data, ensuring accurate and reliable results in neurophysiological studies. The strategies discussed are particularly relevant for wearable EEG systems and real-time applications, reflecting the growing demand for robust and adaptable solutions in applied neuroscience.
Collapse
Affiliation(s)
- Vincenzo Ronca
- Department of Computer, Control, and Management Engineering, Sapienza University of Rome, 00185 Roma, Italy; (D.G.); (V.D.V.); (B.M.S.I.); or (P.A.)
- BrainSigns S.r.l., Industrial Neurosciences Lab, 00198 Rome, Italy; (G.D.F.); (A.G.); (A.V.); (G.B.); (G.C.); (F.B.)
| | - Rossella Capotorto
- Department of Anatomical, Histological, Forensic and Orthopaedic Sciences, Sapienza University of Rome, 00185 Roma, Italy;
| | - Gianluca Di Flumeri
- BrainSigns S.r.l., Industrial Neurosciences Lab, 00198 Rome, Italy; (G.D.F.); (A.G.); (A.V.); (G.B.); (G.C.); (F.B.)
- Department of Molecular Medicine, Sapienza University of Rome, 00185 Roma, Italy;
| | - Andrea Giorgi
- BrainSigns S.r.l., Industrial Neurosciences Lab, 00198 Rome, Italy; (G.D.F.); (A.G.); (A.V.); (G.B.); (G.C.); (F.B.)
- Department of Anatomical, Histological, Forensic and Orthopaedic Sciences, Sapienza University of Rome, 00185 Roma, Italy;
| | - Alessia Vozzi
- BrainSigns S.r.l., Industrial Neurosciences Lab, 00198 Rome, Italy; (G.D.F.); (A.G.); (A.V.); (G.B.); (G.C.); (F.B.)
| | - Daniele Germano
- Department of Computer, Control, and Management Engineering, Sapienza University of Rome, 00185 Roma, Italy; (D.G.); (V.D.V.); (B.M.S.I.); or (P.A.)
| | - Valerio Di Virgilio
- Department of Computer, Control, and Management Engineering, Sapienza University of Rome, 00185 Roma, Italy; (D.G.); (V.D.V.); (B.M.S.I.); or (P.A.)
| | - Gianluca Borghini
- BrainSigns S.r.l., Industrial Neurosciences Lab, 00198 Rome, Italy; (G.D.F.); (A.G.); (A.V.); (G.B.); (G.C.); (F.B.)
- Department of Molecular Medicine, Sapienza University of Rome, 00185 Roma, Italy;
| | - Giulia Cartocci
- BrainSigns S.r.l., Industrial Neurosciences Lab, 00198 Rome, Italy; (G.D.F.); (A.G.); (A.V.); (G.B.); (G.C.); (F.B.)
- Department of Molecular Medicine, Sapienza University of Rome, 00185 Roma, Italy;
| | - Dario Rossi
- Department of Molecular Medicine, Sapienza University of Rome, 00185 Roma, Italy;
| | - Bianca M. S. Inguscio
- Department of Computer, Control, and Management Engineering, Sapienza University of Rome, 00185 Roma, Italy; (D.G.); (V.D.V.); (B.M.S.I.); or (P.A.)
- BrainSigns S.r.l., Industrial Neurosciences Lab, 00198 Rome, Italy; (G.D.F.); (A.G.); (A.V.); (G.B.); (G.C.); (F.B.)
| | - Fabio Babiloni
- BrainSigns S.r.l., Industrial Neurosciences Lab, 00198 Rome, Italy; (G.D.F.); (A.G.); (A.V.); (G.B.); (G.C.); (F.B.)
- Department of Physiology and Pharmacology “Vittorio Erspamer”, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Rome, Italy
- College of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou 310005, China
| | - Pietro Aricò
- Department of Computer, Control, and Management Engineering, Sapienza University of Rome, 00185 Roma, Italy; (D.G.); (V.D.V.); (B.M.S.I.); or (P.A.)
- BrainSigns S.r.l., Industrial Neurosciences Lab, 00198 Rome, Italy; (G.D.F.); (A.G.); (A.V.); (G.B.); (G.C.); (F.B.)
| |
Collapse
|
10
|
Yu Y, Li Y, Zhou Y, Wang Y, Wang J. A Learnable and Explainable Wavelet Neural Network for EEG Artifacts Detection and Classification. IEEE Trans Neural Syst Rehabil Eng 2024; 32:3358-3368. [PMID: 39213275 DOI: 10.1109/tnsre.2024.3452315] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/04/2024]
Abstract
Electroencephalography (EEG) artifacts are very common in clinical diagnosis and can heavily impact diagnosis. Manual screening of artifact events is labor-intensive with little benefit. Therefore, exploring algorithms for automatic detection and classification of EEG artifacts can significantly assist clinical diagnosis. In this paper, we propose a learnable and explainable wavelet neural network (WaveNet) for EEG artifact detection and classification. The model is powered by the wavelet decomposition block based on invertible neural network, which can extract signal features without information loss, and a tree generator for building wavelet tree structure automatically. They provide the model with good feature extraction capabilities and explainability. To evaluate the model's performance more fairly, we introduce the base point level matching score (BASE) and the Event-Aligned Compensation Scoring (EACS) at the event level as two metrics for model performance evaluation. On the challenging Temple University EEG Artifact (TUAR) dataset, our model outperforms other baselines in terms of F1-score for both artifact detection and classification tasks. The case study also validates the model's ability to offer explainability for predictions based on frequency band energy, suggesting potential applications in clinical diagnosis.
Collapse
|
11
|
Razavi M, Ziyadidegan S, Mahmoudzadeh A, Kazeminasab S, Baharlouei E, Janfaza V, Jahromi R, Sasangohar F. Machine Learning, Deep Learning, and Data Preprocessing Techniques for Detecting, Predicting, and Monitoring Stress and Stress-Related Mental Disorders: Scoping Review. JMIR Ment Health 2024; 11:e53714. [PMID: 39167782 PMCID: PMC11375388 DOI: 10.2196/53714] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/16/2023] [Revised: 05/01/2024] [Accepted: 05/17/2024] [Indexed: 08/23/2024] Open
Abstract
BACKGROUND Mental stress and its consequent mental health disorders (MDs) constitute a significant public health issue. With the advent of machine learning (ML), there is potential to harness computational techniques for better understanding and addressing mental stress and MDs. This comprehensive review seeks to elucidate the current ML methodologies used in this domain to pave the way for enhanced detection, prediction, and analysis of mental stress and its subsequent MDs. OBJECTIVE This review aims to investigate the scope of ML methodologies used in the detection, prediction, and analysis of mental stress and its consequent MDs. METHODS Using a rigorous scoping review process with PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines, this investigation delves into the latest ML algorithms, preprocessing techniques, and data types used in the context of stress and stress-related MDs. RESULTS A total of 98 peer-reviewed publications were examined for this review. The findings highlight that support vector machine, neural network, and random forest models consistently exhibited superior accuracy and robustness among all ML algorithms examined. Physiological parameters such as heart rate measurements and skin response are prevalently used as stress predictors due to their rich explanatory information concerning stress and stress-related MDs, as well as the relative ease of data acquisition. The application of dimensionality reduction techniques, including mappings, feature selection, filtering, and noise reduction, is frequently observed as a crucial step preceding the training of ML algorithms. CONCLUSIONS The synthesis of this review identified significant research gaps and outlines future directions for the field. These encompass areas such as model interpretability, model personalization, the incorporation of naturalistic settings, and real-time processing capabilities for the detection and prediction of stress and stress-related MDs.
Collapse
Affiliation(s)
- Moein Razavi
- Department of Industrial and Systems Engineering, Texas A&M University, College Station, TX, United States
- Department of Computer Science and Engineering, Texas A&M University, College Station, TX, United States
| | - Samira Ziyadidegan
- Department of Industrial and Systems Engineering, Texas A&M University, College Station, TX, United States
| | - Ahmadreza Mahmoudzadeh
- Zachry Department of Civil and Environmental Engineering, Texas A&M University, College Station, TX, United States
| | - Saber Kazeminasab
- Harvard Medical School, Harvard University, Boston, MA, United States
| | - Elaheh Baharlouei
- Department of Computer Science, University of Houston, Houston, TX, United States
| | - Vahid Janfaza
- Department of Computer Science and Engineering, Texas A&M University, College Station, TX, United States
| | - Reza Jahromi
- Department of Industrial and Systems Engineering, Texas A&M University, College Station, TX, United States
- Department of Computer Science and Engineering, Texas A&M University, College Station, TX, United States
| | - Farzan Sasangohar
- Department of Industrial and Systems Engineering, Texas A&M University, College Station, TX, United States
| |
Collapse
|
12
|
Gorshkov O, Ombao H. Assessment of Fractal Synchronization during an Epileptic Seizure. ENTROPY (BASEL, SWITZERLAND) 2024; 26:666. [PMID: 39202136 PMCID: PMC11353581 DOI: 10.3390/e26080666] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/10/2024] [Revised: 07/31/2024] [Accepted: 08/01/2024] [Indexed: 09/03/2024]
Abstract
In this paper, we define fractal synchronization (FS) based on the idea of stochastic synchronization and propose a mathematical apparatus for estimating FS. One major advantage of our proposed approach is that fractal synchronization makes it possible to estimate the aggregate strength of the connection on multiple time scales between two projections of the attractor, which are time series with a fractal structure. We believe that one of the promising uses of FS is the assessment of the interdependence of encephalograms. To demonstrate this approach in evaluating the cross-dependence between channels in a network of electroencephalograms, we evaluated the FS of encephalograms during an epileptic seizure. Fractal synchronization demonstrates the presence of desynchronization during an epileptic seizure.
Collapse
Affiliation(s)
- Oleg Gorshkov
- Statistics Program, King Abdullah University of Science and Technology, Thuwal 23955, Saudi Arabia;
| | | |
Collapse
|
13
|
Grasso-Cladera A, Bremer M, Ladouce S, Parada F. A systematic review of mobile brain/body imaging studies using the P300 event-related potentials to investigate cognition beyond the laboratory. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2024; 24:631-659. [PMID: 38834886 DOI: 10.3758/s13415-024-01190-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 04/15/2024] [Indexed: 06/06/2024]
Abstract
The P300 ERP component, related to the onset of task-relevant or infrequent stimuli, has been widely used in the Mobile Brain/Body Imaging (MoBI) literature. This systematic review evaluates the quality and breadth of P300 MoBI studies, revealing a maturing field with well-designed research yet grappling with standardization and global representation challenges. While affirming the reliability of measuring P300 ERP components in mobile settings, the review identifies significant hurdles in standardizing data cleaning and processing techniques, impacting comparability and reproducibility. Geographical disparities emerge, with studies predominantly in the Global North and a dearth of research from the Global South, emphasizing the need for broader inclusivity to counter the WEIRD bias in psychology. Collaborative projects and mobile EEG systems showcase the feasibility of reaching diverse populations, which is essential to advance precision psychiatry and to integrate varied data streams. Methodologically, a trend toward ecological validity is noted, shifting from lab-based to real-world settings with portable EEG system advancements. Future hardware developments are expected to balance signal quality and sensor intrusiveness, enriching data collection in everyday contexts. Innovative methodologies reflect a move toward more natural experimental settings, prompting critical questions about the applicability of traditional ERP markers, such as the P300 outside structured paradigms. The review concludes by highlighting the crucial role of integrating mobile technologies, physiological sensors, and machine learning to advance cognitive neuroscience. It advocates for an operational definition of ecological validity to bridge the gap between controlled experiments and the complexity of embodied cognitive experiences, enhancing both theoretical understanding and practical application in study design.
Collapse
Affiliation(s)
| | - Marko Bremer
- Facultad de Psicología, Centro de Estudios en Neurociencia Humana y Neuropsicología (CENHN), Diego Portales University, Santiago, Chile
- Facultad de Psicología, Programa de Magíster en Neurociencia Social, Diego Portales University, Santiago, Chile
| | - Simon Ladouce
- Department Brain and Cognition, Leuven Brain Institute, KU Leuven, Leuven, Belgium
| | - Francisco Parada
- Facultad de Psicología, Centro de Estudios en Neurociencia Humana y Neuropsicología (CENHN), Diego Portales University, Santiago, Chile.
| |
Collapse
|
14
|
Marchant S, van der Vaart M, Pillay K, Baxter L, Bhatt A, Fitzgibbon S, Hartley C, Slater R. A machine learning artefact detection method for single-channel infant event-related potential studies. J Neural Eng 2024; 21:046021. [PMID: 38925111 PMCID: PMC11250100 DOI: 10.1088/1741-2552/ad5c04] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Revised: 06/04/2024] [Accepted: 06/26/2024] [Indexed: 06/28/2024]
Abstract
Objective. Automated detection of artefact in stimulus-evoked electroencephalographic (EEG) data recorded in neonates will improve the reproducibility and speed of analysis in clinical research compared with manual identification of artefact. Some studies use very short, single-channel epochs of EEG data with little recorded EEG per infant-for example because the clinical vulnerability of the infants limits access for recording. Current artefact-detection methods that perform well on adult data and resting-state and multi-channel data in infants are not suitable for this application. The aim of this study was to create and test an automated method of detecting artefact in single-channel 1500 ms epochs of infant EEG.Approach. A total of 410 epochs of EEG were used, collected from 160 infants of 28-43 weeks postmenstrual age. This dataset-which was balanced to include epochs of background activity and responses to visual, auditory, tactile and noxious stimuli-was presented to seven independent raters, who independently labelled the epochs according to whether or not they were able to visually identify artefacts. The data was split into a training set (340 epochs) and an independent test set (70 epochs). A random forest model was trained to identify epochs as either artefact or not artefact.Main results. This model performs well, achieving a balanced accuracy of 0.81, which is as good as manual review of data. Accuracy was not significantly related to the infant age or type of stimulus.Significance. This method provides an objective tool for automated artefact rejection for short epoch, single-channel EEG in neonates and could increase the utility of EEG in neonates in both the clinical and research setting.
Collapse
Affiliation(s)
- Simon Marchant
- Department of Paediatrics, University of Oxford, Oxford, United Kingdom
| | | | - Kirubin Pillay
- Department of Paediatrics, University of Oxford, Oxford, United Kingdom
| | - Luke Baxter
- Department of Paediatrics, University of Oxford, Oxford, United Kingdom
| | - Aomesh Bhatt
- Department of Paediatrics, University of Oxford, Oxford, United Kingdom
| | - Sean Fitzgibbon
- FMRIB, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Caroline Hartley
- Department of Paediatrics, University of Oxford, Oxford, United Kingdom
| | - Rebeccah Slater
- Department of Paediatrics, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
15
|
Lee TW, Tramontano G. Neural consequences of 5-Hz transcranial alternating current stimulation over right hemisphere: An eLORETA EEG study. Neurosci Lett 2024; 835:137849. [PMID: 38825146 DOI: 10.1016/j.neulet.2024.137849] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2024] [Revised: 05/06/2024] [Accepted: 05/30/2024] [Indexed: 06/04/2024]
Abstract
INTRODUCTION Transcranial alternating current stimulation (tACS) at 5-Hz to the right hemisphere can effectively alleviate anxiety symptoms. This study aimed to explore the neural mechanisms that drive the therapeutic benefits. METHODS We collected electroencephalography (EEG) data from 24 participants with anxiety disorders before and after a tACS treatment session. tACS was applied over the right hemisphere, with 1.0 mA at F4, 1.0 mA at P4, and 2.0 mA at T8 (10-10 EEG convention). With eLORETA, we transformed the scalp signals into the current source density in the cortex. We then assessed the differences between post- and pre-treatment brain maps across multiple spectra (delta to low gamma) with non-parametric statistics. RESULTS We observed a trend of heightened power in alpha and reduced power in mid-to-high beta and low gamma, in accord with the EEG markers of anxiolytic effects reported in previous studies. Additionally, we observed a consistent trend of de-synchronization at the stimulating sites across spectra. CONCLUSION tACS 5-Hz over the right hemisphere demonstrated EEG markers of anxiety reduction. The after-effects of tACS on the brain are intricate and cannot be explained solely by the widely circulated entrainment theory. Rather, our results support the involvement of plasticity mechanisms in the offline effects of tACS.
Collapse
Affiliation(s)
- Tien-Wen Lee
- The NeuroCognitive Institute (NCI) Clinical Research Foundation, NJ 07856, USA
| | - Gerald Tramontano
- The NeuroCognitive Institute (NCI) Clinical Research Foundation, NJ 07856, USA.
| |
Collapse
|
16
|
Xiong Z, Schwamb AL, Palanca BJA, Ching S. Estimating and detecting slow wave events in EEG. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2024; 2024:1-4. [PMID: 40039115 DOI: 10.1109/embc53108.2024.10782352] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2025]
Abstract
Slow-wave activity (SWA) is an electroencephalogram (EEG) pattern commonly occurring during anesthesia and deep sleep, and is hence a candidate biomarker to quantify such states and understand their connection to related phenotypes. SWA consists of individual slow waves (ISWs), high-amplitude deflections lasting for approximately 0.5 to 1 second, and occurring quasi-periodically. This latter fact poses a challenge for conventional power spectral density EEG analysis methods that perform best when there is persistent oscillatory activity. In this brief paper, we explore a time-domain detection framework for identifying and quantifying ISWs as a metric for SWA. Our method operates by quantifying the extent to which an EEG signal conforms to a canonical ISW morphology. To do this, we formulate a given univariate EEG signal in two dimensions by means of time-delay embedding. Candidate ISWs are defined as waveform segments between every two zero crossings. In the delay embedded space (DES) we define an admissible region whose traversal by a candidate wave is defined as a slow-wave occurrence. The result of this detection procedure is a binary time series indicating the occurrence of ISWs as a function of time. Once ISWs are detected, we apply a state-space estimation technique based on Kalman filtering to convert this time series into an estimate of the probability of ISW occurrence, which we term the SWA probability. The latter is posed as an instantaneous measure of SWA. We apply this method to EEG data from general anesthesia and deep sleep, establishing that it detects and tracks elevated SWA in both cases.
Collapse
|
17
|
Ron-Angevin R, Fernández-Rodríguez Á, Velasco-Álvarez F, Lespinet-Najib V, André JM. Evaluation of Different Types of Stimuli in an Event-Related Potential-Based Brain-Computer Interface Speller under Rapid Serial Visual Presentation. SENSORS (BASEL, SWITZERLAND) 2024; 24:3315. [PMID: 38894107 PMCID: PMC11174573 DOI: 10.3390/s24113315] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/02/2024] [Revised: 05/10/2024] [Accepted: 05/21/2024] [Indexed: 06/21/2024]
Abstract
Rapid serial visual presentation (RSVP) is currently a suitable gaze-independent paradigm for controlling visual brain-computer interfaces (BCIs) based on event-related potentials (ERPs), especially for users with limited eye movement control. However, unlike gaze-dependent paradigms, gaze-independent ones have received less attention concerning the specific choice of visual stimuli that are used. In gaze-dependent BCIs, images of faces-particularly those tinted red-have been shown to be effective stimuli. This study aims to evaluate whether the colour of faces used as visual stimuli influences ERP-BCI performance under RSVP. Fifteen participants tested four conditions that varied only in the visual stimulus used: grey letters (GL), red famous faces with letters (RFF), green famous faces with letters (GFF), and blue famous faces with letters (BFF). The results indicated significant accuracy differences only between the GL and GFF conditions, unlike prior gaze-dependent studies. Additionally, GL achieved higher comfort ratings compared with other face-related conditions. This study highlights that the choice of stimulus type impacts both performance and user comfort, suggesting implications for future ERP-BCI designs for users requiring gaze-independent systems.
Collapse
Affiliation(s)
- Ricardo Ron-Angevin
- Departamento de Tecnología Electrónica, Instituto Universitario de Investigación en Telecomunicación de la Universidad de Málaga (TELMA), Universidad de Málaga, 29071 Malaga, Spain; (Á.F.-R.); (F.V.-Á.)
| | - Álvaro Fernández-Rodríguez
- Departamento de Tecnología Electrónica, Instituto Universitario de Investigación en Telecomunicación de la Universidad de Málaga (TELMA), Universidad de Málaga, 29071 Malaga, Spain; (Á.F.-R.); (F.V.-Á.)
| | - Francisco Velasco-Álvarez
- Departamento de Tecnología Electrónica, Instituto Universitario de Investigación en Telecomunicación de la Universidad de Málaga (TELMA), Universidad de Málaga, 29071 Malaga, Spain; (Á.F.-R.); (F.V.-Á.)
| | - Véronique Lespinet-Najib
- Laboratoire IMS, CNRS UMR 5218, Cognitive Team, Bordeaux INP-ENSC, 33400 Bordeaux, France; (V.L.-N.); (J.-M.A.)
| | - Jean-Marc André
- Laboratoire IMS, CNRS UMR 5218, Cognitive Team, Bordeaux INP-ENSC, 33400 Bordeaux, France; (V.L.-N.); (J.-M.A.)
| |
Collapse
|
18
|
Zhang G, Garrett DR, Simmons AM, Kiat JE, Luck SJ. Evaluating the effectiveness of artifact correction and rejection in event-related potential research. Psychophysiology 2024; 61:e14511. [PMID: 38165059 PMCID: PMC11021170 DOI: 10.1111/psyp.14511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2023] [Revised: 11/18/2023] [Accepted: 12/14/2023] [Indexed: 01/03/2024]
Abstract
Eyeblinks and other large artifacts can create two major problems in event-related potential (ERP) research, namely confounds and increased noise. Here, we developed a method for assessing the effectiveness of artifact correction and rejection methods in minimizing these two problems. We then used this method to assess a common artifact minimization approach, in which independent component analysis (ICA) is used to correct ocular artifacts, and artifact rejection is used to reject trials with extreme values resulting from other sources (e.g., movement artifacts). This approach was applied to data from five common ERP components (P3b, N400, N170, mismatch negativity, and error-related negativity). Four common scoring methods (mean amplitude, peak amplitude, peak latency, and 50% area latency) were examined for each component. We found that eyeblinks differed systematically across experimental conditions for several of the components. We also found that artifact correction was reasonably effective at minimizing these confounds, although it did not usually eliminate them completely. In addition, we found that the rejection of trials with extreme voltage values was effective at reducing noise, with the benefits of eliminating these trials outweighing the reduced number of trials available for averaging. For researchers who are analyzing similar ERP components and participant populations, this combination of artifact correction and rejection approaches should minimize artifact-related confounds and lead to improved data quality. Researchers who are analyzing other components or participant populations can use the method developed in this study to determine which artifact minimization approaches are effective in their data.
Collapse
Affiliation(s)
- Guanghui Zhang
- Center for Mind & Brain, University of California-Davis, Davis, California, USA
| | - David R Garrett
- Center for Mind & Brain, University of California-Davis, Davis, California, USA
| | - Aaron M Simmons
- Center for Mind & Brain, University of California-Davis, Davis, California, USA
| | - John E Kiat
- Center for Mind & Brain, University of California-Davis, Davis, California, USA
| | - Steven J Luck
- Center for Mind & Brain, University of California-Davis, Davis, California, USA
| |
Collapse
|
19
|
Kaar SJ, Nottage JF, Angelescu I, Marques TR, Howes OD. Gamma Oscillations and Potassium Channel Modulation in Schizophrenia: Targeting GABAergic Dysfunction. Clin EEG Neurosci 2024; 55:203-213. [PMID: 36591873 PMCID: PMC10851642 DOI: 10.1177/15500594221148643] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/28/2022] [Revised: 12/08/2022] [Accepted: 12/12/2022] [Indexed: 01/03/2023]
Abstract
Impairments in gamma-aminobutyric acid (GABAergic) interneuron function lead to gamma power abnormalities and are thought to underlie symptoms in people with schizophrenia. Voltage-gated potassium 3.1 (Kv3.1) and 3.2 (Kv3.2) channels on GABAergic interneurons are critical to the generation of gamma oscillations suggesting that targeting Kv3.1/3.2 could augment GABAergic function and modulate gamma oscillation generation. Here, we studied the effect of a novel potassium Kv3.1/3.2 channel modulator, AUT00206, on resting state frontal gamma power in people with schizophrenia. We found a significant positive correlation between frontal resting gamma (35-45 Hz) power (n = 22, r = 0.613, P < .002) and positive and negative syndrome scale (PANSS) positive symptom severity. We also found a significant reduction in frontal gamma power (t13 = 3.635, P = .003) from baseline in patients who received AUT00206. This provides initial evidence that the Kv3.1/3.2 potassium channel modulator, AUT00206, may address gamma oscillation abnormalities in schizophrenia.
Collapse
Affiliation(s)
- Stephen J. Kaar
- Department of Psychosis Studies, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
- MRC London Institute of Medical Sciences, Hammersmith Hospital, London, UK
- Division of Psychology and Mental Health, Faculty of Biology, Medicine, and Health, University of Manchester, Manchester, UK
| | - Judith F. Nottage
- Department of Neuroimaging, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | - Ilinca Angelescu
- Department of Psychosis Studies, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research London, London, UK
| | - Tiago Reis Marques
- Department of Psychosis Studies, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
- MRC London Institute of Medical Sciences, Hammersmith Hospital, London, UK
| | - Oliver D. Howes
- Department of Psychosis Studies, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
- MRC London Institute of Medical Sciences, Hammersmith Hospital, London, UK
- Faculty of Medicine, Institute of Clinical Sciences (ICS), Imperial College London, London, UK
| |
Collapse
|
20
|
Ingolfsson TM, Benatti S, Wang X, Bernini A, Ducouret P, Ryvlin P, Beniczky S, Benini L, Cossettini A. Minimizing artifact-induced false-alarms for seizure detection in wearable EEG devices with gradient-boosted tree classifiers. Sci Rep 2024; 14:2980. [PMID: 38316856 PMCID: PMC10844293 DOI: 10.1038/s41598-024-52551-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Accepted: 01/19/2024] [Indexed: 02/07/2024] Open
Abstract
Electroencephalography (EEG) is widely used to monitor epileptic seizures, and standard clinical practice consists of monitoring patients in dedicated epilepsy monitoring units via video surveillance and cumbersome EEG caps. Such a setting is not compatible with long-term tracking under typical living conditions, thereby motivating the development of unobtrusive wearable solutions. However, wearable EEG devices present the challenges of fewer channels, restricted computational capabilities, and lower signal-to-noise ratio. Moreover, artifacts presenting morphological similarities to seizures act as major noise sources and can be misinterpreted as seizures. This paper presents a combined seizure and artifacts detection framework targeting wearable EEG devices based on Gradient Boosted Trees. The seizure detector achieves nearly zero false alarms with average sensitivity values of [Formula: see text] for 182 seizures from the CHB-MIT dataset and [Formula: see text] for 25 seizures from the private dataset with no preliminary artifact detection or removal. The artifact detector achieves a state-of-the-art accuracy of [Formula: see text] (on the TUH-EEG Artifact Corpus dataset). Integrating artifact and seizure detection significantly reduces false alarms-up to [Formula: see text] compared to standalone seizure detection. Optimized for a Parallel Ultra-Low Power platform, these algorithms enable extended monitoring with a battery lifespan reaching 300 h. These findings highlight the benefits of integrating artifact detection in wearable epilepsy monitoring devices to limit the number of false positives.
Collapse
Affiliation(s)
| | - Simone Benatti
- University of Bologna, 40126, Bologna, Italy
- University of Modena and Reggio Emilia, 41121, Reggio Emilia, Italy
| | | | - Adriano Bernini
- University Hospital of Lausanne (CHUV), 1011, Lausanne, Switzerland
| | - Pauline Ducouret
- University Hospital of Lausanne (CHUV), 1011, Lausanne, Switzerland
| | - Philippe Ryvlin
- University Hospital of Lausanne (CHUV), 1011, Lausanne, Switzerland
| | - Sandor Beniczky
- Aarhus University Hospital, 8200, Aarhus, Denmark
- Danish Epilepsy Centre (Filadelfia), 4293, Dianalund, Denmark
| | - Luca Benini
- ETH Zürich, D-ITET, 8092, Zürich, Switzerland
- University of Bologna, 40126, Bologna, Italy
| | | |
Collapse
|
21
|
Darvishi-Bayazi MJ, Ghaemi MS, Lesort T, Arefin MR, Faubert J, Rish I. Amplifying pathological detection in EEG signaling pathways through cross-dataset transfer learning. Comput Biol Med 2024; 169:107893. [PMID: 38183700 DOI: 10.1016/j.compbiomed.2023.107893] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2023] [Revised: 11/28/2023] [Accepted: 12/20/2023] [Indexed: 01/08/2024]
Abstract
Pathology diagnosis based on EEG signals and decoding brain activity holds immense importance in understanding neurological disorders. With the advancement of artificial intelligence methods and machine learning techniques, the potential for accurate data-driven diagnoses and effective treatments has grown significantly. However, applying machine learning algorithms to real-world datasets presents diverse challenges at multiple levels. The scarcity of labeled data, especially in low regime scenarios with limited availability of real patient cohorts due to high costs of recruitment, underscores the vital deployment of scaling and transfer learning techniques. In this study, we explore a real-world pathology classification task to highlight the effectiveness of data and model scaling and cross-dataset knowledge transfer. As such, we observe varying performance improvements through data scaling, indicating the need for careful evaluation and labeling. Additionally, we identify the challenges of possible negative transfer and emphasize the significance of some key components to overcome distribution shifts and potential spurious correlations and achieve positive transfer. We see improvement in the performance of the target model on the target (NMT) datasets by using the knowledge from the source dataset (TUAB) when a low amount of labeled data was available. Our findings demonstrated that a small and generic model (e.g. ShallowNet) performs well on a single dataset, however, a larger model (e.g. TCN) performs better in transfer learning when leveraging a larger and more diverse dataset.
Collapse
Affiliation(s)
- Mohammad-Javad Darvishi-Bayazi
- Mila, Québec AI Institute, Montréal, QC, Canada; Faubert Lab, Montréal, QC, Canada; Université de Montréal, Montréal, QC, Canada.
| | | | - Timothee Lesort
- Mila, Québec AI Institute, Montréal, QC, Canada; Université de Montréal, Montréal, QC, Canada
| | - Md Rifat Arefin
- Mila, Québec AI Institute, Montréal, QC, Canada; Université de Montréal, Montréal, QC, Canada
| | - Jocelyn Faubert
- Faubert Lab, Montréal, QC, Canada; Université de Montréal, Montréal, QC, Canada
| | - Irina Rish
- Mila, Québec AI Institute, Montréal, QC, Canada; Université de Montréal, Montréal, QC, Canada
| |
Collapse
|
22
|
Zhang R, Rong R, Gan JQ, Xu Y, Wang H, Wang X. Reliable and fast automatic artifact rejection of Long-Term EEG recordings based on Isolation Forest. Med Biol Eng Comput 2024; 62:521-535. [PMID: 37943419 DOI: 10.1007/s11517-023-02961-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2023] [Accepted: 10/28/2023] [Indexed: 11/10/2023]
Abstract
Long-term electroencephalogram (Long-Term EEG) has the capacity to monitor over a long period, making it a valuable tool in medical institutions. However, due to the large volume of patient data, selecting clean data segments from raw Long-Term EEG for further analysis is an extremely time-consuming and labor-intensive task. Furthermore, the various actions of patients during recording make it difficult to use algorithms to denoise part of the EEG data, and thus lead to the rejection of these data. Therefore, tools for the quick rejection of heavily corrupted epochs in Long-Term EEG records are highly beneficial. In this paper, a new reliable and fast automatic artifact rejection method for Long-Term EEG based on Isolation Forest (IF) is proposed. Specifically, the IF algorithm is repetitively applied to detect outliers in the EEG data, and the boundary of inliers is promptly adjusted by using a statistical indicator to make the algorithm proceed in an iterative manner. The iteration is terminated when the distance metric between clean epochs and artifact-corrupted epochs remains unchanged. Six statistical indicators (i.e., min, max, median, mean, kurtosis, and skewness) are evaluated by setting them as centroid to adjust the boundary during iteration, and the proposed method is compared with several state-of-the-art methods on a retrospectively collected dataset. The experimental results indicate that utilizing the min value of data as the centroid yields the most optimal performance, and the proposed method is highly efficacious and reliable in the automatic artifact rejection of Long-Term EEG, as it significantly improves the overall data quality. Furthermore, the proposed method surpasses compared methods on most data segments with poor data quality, demonstrating its superior capacity to enhance the data quality of the heavily corrupted data. Besides, owing to the linear time complexity of IF, the proposed method is much faster than other methods, thus providing an advantage when dealing with extensive datasets.
Collapse
Affiliation(s)
- Runkai Zhang
- Key Laboratory of Child Development and Learning Science of Ministry of Education, School of Biological Science & Medical Engineering, Southeast University, Nanjing, 210096, Jiangsu, People's Republic of China
| | - Rong Rong
- Department of Neurology, Nanjing Drum Tower Hospital, Nanjing, 210008, Jiangsu, People's Republic of China
| | - John Q Gan
- School of Computer Science and Electronic Engineering, University of Essex, Colchester, CO4 3SQ, UK
| | - Yun Xu
- Department of Neurology, Nanjing Drum Tower Hospital, Nanjing, 210008, Jiangsu, People's Republic of China
| | - Haixian Wang
- Key Laboratory of Child Development and Learning Science of Ministry of Education, School of Biological Science & Medical Engineering, Southeast University, Nanjing, 210096, Jiangsu, People's Republic of China.
| | - Xiaoyun Wang
- Department of Neurology, Nanjing Drum Tower Hospital, Nanjing, 210008, Jiangsu, People's Republic of China.
| |
Collapse
|
23
|
Zhang G, Garrett DR, Simmons AM, Kiat JE, Luck SJ. Evaluating the effectiveness of artifact correction and rejection in event-related potential research. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.09.16.558075. [PMID: 37745415 PMCID: PMC10516012 DOI: 10.1101/2023.09.16.558075] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/26/2023]
Abstract
Eyeblinks and other large artifacts can create two major problems in event-related potential (ERP) research, namely confounds and increased noise. Here, we developed a method for assessing the effectiveness of artifact correction and rejection methods at minimizing these two problems. We then used this method to assess a common artifact minimization approach, in which independent component analysis (ICA) is used to correct ocular artifacts, and artifact rejection is used to reject trials with extreme values resulting from other sources (e.g., movement artifacts). This approach was applied to data from five common ERP components (P3b, N400, N170, mismatch negativity, and error-related negativity). Four common scoring methods (mean amplitude, peak amplitude, peak latency, and 50% area latency) were examined for each component. We found that eyeblinks differed systematically across experimental conditions for several of the components. We also found that artifact correction was reasonably effective at minimizing these confounds, although it did not usually eliminate them completely. In addition, we found that the rejection of trials with extreme voltage values was effective at reducing noise, with the benefits of eliminating these trials outweighing the reduced number of trials available for averaging. For researchers who are analyzing similar ERP components and participant populations, this combination of artifact correction and rejection approaches should minimize artifact-related confounds and lead to improved data quality. Researchers who are analyzing other components or participant populations can use the method developed in this study to determine which artifact minimization approaches are effective in their data.
Collapse
Affiliation(s)
- Guanghui Zhang
- Center for Mind & Brain, University of California-Davis, Davis, CA, USA
| | - David R Garrett
- Center for Mind & Brain, University of California-Davis, Davis, CA, USA
| | - Aaron M Simmons
- Center for Mind & Brain, University of California-Davis, Davis, CA, USA
| | - John E Kiat
- Center for Mind & Brain, University of California-Davis, Davis, CA, USA
| | - Steven J Luck
- Center for Mind & Brain, University of California-Davis, Davis, CA, USA
| |
Collapse
|
24
|
Schmoigl-Tonis M, Schranz C, Müller-Putz GR. Methods for motion artifact reduction in online brain-computer interface experiments: a systematic review. Front Hum Neurosci 2023; 17:1251690. [PMID: 37920561 PMCID: PMC10619676 DOI: 10.3389/fnhum.2023.1251690] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2023] [Accepted: 09/11/2023] [Indexed: 11/04/2023] Open
Abstract
Brain-computer interfaces (BCIs) have emerged as a promising technology for enhancing communication between the human brain and external devices. Electroencephalography (EEG) is particularly promising in this regard because it has high temporal resolution and can be easily worn on the head in everyday life. However, motion artifacts caused by muscle activity, fasciculation, cable swings, or magnetic induction pose significant challenges in real-world BCI applications. In this paper, we present a systematic review of methods for motion artifact reduction in online BCI experiments. Using the PRISMA filter method, we conducted a comprehensive literature search on PubMed, focusing on open access publications from 1966 to 2022. We evaluated 2,333 publications based on predefined filtering rules to identify existing methods and pipelines for motion artifact reduction in EEG data. We present a lookup table of all papers that passed the defined filters, all used methods, and pipelines and compare their overall performance and suitability for online BCI experiments. We summarize suitable methods, algorithms, and concepts for motion artifact reduction in online BCI applications, highlight potential research gaps, and discuss existing community consensus. This review aims to provide a comprehensive overview of the current state of the field and guide researchers in selecting appropriate methods for motion artifact reduction in online BCI experiments.
Collapse
Affiliation(s)
- Mathias Schmoigl-Tonis
- Laboratory of Collaborative Robotics, Department of Human Motion Analytics, Salzburg Research GmbH, Salzburg, Austria
- Institute of Neural Engineering, Laboratory of Brain-Computer Interfaces, Graz University of Technology, Graz, Austria
| | - Christoph Schranz
- Laboratory of Collaborative Robotics, Department of Human Motion Analytics, Salzburg Research GmbH, Salzburg, Austria
| | - Gernot R. Müller-Putz
- Institute of Neural Engineering, Laboratory of Brain-Computer Interfaces, Graz University of Technology, Graz, Austria
- BioTechMed Graz, Graz, Austria
| |
Collapse
|
25
|
Kaongoen N, Choi J, Woo Choi J, Kwon H, Hwang C, Hwang G, Kim BH, Jo S. The future of wearable EEG: a review of ear-EEG technology and its applications. J Neural Eng 2023; 20:051002. [PMID: 37748474 DOI: 10.1088/1741-2552/acfcda] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Accepted: 09/25/2023] [Indexed: 09/27/2023]
Abstract
Objective.This review paper provides a comprehensive overview of ear-electroencephalogram (EEG) technology, which involves recording EEG signals from electrodes placed in or around the ear, and its applications in the field of neural engineering.Approach.We conducted a thorough literature search using multiple databases to identify relevant studies related to ear-EEG technology and its various applications. We selected 123 publications and synthesized the information to highlight the main findings and trends in this field.Main results.Our review highlights the potential of ear-EEG technology as the future of wearable EEG technology. We discuss the advantages and limitations of ear-EEG compared to traditional scalp-based EEG and methods to overcome those limitations. Through our review, we found that ear-EEG is a promising method that produces comparable results to conventional scalp-based methods. We review the development of ear-EEG sensing devices, including the design, types of sensors, and materials. We also review the current state of research on ear-EEG in different application areas such as brain-computer interfaces, and clinical monitoring.Significance.This review paper is the first to focus solely on reviewing ear-EEG research articles. As such, it serves as a valuable resource for researchers, clinicians, and engineers working in the field of neural engineering. Our review sheds light on the exciting future prospects of ear-EEG, and its potential to advance neural engineering research and become the future of wearable EEG technology.
Collapse
Affiliation(s)
- Netiwit Kaongoen
- Information and Electronics Research Institute, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Jaehoon Choi
- School of Computing, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Jin Woo Choi
- Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA 94304, United States of America
| | - Haram Kwon
- School of Computing, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Chaeeun Hwang
- School of Computing, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Guebin Hwang
- Robotics Program, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| | - Byung Hyung Kim
- Department of Artificial Intelligence, Inha University, Incheon, Republic of Korea
| | - Sungho Jo
- School of Computing, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
| |
Collapse
|
26
|
Downey RJ, Ferris DP. iCanClean Removes Motion, Muscle, Eye, and Line-Noise Artifacts from Phantom EEG. SENSORS (BASEL, SWITZERLAND) 2023; 23:8214. [PMID: 37837044 PMCID: PMC10574843 DOI: 10.3390/s23198214] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Revised: 09/26/2023] [Accepted: 09/27/2023] [Indexed: 10/15/2023]
Abstract
The goal of this study was to test a novel approach (iCanClean) to remove non-brain sources from scalp EEG data recorded in mobile conditions. We created an electrically conductive phantom head with 10 brain sources, 10 contaminating sources, scalp, and hair. We tested the ability of iCanClean to remove artifacts while preserving brain activity under six conditions: Brain, Brain + Eyes, Brain + Neck Muscles, Brain + Facial Muscles, Brain + Walking Motion, and Brain + All Artifacts. We compared iCanClean to three other methods: Artifact Subspace Reconstruction (ASR), Auto-CCA, and Adaptive Filtering. Before and after cleaning, we calculated a Data Quality Score (0-100%), based on the average correlation between brain sources and EEG channels. iCanClean consistently outperformed the other three methods, regardless of the type or number of artifacts present. The most striking result was for the condition with all artifacts simultaneously present. Starting from a Data Quality Score of 15.7% (before cleaning), the Brain + All Artifacts condition improved to 55.9% after iCanClean. Meanwhile, it only improved to 27.6%, 27.2%, and 32.9% after ASR, Auto-CCA, and Adaptive Filtering. For context, the Brain condition scored 57.2% without cleaning (reasonable target). We conclude that iCanClean offers the ability to clear multiple artifact sources in real time and could facilitate human mobile brain-imaging studies with EEG.
Collapse
Affiliation(s)
| | - Daniel P. Ferris
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA;
| |
Collapse
|
27
|
Lee M, Hong Y, An S, Park U, Shin J, Lee J, Oh MS, Lee BC, Yu KH, Lim JS, Kang SW. Machine learning-based prediction of post-stroke cognitive status using electroencephalography-derived brain network attributes. Front Aging Neurosci 2023; 15:1238274. [PMID: 37842126 PMCID: PMC10568623 DOI: 10.3389/fnagi.2023.1238274] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2023] [Accepted: 09/11/2023] [Indexed: 10/17/2023] Open
Abstract
Objectives More than half of patients with acute ischemic stroke develop post-stroke cognitive impairment (PSCI), a significant barrier to future neurological recovery. Thus, predicting cognitive trajectories post-AIS is crucial. Our primary objective is to determine whether brain network properties from electroencephalography (EEG) can predict post-stroke cognitive function using machine learning approach. Methods We enrolled consecutive stroke patients who underwent both EEG during the acute stroke phase and cognitive assessments 3 months post-stroke. We preprocessed acute stroke EEG data to eliminate low-quality epochs, then performed independent component analysis and quantified network characteristics using iSyncBrain®. Cognitive function was evaluated using the Montreal cognitive assessment (MoCA). We initially categorized participants based on the lateralization of their lesions and then developed machine learning models to predict cognitive status in the left and right hemisphere lesion groups. Results Eighty-seven patients were included, and the accuracy of lesion laterality prediction using EEG attributes was 97.0%. In the left hemispheric lesion group, the network attributes of the theta band were significantly correlated with MoCA scores, and higher global efficiency, clustering coefficient, and lower characteristic path length were associated with higher MoCA scores. Most features related to cognitive scores were selected from the frontal lobe. The predictive powers (R-squared) were 0.76 and 0.65 for the left and right stroke groups, respectively. Conclusion Estimating EEG-based network properties in the acute phase of ischemic stroke through a machine learning model has a potential to predict cognitive outcomes after ischemic stroke.
Collapse
Affiliation(s)
- Minwoo Lee
- Department of Neurology, Hallym University Sacred Heart Hospital, Hallym Neurological Institute, Hallym University College of Medicine, Anyang, Republic of Korea
| | | | - Sungsik An
- Department of Neurology, Hwahong Hospital, Suwon, Republic of Korea
| | - Ukeob Park
- iMedisync, Inc., Seoul, Republic of Korea
| | | | - Jeongjae Lee
- Department of Neurology, Hallym University Sacred Heart Hospital, Hallym Neurological Institute, Hallym University College of Medicine, Anyang, Republic of Korea
| | - Mi Sun Oh
- Department of Neurology, Hallym University Sacred Heart Hospital, Hallym Neurological Institute, Hallym University College of Medicine, Anyang, Republic of Korea
| | - Byung-Chul Lee
- Department of Neurology, Hallym University Sacred Heart Hospital, Hallym Neurological Institute, Hallym University College of Medicine, Anyang, Republic of Korea
| | - Kyung-Ho Yu
- Department of Neurology, Hallym University Sacred Heart Hospital, Hallym Neurological Institute, Hallym University College of Medicine, Anyang, Republic of Korea
| | - Jae-Sung Lim
- Department of Neurology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | | |
Collapse
|
28
|
Dong Y, Tang X, Li Q, Wang Y, Jiang N, Tian L, Zheng Y, Li X, Zhao S, Li G, Fang P. An Approach for EEG Denoising Based on Wasserstein Generative Adversarial Network. IEEE Trans Neural Syst Rehabil Eng 2023; 31:3524-3534. [PMID: 37643110 DOI: 10.1109/tnsre.2023.3309815] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/31/2023]
Abstract
Electroencephalogram (EEG) recordings often contain artifacts that would lower signal quality. Many efforts have been made to eliminate or at least minimize the artifacts, and most of them rely on visual inspection and manual operations, which is time/labor-consuming, subjective, and incompatible to filter massive EEG data in real-time. In this paper, we proposed a deep learning framework named Artifact Removal Wasserstein Generative Adversarial Network (AR-WGAN), where the well-trained model can decompose input EEG, detect and delete artifacts, and then reconstruct denoised signals within a short time. The proposed approach was systematically compared with commonly used denoising methods including Denoised AutoEncoder, Wiener Filter, and Empirical Mode Decomposition, with both public and self-collected datasets. The experimental results proved the promising performance of AR-WGAN on automatic artifact removal for massive data across subjects, with correlation coefficient up to 0.726±0.033, and temporal and spatial relative root-mean-square error as low as 0.176±0.046 and 0.761±0.046, respectively. This work may demonstrate the proposed AR-WGAN as a high-performance end-to-end method for EEG denoising, with many on-line applications in clinical EEG monitoring and brain-computer interfaces.
Collapse
|
29
|
Saini F, Masina F, Wells J, Rosch R, Hamburg S, Startin C, Strydom A. The mismatch negativity as an index of cognitive abilities in adults with Down syndrome. Cereb Cortex 2023; 33:9639-9651. [PMID: 37401006 PMCID: PMC10431748 DOI: 10.1093/cercor/bhad233] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Revised: 06/09/2023] [Accepted: 06/10/2023] [Indexed: 07/05/2023] Open
Abstract
Down syndrome (DS) is associated with an ultra-high risk of developing Alzheimer's disease (AD). Understanding variability in pre-AD cognitive abilities may help understand cognitive decline in this population. The mismatch negativity (MMN) is an event-related potential component reflecting the detection of deviant stimuli that is thought to represent underlying memory processes, with reduced MMN amplitudes being associated with cognitive decline. To further understand the MMN in adults with DS without AD, we explored the relationships between MMN, age, and cognitive abilities (memory, language, and attention) in 27 individuals (aged 17-51) using a passive auditory oddball task. Statistically significant MMN was present only in 18 individuals up to 41 years of age and the latency were longer than canonical parameters reported in the literature. Reduced MMN amplitude was associated with lower memory scores, while longer MMN latencies were associated with poorer memory, verbal abilities, and attention. Therefore, the MMN may represent a valuable index of cognitive abilities in DS. In combination with previous findings, we hypothesize that while MMN response and amplitude may be associated with AD-related memory loss, MMN latency may be associated with speech signal processing. Future studies may explore the potential impact of AD on MMN in people with DS.
Collapse
Affiliation(s)
- Fedal Saini
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, 16 De Crespigny Park, London SE5 8AB, UK
| | - Fabio Masina
- IRCCS San Camillo Hospital, Via Alberoni, 70, 30126 Lido VE, Italy
| | - Jasmine Wells
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, 16 De Crespigny Park, London SE5 8AB, UK
| | - Richard Rosch
- Department of Clinical Neurophysiology, King’s College Hospital NHS Foundation Trust, Golden Jubilee, Denmark Hill, London SE5 9RS, UK
- Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, University College London, Queen Square, London WC1N 3AR, UK
| | - Sarah Hamburg
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, 16 De Crespigny Park, London SE5 8AB, UK
- Division of Psychiatry, University College London, Maple House, 149 Tottenham Ct Rd, London W1T 7BN, UK
| | - Carla Startin
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, 16 De Crespigny Park, London SE5 8AB, UK
- Division of Psychiatry, University College London, Maple House, 149 Tottenham Ct Rd, London W1T 7BN, UK
- School of Psychology, University of Roehampton, Grove House, Roehampton Lane, London, SW15 5PJ, UK
| | - André Strydom
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, 16 De Crespigny Park, London SE5 8AB, UK
- Division of Psychiatry, University College London, Maple House, 149 Tottenham Ct Rd, London W1T 7BN, UK
| |
Collapse
|
30
|
Georgiadis K, Kalaganis FP, Riskos K, Matta E, Oikonomou VP, Yfantidou I, Chantziaras D, Pantouvakis K, Nikolopoulos S, Laskaris NA, Kompatsiaris I. NeuMa - the absolute Neuromarketing dataset en route to an holistic understanding of consumer behaviour. Sci Data 2023; 10:508. [PMID: 37537187 PMCID: PMC10400531 DOI: 10.1038/s41597-023-02392-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2023] [Accepted: 07/17/2023] [Indexed: 08/05/2023] Open
Abstract
Neuromarketing is a continuously evolving field that utilises neuroimaging technologies to explore consumers' behavioural responses to specific marketing-related stimulation, and furthermore introduces novel marketing tools that could complement the traditional ones like questionnaires. In this context, the present paper introduces a multimodal Neuromarketing dataset that encompasses the data from 42 individuals who participated in an advertising brochure-browsing scenario. In more detail, participants were exposed to a series of supermarket brochures (containing various products) and instructed to select the products they intended to buy. The data collected for each individual executing this protocol included: (i) encephalographic (EEG) recordings, (ii) eye tracking (ET) recordings, (iii) questionnaire responses (demographic, profiling and product related questions), and (iv) computer mouse data. NeuMa dataset has both dynamic and multimodal nature and, due to the narrow availability of open relevant datasets, provides new and unique opportunities for researchers in the field to attempt a more holistic approach to neuromarketing.
Collapse
Affiliation(s)
- Kostas Georgiadis
- Centre for Research & Technology Hellas, Information Technologies Institute (ITI), Thermi-Thessaloniki, Greece.
| | - Fotis P Kalaganis
- Centre for Research & Technology Hellas, Information Technologies Institute (ITI), Thermi-Thessaloniki, Greece
| | - Kyriakos Riskos
- Aristotle University of Thessaloniki, Department of Journalism and Mass Communications, Thessaloniki, Greece
- Erasmus University Rotterdam, Department of Media and Communication, Rotterdam, the Netherlands
| | | | - Vangelis P Oikonomou
- Centre for Research & Technology Hellas, Information Technologies Institute (ITI), Thermi-Thessaloniki, Greece
| | - Ioanna Yfantidou
- Aristotle University of Thessaloniki, Department of Journalism and Mass Communications, Thessaloniki, Greece
| | | | | | - Spiros Nikolopoulos
- Centre for Research & Technology Hellas, Information Technologies Institute (ITI), Thermi-Thessaloniki, Greece
| | - Nikos A Laskaris
- Artificial Intelligence & Information Analysis Lab, Department of Informatics, School of Sciences, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Ioannis Kompatsiaris
- Centre for Research & Technology Hellas, Information Technologies Institute (ITI), Thermi-Thessaloniki, Greece
| |
Collapse
|
31
|
Kaongoen N, Jo S. Adapting Artifact Subspace Reconstruction Method for SingleChannel EEG using Signal Decomposition Techniques . ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38083141 DOI: 10.1109/embc40787.2023.10340077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Artifact removal from electroencephalography (EEG) data is a crucial step in the analysis of neural signals. One method that has been gaining popularity in recent years is Artifact Subspace Reconstruction (ASR), which is highly effective in eliminating large amplitude and transient artifacts in EEG data. However, traditional ASR is not possible to use with single-channel EEG data. In this study, we propose incorporating signal decomposition techniques such as ensemble empirical mode decomposition (EEMD), wavelet transform (WT), and singular spectrum analysis (SSA) into ASR, to decompose single-channel data into multiple components. This allows the ASR process to be applied effectively to the data. Our results show that the proposed single-channel version of ASR outperforms its counterpart Independent Component Analysis (ICA) methods when tested on two open datasets. Our findings indicate that ASR has significant potential as a powerful tool for removing artifacts from EEG data analysis.Clinical Relevance- This provided artifact removal technique for single-channel EEG.
Collapse
|
32
|
Fernández-Rodríguez Á, Ron-Angevin R, Velasco-Álvarez F, Diaz-Pineda J, Letouzé T, André JM. Evaluation of Single-Trial Classification to Control a Visual ERP-BCI under a Situation Awareness Scenario. Brain Sci 2023; 13:886. [PMID: 37371365 DOI: 10.3390/brainsci13060886] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Revised: 05/15/2023] [Accepted: 05/29/2023] [Indexed: 06/29/2023] Open
Abstract
An event-related potential (ERP)-based brain-computer interface (BCI) can be used to monitor a user's cognitive state during a surveillance task in a situational awareness context. The present study explores the use of an ERP-BCI for detecting new planes in an air traffic controller (ATC). Two experiments were conducted to evaluate the impact of different visual factors on target detection. Experiment 1 validated the type of stimulus used and the effect of not knowing its appearance location in an ERP-BCI scenario. Experiment 2 evaluated the effect of the size of the target stimulus appearance area and the stimulus salience in an ATC scenario. The main results demonstrate that the size of the plane appearance area had a negative impact on the detection performance and on the amplitude of the P300 component. Future studies should address this issue to improve the performance of an ATC in stimulus detection using an ERP-BCI.
Collapse
Affiliation(s)
- Álvaro Fernández-Rodríguez
- Departamento de Tecnología Electrónica, Instituto Universitario de Investigación en Telecomunicación de la Universidad de Málaga (TELMA), Universidad de Málaga, 29071 Malaga, Spain
| | - Ricardo Ron-Angevin
- Departamento de Tecnología Electrónica, Instituto Universitario de Investigación en Telecomunicación de la Universidad de Málaga (TELMA), Universidad de Málaga, 29071 Malaga, Spain
| | - Francisco Velasco-Álvarez
- Departamento de Tecnología Electrónica, Instituto Universitario de Investigación en Telecomunicación de la Universidad de Málaga (TELMA), Universidad de Málaga, 29071 Malaga, Spain
| | | | - Théodore Letouzé
- Laboratoire IMS, CNRS UMR 5218, Cognitive Team, Bordeaux INP-ENSC, 33400 Talence, France
| | - Jean-Marc André
- Laboratoire IMS, CNRS UMR 5218, Cognitive Team, Bordeaux INP-ENSC, 33400 Talence, France
| |
Collapse
|
33
|
Wireless EEG: A survey of systems and studies. Neuroimage 2023; 269:119774. [PMID: 36566924 DOI: 10.1016/j.neuroimage.2022.119774] [Citation(s) in RCA: 55] [Impact Index Per Article: 27.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Revised: 11/18/2022] [Accepted: 11/27/2022] [Indexed: 12/24/2022] Open
Abstract
The popular brain monitoring method of electroencephalography (EEG) has seen a surge in commercial attention in recent years, focusing mostly on hardware miniaturization. This has led to a varied landscape of portable EEG devices with wireless capability, allowing them to be used by relatively unconstrained users in real-life conditions outside of the laboratory. The wide availability and relative affordability of these devices provide a low entry threshold for newcomers to the field of EEG research. The large device variety and the at times opaque communication from their manufacturers, however, can make it difficult to obtain an overview of this hardware landscape. Similarly, given the breadth of existing (wireless) EEG knowledge and research, it can be challenging to get started with novel ideas. Therefore, this paper first provides a list of 48 wireless EEG devices along with a number of important-sometimes difficult-to-obtain-features and characteristics to enable their side-by-side comparison, along with a brief introduction to each of these aspects and how they may influence one's decision. Secondly, we have surveyed previous literature and focused on 110 high-impact journal publications making use of wireless EEG, which we categorized by application and analyzed for device used, number of channels, sample size, and participant mobility. Together, these provide a basis for informed decision making with respect to hardware and experimental precedents when considering new, wireless EEG devices and research. At the same time, this paper provides background material and commentary about pitfalls and caveats regarding this increasingly accessible line of research.
Collapse
|
34
|
Wascher E, Reiser J, Rinkenauer G, Larrá M, Dreger FA, Schneider D, Karthaus M, Getzmann S, Gutberlet M, Arnau S. Neuroergonomics on the Go: An Evaluation of the Potential of Mobile EEG for Workplace Assessment and Design. HUMAN FACTORS 2023; 65:86-106. [PMID: 33861182 PMCID: PMC9846382 DOI: 10.1177/00187208211007707] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/15/2021] [Accepted: 03/13/2021] [Indexed: 06/12/2023]
Abstract
OBJECTIVE We demonstrate and discuss the use of mobile electroencephalogram (EEG) for neuroergonomics. Both technical state of the art as well as measures and cognitive concepts are systematically addressed. BACKGROUND Modern work is increasingly characterized by information processing. Therefore, the examination of mental states, mental load, or cognitive processing during work is becoming increasingly important for ergonomics. RESULTS Mobile EEG allows to measure mental states and processes under real live conditions. It can be used for various research questions in cognitive neuroergonomics. Besides measures in the frequency domain that have a long tradition in the investigation of mental fatigue, task load, and task engagement, new approaches-like blink-evoked potentials-render event-related analyses of the EEG possible also during unrestricted behavior. CONCLUSION Mobile EEG has become a valuable tool for evaluating mental states and mental processes on a highly objective level during work. The main advantage of this technique is that working environments don't have to be changed while systematically measuring brain functions at work. Moreover, the workflow is unaffected by such neuroergonomic approaches.
Collapse
Affiliation(s)
- Edmund Wascher
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Julian Reiser
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Gerhard Rinkenauer
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Mauro Larrá
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Felix A. Dreger
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Daniel Schneider
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Melanie Karthaus
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | - Stephan Getzmann
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| | | | - Stefan Arnau
- IfADo – Leibniz Research Centre for Working Environment and
Human Factors, Dortmund, Germany
| |
Collapse
|
35
|
Duan X, Xie S, Lv Y, Xie X, Obermayer K, Yan H. A transfer learning-based feedback training motivates the performance of SMR-BCI. J Neural Eng 2023; 20. [PMID: 36577144 DOI: 10.1088/1741-2552/acaee7] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2022] [Accepted: 12/28/2022] [Indexed: 12/29/2022]
Abstract
Objective. Feedback training is a practical approach to brain-computer interface (BCI) end-users learning to modulate their sensorimotor rhythms (SMRs). BCI self-regulation learning has been shown to be influenced by subjective psychological factors, such as motivation. However, few studies have taken into account the users' self-motivation as additional guidance for the cognitive process involved in BCI learning. In this study we tested a transfer learning (TL) feedback method designed to increase self-motivation by providing information about past performance.Approach. Electroencephalography (EEG) signals from the previous runs were affine transformed and displayed as points on the screen, along with the newly recorded EEG signals in the current run, giving the subjects a context for self-motivation. Subjects were asked to separate the feedback points for the current run under the display of the separability of prior training. We conducted a between-subject feedback training experiment, in which 24 healthy SMR-BCI naive subjects were trained to imagine left- and right-hand movements. The participants were provided with either TL feedback or typical cursor-bar (CB) feedback (control condition), for three sessions on separate days.Main results. The behavioral results showed an increased challenge and stable mastery confidence, suggesting that subjects' motivation grew as the feedback training went on. The EEG results showed favorable overall training effects with TL feedback in terms of the class distinctiveness and EEG discriminancy. Performance was 28.5% higher in the third session than in the first. About 41.7% of the subjects were 'learners' including not only low-performance subjects, but also good-performance subjects who might be affected by the ceiling effect. Subjects were able to control BCI with TL feedback with a higher performance of 60.5% during the last session compared to CB feedback.Significance. The present study demonstrated that the proposed TL feedback method boosted psychological engagement through the self-motivated context, and further allowed subjects to modulate SMR effectively. The proposed TL feedback method also provided an alternative to typical CB feedback.
Collapse
Affiliation(s)
- Xu Duan
- School of Electronics and Information, Northwestern Polytechnical University, Dongxiang Road 1, Xi'an 710129, People's Republic of China.,Key Laboratory for Artificial Intelligence and Cognitive Neuroscience of Language, Xi'an International Studies University, Wenyuan South Road, Xi'an 710128, People's Republic of China
| | - Songyun Xie
- School of Electronics and Information, Northwestern Polytechnical University, Dongxiang Road 1, Xi'an 710129, People's Republic of China
| | - Yanxia Lv
- School of Electronics and Information, Northwestern Polytechnical University, Dongxiang Road 1, Xi'an 710129, People's Republic of China
| | - Xinzhou Xie
- School of Electronics and Information, Northwestern Polytechnical University, Dongxiang Road 1, Xi'an 710129, People's Republic of China
| | - Klaus Obermayer
- Faculty of Electrical Engineering and Computer Science, Technical University Berlin, Marchstraße 23, Berlin 10587, Germany
| | - Hao Yan
- Key Laboratory for Artificial Intelligence and Cognitive Neuroscience of Language, Xi'an International Studies University, Wenyuan South Road, Xi'an 710128, People's Republic of China
| |
Collapse
|
36
|
Sato Y, Nishimaru H, Matsumoto J, Setogawa T, Nishijo H. Electroencephalographic Effective Connectivity Analysis of the Neural Networks during Gesture and Speech Production Planning in Young Adults. Brain Sci 2023; 13:brainsci13010100. [PMID: 36672081 PMCID: PMC9856316 DOI: 10.3390/brainsci13010100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2022] [Revised: 12/19/2022] [Accepted: 12/29/2022] [Indexed: 01/06/2023] Open
Abstract
Gestures and speech, as linked communicative expressions, form an integrated system. Previous functional magnetic resonance imaging studies have suggested that neural networks for gesture and spoken word production share similar brain regions consisting of fronto-temporo-parietal brain regions. However, information flow within the neural network may dynamically change during the planning of two communicative expressions and also differ between them. To investigate dynamic information flow in the neural network during the planning of gesture and spoken word generation in this study, participants were presented with spatial images and were required to plan the generation of gestures or spoken words to represent the same spatial situations. The evoked potentials in response to spatial images were recorded to analyze the effective connectivity within the neural network. An independent component analysis of the evoked potentials indicated 12 clusters of independent components, the dipoles of which were located in the bilateral fronto-temporo-parietal brain regions and on the medial wall of the frontal and parietal lobes. Comparison of effective connectivity indicated that information flow from the right middle cingulate gyrus (MCG) to the left supplementary motor area (SMA) and from the left SMA to the left precentral area increased during gesture planning compared with that of word planning. Furthermore, information flow from the right MCG to the left superior frontal gyrus also increased during gesture planning compared with that of word planning. These results suggest that information flow to the brain regions for hand praxis is more strongly activated during gesture planning than during word planning.
Collapse
Affiliation(s)
- Yohei Sato
- Department of System Emotional Science, Faculty of Medicine, University of Toyama, Toyama 930-0194, Japan
| | - Hiroshi Nishimaru
- Department of System Emotional Science, Faculty of Medicine, University of Toyama, Toyama 930-0194, Japan
- Research Center for Idling Brain Science (RCIBS), University of Toyama, Toyama 930-0194, Japan
| | - Jumpei Matsumoto
- Department of System Emotional Science, Faculty of Medicine, University of Toyama, Toyama 930-0194, Japan
- Research Center for Idling Brain Science (RCIBS), University of Toyama, Toyama 930-0194, Japan
| | - Tsuyoshi Setogawa
- Department of System Emotional Science, Faculty of Medicine, University of Toyama, Toyama 930-0194, Japan
- Research Center for Idling Brain Science (RCIBS), University of Toyama, Toyama 930-0194, Japan
| | - Hisao Nishijo
- Department of System Emotional Science, Faculty of Medicine, University of Toyama, Toyama 930-0194, Japan
- Research Center for Idling Brain Science (RCIBS), University of Toyama, Toyama 930-0194, Japan
- Correspondence:
| |
Collapse
|
37
|
Kim H, Miyakoshi M, Kim Y, Stapornchaisit S, Yoshimura N, Koike Y. Electroencephalography Reflects User Satisfaction in Controlling Robot Hand through Electromyographic Signals. SENSORS (BASEL, SWITZERLAND) 2022; 23:277. [PMID: 36616877 PMCID: PMC9823960 DOI: 10.3390/s23010277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 12/23/2022] [Accepted: 12/25/2022] [Indexed: 06/17/2023]
Abstract
This study addresses time intervals during robot control that dominate user satisfaction and factors of robot movement that induce satisfaction. We designed a robot control system using electromyography signals. In each trial, participants were exposed to different experiences as the cutoff frequencies of a low-pass filter were changed. The participants attempted to grab a bottle by controlling a robot. They were asked to evaluate four indicators (stability, imitation, response time, and movement speed) and indicate their satisfaction at the end of each trial by completing a questionnaire. The electroencephalography signals of the participants were recorded while they controlled the robot and responded to the questionnaire. Two independent component clusters in the precuneus and postcentral gyrus were the most sensitive to subjective evaluations. For the moment that dominated satisfaction, we observed that brain activity exhibited significant differences in satisfaction not immediately after feeding an input but during the later stage. The other indicators exhibited independently significant patterns in event-related spectral perturbations. Comparing these indicators in a low-frequency band related to the satisfaction with imitation and movement speed, which had significant differences, revealed that imitation covered significant intervals in satisfaction. This implies that imitation was the most important contributing factor among the four indicators. Our results reveal that regardless of subjective satisfaction, objective performance evaluation might more fully reflect user satisfaction.
Collapse
Affiliation(s)
- Hyeonseok Kim
- Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, La Jolla, CA 92093, USA
| | - Makoto Miyakoshi
- Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, La Jolla, CA 92093, USA
| | - Yeongdae Kim
- Department of Industrial Engineering and Economics, Tokyo Institute of Technology, Tokyo 152-8550, Japan
| | - Sorawit Stapornchaisit
- Department of Information and Communications Engineering, Tokyo Institute of Technology, Yokohama 226-0026, Japan
| | - Natsue Yoshimura
- Institute of Innovative Research, Tokyo Institute of Technology, Yokohama 226-0026, Japan
| | - Yasuharu Koike
- Institute of Innovative Research, Tokyo Institute of Technology, Yokohama 226-0026, Japan
| |
Collapse
|
38
|
Kim N, Grégoire L, Razavi M, Yan N, Ahn CR, Anderson BA. Virtual accident curb risk habituation in workers by restoring sensory responses to real-world warning. iScience 2022; 26:105827. [PMID: 36636343 PMCID: PMC9830218 DOI: 10.1016/j.isci.2022.105827] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 11/06/2022] [Accepted: 12/13/2022] [Indexed: 12/23/2022] Open
Abstract
In high-risk work environments, workers become habituated to hazards they frequently encounter, subsequently underestimating risk and engaging in unsafe behaviors. This phenomenon has been termed "risk habituation" and identified as a vital root cause of fatalities and injuries at workplaces. Providing an effective intervention that curbs workers' risk habituation is critical in preventing occupational injuries and fatalities. However, there exists no empirically supported intervention for curbing risk habituation. To this end, here we investigated how experiencing an accident in a virtual reality (VR) environment affects workers' risk habituation toward repeatedly exposed workplace hazards. We examined an underlying mechanism of risk habituation at the sensory level and evaluated the effect of the accident intervention through electroencephalography (EEG). The results of pre- and posttreatment analyses indicate experiencing the virtual accident effectively curbs risk habituation at both the behavioral and sensory level. The findings open new vistas for occupational safety training.
Collapse
Affiliation(s)
- Namgyun Kim
- Department of Civil and Environmental Engineering and Engineering Mechanics, University of Dayton, Dayton, OH, USA
| | - Laurent Grégoire
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, TX, USA
| | - Moein Razavi
- Department of Industrial and Systems Engineering, Texas A&M University, College Station, TX, USA
| | - Niya Yan
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, TX, USA
| | - Changbum R. Ahn
- Department of Architecture and Architectural Engineering, Seoul National University, Seoul, South Korea
- Corresponding author
| | - Brian A. Anderson
- Department of Psychological and Brain Sciences, Texas A&M University, College Station, TX, USA
- Corresponding author
| |
Collapse
|
39
|
Bao Z, Frewen P. Sense of self in mind and body: an eLORETA-EEG study. Neurosci Conscious 2022; 2022:niac017. [PMID: 36530551 PMCID: PMC9748806 DOI: 10.1093/nc/niac017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2022] [Revised: 10/06/2022] [Accepted: 11/03/2022] [Indexed: 12/23/2022] Open
Abstract
The human brain engages the sense of self through both semantic and somatic self-referential processing (SRP). Alpha and theta oscillations have been found to underlie SRP but have not been compared with respect to semantic and somatic SRP. We recorded electroencephalography (EEG) from 50 participants during focused internal attention on life roles (e.g. "friend") and outer body (e.g. "arms") compared to resting state and an external attention memory task and localized the sources of on-scalp alpha (8-12 Hz) and theta (4-8 Hz) EEG signals with exact low-resolution tomography. Logarithm of F-ratios was calculated to compare differences in alpha and theta power between SRP conditions, resting state, and external attention. Results indicated that compared to resting state, semantic SRP induced lower theta in the frontal cortex and higher theta in the parietal cortex, whereas somatic SRP induced lower alpha in the frontal and insula cortex and higher alpha in the parietal cortex. Furthermore, results indicated that compared to external attention, both semantic and somatic SRP induced higher alpha in the dorsolateral prefrontal cortex with lateralized patterns based on task condition. Finally, an analysis directly comparing semantic and somatic SRP indicated frontal-parietal and left-right lateralization of SRP in the brain. Our results suggest the alpha and theta oscillations in the frontal, parietal, and the insula cortex may play crucial roles in semantic and somatic SRP.
Collapse
Affiliation(s)
| | - Paul Frewen
- *Correspondence address. Department of Psychiatry, Schulich School of Medicine and Dentistry, 339 Windermere Rd., London, ON N6A 5A5, Canada. Tel: +519 685 8500 E-mail:
| |
Collapse
|
40
|
Fernández-Rodríguez Á, Darves-Bornoz A, Velasco-Álvarez F, Ron-Angevin R. Effect of Stimulus Size in a Visual ERP-Based BCI under RSVP. SENSORS (BASEL, SWITZERLAND) 2022; 22:9505. [PMID: 36502205 PMCID: PMC9741214 DOI: 10.3390/s22239505] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Revised: 11/23/2022] [Accepted: 12/02/2022] [Indexed: 06/17/2023]
Abstract
Rapid serial visual presentation (RSVP) is currently one of the most suitable paradigms for use with a visual brain-computer interface based on event-related potentials (ERP-BCI) by patients with a lack of ocular motility. However, gaze-independent paradigms have not been studied as closely as gaze-dependent ones, and variables such as the sizes of the stimuli presented have not yet been explored under RSVP. Hence, the aim of the present work is to assess whether stimulus size has an impact on ERP-BCI performance under the RSVP paradigm. Twelve participants tested the ERP-BCI under RSVP using three different stimulus sizes: small (0.1 × 0.1 cm), medium (1.9 × 1.8 cm), and large (20.05 × 19.9 cm) at 60 cm. The results showed significant differences in accuracy between the conditions; the larger the stimulus, the better the accuracy obtained. It was also shown that these differences were not due to incorrect perception of the stimuli since there was no effect from the size in a perceptual discrimination task. The present work therefore shows that stimulus size has an impact on the performance of an ERP-BCI under RSVP. This finding should be considered by future ERP-BCI proposals aimed at users who need gaze-independent systems.
Collapse
Affiliation(s)
| | | | | | - Ricardo Ron-Angevin
- Departamento de Tecnología Electrónica, Universidad de Málaga, 29071 Malaga, Spain
| |
Collapse
|
41
|
Fuseda K, Watanabe H, Matsumoto A, Saito J, Naruse Y, Ihara AS. Impact of depressed state on attention and language processing during news broadcasts: EEG analysis and machine learning approach. Sci Rep 2022; 12:20492. [PMID: 36443392 PMCID: PMC9703439 DOI: 10.1038/s41598-022-24319-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Accepted: 11/14/2022] [Indexed: 11/29/2022] Open
Abstract
While information enriches daily life, it can also sometimes have a negative impact, depending on an individual's mental state. We recorded electroencephalogram (EEG) signals from depressed and non-depressed individuals classified based on the Beck Depression Inventory-II score while they listened to news to clarify differences in their attention to affective information and the impact of attentional bias on language processing. Results showed that depressed individuals are characterized by delayed attention to positive news and require a more increased load on language processing. The feasibility of detecting a depressed state using these EEG characteristics was evaluated by classifying individuals as depressed and non-depressed individuals. The area under the curve in the models trained by the EEG features used was 0.73. This result shows that individuals' mental states may be assessed based on EEG measured during daily activities like listening to news.
Collapse
Affiliation(s)
- Kohei Fuseda
- Center for Information and Neural Networks, Advanced ICT Research Institute, National Institute of Information and Communications Technology, and Osaka University, 588-2 Iwaoka, Iwaoka-cho, Nishi-ku, Kobe, Japan
- Bunkyo Gakuin University, Fujimino, Saitama, Japan
| | - Hiroki Watanabe
- Center for Information and Neural Networks, Advanced ICT Research Institute, National Institute of Information and Communications Technology, and Osaka University, 588-2 Iwaoka, Iwaoka-cho, Nishi-ku, Kobe, Japan.
| | - Atsushi Matsumoto
- Center for Information and Neural Networks, Advanced ICT Research Institute, National Institute of Information and Communications Technology, and Osaka University, 588-2 Iwaoka, Iwaoka-cho, Nishi-ku, Kobe, Japan
- Kansai University of Welfare Sciences, Kashiwara, Osaka, Japan
| | - Junpei Saito
- Center for Information and Neural Networks, Advanced ICT Research Institute, National Institute of Information and Communications Technology, and Osaka University, 588-2 Iwaoka, Iwaoka-cho, Nishi-ku, Kobe, Japan
| | - Yasushi Naruse
- Center for Information and Neural Networks, Advanced ICT Research Institute, National Institute of Information and Communications Technology, and Osaka University, 588-2 Iwaoka, Iwaoka-cho, Nishi-ku, Kobe, Japan
| | - Aya S Ihara
- Center for Information and Neural Networks, Advanced ICT Research Institute, National Institute of Information and Communications Technology, and Osaka University, 588-2 Iwaoka, Iwaoka-cho, Nishi-ku, Kobe, Japan.
| |
Collapse
|
42
|
Mavros P, J Wälti M, Nazemi M, Ong CH, Hölscher C. A mobile EEG study on the psychophysiological effects of walking and crowding in indoor and outdoor urban environments. Sci Rep 2022; 12:18476. [PMID: 36323718 PMCID: PMC9628500 DOI: 10.1038/s41598-022-20649-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2021] [Accepted: 09/16/2022] [Indexed: 11/06/2022] Open
Abstract
Environmental psychologists have established multiple psychological benefits of interaction with natural, compared to urban, environments on emotion, cognition, and attention. Yet, given the increasing urbanisation worldwide, it is equally important to understand how differences within different urban environments influence human psychological experience. We developed a laboratory experiment to examine the psychophysiological effects of the physical (outdoor or indoor) and social (crowded versus uncrowded) environment in healthy young adults, and to validate the use of mobile electroencephalography (EEG) and electrodermal activity (EDA) measurements during active walking. Participants (N = 42) were randomly assigned into a walking or a standing group, and watched six 1-min walk-through videos of green, urban indoor and urban outdoor environments, depicting high or low levels of social density. Self-reported emotional states show that green spaces is perceived as more calm and positive, and reduce attentional demands. Further, the outdoor urban space is perceived more positively than the indoor environment. These findings are consistent with earlier studies on the psychological benefits of nature and confirm the effectiveness of our paradigm and stimuli. In addition, we hypothesised that even short-term exposure to crowded scenes would have negative psychological effects. We found that crowded scenes evoked higher self-reported arousal, more negative self-reported valence, and recruited more cognitive and attentional resources. However, in walking participants, they evoked higher frontal alpha asymmetry, suggesting more positive affective responses. Furthermore, we found that using recent signal-processing methods, the EEG data produced a comparable signal-to-noise ratio between walking and standing, and that despite differences between walking and standing, skin-conductance also captured effectively psychophysiological responses to stimuli. These results suggest that emotional responses to visually presented stimuli can be measured effectively using mobile EEG and EDA in ambulatory settings, and that there is complex interaction between active walking, the social density of urban spaces, and direct and indirect affective responses to such environments.
Collapse
Affiliation(s)
- Panagiotis Mavros
- Singapore-ETH Centre, Future Cities Laboratory, CREATE campus, 1 CREATE Way, #06-01 CREATE Tower, Singapore, 138602, Singapore.
| | - Michel J Wälti
- Singapore-ETH Centre, Future Cities Laboratory, CREATE campus, 1 CREATE Way, #06-01 CREATE Tower, Singapore, 138602, Singapore
| | - Mohsen Nazemi
- Singapore-ETH Centre, Future Cities Laboratory, CREATE campus, 1 CREATE Way, #06-01 CREATE Tower, Singapore, 138602, Singapore
| | - Crystal Huiyi Ong
- Singapore-ETH Centre, Future Cities Laboratory, CREATE campus, 1 CREATE Way, #06-01 CREATE Tower, Singapore, 138602, Singapore
- National University of Singapore, Singapore, Singapore
| | - Christoph Hölscher
- Singapore-ETH Centre, Future Cities Laboratory, CREATE campus, 1 CREATE Way, #06-01 CREATE Tower, Singapore, 138602, Singapore
- Chair of Cognitive Science, Department of Humanities, Social and Political Sciences, ETH Zürich, Zürich, 8092, Switzerland
| |
Collapse
|
43
|
Tsai BY, Diddi SVS, Ko LW, Wang SJ, Chang CY, Jung TP. Development of an Adaptive Artifact Subspace Reconstruction Based on Hebbian/Anti-Hebbian Learning Networks for Enhancing BCI Performance. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022; PP:348-361. [PMID: 35714085 DOI: 10.1109/tnnls.2022.3174528] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Brain-computer interface (BCI) actively translates the brain signals into executable actions by establishing direct communication between the human brain and external devices. Recording brain activity through electroencephalography (EEG) is generally contaminated with both physiological and nonphysiological artifacts, which significantly hinders the BCI performance. Artifact subspace reconstruction (ASR) is a well-known statistical technique that automatically removes artifact components by determining the rejection threshold based on the initial reference EEG segment in multichannel EEG recordings. In real-world applications, the fixed threshold may limit the efficacy of the artifact correction, especially when the quality of the reference data is poor. This study proposes an adaptive online ASR technique by integrating the Hebbian/anti-Hebbian neural networks into the ASR algorithm, namely, principle subspace projection ASR (PSP-ASR) and principal subspace whitening ASR (PSW-ASR) that segmentwise self-organize the artifact subspace by updating the synaptic weights according to the Hebbian and anti-Hebbian learning rules. The effectiveness of the proposed algorithm is compared to the conventional ASR approaches on benchmark EEG dataset and three BCI frameworks, including steady-state visual evoked potential (SSVEP), rapid serial visual presentation (RSVP), and motor imagery (MI) by evaluating the root-mean-square error (RMSE), the signal-to-noise ratio (SNR), the Pearson correlation, and classification accuracy. The results demonstrated that the PSW-ASR algorithm effectively removed the EEG artifacts and retained the activity-specific brain signals compared to the PSP-ASR, standard ASR (Init-ASR), and moving-window ASR (MW-ASR) methods, thereby enhancing the SSVEP, RSVP, and MI BCI performances. Finally, our empirical results from the PSW-ASR algorithm suggested the choice of an aggressive cutoff range of c = 1-10 for activity-specific BCI applications and a moderate range of for the benchmark dataset and general BCI applications.
Collapse
|
44
|
Koshiyama D, Miyakoshi M, Tanaka-Koshiyama K, Sprock J, Light GA. High-power gamma-related delta phase alteration in schizophrenia patients at rest. Psychiatry Clin Neurosci 2022; 76:179-186. [PMID: 35037330 DOI: 10.1111/pcn.13331] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/06/2021] [Revised: 12/12/2021] [Accepted: 01/03/2022] [Indexed: 11/30/2022]
Abstract
AIM Information processing is supported by the cortico-cortical transmission of neural oscillations across brain regions. Recent studies have demonstrated that the rhythmic firing of neural populations is not random but is governed by interactions with other frequency bands. Specifically, the amplitude of gamma-band oscillations is associated with the phase of lower frequency oscillations in support of short and long-range communications among networks. This cross-frequency relation is thought to reflect the temporal coordination of neural communication. While schizophrenia patients show abnormal oscillatory responses across multiple frequencies at rest, it is unclear whether the functional relationships among frequency bands are intact. This study aimed to characterize the lower frequency (delta/theta, 1-8 Hz) phase and the amplitude of gamma oscillations in healthy subjects and schizophrenia patients at rest. METHODS Low frequency-phase (delta- and theta- band) angles and gamma-band amplitude relationships were assessed in 142 schizophrenia patients and 128 healthy subjects. RESULTS Significant low-frequency phase alteration related to high-power gamma was detected across broadly distributed scalp regions in both healthy subjects and patients. In patients, delta phase synchronization related to high-power gamma was significantly decreased at the frontocentral, right middle temporal, and left temporoparietal electrodes but significantly increased at the left parietal electrode. CONCLUSIONS High-power gamma-related delta phase alteration may reflect a core pathophysiologic abnormality in schizophrenia. Data-driven measures of functional relationships among frequency bands may prove useful in the development of novel therapeutics. Future studies are needed to determine whether these alterations are specific to schizophrenia or appear in other neuropsychiatric patient populations.
Collapse
Affiliation(s)
- Daisuke Koshiyama
- Department of Psychiatry, University of California San Diego, La Jolla, California, USA
| | - Makoto Miyakoshi
- Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, La Jolla, California, USA
| | | | - Joyce Sprock
- Department of Psychiatry, University of California San Diego, La Jolla, California, USA.,VISN-22 Mental Illness, Research, Education and Clinical Center (MIRECC), VA San Diego Healthcare System, San Diego, California, USA
| | - Gregory A Light
- Department of Psychiatry, University of California San Diego, La Jolla, California, USA.,VISN-22 Mental Illness, Research, Education and Clinical Center (MIRECC), VA San Diego Healthcare System, San Diego, California, USA
| |
Collapse
|
45
|
Scanlon JEM, Jacobsen NSJ, Maack MC, Debener S. Stepping in time: Alpha-mu and beta oscillations during a walking synchronization task. Neuroimage 2022; 253:119099. [PMID: 35301131 DOI: 10.1016/j.neuroimage.2022.119099] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2021] [Revised: 02/18/2022] [Accepted: 03/13/2022] [Indexed: 11/25/2022] Open
Abstract
Interpersonal behavioral synchrony is referred to as temporal coordination of action between two or more individuals. Humans tend to synchronize their movements during repetitive movement tasks such as walking. Mobile EEG technology now allows us to examine how this happens during gait. 18 participants equipped with foot accelerometers and mobile EEG walked with an experimenter in three conditions: With their view of the experimenter blocked, walking naturally, and trying to synchronize their steps with the experimenter. The experimenter walked following a headphone metronome to keep their steps consistent for all conditions. Step behavior and synchronization between the experimenter and participant were compared between conditions. Additionally, event-related spectral perturbations (ERSPs) were time-warped to the gait cycle in order to analyze alpha-mu (7.5-12.5 Hz) and beta (16-32 Hz) rhythms over the whole gait cycle. Step synchronization was significantly higher in the synchrony condition than in the natural condition. Likewise regarding ERSPs, right parietal channel (C4, C6, CP4, CP6) alpha-mu and central channel (C1, Cz, C2) beta power were suppressed from baseline in the walking synchrony condition compared to the natural walking condition. The natural and blocked conditions were not found to be significantly different in behavioral or spectral comparisons. Our results are compatible with the view that intentional synchronization employs systems associated with social interaction as well as the central motor system.
Collapse
Affiliation(s)
- J E M Scanlon
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany.
| | - N S J Jacobsen
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany
| | - M C Maack
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany
| | - S Debener
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany; Cluster of Excellence Hearing4all, University of Oldenburg, Oldenburg, Germany; Center for Neurosensory Science and Systems, University of Oldenburg, Oldenburg, Germany
| |
Collapse
|
46
|
Gorjan D, Gramann K, De Pauw K, Marusic U. Removal of movement-induced EEG artifacts: current state of the art and guidelines. J Neural Eng 2022; 19. [PMID: 35147512 DOI: 10.1088/1741-2552/ac542c] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2021] [Accepted: 02/08/2022] [Indexed: 11/12/2022]
Abstract
Electroencephalography (EEG) is a non-invasive technique used to record cortical neurons' electrical activity using electrodes placed on the scalp. It has become a promising avenue for research beyond state-of-the-art EEG research that is conducted under static conditions. EEG signals are always contaminated by artifacts and other physiological signals. Artifact contamination increases with the intensity of movement. In the last decade (since 2010), researchers have started to implement EEG measurements in dynamic setups to increase the overall ecological validity of the studies. Many different methods are used to remove non-brain activity from the EEG signal, and there are no clear guidelines on which method should be used in dynamic setups and for specific movement intensities. Currently, the most common methods for removing artifacts in movement studies are methods based on independent component analysis (ICA). However, the choice of method for artifact removal depends on the type and intensity of movement, which affects the characteristics of the artifacts and the EEG parameters of interest. When dealing with EEG under non-static conditions, special care must be taken already in the designing period of an experiment. Software and hardware solutions must be combined to achieve sufficient removal of unwanted signals from EEG measurements. We have provided recommendations for the use of each method depending on the intensity of the movement and highlighted the advantages and disadvantages of the methods. However, due to the current gap in the literature, further development and evaluation of methods for artifact removal in EEG data during locomotion is needed.
Collapse
Affiliation(s)
- Dasa Gorjan
- Science and Research Centre Koper, Garibaldijeva 1, Koper, 6000, SLOVENIA
| | - Klaus Gramann
- Technische Universität Berlin, Fasanenstr. 1, Berlin, Berlin, 10623, GERMANY
| | - Kevin De Pauw
- Vrije Universiteit Brussel, Pleinlaan 2, Brussel, Brussel, 1050, BELGIUM
| | - Uros Marusic
- Science and Research Centre Koper, Garibaldijeva 1, Koper, 6000, SLOVENIA
| |
Collapse
|
47
|
Hölle D, Blum S, Kissner S, Debener S, Bleichner MG. Real-Time Audio Processing of Real-Life Soundscapes for EEG Analysis: ERPs Based on Natural Sound Onsets. FRONTIERS IN NEUROERGONOMICS 2022; 3:793061. [PMID: 38235458 PMCID: PMC10790832 DOI: 10.3389/fnrgo.2022.793061] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/11/2021] [Accepted: 01/03/2021] [Indexed: 01/19/2024]
Abstract
With smartphone-based mobile electroencephalography (EEG), we can investigate sound perception beyond the lab. To understand sound perception in the real world, we need to relate naturally occurring sounds to EEG data. For this, EEG and audio information need to be synchronized precisely, only then it is possible to capture fast and transient evoked neural responses and relate them to individual sounds. We have developed Android applications (AFEx and Record-a) that allow for the concurrent acquisition of EEG data and audio features, i.e., sound onsets, average signal power (RMS), and power spectral density (PSD) on smartphone. In this paper, we evaluate these apps by computing event-related potentials (ERPs) evoked by everyday sounds. One participant listened to piano notes (played live by a pianist) and to a home-office soundscape. Timing tests showed a stable lag and a small jitter (< 3 ms) indicating a high temporal precision of the system. We calculated ERPs to sound onsets and observed the typical P1-N1-P2 complex of auditory processing. Furthermore, we show how to relate information on loudness (RMS) and spectra (PSD) to brain activity. In future studies, we can use this system to study sound processing in everyday life.
Collapse
Affiliation(s)
- Daniel Hölle
- Neurophysiology of Everyday Life Group, Department of Psychology, University of Oldenburg, Oldenburg, Germany
| | - Sarah Blum
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany
- Cluster of Excellence Hearing4all, Oldenburg, Germany
| | - Sven Kissner
- Institute for Hearing Technology and Audiology, Jade University of Applied Sciences, Oldenburg, Germany
| | - Stefan Debener
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany
| | - Martin G. Bleichner
- Neurophysiology of Everyday Life Group, Department of Psychology, University of Oldenburg, Oldenburg, Germany
| |
Collapse
|
48
|
Simar C, Petit R, Bozga N, Leroy A, Cebolla AM, Petieau M, Bontempi G, Cheron G. Riemannian classification of single-trial surface EEG and sources during checkerboard and navigational images in humans. PLoS One 2022; 17:e0262417. [PMID: 35030232 PMCID: PMC8759639 DOI: 10.1371/journal.pone.0262417] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Accepted: 12/23/2021] [Indexed: 11/19/2022] Open
Abstract
OBJECTIVE Different visual stimuli are classically used for triggering visual evoked potentials comprising well-defined components linked to the content of the displayed image. These evoked components result from the average of ongoing EEG signals in which additive and oscillatory mechanisms contribute to the component morphology. The evoked related potentials often resulted from a mixed situation (power variation and phase-locking) making basic and clinical interpretations difficult. Besides, the grand average methodology produced artificial constructs that do not reflect individual peculiarities. This motivated new approaches based on single-trial analysis as recently used in the brain-computer interface field. APPROACH We hypothesize that EEG signals may include specific information about the visual features of the displayed image and that such distinctive traits can be identified by state-of-the-art classification algorithms based on Riemannian geometry. The same classification algorithms are also applied to the dipole sources estimated by sLORETA. MAIN RESULTS AND SIGNIFICANCE We show that our classification pipeline can effectively discriminate between the display of different visual items (Checkerboard versus 3D navigational image) in single EEG trials throughout multiple subjects. The present methodology reaches a single-trial classification accuracy of about 84% and 93% for inter-subject and intra-subject classification respectively using surface EEG. Interestingly, we note that the classification algorithms trained on sLORETA sources estimation fail to generalize among multiple subjects (63%), which may be due to either the average head model used by sLORETA or the subsequent spatial filtering failing to extract discriminative information, but reach an intra-subject classification accuracy of 82%.
Collapse
Affiliation(s)
- Cédric Simar
- Machine Learning Group, Computer Science Department, Faculty of Sciences, Université Libre de Bruxelles (ULB), Brussels, Belgium
| | - Robin Petit
- Machine Learning Group, Computer Science Department, Faculty of Sciences, Université Libre de Bruxelles (ULB), Brussels, Belgium
- Interuniversity Institute of Bioinformatics in Brussels, Université Libre de Bruxelles- Vrije Universiteit Brussel, Brussels, Belgium
| | - Nichita Bozga
- Machine Learning Group, Computer Science Department, Faculty of Sciences, Université Libre de Bruxelles (ULB), Brussels, Belgium
| | - Axelle Leroy
- Laboratory of Neurophysiology and Movement Biomechanics, Neuroscience Institute, Université Libre de Bruxelles (ULB), Brussels, Belgium
| | - Ana-Maria Cebolla
- Laboratory of Neurophysiology and Movement Biomechanics, Neuroscience Institute, Université Libre de Bruxelles (ULB), Brussels, Belgium
| | - Mathieu Petieau
- Laboratory of Neurophysiology and Movement Biomechanics, Neuroscience Institute, Université Libre de Bruxelles (ULB), Brussels, Belgium
| | - Gianluca Bontempi
- Machine Learning Group, Computer Science Department, Faculty of Sciences, Université Libre de Bruxelles (ULB), Brussels, Belgium
| | - Guy Cheron
- Laboratory of Neurophysiology and Movement Biomechanics, Neuroscience Institute, Université Libre de Bruxelles (ULB), Brussels, Belgium
- Laboratory of Electrophysiology, Université de Mons-Hainaut, Mons, Belgium
| |
Collapse
|
49
|
Kim H, Kim Y, Miyakoshi M, Stapornchaisit S, Yoshimura N, Koike Y. Brain Activity Reflects Subjective Response to Delayed Input When Using an Electromyography-Controlled Robot. Front Syst Neurosci 2021; 15:767477. [PMID: 34912195 PMCID: PMC8667890 DOI: 10.3389/fnsys.2021.767477] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2021] [Accepted: 10/18/2021] [Indexed: 11/26/2022] Open
Abstract
In various experimental settings, electromyography (EMG) signals have been used to control robots. EMG-based robot control requires intrinsic parameters for control, which makes it difficult for users to understand the input protocol. When a proper input is not provided, the response time of the system varies; as such, the user’s subjective delay should be investigated regardless of the actual delay. In this study, we investigated the influence of the subjective perception of delay on brain activation. Brain recordings were taken while subjects used EMG signals to control a robot hand, which requires a basic processing delay. We used muscle synergy for the grip command of the robot hand. After controlling the robot by grasping their hand, one of four additional delay durations (0 ms, 50 ms, 125 ms, and 250 ms) was applied in every trial, and subjects were instructed to answer whether the delay was natural, additional, or whether they were not sure. We compared brain activity based on responses (“sure” and “not sure”). Our results revealed a significant power difference in the theta band of the parietal lobe, and this time range included the interval in which the subjects could not feel the delay. Our study provides important insights that should be considered when constructing an adaptive system and evaluating its usability.
Collapse
Affiliation(s)
- Hyeonseok Kim
- Institute of Innovative Research, Tokyo Institute of Technology, Yokohama, Japan.,Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California, San Diego, San Diego, CA, United States
| | - Yeongdae Kim
- Department of Industrial Engineering and Economics, Tokyo Institute of Technology, Tokyo, Japan
| | - Makoto Miyakoshi
- Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California, San Diego, San Diego, CA, United States
| | | | - Natsue Yoshimura
- Institute of Innovative Research, Tokyo Institute of Technology, Yokohama, Japan
| | - Yasuharu Koike
- Institute of Innovative Research, Tokyo Institute of Technology, Yokohama, Japan
| |
Collapse
|
50
|
Miyakoshi M, Nariai H, Rajaraman RR, Bernardo D, Shrey DW, Lopour BA, Sim MS, Staba RJ, Hussain SA. Automated preprocessing and phase-amplitude coupling analysis of scalp EEG discriminates infantile spasms from controls during wakefulness. Epilepsy Res 2021; 178:106809. [PMID: 34823159 DOI: 10.1016/j.eplepsyres.2021.106809] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2021] [Revised: 10/26/2021] [Accepted: 11/02/2021] [Indexed: 10/19/2022]
Abstract
OBJECTIVE Delta-gamma phase-amplitude coupling in EEG is useful for localizing epileptic sources and to evaluate severity in children with infantile spasms. We (1) develop an automated EEG preprocessing pipeline to clean data using artifact subspace reconstruction (ASR) and independent component (IC) analysis (ICA) and (2) evaluate delta-gamma modulation index (MI) as a method to distinguish children with epileptic spasms (cases) from normal controls during sleep and awake. METHODS Using 400 scalp EEG datasets (200 sleep, 200 awake) from 100 subjects, we calculated MI after applying high-pass and line-noise filters (Clean 0), and after ASR followed by either conservative (Clean 1) or stringent (Clean 2) artifactual IC rejection. Classification of cases and controls using MI was evaluated with Receiver Operating Characteristics (ROC) to obtain area under curve (AUC). RESULTS The artifact rejection algorithm reduced raw signal variance by 29-45% and 38-60% for Clean 1 and Clean 2, respectively. MI derived from sleep data, with or without preprocessing, robustly classified the groups (all AUC > 0.98). In contrast, group classification using MI derived from awake data was successful only after Clean 2 (AUC = 0.85). CONCLUSIONS We have developed an automated EEG preprocessing pipeline to perform artifact rejection and quantify delta-gamma modulation index.
Collapse
Affiliation(s)
- Makoto Miyakoshi
- Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, United States
| | - Hiroki Nariai
- David Geffen School of Medicine, Department of Pediatrics, University of California Los Angeles, United States.
| | - Rajsekar R Rajaraman
- David Geffen School of Medicine, Department of Pediatrics, University of California Los Angeles, United States
| | | | - Daniel W Shrey
- Children's Hospital of Orange County, Neurology, University of California, Irvine, Pediatrics, United States
| | - Beth A Lopour
- Henry Samueli School of Engineering, University of California Irvine, United States
| | - Myung Shin Sim
- Division of General Internal Medicine and Health Services Research, Department of Medicine Statistics Core, University of California Los Angeles, United States
| | - Richard J Staba
- David Geffen School of Medicine, Department of Neurology, University of California Los Angeles, United States
| | - Shaun A Hussain
- David Geffen School of Medicine, Department of Pediatrics, University of California Los Angeles, United States
| |
Collapse
|