1
|
Sireesha V, Tallapragada VVS, Naresh M, Pradeep Kumar GV. EEG-BCI-based motor imagery classification using double attention convolutional network. Comput Methods Biomech Biomed Engin 2025; 28:581-600. [PMID: 38164118 DOI: 10.1080/10255842.2023.2298369] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Revised: 11/07/2023] [Accepted: 12/13/2023] [Indexed: 01/03/2024]
Abstract
This article aims to improve and diversify signal processing techniques to execute a brain-computer interface (BCI) based on neurological phenomena observed when performing motor tasks using motor imagery (MI). The noise present in the original data, such as intermodulation noise, crosstalk, and other unwanted noise, is removed by Modify Least Mean Square (M-LMS) in the pre-processing stage. Traditional LMSs were unable to extract all the noise from the images. After pre-processing, the required features, such as statistical features, entropy features, etc., were extracted using Common Spatial Pattern (CSP) and Pearson's Correlation Coefficient (PCC) instead of the traditional single feature extraction model. The arithmetic optimization algorithm cannot select the features accurately and fails to reduce the feature dimensionality of the data. Thus, an Extended Arithmetic operation optimization (ExAo) algorithm is used to select the most significant attributes from the extracted features. The proposed model uses Double Attention Convolutional Neural Networks (DAttnConvNet) to classify the types of EEG signals based on optimal feature selection. Here, the attention mechanism is used to select and optimize the features to improve the classification accuracy and efficiency of the model. In EEG motor imagery datasets, the proposed model has been analyzed under class, which obtained an accuracy of 99.98% in class Baseline (B), 99.82% in class Imagined movement of a right fist (R) and 99.61% in class Imagined movement of both fists (RL). In the EEG dataset, the proposed model can obtain a high accuracy of 97.94% compared to EEG datasets of other models.
Collapse
Affiliation(s)
- V Sireesha
- Department of Computer Science and Engineering, School of Technology, GITAM University, Hyderabad, India
| | | | - M Naresh
- Department of ECE, Matrusri Engineering College, Saidabad, Hyderabad, India
| | - G V Pradeep Kumar
- Department of ECE, Chaitanya Bharathi Institute of Technology, Hyderabad, India
| |
Collapse
|
2
|
Maiseli B, Abdalla AT, Massawe LV, Mbise M, Mkocha K, Nassor NA, Ismail M, Michael J, Kimambo S. Brain-computer interface: trend, challenges, and threats. Brain Inform 2023; 10:20. [PMID: 37540385 PMCID: PMC10403483 DOI: 10.1186/s40708-023-00199-3] [Citation(s) in RCA: 21] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2023] [Accepted: 07/01/2023] [Indexed: 08/05/2023] Open
Abstract
Brain-computer interface (BCI), an emerging technology that facilitates communication between brain and computer, has attracted a great deal of research in recent years. Researchers provide experimental results demonstrating that BCI can restore the capabilities of physically challenged people, hence improving the quality of their lives. BCI has revolutionized and positively impacted several industries, including entertainment and gaming, automation and control, education, neuromarketing, and neuroergonomics. Notwithstanding its broad range of applications, the global trend of BCI remains lightly discussed in the literature. Understanding the trend may inform researchers and practitioners on the direction of the field, and on where they should invest their efforts more. Noting this significance, we have analyzed 25,336 metadata of BCI publications from Scopus to determine advancement of the field. The analysis shows an exponential growth of BCI publications in China from 2019 onwards, exceeding those from the United States that started to decline during the same period. Implications and reasons for this trend are discussed. Furthermore, we have extensively discussed challenges and threats limiting exploitation of BCI capabilities. A typical BCI architecture is hypothesized to address two prominent BCI threats, privacy and security, as an attempt to make the technology commercially viable to the society.
Collapse
Affiliation(s)
- Baraka Maiseli
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania.
| | - Abdi T Abdalla
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - Libe V Massawe
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - Mercy Mbise
- Department of Computer Science and Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - Khadija Mkocha
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - Nassor Ally Nassor
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - Moses Ismail
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - James Michael
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - Samwel Kimambo
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| |
Collapse
|
3
|
Dillen A, Steckelmacher D, Efthymiadis K, Langlois K, De Beir A, Marušič U, Vanderborght B, Nowé A, Meeusen R, Ghaffari F, Romain O, De Pauw K. Deep learning for biosignal control: insights from basic to real-time methods with recommendations. J Neural Eng 2022; 19. [PMID: 35086076 DOI: 10.1088/1741-2552/ac4f9a] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2021] [Accepted: 01/27/2022] [Indexed: 11/11/2022]
Abstract
Biosignal control is an interaction modality that allows users to interact with electronic devices by decoding the biological signals emanating from the movements or thoughts of the user. This manner of interaction with devices can enhance the sense of agency for users and enable persons suffering from a paralyzing condition to interact with everyday devices that would otherwise be challenging for them to use. It can also improve control of prosthetic devices and exoskeletons by making the interaction feel more natural and intuitive. However, with the current state of the art, several issues still need to be addressed to reliably decode user intent from biosignals and provide an improved user experience over other interaction modalities. One solution is to leverage advances in Deep Learning (DL) methods to provide more reliable decoding at the expense of added computational complexity. This scoping review introduces the basic concepts of DL and assists readers in deploying DL methods to a real-time control system that should operate under real-world conditions. The scope of this review covers any electronic device, but with an emphasis on robotic devices, as this is the most active area of research in biosignal control. We review the literature pertaining to the implementation and evaluation of control systems that incorporate DL to identify the main gaps and issues in the field, and formulate suggestions on how to mitigate them. Additionally, we formulate guidelines on the best approach to designing, implementing and evaluating research prototypes that use DL in their biosignal control systems.
Collapse
Affiliation(s)
- Arnau Dillen
- Vrije Universiteit Brussel, Pleinlaan 2, Brussel, Brussel, 1050, BELGIUM
| | | | | | - Kevin Langlois
- Vrije Universiteit Brussel, Pleinlaan 2, Brussel, Brussel, 1050, BELGIUM
| | - Albert De Beir
- Vrije Universiteit Brussel, Pleinlaan 2, Brussel, Brussel, 1050, BELGIUM
| | - Uroš Marušič
- Alma Mater Europaea - Evropski Center Maribor, Slovenska ulica 17, Maribor, Maribor, 2000, SLOVENIA
| | - Bram Vanderborght
- Vrije Universiteit Brussel, Faculty of Applied Sciences, Brussel, Brussel, 1050, BELGIUM
| | - Ann Nowé
- Vrije Universiteit Brussel, Pleinlaan 2, Brussel, Brussel, 1050, BELGIUM
| | - Romain Meeusen
- Vrije Universiteit Brussel, Pleinlaan 2, Brussel, Brussel, 1050, BELGIUM
| | - Fakhreddine Ghaffari
- Equipe Traitement de l'Information et Systèmes, CY Cergy Paris University, 6 Rue du Ponceau, Cergy-Pontoise, 95000 , FRANCE
| | - Olivier Romain
- Equipe Traitement de l'Information et Systèmes, CY Cergy Paris University, 6 Rue du Ponceau, Cergy-Pontoise, 95000 , FRANCE
| | - Kevin De Pauw
- Vrije Universiteit Brussel, Pleinlaan 2, Brussel, Brussel, 1050, BELGIUM
| |
Collapse
|
4
|
Cattan G. The Use of Brain–Computer Interfaces in Games Is Not Ready for the General Public. FRONTIERS IN COMPUTER SCIENCE 2021. [DOI: 10.3389/fcomp.2021.628773] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
|
5
|
Hogan J, Sun H, Paixao L, Westmeijer M, Sikka P, Jin J, Tesh R, Cardoso M, Cash SS, Akeju O, Thomas R, Westover MB. Night-to-night variability of sleep electroencephalography-based brain age measurements. Clin Neurophysiol 2021; 132:1-12. [PMID: 33248430 PMCID: PMC7855943 DOI: 10.1016/j.clinph.2020.09.029] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2020] [Revised: 08/21/2020] [Accepted: 09/18/2020] [Indexed: 11/28/2022]
Abstract
OBJECTIVE Brain Age Index (BAI), calculated from sleep electroencephalography (EEG), has been proposed as a biomarker of brain health. This study quantifies night-to-night variability of BAI and establishes probability thresholds for inferring underlying brain pathology based on a patient's BAI. METHODS 86 patients with multiple nights of consecutive EEG recordings were selected from Epilepsy Monitoring Unit patients whose EEGs reported as within normal limits. While EEGs with epileptiform activity were excluded, the majority of patients included in the study had a diagnosis of chronic epilepsy. BAI was calculated for each 12-hour segment of patient data using a previously established algorithm, and the night-to-night variability in BAI was measured. RESULTS The within-patient night-to-night standard deviation in BAI was 7.5 years. Estimates of BAI derived by averaging over 2, 3, and 4 nights had standard deviations of 4.7, 3.7, and 3.0 years, respectively. CONCLUSIONS Averaging BAI over n nights reduces night-to-night variability of BAI by a factor of n, rendering BAI a more suitable biomarker of brain health at the individual level. A brain age risk lookup table of results provides thresholds above which a patient has a high probability of excess BAI. SIGNIFICANCE With increasing ease of EEG acquisition, including wearable technology, BAI has the potential to track brain health and detect deviations from normal physiologic function. The measure of night-to-night variability and how this is reduced by averaging across multiple nights provides a basis for using BAI in patients' homes to identify patients who should undergo further investigation or monitoring.
Collapse
Affiliation(s)
- Jacob Hogan
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Haoqi Sun
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Luis Paixao
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Mike Westmeijer
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Pooja Sikka
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Jing Jin
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Ryan Tesh
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Madalena Cardoso
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Sydney S Cash
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Oluwaseun Akeju
- Department of Anesthesia, Critical Care, and Pain Medicine, Massachusetts General Hospital, Boston, MA, USA
| | - Robert Thomas
- Division of Pulmonary, Critical Care and Sleep Medicine, Department of Medicine, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - M Brandon Westover
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA.
| |
Collapse
|
6
|
Craik A, He Y, Contreras-Vidal JL. Deep learning for electroencephalogram (EEG) classification tasks: a review. J Neural Eng 2019; 16:031001. [PMID: 30808014 DOI: 10.1088/1741-2552/ab0ab5] [Citation(s) in RCA: 504] [Impact Index Per Article: 84.0] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
OBJECTIVE Electroencephalography (EEG) analysis has been an important tool in neuroscience with applications in neuroscience, neural engineering (e.g. Brain-computer interfaces, BCI's), and even commercial applications. Many of the analytical tools used in EEG studies have used machine learning to uncover relevant information for neural classification and neuroimaging. Recently, the availability of large EEG data sets and advances in machine learning have both led to the deployment of deep learning architectures, especially in the analysis of EEG signals and in understanding the information it may contain for brain functionality. The robust automatic classification of these signals is an important step towards making the use of EEG more practical in many applications and less reliant on trained professionals. Towards this goal, a systematic review of the literature on deep learning applications to EEG classification was performed to address the following critical questions: (1) Which EEG classification tasks have been explored with deep learning? (2) What input formulations have been used for training the deep networks? (3) Are there specific deep learning network structures suitable for specific types of tasks? APPROACH A systematic literature review of EEG classification using deep learning was performed on Web of Science and PubMed databases, resulting in 90 identified studies. Those studies were analyzed based on type of task, EEG preprocessing methods, input type, and deep learning architecture. MAIN RESULTS For EEG classification tasks, convolutional neural networks, recurrent neural networks, deep belief networks outperform stacked auto-encoders and multi-layer perceptron neural networks in classification accuracy. The tasks that used deep learning fell into five general groups: emotion recognition, motor imagery, mental workload, seizure detection, event related potential detection, and sleep scoring. For each type of task, we describe the specific input formulation, major characteristics, and end classifier recommendations found through this review. SIGNIFICANCE This review summarizes the current practices and performance outcomes in the use of deep learning for EEG classification. Practical suggestions on the selection of many hyperparameters are provided in the hope that they will promote or guide the deployment of deep learning to EEG datasets in future research.
Collapse
|