1
|
Clemente L, La Rocca M, Paparella G, Delussi M, Tancredi G, Ricci K, Procida G, Introna A, Brunetti A, Taurisano P, Bevilacqua V, de Tommaso M. Exploring Aesthetic Perception in Impaired Aging: A Multimodal Brain-Computer Interface Study. Sensors (Basel) 2024; 24:2329. [PMID: 38610540 PMCID: PMC11014209 DOI: 10.3390/s24072329] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Revised: 04/03/2024] [Accepted: 04/03/2024] [Indexed: 04/14/2024]
Abstract
In the field of neuroscience, brain-computer interfaces (BCIs) are used to connect the human brain with external devices, providing insights into the neural mechanisms underlying cognitive processes, including aesthetic perception. Non-invasive BCIs, such as EEG and fNIRS, are critical for studying central nervous system activity and understanding how individuals with cognitive deficits process and respond to aesthetic stimuli. This study assessed twenty participants who were divided into control and impaired aging (AI) groups based on MMSE scores. EEG and fNIRS were used to measure their neurophysiological responses to aesthetic stimuli that varied in pleasantness and dynamism. Significant differences were identified between the groups in P300 amplitude and late positive potential (LPP), with controls showing greater reactivity. AI subjects showed an increase in oxyhemoglobin in response to pleasurable stimuli, suggesting hemodynamic compensation. This study highlights the effectiveness of multimodal BCIs in identifying the neural basis of aesthetic appreciation and impaired aging. Despite its limitations, such as sample size and the subjective nature of aesthetic appreciation, this research lays the groundwork for cognitive rehabilitation tailored to aesthetic perception, improving the comprehension of cognitive disorders through integrated BCI methodologies.
Collapse
Affiliation(s)
- Livio Clemente
- Translational Biomedicine and Neuroscience (DiBraiN) Department, University of Bari, 70124 Bari, Italy; (L.C.); (G.P.); (M.D.); (G.T.); (K.R.); (G.P.); (A.I.); (P.T.)
| | - Marianna La Rocca
- Interateneo Department of Fisica ‘M. Merlin’, University of Bari, 70125 Bari, Italy;
- Laboratory of Neuroimaging, USC Stevens Neuroimaging and Informatics Institute, Keck School of Medicine of USC, University of Southern California, Los Angeles, CA 90033, USA
| | - Giulia Paparella
- Translational Biomedicine and Neuroscience (DiBraiN) Department, University of Bari, 70124 Bari, Italy; (L.C.); (G.P.); (M.D.); (G.T.); (K.R.); (G.P.); (A.I.); (P.T.)
| | - Marianna Delussi
- Translational Biomedicine and Neuroscience (DiBraiN) Department, University of Bari, 70124 Bari, Italy; (L.C.); (G.P.); (M.D.); (G.T.); (K.R.); (G.P.); (A.I.); (P.T.)
| | - Giusy Tancredi
- Translational Biomedicine and Neuroscience (DiBraiN) Department, University of Bari, 70124 Bari, Italy; (L.C.); (G.P.); (M.D.); (G.T.); (K.R.); (G.P.); (A.I.); (P.T.)
| | - Katia Ricci
- Translational Biomedicine and Neuroscience (DiBraiN) Department, University of Bari, 70124 Bari, Italy; (L.C.); (G.P.); (M.D.); (G.T.); (K.R.); (G.P.); (A.I.); (P.T.)
| | - Giuseppe Procida
- Translational Biomedicine and Neuroscience (DiBraiN) Department, University of Bari, 70124 Bari, Italy; (L.C.); (G.P.); (M.D.); (G.T.); (K.R.); (G.P.); (A.I.); (P.T.)
| | - Alessandro Introna
- Translational Biomedicine and Neuroscience (DiBraiN) Department, University of Bari, 70124 Bari, Italy; (L.C.); (G.P.); (M.D.); (G.T.); (K.R.); (G.P.); (A.I.); (P.T.)
| | - Antonio Brunetti
- Electrical and Information Engineering Department, Polytechnic of Bari, 70125 Bari, Italy; (A.B.); (V.B.)
| | - Paolo Taurisano
- Translational Biomedicine and Neuroscience (DiBraiN) Department, University of Bari, 70124 Bari, Italy; (L.C.); (G.P.); (M.D.); (G.T.); (K.R.); (G.P.); (A.I.); (P.T.)
| | - Vitoantonio Bevilacqua
- Electrical and Information Engineering Department, Polytechnic of Bari, 70125 Bari, Italy; (A.B.); (V.B.)
| | - Marina de Tommaso
- Translational Biomedicine and Neuroscience (DiBraiN) Department, University of Bari, 70124 Bari, Italy; (L.C.); (G.P.); (M.D.); (G.T.); (K.R.); (G.P.); (A.I.); (P.T.)
| |
Collapse
|
2
|
Nagarajan A, Robinson N, Ang KK, Chua KSG, Chew E, Guan C. Transferring a deep learning model from healthy subjects to stroke patients in a motor imagery brain-computer interface. J Neural Eng 2024; 21:016007. [PMID: 38091617 DOI: 10.1088/1741-2552/ad152f] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Accepted: 12/13/2023] [Indexed: 01/18/2024]
Abstract
Objective.Motor imagery (MI) brain-computer interfaces (BCIs) based on electroencephalogram (EEG) have been developed primarily for stroke rehabilitation, however, due to limited stroke data, current deep learning methods for cross-subject classification rely on healthy data. This study aims to assess the feasibility of applying MI-BCI models pre-trained using data from healthy individuals to detect MI in stroke patients.Approach.We introduce a new transfer learning approach where features from two-class MI data of healthy individuals are used to detect MI in stroke patients. We compare the results of the proposed method with those obtained from analyses within stroke data. Experiments were conducted using Deep ConvNet and state-of-the-art subject-specific machine learning MI classifiers, evaluated on OpenBMI two-class MI-EEG data from healthy subjects and two-class MI versus rest data from stroke patients.Main results.Results of our study indicate that through domain adaptation of a model pre-trained using healthy subjects' data, an average MI detection accuracy of 71.15% (±12.46%) can be achieved across 71 stroke patients. We demonstrate that the accuracy of the pre-trained model increased by 18.15% after transfer learning (p<0.001). Additionally, the proposed transfer learning method outperforms the subject-specific results achieved by Deep ConvNet and FBCSP, with significant enhancements of 7.64% (p<0.001) and 5.55% (p<0.001) in performance, respectively. Notably, the healthy-to-stroke transfer learning approach achieved similar performance to stroke-to-stroke transfer learning, with no significant difference (p>0.05). Explainable AI analyses using transfer models determined channel relevance patterns that indicate contributions from the bilateral motor, frontal, and parietal regions of the cortex towards MI detection in stroke patients.Significance.Transfer learning from healthy to stroke can enhance the clinical use of BCI algorithms by overcoming the challenge of insufficient clinical data for optimal training.
Collapse
Affiliation(s)
- Aarthy Nagarajan
- School of Computer Science and Engineering, Nanyang Technological University, 50 Nanyang Ave, Singapore 639798, Singapore
| | - Neethu Robinson
- School of Computer Science and Engineering, Nanyang Technological University, 50 Nanyang Ave, Singapore 639798, Singapore
| | - Kai Keng Ang
- School of Computer Science and Engineering, Nanyang Technological University, 50 Nanyang Ave, Singapore 639798, Singapore
- Institute for Infocomm Research, Agency of Science, Technology and Research (A*STAR), 1 Fusionopolis Way, Singapore 138632, Singapore
| | - Karen Sui Geok Chua
- Department of Rehabilitation Medicine, Tan Tock Seng Hospital, 11 Jln Tan Tock Seng, Singapore 308433, Singapore
| | - Effie Chew
- National University Health System, 1E Kent Ridge Road, Singapore 119228, Singapore
| | - Cuntai Guan
- School of Computer Science and Engineering, Nanyang Technological University, 50 Nanyang Ave, Singapore 639798, Singapore
| |
Collapse
|
3
|
Leoni J, Strada SC, Tanelli M, Proverbio AM. MIRACLE: MInd ReAding CLassification Engine. IEEE Trans Neural Syst Rehabil Eng 2023; 31:3212-3222. [PMID: 37535483 DOI: 10.1109/tnsre.2023.3301507] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/05/2023]
Abstract
Brain-computer interfaces (BCIs) have revolutionized the way humans interact with machines, particularly for patients with severe motor impairments. EEG-based BCIs have limited functionality due to the restricted pool of stimuli that they can distinguish, while those elaborating event-related potentials up to now employ paradigms that require the patient's perception of the eliciting stimulus. In this work, we propose MIRACLE: a novel BCI system that combines functional data analysis and machine-learning techniques to decode patients' minds from the elicited potentials. MIRACLE relies on a hierarchical ensemble classifier recognizing 10 different semantic categories of imagined stimuli. We validated MIRACLE on an extensive dataset collected from 20 volunteers, with both imagined and perceived stimuli, to compare the system performance on the two. Furthermore, we quantify the importance of each EEG channel in the decision-making process of the classifier, which can help reduce the number of electrodes required for data acquisition, enhancing patients' comfort.
Collapse
|
4
|
Maiseli B, Abdalla AT, Massawe LV, Mbise M, Mkocha K, Nassor NA, Ismail M, Michael J, Kimambo S. Brain-computer interface: trend, challenges, and threats. Brain Inform 2023; 10:20. [PMID: 37540385 PMCID: PMC10403483 DOI: 10.1186/s40708-023-00199-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2023] [Accepted: 07/01/2023] [Indexed: 08/05/2023] Open
Abstract
Brain-computer interface (BCI), an emerging technology that facilitates communication between brain and computer, has attracted a great deal of research in recent years. Researchers provide experimental results demonstrating that BCI can restore the capabilities of physically challenged people, hence improving the quality of their lives. BCI has revolutionized and positively impacted several industries, including entertainment and gaming, automation and control, education, neuromarketing, and neuroergonomics. Notwithstanding its broad range of applications, the global trend of BCI remains lightly discussed in the literature. Understanding the trend may inform researchers and practitioners on the direction of the field, and on where they should invest their efforts more. Noting this significance, we have analyzed 25,336 metadata of BCI publications from Scopus to determine advancement of the field. The analysis shows an exponential growth of BCI publications in China from 2019 onwards, exceeding those from the United States that started to decline during the same period. Implications and reasons for this trend are discussed. Furthermore, we have extensively discussed challenges and threats limiting exploitation of BCI capabilities. A typical BCI architecture is hypothesized to address two prominent BCI threats, privacy and security, as an attempt to make the technology commercially viable to the society.
Collapse
Affiliation(s)
- Baraka Maiseli
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania.
| | - Abdi T Abdalla
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - Libe V Massawe
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - Mercy Mbise
- Department of Computer Science and Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - Khadija Mkocha
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - Nassor Ally Nassor
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - Moses Ismail
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - James Michael
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| | - Samwel Kimambo
- Department of Electronics and Telecommunications Engineering, College of Information and Communication Technologies, University of Dar es Salaam, 14113, Dar es Salaam, Tanzania
| |
Collapse
|
5
|
Cardona-Álvarez YN, Álvarez-Meza AM, Cárdenas-Peña DA, Castaño-Duque GA, Castellanos-Dominguez G. A Novel OpenBCI Framework for EEG-Based Neurophysiological Experiments. Sensors (Basel) 2023; 23:3763. [PMID: 37050823 PMCID: PMC10098804 DOI: 10.3390/s23073763] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/12/2023] [Revised: 02/23/2023] [Accepted: 02/27/2023] [Indexed: 06/19/2023]
Abstract
An Open Brain-Computer Interface (OpenBCI) provides unparalleled freedom and flexibility through open-source hardware and firmware at a low-cost implementation. It exploits robust hardware platforms and powerful software development kits to create customized drivers with advanced capabilities. Still, several restrictions may significantly reduce the performance of OpenBCI. These limitations include the need for more effective communication between computers and peripheral devices and more flexibility for fast settings under specific protocols for neurophysiological data. This paper describes a flexible and scalable OpenBCI framework for electroencephalographic (EEG) data experiments using the Cyton acquisition board with updated drivers to maximize the hardware benefits of ADS1299 platforms. The framework handles distributed computing tasks and supports multiple sampling rates, communication protocols, free electrode placement, and single marker synchronization. As a result, the OpenBCI system delivers real-time feedback and controlled execution of EEG-based clinical protocols for implementing the steps of neural recording, decoding, stimulation, and real-time analysis. In addition, the system incorporates automatic background configuration and user-friendly widgets for stimuli delivery. Motor imagery tests the closed-loop BCI designed to enable real-time streaming within the required latency and jitter ranges. Therefore, the presented framework offers a promising solution for tailored neurophysiological data processing.
Collapse
Affiliation(s)
| | | | | | - Germán Albeiro Castaño-Duque
- Cultura de la Calidad en la Educación Research Group, Universidad Nacional de Colombia, Manizales 170003, Colombia
| | | |
Collapse
|
6
|
Shi B, Chen X, Yue Z, Zeng F, Yin S, Wang B, Wang J. Feature optimization based on improved novel global harmony search algorithm for motor imagery electroencephalogram classification. Front Comput Neurosci 2022; 16:1004301. [PMID: 36589278 PMCID: PMC9801329 DOI: 10.3389/fncom.2022.1004301] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2022] [Accepted: 11/23/2022] [Indexed: 12/23/2022] Open
Abstract
Background Effectively decoding electroencephalogram (EEG) pattern for specific mental tasks is a crucial topic in the development of brain-computer interface (BCI). Extracting common spatial pattern (CSP) features from motor imagery EEG signals is often highly dependent on the selection of frequency band and time interval. Therefore, optimizing frequency band and time interval would contribute to effective feature extraction and accurate EEG decoding. Objective This study proposes an approach based on an improved novel global harmony search (INGHS) to optimize frequency-time parameters for effective CSP feature extraction. Methods The INGHS algorithm is applied to find the optimal frequency band and temporal interval. The linear discriminant analysis and support vector machine are used for EEG pattern decoding. Extensive experimental studies are conducted on three EEG datasets to assess the effectiveness of our proposed method. Results The average test accuracy obtained by the time-frequency parameters selected by the proposed INGHS method is slightly better than artificial bee colony (ABC) and particle swarm optimization (PSO) algorithms. Furthermore, the INGHS algorithm is superior to PSO and ABC in running time. Conclusion These superior experimental results demonstrate that the optimal frequency band and time interval selected by the INGHS algorithm could significantly improve the decoding accuracy compared with the traditional CSP method. This method has a potential to improve the performance of MI-based BCI systems.
Collapse
Affiliation(s)
- Bin Shi
- Xi’an Research Institute of High-Technology, Xi’an, Shaanxi, China
| | - Xiaokai Chen
- Rehabilitation Medical Center, Huizhou Third People’s Hospital, Huizhou, China
| | - Zan Yue
- Institute of Robotics and Intelligent System, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
- iHarbour Academy of Frontier Equipment (iAFE), Xi’an, China
| | - Feixiang Zeng
- Rehabilitation Medical Center, Huizhou Third People’s Hospital, Huizhou, China
| | - Shuai Yin
- Institute of Robotics and Intelligent System, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
- iHarbour Academy of Frontier Equipment (iAFE), Xi’an, China
| | - Benguo Wang
- Department of Rehabilitation Medicine, Longgang District People’s Hospital of Shenzhen, Shenzhen, China
- Department of Rehabilitation Medicine, The Second Affiliated Hospital of The Chinese University of Hong Kong, Shenzhen, China
| | - Jing Wang
- Institute of Robotics and Intelligent System, School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an, China
- iHarbour Academy of Frontier Equipment (iAFE), Xi’an, China
| |
Collapse
|
7
|
Ou W, Xiao S, Zhu C, Han W, Zhang Q. An overview of brain-like computing: Architecture, applications, and future trends. Front Neurorobot 2022; 16:1041108. [PMID: 36506817 PMCID: PMC9730831 DOI: 10.3389/fnbot.2022.1041108] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2022] [Accepted: 10/31/2022] [Indexed: 11/25/2022] Open
Abstract
With the development of technology, Moore's law will come to an end, and scientists are trying to find a new way out in brain-like computing. But we still know very little about how the brain works. At the present stage of research, brain-like models are all structured to mimic the brain in order to achieve some of the brain's functions, and then continue to improve the theories and models. This article summarizes the important progress and status of brain-like computing, summarizes the generally accepted and feasible brain-like computing models, introduces, analyzes, and compares the more mature brain-like computing chips, outlines the attempts and challenges of brain-like computing applications at this stage, and looks forward to the future development of brain-like computing. It is hoped that the summarized results will help relevant researchers and practitioners to quickly grasp the research progress in the field of brain-like computing and acquire the application methods and related knowledge in this field.
Collapse
Affiliation(s)
- Wei Ou
- The School of Cyberspace Security, Hainan University, Hainan, China
- Henan Key Laboratory of Network Cryptography Technology, Zhengzhou, China
| | - Shitao Xiao
- The School of Computer Science and Technology, Hainan, China
| | - Chengyu Zhu
- The School of Cyberspace Security, Hainan University, Hainan, China
| | - Wenbao Han
- The School of Cyberspace Security, Hainan University, Hainan, China
| | - Qionglu Zhang
- State Key Laboratory of Information Security, Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
8
|
Mouratille D, Amadieu F, Matton N. A meta-analysis on air traffic controllers selection: cognitive and non-cognitive predictors. Journal of Vocational Behavior 2022; 138:103769. [DOI: 10.1016/j.jvb.2022.103769] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
9
|
Patwardhan S, Schofield J, Joiner WM, Sikdar S. Sonomyography shows feasibility as a tool to quantify joint movement at the muscle level. IEEE Int Conf Rehabil Robot 2022; 2022:1-5. [PMID: 36176162 PMCID: PMC9806856 DOI: 10.1109/icorr55369.2022.9896582] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
Several methods have been used to quantify human movement at different levels, from coordinated multi joint movements to those taking place at the single muscle level. These methods are developed either in order to allow us to interact with computers and machines, or to use such technologies for aiding rehabilitation among those with mobility impairments or movement disorders. Human machine interfaces typically rely on some existing human movement ability and measure it using motion tracking or inertial measurement units, while the rehabilitation applications may require us to measure human motor intent. Surface or implanted electrodes, electromyography, electroencephalography, and brain computer interfaces are beneficial in this regard, but have their own shortcomings. We have previously shown feasibility of using ultrasound imaging (Sonomyography) to infer human motor intent and allow users to control external biomechatronic devices such as prosthetics. Here, we asked users to freely move their hand in three different movement patterns, measuring their actual joint angles and passively computing their Sonomyographic output signal. We found a high correlation between these two signals, demonstrating that the Sonomyography signal is not only user-controlled and stable, but it is closely linked with the user's actual movement level. These results could help design wearable rehabilitation or human computer interaction devices based on Sonomyography to decode human motor intent.
Collapse
Affiliation(s)
| | - Jonathon Schofield
- Mechanical and Aerospace Engineering Department, University of California, Davis, USA
| | - Wilsaan M. Joiner
- Department of Neurobiology, Physiology and Behavior, University of California, Davis, CA, USA
| | - Siddhartha Sikdar
- Department of Bioengineering, George Mason University, Fairfax VA, USA,Center for Adaptive Systems of Brain-Body Interactions, Fairfax, VA
| |
Collapse
|
10
|
Ramírez-arias FJ, García-guerrero EE, Tlelo-cuautle E, Colores-vargas JM, García-canseco E, López-bonilla OR, Galindo-aldana GM, Inzunza-gonzález E. Evaluation of Machine Learning Algorithms for Classification of EEG Signals. Technologies 2022; 10:79. [DOI: 10.3390/technologies10040079] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
In brain–computer interfaces (BCIs), it is crucial to process brain signals to improve the accuracy of the classification of motor movements. Machine learning (ML) algorithms such as artificial neural networks (ANNs), linear discriminant analysis (LDA), decision tree (D.T.), K-nearest neighbor (KNN), naive Bayes (N.B.), and support vector machine (SVM) have made significant progress in classification issues. This paper aims to present a signal processing analysis of electroencephalographic (EEG) signals among different feature extraction techniques to train selected classification algorithms to classify signals related to motor movements. The motor movements considered are related to the left hand, right hand, both fists, feet, and relaxation, making this a multiclass problem. In this study, nine ML algorithms were trained with a dataset created by the feature extraction of EEG signals.The EEG signals of 30 Physionet subjects were used to create a dataset related to movement. We used electrodes C3, C1, CZ, C2, and C4 according to the standard 10-10 placement. Then, we extracted the epochs of the EEG signals and applied tone, amplitude levels, and statistical techniques to obtain the set of features. LabVIEW™2015 version custom applications were used for reading the EEG signals; for channel selection, noise filtering, band selection, and feature extraction operations; and for creating the dataset. MATLAB 2021a was used for training, testing, and evaluating the performance metrics of the ML algorithms. In this study, the model of Medium-ANN achieved the best performance, with an AUC average of 0.9998, Cohen’s Kappa coefficient of 0.9552, a Matthews correlation coefficient of 0.9819, and a loss of 0.0147. These findings suggest the applicability of our approach to different scenarios, such as implementing robotic prostheses, where the use of superficial features is an acceptable option when resources are limited, as in embedded systems or edge computing devices.
Collapse
|
11
|
Sapari L, Hout S, Chung JY. Brain Implantable End-Fire Antenna with Enhanced Gain and Bandwidth. Sensors (Basel) 2022; 22:s22124328. [PMID: 35746109 PMCID: PMC9231057 DOI: 10.3390/s22124328] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/29/2022] [Revised: 06/05/2022] [Accepted: 06/06/2022] [Indexed: 12/31/2022]
Abstract
An end-fire radiating implantable antenna with a small footprint and broadband operation at the frequency range of 3–5 GHz is proposed for high-data-rate wireless communication in a brain–machine interface. The proposed Vivaldi antenna was implanted vertically along the height of the skull to avoid deformation in the radiation pattern and to compensate for a gain–loss caused by surrounding lossy brain tissues. It was shown that the vertically implanted end-fire antenna had a 3 dB higher antenna gain than a horizontally implanted broadside radiating antenna discussed in recent literature. Additionally, comb-shaped slot arrays imprinted on the Vivaldi antenna lowered the resonant frequency by approximately 2 GHz and improved the antenna gain by more than 2 dB compared to an ordinary Vivaldi antenna. An antenna prototype was fabricated and then tested for verification inside a seven-layered semi-solid brain phantom where each layer had similar electromagnetic material properties as actual brain tissues. The measured data showed that the antenna radiated toward the end-fire direction with an average gain of −15.7 dBi under the frequency of interest, 3–5 GHz. A link budget analysis shows that reliable wireless communication can be achieved over a distance of 10.8 cm despite the electromagnetically harsh environment.
Collapse
Affiliation(s)
- Lisa Sapari
- Department of Electrical & Information Engineering, SeoulTech, Seoul 01811, Korea;
| | - Samnang Hout
- Department of Integrated IT Engineering, SeoulTech, Seoul 01811, Korea;
| | - Jae-Young Chung
- Department of Electrical & Information Engineering, SeoulTech, Seoul 01811, Korea;
- Correspondence: ; Tel.: +82-2-970-6445
| |
Collapse
|
12
|
Arpaia P, Esposito A, Natalizio A, Parvis M. How to successfully classify EEG in motor imagery BCI: a metrological analysis of the state of the art. J Neural Eng 2022; 19. [PMID: 35640554 DOI: 10.1088/1741-2552/ac74e0] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2021] [Accepted: 05/31/2022] [Indexed: 11/11/2022]
Abstract
Objective. Processing strategies are analysed with respect to the classification of electroencephalographic signals related to brain-computer interfaces based on motor imagery. A review of literature is carried out to understand the achievements in motor imagery classification, the most promising trends, and the challenges in replicating these results. Main focus is placed on performance by means of a rigorous metrological analysis carried out in compliance with the international vocabulary of metrology. Hence, classification accuracy and its uncertainty are considered, as well as repeatability and reproducibility.Approach. The paper works included in the review concern the classification of electroencephalographic signals in motor-imagery- based brain-computer interfaces. Article search was carried out in accordance with the PRISMA standard and 89 studies were included.Main results. Statistically-based analyses show that brain-inspired approaches are increasingly proposed, and that these are particularly successful in discriminating against multiple classes. Notably, many proposals involve convolutional neural networks. Instead, classical machine learning approaches are still effective for binary classifications. Many proposals combine common spatial pattern, least absolute shrinkage and selection operator, and support vector machines. Regarding reported classification accuracies, performance above the upper quartile is in the 85 % to 100 % range for the binary case and in the 83 % to 93 % range for multi-class one. Associated uncertainties are up to 6 % while repeatability for a predetermined dataset is up to 8 %. Reproducibility assessment was instead prevented by lack of standardization in experiments.Significance. By relying on the analysed studies, the reader is guided towards the development of a successful processing strategy as a crucial part of a brain-computer interface. Moreover, it is suggested that future studies should extend these approaches on data from more subjects and with custom experiments, even by investigating online operation. This would also enable the quantification of results reproducibility.
Collapse
Affiliation(s)
- Pasquale Arpaia
- Centro Interdipartimentale di Ricerca in Management Sanitario e Innovazione in Sanità, Università degli Studi di Napoli Federico II, Via Claudio, 21, Napoli, Campania, 80125, ITALY
| | - Antonio Esposito
- Department of Electronics and Telecommunications (DET), Politecnico di Torino, Corso Castelfidardo, 39, Torino, 10129, ITALY
| | - Angela Natalizio
- Department of Electronics and Telecommunications (DET), Politecnico di Torino, Corso Castelfidardo, 39, Torino, Piemonte, 10129, ITALY
| | - Marco Parvis
- Department of Electronics and Telecommunications (DET), Politecnico di Torino, Corso Castelfidardo, 39, Torino, Piemonte, 10129, ITALY
| |
Collapse
|
13
|
Houssein EH, Hammad A, Ali AA. Human emotion recognition from EEG-based brain–computer interface using machine learning: a comprehensive review. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07292-4] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
AbstractAffective computing, a subcategory of artificial intelligence, detects, processes, interprets, and mimics human emotions. Thanks to the continued advancement of portable non-invasive human sensor technologies, like brain–computer interfaces (BCI), emotion recognition has piqued the interest of academics from a variety of domains. Facial expressions, speech, behavior (gesture/posture), and physiological signals can all be used to identify human emotions. However, the first three may be ineffectual because people may hide their true emotions consciously or unconsciously (so-called social masking). Physiological signals can provide more accurate and objective emotion recognition. Electroencephalogram (EEG) signals respond in real time and are more sensitive to changes in affective states than peripheral neurophysiological signals. Thus, EEG signals can reveal important features of emotional states. Recently, several EEG-based BCI emotion recognition techniques have been developed. In addition, rapid advances in machine and deep learning have enabled machines or computers to understand, recognize, and analyze emotions. This study reviews emotion recognition methods that rely on multi-channel EEG signal-based BCIs and provides an overview of what has been accomplished in this area. It also provides an overview of the datasets and methods used to elicit emotional states. According to the usual emotional recognition pathway, we review various EEG feature extraction, feature selection/reduction, machine learning methods (e.g., k-nearest neighbor), support vector machine, decision tree, artificial neural network, random forest, and naive Bayes) and deep learning methods (e.g., convolutional and recurrent neural networks with long short term memory). In addition, EEG rhythms that are strongly linked to emotions as well as the relationship between distinct brain areas and emotions are discussed. We also discuss several human emotion recognition studies, published between 2015 and 2021, that use EEG data and compare different machine and deep learning algorithms. Finally, this review suggests several challenges and future research directions in the recognition and classification of human emotional states using EEG.
Collapse
|
14
|
van Velthoven EAM, van Stuijvenberg OC, Haselager DRE, Broekman M, Chen X, Roelfsema P, Bredenoord AL, Jongsma KR. Ethical implications of visual neuroprostheses-a systematic review. J Neural Eng 2022; 19. [PMID: 35475424 DOI: 10.1088/1741-2552/ac65b2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2021] [Accepted: 04/08/2022] [Indexed: 11/12/2022]
Abstract
Objective. The aim of this review was to systematically identify the ethical implications of visual neuroprostheses.Approach. A systematic search was performed in both PubMed and Embase using a search string that combined synonyms for visual neuroprostheses, brain-computer interfaces (BCIs), cochlear implants (CIs), and ethics. We chose to include literature on BCIs and CIs, because of their ethically relavant similarities and functional parallels with visual neuroprostheses.Main results. We included 84 articles in total. Six focused specifically on visual prostheses. The other articles focused more broadly on neurotechnologies, on BCIs or CIs. We identified 169 ethical implications that have been categorized under seven main themes: (a) benefits for health and well-being; (b) harm and risk; (c) autonomy; (d) societal effects; (e) clinical research; (f) regulation and governance; and (g) involvement of experts, patients and the public.Significance. The development and clinical use of visual neuroprostheses is accompanied by ethical issues that should be considered early in the technological development process. Though there is ample literature on the ethical implications of other types of neuroprostheses, such as motor neuroprostheses and CIs, there is a significant gap in the literature regarding the ethical implications of visual neuroprostheses. Our findings can serve as a starting point for further research and normative analysis.
Collapse
Affiliation(s)
- E A M van Velthoven
- Department of Medical Humanities, Julius Center, University Medical Center Utrecht, PO Box 85500, Utrecht, 3508 GA, The Netherlands
| | - O C van Stuijvenberg
- Department of Medical Humanities, Julius Center, University Medical Center Utrecht, PO Box 85500, Utrecht, 3508 GA, The Netherlands
| | - D R E Haselager
- Department of Medical Humanities, Julius Center, University Medical Center Utrecht, PO Box 85500, Utrecht, 3508 GA, The Netherlands
| | - M Broekman
- Department of Neurosurgery, Haaglanden Medical Center, The Hague, The Netherlands.,Department of Neurosurgery, Leiden Medical Center, Leiden, The Netherlands
| | - X Chen
- Department of Vision & Cognition, Netherlands Institute for Neuroscience, Meibergdreef 47, 1105 BA Amsterdam, The Netherlands
| | - P Roelfsema
- Department of Vision & Cognition, Netherlands Institute for Neuroscience, Meibergdreef 47, 1105 BA Amsterdam, The Netherlands.,Department of Integrative Neurophysiology, Center for Neurogenomics and Cognitive Research, VU University, Amsterdam, The Netherlands.,Department of Psychiatry, Academic Medical Center, Amsterdam, The Netherlands
| | - A L Bredenoord
- Erasmus School of Philosophy, Erasmus University Rotterdam, Rotterdam, The Netherlands
| | - K R Jongsma
- Department of Medical Humanities, Julius Center, University Medical Center Utrecht, PO Box 85500, Utrecht, 3508 GA, The Netherlands
| |
Collapse
|
15
|
Lopez-Bernal D, Balderas D, Ponce P, Molina A. A State-of-the-Art Review of EEG-Based Imagined Speech Decoding. Front Hum Neurosci 2022; 16:867281. [PMID: 35558735 PMCID: PMC9086783 DOI: 10.3389/fnhum.2022.867281] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2022] [Accepted: 03/24/2022] [Indexed: 11/13/2022] Open
Abstract
Currently, the most used method to measure brain activity under a non-invasive procedure is the electroencephalogram (EEG). This is because of its high temporal resolution, ease of use, and safety. These signals can be used under a Brain Computer Interface (BCI) framework, which can be implemented to provide a new communication channel to people that are unable to speak due to motor disabilities or other neurological diseases. Nevertheless, EEG-based BCI systems have presented challenges to be implemented in real life situations for imagined speech recognition due to the difficulty to interpret EEG signals because of their low signal-to-noise ratio (SNR). As consequence, in order to help the researcher make a wise decision when approaching this problem, we offer a review article that sums the main findings of the most relevant studies on this subject since 2009. This review focuses mainly on the pre-processing, feature extraction, and classification techniques used by several authors, as well as the target vocabulary. Furthermore, we propose ideas that may be useful for future work in order to achieve a practical application of EEG-based BCI systems toward imagined speech decoding.
Collapse
Affiliation(s)
- Diego Lopez-Bernal
- Tecnologico de Monterrey, National Department of Research, Mexico City, Mexico
| | | | | | | |
Collapse
|
16
|
Andrews A. Integration of Augmented Reality and Brain-Computer Interface Technologies for Health Care Applications: Exploratory and Prototyping Study. JMIR Form Res 2022; 6:e18222. [PMID: 35451963 PMCID: PMC9073621 DOI: 10.2196/18222] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Revised: 01/28/2021] [Accepted: 01/24/2022] [Indexed: 11/13/2022] Open
Abstract
Background Augmented reality (AR) and brain-computer interface (BCI) are promising technologies that have a tremendous potential to revolutionize health care. While there has been a growing interest in these technologies for medical applications in the recent years, the combined use of AR and BCI remains a fairly unexplored area that offers significant opportunities for improving health care professional education and clinical practice. This paper describes a recent study to explore the integration of AR and BCI technologies for health care applications. Objective The described effort aims to advance an understanding of how AR and BCI technologies can effectively work together to transform modern health care practice by providing new mechanisms to improve patient and provider learning, communication, and shared decision-making. Methods The study methods included an environmental scan of AR and BCI technologies currently used in health care, a use case analysis for a combined AR-BCI capability, and development of an integrated AR-BCI prototype solution for health care applications. Results The study resulted in a novel interface technology solution that enables interoperability between consumer-grade wearable AR and BCI devices and provides the users with an ability to control digital objects in augmented reality using neural commands. The article discusses this novel solution within the context of practical digital health use cases developed during the course of the study where the combined AR and BCI technologies are anticipated to produce the most impact. Conclusions As one of the pioneering efforts in the area of AR and BCI integration, the study presents a practical implementation pathway for AR-BCI integration and provides directions for future research and innovation in this area.
Collapse
Affiliation(s)
- Anya Andrews
- Department of Internal Medicine, College of Medicine, University of Central Florida, Orlando, FL, United States
| |
Collapse
|
17
|
Butt AM, Alsaffar H, Alshareef M, Qureshi KK. AI Prediction of Brain Signals for Human Gait Using BCI Device and FBG Based Sensorial Platform for Plantar Pressure Measurements. Sensors (Basel) 2022; 22:s22083085. [PMID: 35459070 PMCID: PMC9025845 DOI: 10.3390/s22083085] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/23/2022] [Revised: 03/30/2022] [Accepted: 04/11/2022] [Indexed: 12/16/2022]
Abstract
Artificial intelligence (AI) in developing modern solutions for biomedical problems such as the prediction of human gait for human rehabilitation is gaining ground. An attempt was made to use plantar pressure information through fiber Bragg grating (FBG) sensors mounted on an in-sole, in tandem with a brain-computer interface (BCI) device to predict brain signals corresponding to sitting, standing and walking postures of a person. Posture classification was attained with an accuracy range between 87–93% from FBG and BCI signals using machine learning models such as K-nearest neighbor (KNN), logistic regression (LR), support vector machine (SVM), and naïve Bayes (NB). These models were used to identify electrodes responding to sitting, standing and walking activities of four users from a 16 channel BCI device. Six electrode positions based on the 10–20 system for electroencephalography (EEG) were identified as the most sensitive to plantar activities and found to be consistent with clinical investigations of the sensorimotor cortex during foot movement. A prediction of brain EEG corresponding to given FBG data with lowest mean square error (MSE) values (0.065–0.109) was made with the selection of a long-short term memory (LSTM) machine learning model when compared to the recurrent neural network (RNN) and gated recurrent unit (GRU) models.
Collapse
Affiliation(s)
- Asad Muhammad Butt
- College of Chemicals & Materials, King Fahd University of Petroleum & Minerals, Dhahran 31261, Saudi Arabia
- Correspondence: ; Tel.: +966-537651766
| | - Hassan Alsaffar
- Electrical Engineering Department, King Fahd University of Petroleum & Minerals, Dhahran 31261, Saudi Arabia; (H.A.); (M.A.)
- Physics Department, King Fahd University of Petroleum & Minerals, Dhahran 31261, Saudi Arabia
| | - Muhannad Alshareef
- Electrical Engineering Department, King Fahd University of Petroleum & Minerals, Dhahran 31261, Saudi Arabia; (H.A.); (M.A.)
| | - Khurram Karim Qureshi
- Optical Communications and Sensors Laboratory (OCSL), Electrical Engineering Department, King Fahd University of Petroleum & Minerals, Dhahran 31261, Saudi Arabia;
- Center for Communication Systems & Sensing, King Fahd University of Petroleum & Minerals, Dhahran 31261, Saudi Arabia
| |
Collapse
|
18
|
Shankhdhar A, Verma PK, Agrawal P, Madaan V, Gupta C. Quality analysis for reliable complex multiclass neuroscience signal classification via electroencephalography. IJQRM 2022. [DOI: 10.1108/ijqrm-07-2021-0237] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
PurposeThe aim of this paper is to explore the brain–computer interface (BCI) as a methodology for generating awareness and increasing reliable use cases of the same so that an individual's quality of life can be enhanced via neuroscience and neural networks, and risk evaluation of certain experiments of BCI can be conducted in a proactive manner.Design/methodology/approachThis paper puts forward an efficient approach for an existing BCI device, which can enhance the performance of an electroencephalography (EEG) signal classifier in a composite multiclass problem and investigates the effects of sampling rate on feature extraction and multiple channels on the accuracy of a complex multiclass EEG signal. A one-dimensional convolutional neural network architecture is used to further classify and improve the quality of the EEG signals, and other algorithms are applied to test their variability. The paper further also dwells upon the combination of internet of things multimedia technology to be integrated with a customized design BCI network based on a conventionally used system known as the message query telemetry transport.FindingsAt the end of our implementation stage, 98% accuracy was achieved in a binary classification problem of classifying digit and non-digit stimuli, and 36% accuracy was observed in the classification of signals resulting from stimuli of digits 0 to 9.Originality/valueBCI, also known as the neural-control interface, is a device that helps a user reliably interact with a computer using only his/her brain activity, which is measured usually via EEG. An EEG machine is a quality device used for observing the neural activity and electric signals generated in certain parts of the human brain, which in turn can help us in studying the different core components of the human brain and how it functions to improve the quality of human life in general.
Collapse
|
19
|
Wang H, Lu D, Liu L, Gao H, Wu R, Zhou Y, Ai Q, Wang Y, Li G. Quantitatively Recognizing Stimuli Intensity of Primary Taste Based on Surface Electromyography. Sensors (Basel) 2021; 21:s21216965. [PMID: 34770272 PMCID: PMC8588107 DOI: 10.3390/s21216965] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/29/2021] [Revised: 10/06/2021] [Accepted: 10/08/2021] [Indexed: 11/22/2022]
Abstract
A novel approach to quantitatively recognize the intensity of primary taste stimuli was explored based on surface electromyography (sEMG). We captured sEMG samples under stimuli of primary taste with different intensities and quantitatively recognized preprocessed samples with Support Vector Machine (SVM). The feasibility of quantitatively recognizing the intensity of Sour, Bitter, and Salty was verified. The sEMG signals were acquired under the stimuli of citric acid (aq), sucrose (aq), magnesium chloride (aq), sodium chloride (aq), and sodium glutamate (aq) with different concentrations, for five types of primary tastes: Sour, Sweet, Bitter, Salty, and Umami, whose order was fixed in this article. The acquired signals were processed with a method called Quadratic Variation Reduction to remove baseline wandering, and an adaptive notch to remove power frequency interference. After extracting 330 features for each sample, an SVM regressor with five-fold cross-validation was performed and the model reached R2 scores of 0.7277, 0.1963, 0.7450, 0.7642, and 0.5055 for five types of primary tastes, respectively, which manifested the feasibilities of the quantitative recognitions of Sour, Bitter, and Salty. To explore the facial responses to taste stimuli, we summarized and compared the muscle activities under stimuli of different taste types and taste intensities. To further simplify the model, we explored the impact of feature dimensionalities and optimized the feature combination for each taste in a channel-wise manner, and the feature dimensionality was reduced from 330 to 210, 120, 210, 260, 170 for five types of primary tastes, respectively. Lastly, we analyzed the model performance on multiple subjects and the relation between the model’s performance and the number of experiment subjects. This study can provide references for further research and applications on taste stimuli recognition with sEMG.
Collapse
|
20
|
Mridha MF, Das SC, Kabir MM, Lima AA, Islam MR, Watanobe Y. Brain-Computer Interface: Advancement and Challenges. Sensors (Basel) 2021; 21:s21175746. [PMID: 34502636 PMCID: PMC8433803 DOI: 10.3390/s21175746] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/17/2021] [Revised: 08/15/2021] [Accepted: 08/20/2021] [Indexed: 02/04/2023]
Abstract
Brain-Computer Interface (BCI) is an advanced and multidisciplinary active research domain based on neuroscience, signal processing, biomedical sensors, hardware, etc. Since the last decades, several groundbreaking research has been conducted in this domain. Still, no comprehensive review that covers the BCI domain completely has been conducted yet. Hence, a comprehensive overview of the BCI domain is presented in this study. This study covers several applications of BCI and upholds the significance of this domain. Then, each element of BCI systems, including techniques, datasets, feature extraction methods, evaluation measurement matrices, existing BCI algorithms, and classifiers, are explained concisely. In addition, a brief overview of the technologies or hardware, mostly sensors used in BCI, is appended. Finally, the paper investigates several unsolved challenges of the BCI and explains them with possible solutions.
Collapse
Affiliation(s)
- M. F. Mridha
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka 1216, Bangladesh; (M.F.M.); (S.C.D.); (M.M.K.); (A.A.L.)
| | - Sujoy Chandra Das
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka 1216, Bangladesh; (M.F.M.); (S.C.D.); (M.M.K.); (A.A.L.)
| | - Muhammad Mohsin Kabir
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka 1216, Bangladesh; (M.F.M.); (S.C.D.); (M.M.K.); (A.A.L.)
| | - Aklima Akter Lima
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka 1216, Bangladesh; (M.F.M.); (S.C.D.); (M.M.K.); (A.A.L.)
| | - Md. Rashedul Islam
- Department of Computer Science and Engineering, University of Asia Pacific, Dhaka 1216, Bangladesh
- Correspondence:
| | - Yutaka Watanobe
- Department of Computer Science and Engineering, University of Aizu, Aizu-Wakamatsu 965-8580, Japan;
| |
Collapse
|
21
|
Shi B, Wang Q, Yin S, Yue Z, Huai Y, Wang J. A binary harmony search algorithm as channel selection method for motor imagery-based BCI. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2021.02.051] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
|
22
|
Camargo-Vargas D, Callejas-Cuervo M, Mazzoleni S. Brain-Computer Interfaces Systems for Upper and Lower Limb Rehabilitation: A Systematic Review. Sensors (Basel) 2021; 21:4312. [PMID: 34202546 PMCID: PMC8271710 DOI: 10.3390/s21134312] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Revised: 06/09/2021] [Accepted: 06/18/2021] [Indexed: 12/22/2022]
Abstract
In recent years, various studies have demonstrated the potential of electroencephalographic (EEG) signals for the development of brain-computer interfaces (BCIs) in the rehabilitation of human limbs. This article is a systematic review of the state of the art and opportunities in the development of BCIs for the rehabilitation of upper and lower limbs of the human body. The systematic review was conducted in databases considering using EEG signals, interface proposals to rehabilitate upper/lower limbs using motor intention or movement assistance and utilizing virtual environments in feedback. Studies that did not specify which processing system was used were excluded. Analyses of the design processing or reviews were excluded as well. It was identified that 11 corresponded to applications to rehabilitate upper limbs, six to lower limbs, and one to both. Likewise, six combined visual/auditory feedback, two haptic/visual, and two visual/auditory/haptic. In addition, four had fully immersive virtual reality (VR), three semi-immersive VR, and 11 non-immersive VR. In summary, the studies have demonstrated that using EEG signals, and user feedback offer benefits including cost, effectiveness, better training, user motivation and there is a need to continue developing interfaces that are accessible to users, and that integrate feedback techniques.
Collapse
Affiliation(s)
- Daniela Camargo-Vargas
- Software Research Group, Universidad Pedagógica y Tecnológica de Colombia, Tunja 150002, Colombia;
| | - Mauro Callejas-Cuervo
- School of Computer Science, Universidad Pedagógica y Tecnológica de Colombia, Tunja 150002, Colombia
| | - Stefano Mazzoleni
- Department of Electrical and Information Engineering, Politecnico di Bari, 70126 Bari, Italy;
| |
Collapse
|
23
|
Bonci A, Fiori S, Higashi H, Tanaka T, Verdini F. An Introductory Tutorial on Brain–Computer Interfaces and Their Applications. Electronics 2021; 10:560. [DOI: 10.3390/electronics10050560] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
Abstract
The prospect and potentiality of interfacing minds with machines has long captured human imagination. Recent advances in biomedical engineering, computer science, and neuroscience are making brain–computer interfaces a reality, paving the way to restoring and potentially augmenting human physical and mental capabilities. Applications of brain–computer interfaces are being explored in applications as diverse as security, lie detection, alertness monitoring, gaming, education, art, and human cognition augmentation. The present tutorial aims to survey the principal features and challenges of brain–computer interfaces (such as reliable acquisition of brain signals, filtering and processing of the acquired brainwaves, ethical and legal issues related to brain–computer interface (BCI), data privacy, and performance assessment) with special emphasis to biomedical engineering and automation engineering applications. The content of this paper is aimed at students, researchers, and practitioners to glimpse the multifaceted world of brain–computer interfacing.
Collapse
|
24
|
Saha S, Mamun KA, Ahmed K, Mostafa R, Naik GR, Darvishi S, Khandoker AH, Baumert M. Progress in Brain Computer Interface: Challenges and Opportunities. Front Syst Neurosci 2021; 15:578875. [PMID: 33716680 PMCID: PMC7947348 DOI: 10.3389/fnsys.2021.578875] [Citation(s) in RCA: 62] [Impact Index Per Article: 20.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Accepted: 01/06/2021] [Indexed: 12/13/2022] Open
Abstract
Brain computer interfaces (BCI) provide a direct communication link between the brain and a computer or other external devices. They offer an extended degree of freedom either by strengthening or by substituting human peripheral working capacity and have potential applications in various fields such as rehabilitation, affective computing, robotics, gaming, and neuroscience. Significant research efforts on a global scale have delivered common platforms for technology standardization and help tackle highly complex and non-linear brain dynamics and related feature extraction and classification challenges. Time-variant psycho-neurophysiological fluctuations and their impact on brain signals impose another challenge for BCI researchers to transform the technology from laboratory experiments to plug-and-play daily life. This review summarizes state-of-the-art progress in the BCI field over the last decades and highlights critical challenges.
Collapse
Affiliation(s)
- Simanto Saha
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA, Australia
- Department of Electrical and Electronic Engineering, United International University, Dhaka, Bangladesh
| | - Khondaker A. Mamun
- Advanced Intelligent Multidisciplinary Systems (AIMS) Lab, Department of Computer Science and Engineering, United International University, Dhaka, Bangladesh
| | - Khawza Ahmed
- Department of Electrical and Electronic Engineering, United International University, Dhaka, Bangladesh
| | - Raqibul Mostafa
- Department of Electrical and Electronic Engineering, United International University, Dhaka, Bangladesh
| | - Ganesh R. Naik
- Adelaide Institute for Sleep Health, College of Medicine and Public Health, Flinders University, Adelaide, SA, Australia
| | - Sam Darvishi
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA, Australia
| | - Ahsan H. Khandoker
- Healthcare Engineering Innovation Center, Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
| | - Mathias Baumert
- School of Electrical and Electronic Engineering, The University of Adelaide, Adelaide, SA, Australia
| |
Collapse
|
25
|
Gannouni S, Belwafi K, Aboalsamh H, AlSamhan Z, Alebdi B, Almassad Y, Alobaedallah H. EEG-Based BCI System to Detect Fingers Movements. Brain Sci 2020; 10:brainsci10120965. [PMID: 33321915 PMCID: PMC7763179 DOI: 10.3390/brainsci10120965] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2020] [Revised: 11/24/2020] [Accepted: 12/08/2020] [Indexed: 11/16/2022] Open
Abstract
The advancement of assistive technologies toward the restoration of the mobility of paralyzed and/or amputated limbs will go a long way. Herein, we propose a system that adopts the brain-computer interface technology to control prosthetic fingers with the use of brain signals. To predict the movements of each finger, complex electroencephalogram (EEG) signal processing algorithms should be applied to remove the outliers, extract features, and be able to handle separately the five human fingers. The proposed method deals with a multi-class classification problem. Our machine learning strategy to solve this problem is built on an ensemble of one-class classifiers, each of which is dedicated to the prediction of the intention to move a specific finger. Regions of the brain that are sensitive to the movements of the fingers are identified and located. The average accuracy of the proposed EEG signal processing chain reached 81% for five subjects. Unlike the majority of existing prototypes that allow only one single finger to be controlled and only one movement to be performed at a time, the system proposed will enable multiple fingers to perform movements simultaneously. Although the proposed system classifies five tasks, the obtained accuracy is too high compared with a binary classification system. The proposed system contributes to the advancement of a novel prosthetic solution that allows people with severe disabilities to perform daily tasks in an easy manner.
Collapse
|