1
|
Lim MJR, Lo JYT, Tan YY, Lin HY, Wang Y, Tan D, Wang E, Naing Ma YY, Wei Ng JJ, Jefree RA, Tseng Tsai Y. The state-of-the-art of invasive brain-computer interfaces in humans: a systematic review and individual patient meta-analysis. J Neural Eng 2025; 22:026013. [PMID: 39978072 DOI: 10.1088/1741-2552/adb88e] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2024] [Accepted: 02/20/2025] [Indexed: 02/22/2025]
Abstract
Objective.Invasive brain-computer interfaces (iBCIs) have evolved significantly since the first neurotrophic electrode was implanted in a human subject three decades ago. Since then, both hardware and software advances have increased the iBCI performance to enable tasks such as decoding conversations in real-time and manipulating external limb prostheses with haptic feedback. In this systematic review, we aim to evaluate the advances in iBCI hardware, software and functionality and describe challenges and opportunities in the iBCI field.Approach.Medline, EMBASE, PubMed and Cochrane databases were searched from inception until 13 April 2024. Primary studies reporting the use of iBCI in human subjects to restore function were included. Endpoints extracted include iBCI electrode type, iBCI implantation, decoder algorithm, iBCI effector, testing and training methodology and functional outcomes. Narrative synthesis of outcomes was done with a focus on hardware and software development trends over time. Individual patient data (IPD) was also collected and an IPD meta-analysis was done to identify factors significant to iBCI performance.Main results.93 studies involving 214 patients were included in this systematic review. The median task performance accuracy for cursor control tasks was 76.00% (Interquartile range [IQR] = 21.2), for motor tasks was 80.00% (IQR = 23.3), and for communication tasks was 93.27% (IQR = 15.3). Current advances in iBCI software include use of recurrent neural network architectures as decoders, while hardware advances such as intravascular stentrodes provide a less invasive alternative for neural recording. Challenges include the lack of standardized testing paradigms for specific functional outcomes and issues with portability and chronicity limiting iBCI usage to laboratory settings.Significance.Our systematic review demonstrated the exponential rate at which iBCIs have evolved over the past two decades. Yet, more work is needed for widespread clinical adoption and translation to long-term home-use.
Collapse
Affiliation(s)
- Mervyn Jun Rui Lim
- Division of Neurosurgery, Department of Surgery, National University Hospital, Singapore, Singapore
| | - Jack Yu Tung Lo
- Division of Neurosurgery, Department of Surgery, National University Hospital, Singapore, Singapore
| | - Yong Yi Tan
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
| | - Hong-Yi Lin
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Yuhang Wang
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Dewei Tan
- School of Clinical Medicine, University of Cambridge, Cambridge, United Kingdom
| | - Eugene Wang
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Yin Yin Naing Ma
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
| | - Joel Jia Wei Ng
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Ryan Ashraf Jefree
- Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore
| | - Yeo Tseng Tsai
- Division of Neurosurgery, Department of Surgery, National University Hospital, Singapore, Singapore
| |
Collapse
|
2
|
Hagengruber A, Quere G, Iskandar M, Bustamante S, Feng J, Leidner D, Albu-Schäffer A, Stulp F, Vogel J. An assistive robot that enables people with amyotrophia to perform sequences of everyday activities. Sci Rep 2025; 15:8426. [PMID: 40069220 PMCID: PMC11897195 DOI: 10.1038/s41598-025-89405-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2024] [Accepted: 02/05/2025] [Indexed: 03/15/2025] Open
Abstract
Mobile manipulation aids aim at enabling people with motor impairments to physically interact with their environment. To facilitate the operation of such systems, a variety of components, such as suitable user interfaces and intuitive control of the system, play a crucial role. In this article, we validate our highly integrated assistive robot EDAN, operated by an interface based on bioelectrical signals, combined with shared control and a whole-body coordination of the entire system, through a case study involving people with motor impairments to accomplish real-world activities. Three individuals with amyotrophia were able to perform a range of everyday tasks, including pouring a drink, opening and driving through a door, and opening a drawer. Rather than considering these tasks in isolation, our study focuses on the continuous execution of long sequences of realistic everyday tasks.
Collapse
Affiliation(s)
- Annette Hagengruber
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Oberpfaffenhofen, Wessling, 82234, Germany.
| | - Gabriel Quere
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Oberpfaffenhofen, Wessling, 82234, Germany
| | - Maged Iskandar
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Oberpfaffenhofen, Wessling, 82234, Germany
| | - Samuel Bustamante
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Oberpfaffenhofen, Wessling, 82234, Germany
| | - Jianxiang Feng
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Oberpfaffenhofen, Wessling, 82234, Germany
| | - Daniel Leidner
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Oberpfaffenhofen, Wessling, 82234, Germany
| | - Alin Albu-Schäffer
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Oberpfaffenhofen, Wessling, 82234, Germany
| | - Freek Stulp
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Oberpfaffenhofen, Wessling, 82234, Germany
| | - Jörn Vogel
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Oberpfaffenhofen, Wessling, 82234, Germany
| |
Collapse
|
3
|
Kulgod A, van der Linden D, França LGS, Jackson M, Zamansky A. Non-invasive canine electroencephalography (EEG): a systematic review. BMC Vet Res 2025; 21:73. [PMID: 39966923 PMCID: PMC11834203 DOI: 10.1186/s12917-025-04523-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Accepted: 01/24/2025] [Indexed: 02/20/2025] Open
Abstract
The emerging field of canine cognitive neuroscience uses neuroimaging tools such as electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) to map the cognitive processes of dogs to neural substrates in their brain. Within the past decade, the non-invasive use of EEG has provided real-time, accessible, and portable neuroimaging insight into canine cognitive processes. To promote systematization and create an overview of framings, methods and findings for future work, we provide a systematic review of non-invasive canine EEG studies (N=22), dissecting their study makeup, technical setup, and analysis frameworks and highlighting emerging trends. We further propose new directions of development, such as the standardization of data structures and integrating predictive modeling with descriptive statistical approaches. Our review ends by underscoring the advances and advantages of EEG-based canine cognitive neuroscience and the potential for accessible canine neuroimaging to inform both fundamental sciences as well as practical applications for cognitive neuroscience, working dogs, and human-canine interactions.
Collapse
|
4
|
Calvin-Dunn KN, Mcneela A, Leisgang Osse A, Bhasin G, Ridenour M, Kinney JW, Hyman JM. Electrophysiological insights into Alzheimer's disease: A review of human and animal studies. Neurosci Biobehav Rev 2025; 169:105987. [PMID: 39732222 DOI: 10.1016/j.neubiorev.2024.105987] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2024] [Revised: 11/16/2024] [Accepted: 12/17/2024] [Indexed: 12/30/2024]
Abstract
This review highlights the crucial role of neuroelectrophysiology in illuminating the mechanisms underlying Alzheimer's disease (AD) pathogenesis and progression, emphasizing its potential to inform the development of effective treatments. Electrophysiological techniques provide unparalleled precision in exploring the intricate networks affected by AD, offering insights into the synaptic dysfunction, network alterations, and oscillatory abnormalities that characterize the disease. We discuss a range of electrophysiological methods, from non-invasive clinical techniques like electroencephalography and magnetoencephalography to invasive recordings in animal models. By drawing on findings from these studies, we demonstrate how electrophysiological research has deepened our understanding of AD-related network disruptions, paving the way for targeted therapeutic interventions. Moreover, we underscore the potential of electrophysiological modalities to play a pivotal role in evaluating treatment efficacy. Integrating electrophysiological data with clinical neuroimaging and longitudinal studies holds promise for a more comprehensive understanding of AD, enabling early detection and the development of personalized treatment strategies. This expanded research landscape offers new avenues for unraveling the complexities of AD and advancing therapeutic approaches.
Collapse
Affiliation(s)
- Kirsten N Calvin-Dunn
- Interdisciplinary Neuroscience Program, University of Nevada, Las Vegas, United States; Cleveland Clinic Lou Ruvo Center for Brain Health, United States.
| | - Adam Mcneela
- Interdisciplinary Neuroscience Program, University of Nevada, Las Vegas, United States
| | - A Leisgang Osse
- Interdisciplinary Neuroscience Program, University of Nevada, Las Vegas, United States; Department of Brain Health, University of Nevada, Las Vegas, United States
| | - G Bhasin
- Interdisciplinary Neuroscience Program, University of Nevada, Las Vegas, United States; Department of Psychology, University of Nevada, Las Vegas, United States
| | - M Ridenour
- Department of Psychology, University of Nevada, Las Vegas, United States
| | - J W Kinney
- Interdisciplinary Neuroscience Program, University of Nevada, Las Vegas, United States; Department of Brain Health, University of Nevada, Las Vegas, United States
| | - J M Hyman
- Interdisciplinary Neuroscience Program, University of Nevada, Las Vegas, United States; Department of Psychology, University of Nevada, Las Vegas, United States
| |
Collapse
|
5
|
Klein F, Kohl SH, Lührs M, Mehler DMA, Sorger B. From lab to life: challenges and perspectives of fNIRS for haemodynamic-based neurofeedback in real-world environments. Philos Trans R Soc Lond B Biol Sci 2024; 379:20230087. [PMID: 39428887 PMCID: PMC11513164 DOI: 10.1098/rstb.2023.0087] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Revised: 02/09/2024] [Accepted: 02/26/2024] [Indexed: 10/22/2024] Open
Abstract
Neurofeedback allows individuals to monitor and self-regulate their brain activity, potentially improving human brain function. Beyond the traditional electrophysiological approach using primarily electroencephalography, brain haemodynamics measured with functional magnetic resonance imaging (fMRI) and more recently, functional near-infrared spectroscopy (fNIRS) have been used (haemodynamic-based neurofeedback), particularly to improve the spatial specificity of neurofeedback. Over recent years, especially fNIRS has attracted great attention because it offers several advantages over fMRI such as increased user accessibility, cost-effectiveness and mobility-the latter being the most distinct feature of fNIRS. The next logical step would be to transfer haemodynamic-based neurofeedback protocols that have already been proven and validated by fMRI to mobile fNIRS. However, this undertaking is not always easy, especially since fNIRS novices may miss important fNIRS-specific methodological challenges. This review is aimed at researchers from different fields who seek to exploit the unique capabilities of fNIRS for neurofeedback. It carefully addresses fNIRS-specific challenges and offers suggestions for possible solutions. If the challenges raised are addressed and further developed, fNIRS could emerge as a useful neurofeedback technique with its own unique application potential-the targeted training of brain activity in real-world environments, thereby significantly expanding the scope and scalability of haemodynamic-based neurofeedback applications.This article is part of the theme issue 'Neurofeedback: new territories and neurocognitive mechanisms of endogenous neuromodulation'.
Collapse
Affiliation(s)
- Franziska Klein
- Biomedical Devices and Systems Group, R&D Division Health, OFFIS—Institute for Information Technology, Oldenburg, Germany
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical School, RWTH Aachen University, Aachen, Germany
| | - Simon H. Kohl
- JARA-Institute Molecular Neuroscience and Neuroimaging (INM-11), Forschungszentrum Jülich, Jülich, Germany
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Faculty of Medicine, RWTH Aachen University, Aachen, Germany
| | - Michael Lührs
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
- Brain Innovation B.V., Research Department, Maastricht, The Netherlands
| | - David M. A. Mehler
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical School, RWTH Aachen University, Aachen, Germany
- Institute of Translational Psychiatry, Medical Faculty, University of Münster, Münster, Germany
- Cardiff University Brain Research Imaging Centre (CUBRIC), School of Psychology, Cardiff University, Cardiff, UK
| | - Bettina Sorger
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| |
Collapse
|
6
|
Chen Y, Wang F, Li T, Zhao L, Gong A, Nan W, Ding P, Fu Y. Considerations and discussions on the clear definition and definite scope of brain-computer interfaces. Front Neurosci 2024; 18:1449208. [PMID: 39161655 PMCID: PMC11330831 DOI: 10.3389/fnins.2024.1449208] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2024] [Accepted: 07/22/2024] [Indexed: 08/21/2024] Open
Abstract
Brain-computer interface (BCI) is a revolutionizing human-computer interaction with potential applications in both medical and non-medical fields, emerging as a cutting-edge and trending research direction. Increasing numbers of groups are engaging in BCI research and development. However, in recent years, there has been some confusion regarding BCI, including misleading and hyped propaganda about BCI, and even non-BCI technologies being labeled as BCI. Therefore, a clear definition and a definite scope for BCI are thoroughly considered and discussed in the paper, based on the existing definitions of BCI, including the six key or essential components of BCI. In the review, different from previous definitions of BCI, BCI paradigms and neural coding are explicitly included in the clear definition of BCI provided, and the BCI user (the brain) is clearly identified as a key component of the BCI system. Different people may have different viewpoints on the definition and scope of BCI, as well as some related issues, which are discussed in the article. This review argues that a clear definition and definite scope of BCI will benefit future research and commercial applications. It is hoped that this review will reduce some of the confusion surrounding BCI and promote sustainable development in this field.
Collapse
Affiliation(s)
- Yanxiao Chen
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| | - Fan Wang
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| | - Tianwen Li
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
- Faculty of Science, Kunming University of Science and Technology, Kunming, China
| | - Lei Zhao
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
- Faculty of Science, Kunming University of Science and Technology, Kunming, China
| | - Anmin Gong
- School of Information Engineering, Chinese People’s Armed Police Force Engineering University, Xi’an, China
| | - Wenya Nan
- School of Psychology, Shanghai Normal University, Shanghai, China
| | - Peng Ding
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| | - Yunfa Fu
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China
- Brain Cognition and Brain-Computer Intelligence Integration Group, Kunming University of Science and Technology, Kunming, China
| |
Collapse
|
7
|
Wang Z, Shi N, Zhang Y, Zheng N, Li H, Jiao Y, Cheng J, Wang Y, Zhang X, Chen Y, Chen Y, Wang H, Xie T, Wang Y, Ma Y, Gao X, Feng X. Conformal in-ear bioelectronics for visual and auditory brain-computer interfaces. Nat Commun 2023; 14:4213. [PMID: 37452047 PMCID: PMC10349124 DOI: 10.1038/s41467-023-39814-6] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Accepted: 06/28/2023] [Indexed: 07/18/2023] Open
Abstract
Brain-computer interfaces (BCIs) have attracted considerable attention in motor and language rehabilitation. Most devices use cap-based non-invasive, headband-based commercial products or microneedle-based invasive approaches, which are constrained for inconvenience, limited applications, inflammation risks and even irreversible damage to soft tissues. Here, we propose in-ear visual and auditory BCIs based on in-ear bioelectronics, named as SpiralE, which can adaptively expand and spiral along the auditory meatus under electrothermal actuation to ensure conformal contact. Participants achieve offline accuracies of 95% in 9-target steady state visual evoked potential (SSVEP) BCI classification and type target phrases successfully in a calibration-free 40-target online SSVEP speller experiment. Interestingly, in-ear SSVEPs exhibit significant 2nd harmonic tendencies, indicating that in-ear sensing may be complementary for studying harmonic spatial distributions in SSVEP studies. Moreover, natural speech auditory classification accuracy can reach 84% in cocktail party experiments. The SpiralE provides innovative concepts for designing 3D flexible bioelectronics and assists the development of biomedical engineering and neural monitoring.
Collapse
Affiliation(s)
- Zhouheng Wang
- Laboratory of Flexible Electronics Technology, Tsinghua University, Beijing, 100084, China
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China
| | - Nanlin Shi
- Department of Biomedical Engineering, Tsinghua University, Beijing, 100084, China
| | - Yingchao Zhang
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China
| | - Ning Zheng
- State Key Laboratory of Chemical Engineering, College of Chemical and Biological Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Haicheng Li
- Laboratory of Flexible Electronics Technology, Tsinghua University, Beijing, 100084, China
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China
| | - Yang Jiao
- Laboratory of Flexible Electronics Technology, Tsinghua University, Beijing, 100084, China
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China
| | - Jiahui Cheng
- Laboratory of Flexible Electronics Technology, Tsinghua University, Beijing, 100084, China
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China
| | - Yutong Wang
- Laboratory of Flexible Electronics Technology, Tsinghua University, Beijing, 100084, China
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China
| | - Xiaoqing Zhang
- Department of Otolaryngology-Head and Neck Surgery, Beijing Tongren Hospital, Capital Medical University, Beijing, 100730, China
| | - Ying Chen
- Institute of Flexible Electronics Technology of THU, Zhejiang, Jiaxing, 314000, China
| | - Yihao Chen
- Laboratory of Flexible Electronics Technology, Tsinghua University, Beijing, 100084, China
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China
| | - Heling Wang
- Laboratory of Flexible Electronics Technology, Tsinghua University, Beijing, 100084, China
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China
| | - Tao Xie
- State Key Laboratory of Chemical Engineering, College of Chemical and Biological Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Yijun Wang
- Institute of Semiconductors, Chinese Academy of Sciences, Beijing, 100083, China
| | - Yinji Ma
- Laboratory of Flexible Electronics Technology, Tsinghua University, Beijing, 100084, China.
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China.
| | - Xiaorong Gao
- Department of Biomedical Engineering, Tsinghua University, Beijing, 100084, China.
| | - Xue Feng
- Laboratory of Flexible Electronics Technology, Tsinghua University, Beijing, 100084, China.
- AML, Department of Engineering Mechanics, Tsinghua University, Beijing, 100084, China.
| |
Collapse
|
8
|
Guo Z, Chen F. Impacts of simplifying articulation movements imagery to speech imagery BCI performance. J Neural Eng 2023; 20. [PMID: 36630714 DOI: 10.1088/1741-2552/acb232] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2022] [Accepted: 01/11/2023] [Indexed: 01/13/2023]
Abstract
Objective.Speech imagery (SI) can be used as a reliable, natural, and user-friendly activation task for the development of brain-computer interface (BCI), which empowers individuals with severe disabilities to interact with their environment. The functional near-infrared spectroscopy (fNIRS) is advanced as one of the most suitable brain imaging methods for developing BCI systems owing to its advantages of being non-invasive, portable, insensitive to motion artifacts, and having relatively high spatial resolution.Approach.To improve the classification performance of SI BCI based on fNIRS, a novel paradigm was developed in this work by simplifying the articulation movements in SI to make the articulation movement differences clearer between different words imagery tasks. A SI BCI was proposed to directly answer questions by covertly rehearsing the word '' or '' ('yes' or 'no' in English), and an unconstrained rest task also was contained in this BCI. The articulation movements of SI were simplified by retaining only the movements of the jaw and lips of vowels in Chinese Pinyin for words '' and ''.Main results.Compared with conventional speech imagery, simplifying the articulation movements in SI could generate more different brain activities among different tasks, which led to more differentiable temporal features and significantly higher classification performance. The average 3-class classification accuracies of the proposed paradigm across all 20 participants reached 69.6% and 60.2% which were about 10.8% and 5.6% significantly higher than those of the conventional SI paradigm operated in the 0-10 s and 0-2.5 s time windows, respectively.Significance.These results suggested that simplifying the articulation movements in SI is promising for improving the classification performance of intuitive BCIs based on speech imagery.
Collapse
Affiliation(s)
- Zengzhi Guo
- School of Electronics and Information Engineering, Harbin Institute of Technology, Harbin, People's Republic of China.,Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen, People's Republic of China
| | - Fei Chen
- Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen, People's Republic of China
| |
Collapse
|
9
|
di Biase L, Bonura A, Caminiti ML, Pecoraro PM, Di Lazzaro V. Neurophysiology tools to lower the stroke onset to treatment time during the golden hour: microwaves, bioelectrical impedance and near infrared spectroscopy. Ann Med 2022; 54:2658-2671. [PMID: 36154386 PMCID: PMC9542520 DOI: 10.1080/07853890.2022.2124448] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Revised: 08/24/2022] [Accepted: 09/09/2022] [Indexed: 11/17/2022] Open
Abstract
Reperfusion therapy administration timing in acute ischaemic stroke is the main determinant of patients' mortality and long-term disability. Indeed, the first hour from the stroke onset is defined the "golden hour", in which the treatment has the highest efficacy and lowest side effects. Delayed ambulance transport, inappropriate triage and difficulty in accessing CT scans lead to delayed onset to treatment time (OTT) in clinical practice. To date brain CT scan is needed to rule out intracranial haemorrhage, which is a major contraindication to thrombolytic therapy. The availability, dimension and portability make CT suitable mainly for intrahospital use, determining further delays in the therapies administration. This review aims at evaluating portable neurophysiology technologies developed with the scope of speeding up the diagnostic phase of acute stroke and, therefore, the initiation of intravenous thrombolysis. Medline databases were explored for studies concerning near infrared spectroscopy (NIRS), bioelectrical impedance spectroscopy (BIS) and Microwave imaging (MWI) as methods for stroke diagnosis. A total of 1368 articles were found, and 12 of these fit with our criteria and were included in the review. For each technology, the following parameters were evaluated: diagnostic accuracy, ability to differentiate ischaemic and haemorrhagic stroke, diagnosis time from stroke onset, portability and technology readiness level (TRL). All the described methods seem to be able to identify acute stroke even though the number of studies is very limited. Low cost and portability make them potentially usable during ambulance transport, possibly leading to a reduction of stroke OTT along with the related huge benefits in terms of patients outcome and health care costs. In addition, unlike standard imaging techniques, neurophysiological techniques could allow continuous monitoring of patients for timely intrahospital stroke diagnosis.KEY MESSAGESFirst hour from the stroke onset is defined the "golden hour", in which the treatment has the highest efficacy and lowest side effects.The delay for stroke onset to brain imaging time is one of the major reasons why only a minority of patients with acute ischaemic stroke are eligible to reperfusion therapies.Neurophysiology techniques (NIRS, BIS and MWI) could have a potential high impact in reducing the time to treatment in stroke patients.
Collapse
Affiliation(s)
- Lazzaro di Biase
- Department of Medicine and Surgery, Unit of Neurology, Neurophysiology and Neurobiology, Università Campus Bio-Medico di Roma, Roma, Italy
- Fondazione Policlinico Universitario Campus Bio-Medico, Roma, Italy
- Brain Innovations Laboratory, Università Campus Bio-Medico di Roma, Rome, Italy
| | - Adriano Bonura
- Department of Medicine and Surgery, Unit of Neurology, Neurophysiology and Neurobiology, Università Campus Bio-Medico di Roma, Roma, Italy
- Fondazione Policlinico Universitario Campus Bio-Medico, Roma, Italy
| | - Maria Letizia Caminiti
- Department of Medicine and Surgery, Unit of Neurology, Neurophysiology and Neurobiology, Università Campus Bio-Medico di Roma, Roma, Italy
- Fondazione Policlinico Universitario Campus Bio-Medico, Roma, Italy
| | - Pasquale Maria Pecoraro
- Department of Medicine and Surgery, Unit of Neurology, Neurophysiology and Neurobiology, Università Campus Bio-Medico di Roma, Roma, Italy
- Fondazione Policlinico Universitario Campus Bio-Medico, Roma, Italy
| | - Vincenzo Di Lazzaro
- Department of Medicine and Surgery, Unit of Neurology, Neurophysiology and Neurobiology, Università Campus Bio-Medico di Roma, Roma, Italy
- Fondazione Policlinico Universitario Campus Bio-Medico, Roma, Italy
| |
Collapse
|
10
|
Guo Z, Chen F. Decoding lexical tones and vowels in imagined tonal monosyllables using fNIRS signals. J Neural Eng 2022; 19. [PMID: 36317255 DOI: 10.1088/1741-2552/ac9e1d] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2022] [Accepted: 10/27/2022] [Indexed: 11/11/2022]
Abstract
Objective.Speech is a common way of communication. Decoding verbal intent could provide a naturalistic communication way for people with severe motor disabilities. Active brain computer interaction (BCI) speller is one of the most commonly used speech BCIs. To reduce the spelling time of Chinese words, identifying vowels and tones that are embedded in imagined Chinese words is essential. Functional near-infrared spectroscopy (fNIRS) has been widely used in BCI because it is portable, non-invasive, safe, low cost, and has a relatively high spatial resolution.Approach.In this study, an active BCI speller based on fNIRS is presented by covertly rehearsing tonal monosyllables with vowels (i.e. /a/, /i/, /o/, and /u/) and four lexical tones in Mandarin Chinese (i.e. tones 1, 2, 3, and 4) for 10 s.Main results.fNIRS results showed significant differences in the right superior temporal gyrus between imagined vowels with tone 2/3/4 and those with tone 1 (i.e. more activations and stronger connections to other brain regions for imagined vowels with tones 2/3/4 than for those with tone 1). Speech-related areas for tone imagery (i.e. the right hemisphere) provided majority of information for identifying tones, while the left hemisphere had advantages in vowel identification. Having decoded both vowels and tones during the post-stimulus 15 s period, the average classification accuracies exceeded 40% and 70% in multiclass (i.e. four classes) and binary settings, respectively. To spell words more quickly, the time window size for decoding was reduced from 15 s to 2.5 s while the classification accuracies were not significantly reduced.Significance.For the first time, this work demonstrated the possibility of discriminating lexical tones and vowels in imagined tonal syllables simultaneously. In addition, the reduced time window for decoding indicated that the spelling time of Chinese words could be significantly reduced in the fNIRS-based BCIs.
Collapse
Affiliation(s)
- Zengzhi Guo
- School of Electronics and Information Engineering, Harbin Institute of Technology, Harbin, People's Republic of China.,Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen, People's Republic of China
| | - Fei Chen
- Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen, People's Republic of China
| |
Collapse
|
11
|
Wang YM, Wei CL, Wang MW. Factors influencing students' adoption intention of brain–computer interfaces in a game-learning context. LIBRARY HI TECH 2022. [DOI: 10.1108/lht-12-2021-0506] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
PurposeA research framework that explains adoption intention in students with regard to brain–computer interface (BCI) games in the learning context was proposed and empirically examined.Design/methodology/approachIn this study, an approach integrating the decomposed theory of planned behavior, perceived playfulness, risk and the task–technology fit (TTF) concept was used to assess data collected using a post-experiment questionnaire from a student sample in Taiwan. The research model was tested using the partial least-squares structural equation modeling (PLS-SEM) technique.FindingsAttitude, subjective norms and TTF were shown to impact intention to play the BCI game significantly, while perceived behavioral control did not show a significant impact. The influence of superiors and peers was found to positively predict subjective norms. With the exception of perceived ease of use, all of the proposed antecedents were found to impact attitude toward BCI games. Technology facilitating conditions and BCI technology characteristics were shown to positively determine perceived behavior control and TTF, respectively. However, the other proposed factors did not significantly influence the latter two dependents.Originality/valueThis research contributes to the nascent literature on BCI games in the context of learning by highlighting the influence of belief-related psychological factors on user acceptance of BCI games. Moreover, this study highlights the important, respective influences of perceived playfulness, risk and TTF on users' perceptions of a game, body monitoring and technology implementation, each of which is known to influence willingness to play.
Collapse
|
12
|
Guo Z, Chen F. Idle-state detection in motor imagery of articulation using early information: A functional Near-infrared spectroscopy study. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103369] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
13
|
Kainolda Y, Abibullaev B, Sameni R, Zollanvari A. Is Riemannian Geometry Better than Euclidean in Averaging Covariance Matrices for CSP-based Subject-Independent Classification of Motor Imagery? ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:910-914. [PMID: 34891438 DOI: 10.1109/embc46164.2021.9629816] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Common Spatial Pattern (CSP) is a popular feature extraction algorithm used for electroencephalogram (EEG) data classification in brain-computer interfaces. One of the critical operations used in CSP is taking the average of trial covariance matrices for each class. In this regard, the arithmetic mean, which minimizes the sum of squared Euclidean distances to the data points, is conventionally used; however, this operation ignores the Riemannian geometry in the manifold of covariance matrices. To alleviate this problem, Fréchet mean determined using different Riemannian distances have been used. In this paper, we are primarily concerned with the following question: Does using the Fréchet mean with Riemannian distances instead of arithmetic mean in averaging CSP covariance matrices improve the subject-independent classification of motor imagery (MI)? To answer this question we conduct a comparative study using the largest MI dataset to date, with 54 subjects and a total of 21,600 trials of left-and right-hand MI. The results indicate a general trend of having a statistically significant better performance when the Riemannian geometry is used.
Collapse
|
14
|
Si X, Li S, Xiang S, Yu J, Ming D. Imagined speech increases the hemodynamic response and functional connectivity of the dorsal motor cortex. J Neural Eng 2021; 18. [PMID: 34507311 DOI: 10.1088/1741-2552/ac25d9] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2021] [Accepted: 09/10/2021] [Indexed: 11/12/2022]
Abstract
Objective. Decoding imagined speech from brain signals could provide a more natural, user-friendly way for developing the next generation of the brain-computer interface (BCI). With the advantages of non-invasive, portable, relatively high spatial resolution and insensitivity to motion artifacts, the functional near-infrared spectroscopy (fNIRS) shows great potential for developing the non-invasive speech BCI. However, there is a lack of fNIRS evidence in uncovering the neural mechanism of imagined speech. Our goal is to investigate the specific brain regions and the corresponding cortico-cortical functional connectivity features during imagined speech with fNIRS.Approach. fNIRS signals were recorded from 13 subjects' bilateral motor and prefrontal cortex during overtly and covertly repeating words. Cortical activation was determined through the mean oxygen-hemoglobin concentration changes, and functional connectivity was calculated by Pearson's correlation coefficient.Main results. (a) The bilateral dorsal motor cortex was significantly activated during the covert speech, whereas the bilateral ventral motor cortex was significantly activated during the overt speech. (b) As a subregion of the motor cortex, sensorimotor cortex (SMC) showed a dominant dorsal response to covert speech condition, whereas a dominant ventral response to overt speech condition. (c) Broca's area was deactivated during the covert speech but activated during the overt speech. (d) Compared to overt speech, dorsal SMC(dSMC)-related functional connections were enhanced during the covert speech.Significance. We provide fNIRS evidence for the involvement of dSMC in speech imagery. dSMC is the speech imagery network's key hub and is probably involved in the sensorimotor information processing during the covert speech. This study could inspire the BCI community to focus on the potential contribution of dSMC during speech imagery.
Collapse
Affiliation(s)
- Xiaopeng Si
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China.,Tianjin Key Laboratory of Brain Science and Neural Engineering, Tianjin University, Tianjin 300072, People's Republic of China.,Tianjin International Engineering Institute, Tianjin University, Tianjin 300072, People's Republic of China.,Institute of Applied Psychology, Tianjin University, Tianjin 300350, People's Republic of China
| | - Sicheng Li
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China.,Tianjin Key Laboratory of Brain Science and Neural Engineering, Tianjin University, Tianjin 300072, People's Republic of China
| | - Shaoxin Xiang
- Tianjin Key Laboratory of Brain Science and Neural Engineering, Tianjin University, Tianjin 300072, People's Republic of China.,Tianjin International Engineering Institute, Tianjin University, Tianjin 300072, People's Republic of China
| | - Jiayue Yu
- Tianjin Key Laboratory of Brain Science and Neural Engineering, Tianjin University, Tianjin 300072, People's Republic of China.,Tianjin International Engineering Institute, Tianjin University, Tianjin 300072, People's Republic of China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China.,Tianjin Key Laboratory of Brain Science and Neural Engineering, Tianjin University, Tianjin 300072, People's Republic of China
| |
Collapse
|
15
|
Usoro JO, Dogra K, Abbott JR, Radhakrishna R, Cogan SF, Pancrazio JJ, Patnaik SS. Influence of Implantation Depth on the Performance of Intracortical Probe Recording Sites. MICROMACHINES 2021; 12:1158. [PMID: 34683209 PMCID: PMC8539313 DOI: 10.3390/mi12101158] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/06/2021] [Revised: 09/18/2021] [Accepted: 09/24/2021] [Indexed: 02/06/2023]
Abstract
Microelectrode arrays (MEAs) enable the recording of electrical activity from cortical neurons which has implications for basic neuroscience and neuroprosthetic applications. The design space for MEA technology is extremely wide where devices may vary with respect to the number of monolithic shanks as well as placement of microelectrode sites. In the present study, we examine the differences in recording ability between two different MEA configurations: single shank (SS) and multi-shank (MS), both of which consist of 16 recording sites implanted in the rat motor cortex. We observed a significant difference in the proportion of active microelectrode sites over the 8-week indwelling period, in which SS devices exhibited a consistent ability to record activity, in contrast to the MS arrays which showed a marked decrease in activity within 2 weeks post-implantation. Furthermore, this difference was revealed to be dependent on the depth at which the microelectrode sites were located and may be mediated by anatomical heterogeneity, as well as the distribution of inhibitory neurons within the cortical layers. Our results indicate that the implantation depth of microelectrodes within the cortex needs to be considered relative to the chronic performance characterization.
Collapse
Affiliation(s)
| | | | | | | | | | - Joseph J. Pancrazio
- Department of Bioengineering, The University of Texas at Dallas, Richardson, TX 75080, USA; (J.O.U.); (K.D.); (J.R.A.); (R.R.); (S.F.C.); (S.S.P.)
| | | |
Collapse
|
16
|
Salahuddin U, Gao PX. Signal Generation, Acquisition, and Processing in Brain Machine Interfaces: A Unified Review. Front Neurosci 2021; 15:728178. [PMID: 34588951 PMCID: PMC8475516 DOI: 10.3389/fnins.2021.728178] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2021] [Accepted: 08/18/2021] [Indexed: 11/13/2022] Open
Abstract
Brain machine interfaces (BMIs), or brain computer interfaces (BCIs), are devices that act as a medium for communications between the brain and the computer. It is an emerging field with numerous applications in domains of prosthetic devices, robotics, communication technology, gaming, education, and security. It is noted in such a multidisciplinary field, many reviews have surveyed on various focused subfields of interest, such as neural signaling, microelectrode fabrication, and signal classification algorithms. A unified review is lacking to cover and link all the relevant areas in this field. Herein, this review intends to connect on the relevant areas that circumscribe BMIs to present a unified script that may help enhance our understanding of BMIs. Specifically, this article discusses signal generation within the cortex, signal acquisition using invasive, non-invasive, or hybrid techniques, and the signal processing domain. The latest development is surveyed in this field, particularly in the last decade, with discussions regarding the challenges and possible solutions to allow swift disruption of BMI products in the commercial market.
Collapse
Affiliation(s)
- Usman Salahuddin
- Institute of Materials Science, University of Connecticut, Storrs, CT, United States
| | - Pu-Xian Gao
- Institute of Materials Science, University of Connecticut, Storrs, CT, United States
- Department of Materials Science and Engineering, University of Connecticut, Storrs, CT, United States
| |
Collapse
|
17
|
Verbaarschot C, Tump D, Lutu A, Borhanazad M, Thielen J, van den Broek P, Farquhar J, Weikamp J, Raaphorst J, Groothuis JT, Desain P. A visual brain-computer interface as communication aid for patients with amyotrophic lateral sclerosis. Clin Neurophysiol 2021; 132:2404-2415. [PMID: 34454267 DOI: 10.1016/j.clinph.2021.07.012] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2020] [Revised: 07/09/2021] [Accepted: 07/15/2021] [Indexed: 10/20/2022]
Abstract
OBJECTIVE Brain-Computer Interface (BCI) spellers that make use of code-modulated Visual Evoked Potentials (cVEP) may provide a fast and more accurate alternative to existing visual BCI spellers for patients with Amyotrophic Lateral Sclerosis (ALS). However, so far the cVEP speller has only been tested on healthy participants. METHODS We assess the brain responses, BCI performance and user experience of the cVEP speller in 20 healthy participants and 10 ALS patients. All participants performed a cued and free spelling task, and a free selection of Yes/No answers. RESULTS 27 out of 30 participants could perform the cued spelling task with an average accuracy of 79% for ALS patients, 88% for healthy older participants and 94% for healthy young participants. All 30 participants could answer Yes/No questions freely, with an average accuracy of around 90%. CONCLUSIONS With ALS patients typing on average 10 characters per minute, the cVEP speller presented in this paper outperforms other visual BCI spellers. SIGNIFICANCE These results support a general usability of cVEP signals for ALS patients, which may extend far beyond the tested speller to control e.g. an alarm, automatic door, or TV within a smart home.
Collapse
Affiliation(s)
- Ceci Verbaarschot
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, Netherlands.
| | | | - Andreea Lutu
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, Netherlands
| | - Marzieh Borhanazad
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, Netherlands
| | - Jordy Thielen
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, Netherlands; MindAffect, Nijmegen, Netherlands
| | - Philip van den Broek
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, Netherlands
| | | | - Janneke Weikamp
- Radboud University Medical Center, Department of Rehabilitation, Nijmegen, Netherlands
| | - Joost Raaphorst
- Amsterdam UMC, University of Amsterdam, Department of Neurology, Amsterdam Neuroscience, Amsterdam, Netherlands
| | - Jan T Groothuis
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, Netherlands; Radboud University Medical Center, Department of Rehabilitation, Nijmegen, Netherlands
| | - Peter Desain
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, Netherlands; MindAffect, Nijmegen, Netherlands
| |
Collapse
|
18
|
Hong J, Qin X. Signal processing algorithms for SSVEP-based brain computer interface: State-of-the-art and recent developments. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2021. [DOI: 10.3233/jifs-201280] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/19/2023]
Abstract
Over past two decades, steady-state evoked potentials (SSVEP)-based brain computer interface (BCI) systems have been extensively developed. As we all know, signal processing algorithms play an important role in this BCI. However, there is no comprehensive review of the latest development of signal processing algorithms for SSVEP-based BCI. By analyzing the papers published in authoritative journals in nearly five years, signal processing algorithms of preprocessing, feature extraction and classification modules are discussed in detail. In addition, other aspects existed in this BCI are mentioned. The following key problems are solved. (1) In recent years, which signal processing algorithms are frequently used in each module? (2) Which signal processing algorithms attract more attention in recent years? (3) Which modules are the key to signal processing in BCI field? This information is very important for choosing the appropriate algorithms, and can also be considered as a reference for further research. Simultaneously, we hope that this work can provide relevant BCI researchers with valuable information about the latest trends of signal processing algorithms for SSVEP-based BCI systems.
Collapse
Affiliation(s)
- Jie Hong
- School of Mechanical Engineering, Northwestern Polytechnical University, Xi’an, Shaanxi, China
| | - Xiansheng Qin
- School of Mechanical Engineering, Northwestern Polytechnical University, Xi’an, Shaanxi, China
| |
Collapse
|
19
|
Abstract
The prospect and potentiality of interfacing minds with machines has long captured human imagination. Recent advances in biomedical engineering, computer science, and neuroscience are making brain–computer interfaces a reality, paving the way to restoring and potentially augmenting human physical and mental capabilities. Applications of brain–computer interfaces are being explored in applications as diverse as security, lie detection, alertness monitoring, gaming, education, art, and human cognition augmentation. The present tutorial aims to survey the principal features and challenges of brain–computer interfaces (such as reliable acquisition of brain signals, filtering and processing of the acquired brainwaves, ethical and legal issues related to brain–computer interface (BCI), data privacy, and performance assessment) with special emphasis to biomedical engineering and automation engineering applications. The content of this paper is aimed at students, researchers, and practitioners to glimpse the multifaceted world of brain–computer interfacing.
Collapse
|
20
|
Roc A, Pillette L, Mladenovic J, Benaroch C, N'Kaoua B, Jeunet C, Lotte F. A review of user training methods in brain computer interfaces based on mental tasks. J Neural Eng 2020; 18. [PMID: 33181488 DOI: 10.1088/1741-2552/abca17] [Citation(s) in RCA: 39] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2020] [Accepted: 11/12/2020] [Indexed: 12/12/2022]
Abstract
Mental-Tasks based Brain-Computer Interfaces (MT-BCIs) allow their users to interact with an external device solely by using brain signals produced through mental tasks. While MT-BCIs are promising for many applications, they are still barely used outside laboratories due to their lack of reliability. MT-BCIs require their users to develop the ability to self-regulate specific brain signals. However, the human learning process to control a BCI is still relatively poorly understood and how to optimally train this ability is currently under investigation. Despite their promises and achievements, traditional training programs have been shown to be sub-optimal and could be further improved. In order to optimize user training and improve BCI performance, human factors should be taken into account. An interdisciplinary approach should be adopted to provide learners with appropriate and/or adaptive training. In this article, we provide an overview of existing methods for MT-BCI user training - notably in terms of environment, instructions, feedback and exercises. We present a categorization and taxonomy of these training approaches, provide guidelines on how to choose the best methods and identify open challenges and perspectives to further improve MT-BCI user training.
Collapse
Affiliation(s)
| | | | | | - Camille Benaroch
- Inria Centre de recherche Bordeaux Sud-Ouest, Talence, 33405, FRANCE
| | - Bernard N'Kaoua
- Handicap, Activity, Cognition, Health, Inserm / University of Bordeaux, Talence, FRANCE
| | | | | |
Collapse
|
21
|
Lee M, Yoon JG, Lee SW. Predicting Motor Imagery Performance From Resting-State EEG Using Dynamic Causal Modeling. Front Hum Neurosci 2020; 14:321. [PMID: 32903663 PMCID: PMC7438792 DOI: 10.3389/fnhum.2020.00321] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2020] [Accepted: 07/20/2020] [Indexed: 11/22/2022] Open
Abstract
Motor imagery-based brain–computer interfaces (MI-BCIs) send commands to a computer using the brain activity registered when a subject imagines—but does not perform—a given movement. However, inconsistent MI-BCI performance occurs in variations of brain signals across subjects and experiments; this is considered to be a significant problem in practical BCI. Moreover, some subjects exhibit a phenomenon referred to as “BCI-inefficiency,” in which they are unable to generate brain signals for BCI control. These subjects have significant difficulties in using BCI. The primary goal of this study is to identify the connections of the resting-state network that affect MI performance and predict MI performance using these connections. We used a public database of MI, which includes the results of psychological questionnaires and pre-experimental resting-state taken over two sessions on different days. A dynamic causal model was used to calculate the coupling strengths between brain regions with directionality. Specifically, we investigated the motor network in resting-state, including the dorsolateral prefrontal cortex, which performs motor planning. As a result, we observed a significant difference in the connectivity strength from the supplementary motor area to the right dorsolateral prefrontal cortex between the low- and high-MI performance groups. This coupling, measured in the resting-state, is significantly stronger in the high-MI performance group than the low-MI performance group. The connection strength is positively correlated with MI-BCI performance (Session 1: r = 0.54; Session 2: r = 0.42). We also predicted MI performance using linear regression based on this connection (r-squared = 0.31). The proposed predictors, based on dynamic causal modeling, can develop new strategies for improving BCI performance. These findings can further our understanding of BCI-inefficiency and help BCI users to lower costs and save time.
Collapse
Affiliation(s)
- Minji Lee
- Department of Brain and Cognitive Engineering, Korea University, Seoul, South Korea
| | - Jae-Geun Yoon
- Department of Brain and Cognitive Engineering, Korea University, Seoul, South Korea
| | - Seong-Whan Lee
- Department of Artificial Intelligence, Korea University, Seoul, South Korea
| |
Collapse
|
22
|
Convolutional neural networks and genetic algorithm for visual imagery classification. Phys Eng Sci Med 2020; 43:973-983. [PMID: 32662039 DOI: 10.1007/s13246-020-00894-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2019] [Accepted: 06/29/2020] [Indexed: 10/23/2022]
Abstract
Brain-Computer Interface (BCI) systems establish a channel for direct communication between the brain and the outside world without having to use the peripheral nervous system. While most BCI systems use evoked potentials and motor imagery, in the present work we present a technique that employs visual imagery. Our technique uses neural networks to classify the signals produced in visual imagery. To this end, we have used densely connected neural and convolutional networks, together with a genetic algorithm to find the best parameters for these networks. The results we obtained are a 60% success rate in the classification of four imagined objects (a tree, a dog, an airplane and a house) plus a state of relaxation, thus outperforming the state of the art in visual imagery classification.
Collapse
|
23
|
Seidel-Marzi O, Ragert P. Neurodiagnostics in Sports: Investigating the Athlete's Brain to Augment Performance and Sport-Specific Skills. Front Hum Neurosci 2020; 14:133. [PMID: 32327988 PMCID: PMC7160821 DOI: 10.3389/fnhum.2020.00133] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2020] [Accepted: 03/23/2020] [Indexed: 12/22/2022] Open
Abstract
Enhancing performance levels of athletes during training and competition is a desired goal in sports. Quantifying training success is typically accompanied by performance diagnostics including the assessment of sports-relevant behavioral and physiological parameters. Even though optimal brain processing is a key factor for augmented motor performance and skill learning, neurodiagnostics is typically not implemented in performance diagnostics of athletes. We propose, that neurodiagnostics via non-invasive brain imaging techniques such as functional near-infrared spectroscopy (fNIRS) will offer novel perspectives to quantify training-induced neuroplasticity and its relation to motor behavior. A better understanding of such a brain-behavior relationship during the execution of sport-specific movements might help to guide training processes and to optimize training outcomes. Furthermore, targeted non-invasive brain stimulation such as transcranial direct current stimulation (tDCS) might help to further enhance training outcomes by modulating brain areas that show training-induced neuroplasticity. However, we strongly suggest that ethical aspects in the use of non-invasive brain stimulation during training and/or competition need to be addressed before neuromodulation can be considered as a performance enhancer in sports.
Collapse
Affiliation(s)
- Oliver Seidel-Marzi
- Institute for General Kinesiology and Exercise Science, Faculty of Sport Science, University of Leipzig, Leipzig, Germany.,Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Patrick Ragert
- Institute for General Kinesiology and Exercise Science, Faculty of Sport Science, University of Leipzig, Leipzig, Germany.,Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
24
|
Abstract
Brain computer interface (BCI) adopts human brain signals to control external devices directly without using normal neural pathway. Recent study has explored many applications, such as controlling a teleoperation robot by electroencephalography (EEG) signals. However, utilizing the motor imagery EEG-based BCI to perform teleoperation for reach and grasp task still has many difficulties, especially in continuous multidimensional control of robot and tactile feedback. In this research, a motor imagery EEG-based continuous teleoperation robot control system with tactile feedback was proposed. Firstly, mental imagination of different hand movements was translated into continuous command to control the remote robotic arm to reach the hover area of the target through a wireless local area network (LAN). Then, the robotic arm automatically completed the task of grasping the target. Meanwhile, the tactile information of remote robotic gripper was detected and converted to the feedback command. Finally, the vibrotactile stimulus was supplied to users to improve their telepresence. Experimental results demonstrate the feasibility of using the motor imagery EEG acquired by wireless portable equipment to realize the continuous teleoperation robot control system to finish the reach and grasp task. The average two-dimensional continuous control success rates for online Task 1 and Task 2 of the six subjects were 78.0% ± 6.1% and 66.2% ± 6.0%, respectively. Furthermore, compared with the traditional EEG triggered robot control using the predefined trajectory, the continuous fully two-dimensional control can not only improve the teleoperation robot system’s efficiency but also give the subject a more natural control which is critical to human–machine interaction (HMI). In addition, vibrotactile stimulus can improve the operator’s telepresence and task performance.
Collapse
|
25
|
What electrophysiology tells us about Alzheimer's disease: a window into the synchronization and connectivity of brain neurons. Neurobiol Aging 2020; 85:58-73. [DOI: 10.1016/j.neurobiolaging.2019.09.008] [Citation(s) in RCA: 77] [Impact Index Per Article: 15.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2019] [Revised: 08/27/2019] [Accepted: 09/14/2019] [Indexed: 01/14/2023]
|
26
|
Kaas A, Goebel R, Valente G, Sorger B. Topographic Somatosensory Imagery for Real-Time fMRI Brain-Computer Interfacing. Front Hum Neurosci 2019; 13:427. [PMID: 31920588 PMCID: PMC6915074 DOI: 10.3389/fnhum.2019.00427] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2019] [Accepted: 11/18/2019] [Indexed: 11/23/2022] Open
Abstract
Real-time functional magnetic resonance imaging (fMRI) is a promising non-invasive method for brain-computer interfaces (BCIs). BCIs translate brain activity into signals that allow communication with the outside world. Visual and motor imagery are often used as information-encoding strategies, but can be challenging if not grounded in recent experience in these modalities, e.g., in patients with locked-in-syndrome (LIS). In contrast, somatosensory imagery might constitute a more suitable information-encoding strategy as the somatosensory function is often very robust. Somatosensory imagery has been shown to activate the somatotopic cortex, but it has been unclear so far whether it can be reliably detected on a single-trial level and successfully classified according to specific somatosensory imagery content. Using ultra-high field 7-T fMRI, we show reliable and high-accuracy single-trial decoding of left-foot (LF) vs. right-hand (RH) somatosensory imagery. Correspondingly, higher decoding accuracies were associated with greater spatial separation of hand and foot decoding-weight patterns in the primary somatosensory cortex (S1). Exploiting these novel neuroscientific insights, we developed-and provide a proof of concept for-basic BCI communication by showing that binary (yes/no) answers encoded by somatosensory imagery can be decoded with high accuracy in simulated real-time (in 7 subjects) as well as in real-time (1 subject). This study demonstrates that body part-specific somatosensory imagery differentially activates somatosensory cortex in a topographically specific manner; evidence which was surprisingly still lacking in the literature. It also offers proof of concept for a novel somatosensory imagery-based fMRI-BCI control strategy, with particularly high potential for visually and motor-impaired patients. The strategy could also be transferred to lower MRI field strengths and to mobile functional near-infrared spectroscopy. Finally, given that communication BCIs provide the BCI user with a form of feedback based on their brain signals and can thus be considered as a specific form of neurofeedback, and that repeated use of a BCI has been shown to enhance underlying representations, we expect that the current BCI could also offer an interesting new approach for somatosensory rehabilitation training in the context of stroke and phantom limb pain.
Collapse
Affiliation(s)
- Amanda Kaas
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands
- Maastricht Brain Imaging Center, Maastricht University, Maastricht, Netherlands
| | - Rainer Goebel
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands
- Maastricht Brain Imaging Center, Maastricht University, Maastricht, Netherlands
| | - Giancarlo Valente
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands
- Maastricht Brain Imaging Center, Maastricht University, Maastricht, Netherlands
| | - Bettina Sorger
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands
- Maastricht Brain Imaging Center, Maastricht University, Maastricht, Netherlands
| |
Collapse
|
27
|
Abstract
Given the prevalence of sleep in early development, any satisfactory account of infant brain activity must consider what happens during sleep. Only recently, however, has it become possible to record sleep-related brain activity in newborn rodents. Using such methods in rat pups, it is now clear that sleep, more so than wake, provides a critical context for the processing of sensory input and the expression of functional connectivity throughout the sensorimotor system. In addition, sleep uniquely reveals functional activity in the developing primary motor cortex, which establishes a somatosensory map long before its role in motor control emerges. These findings will inform our understanding of the developmental processes that contribute to the nascent sense of embodiment in human infants.
Collapse
|
28
|
Korik A, Sosnik R, Siddique N, Coyle D. Decoding Imagined 3D Arm Movement Trajectories From EEG to Control Two Virtual Arms-A Pilot Study. Front Neurorobot 2019; 13:94. [PMID: 31798438 PMCID: PMC6868122 DOI: 10.3389/fnbot.2019.00094] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2018] [Accepted: 10/28/2019] [Indexed: 11/26/2022] Open
Abstract
Background: Realization of online control of an artificial or virtual arm using information decoded from EEG normally occurs by classifying different activation states or voluntary modulation of the sensorimotor activity linked to different overt actions of the subject. However, using a more natural control scheme, such as decoding the trajectory of imagined 3D arm movements to move a prosthetic, robotic, or virtual arm has been reported in a limited amount of studies, all using offline feed-forward control schemes. Objective: In this study, we report the first attempt to realize online control of two virtual arms generating movements toward three targets/arm in 3D space. The 3D trajectory of imagined arm movements was decoded from power spectral density of mu, low beta, high beta, and low gamma EEG oscillations using multiple linear regression. The analysis was performed on a dataset recorded from three subjects in seven sessions wherein each session comprised three experimental blocks: an offline calibration block and two online feedback blocks. Target classification accuracy using predicted trajectories of the virtual arms was computed and compared with results of a filter-bank common spatial patterns (FBCSP) based multi-class classification method involving mutual information (MI) selection and linear discriminant analysis (LDA) modules. Main Results: Target classification accuracy from predicted trajectory of imagined 3D arm movements in the offline runs for two subjects (mean 45%, std 5%) was significantly higher (p < 0.05) than chance level (33.3%). Nevertheless, the accuracy during real-time control of the virtual arms using the trajectory decoded directly from EEG was in the range of chance level (33.3%). However, the results of two subjects show that false-positive feedback may increase the accuracy in closed-loop. The FBCSP based multi-class classification method distinguished imagined movements of left and right arm with reasonable accuracy for two of the three subjects (mean 70%, std 5% compared to 50% chance level). However, classification of the imagined arm movement toward three targets was not successful with the FBCSP classifier as the achieved accuracy (mean 33%, std 5%) was similar to the chance level (33.3%). Sub-optimal components of the multi-session experimental paradigm were identified, and an improved paradigm proposed.
Collapse
Affiliation(s)
- Attila Korik
- Intelligent Systems Research Centre, Ulster University, Derry, United Kingdom
| | - Ronen Sosnik
- Hybrid BCI Lab, Holon Institute of Technology, Holon, Israel
| | - Nazmul Siddique
- Intelligent Systems Research Centre, Ulster University, Derry, United Kingdom
| | - Damien Coyle
- Intelligent Systems Research Centre, Ulster University, Derry, United Kingdom
| |
Collapse
|
29
|
Kiran Kumar GR, Ramasubba Reddy M. Designing a Sum of Squared Correlations Framework for Enhancing SSVEP-Based BCIs. IEEE Trans Neural Syst Rehabil Eng 2019; 27:2044-2050. [DOI: 10.1109/tnsre.2019.2941349] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
30
|
Qiu JM, Casey MA, Diamond SG. Assessing Feedback Response With a Wearable Electroencephalography System. Front Hum Neurosci 2019; 13:258. [PMID: 31402858 PMCID: PMC6669939 DOI: 10.3389/fnhum.2019.00258] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2019] [Accepted: 07/10/2019] [Indexed: 01/06/2023] Open
Abstract
Background: Event related potential (ERP) components, such as P3, N2, and FRN, are potential metrics for assessing feedback response as a form of performance monitoring. Most research studies investigate these ERP components using clinical or research-grade electroencephalography (EEG) systems. Wearable EEGs, which are an affordable alternative, have the potential to assess feedback response using ERPs but have not been sufficiently evaluated. Feedback-related ERPs also have not been scientifically evaluated in interactive settings that are similar to daily computer use. In this study, a consumer-grade wearable EEG system was assessed for its feasibility to collect feedback-related ERPs through an interactive software module that provided an environment in which users were permitted to navigate freely within the program to make decisions. Methods: The recording hardware, which costs < $1,500 in total, incorporated the OpenBCI Cyton Board with Daisy chain, a consumer-grade EEG system that costs $949 USD. Seventeen participants interacted with an oddball paradigm and an interactive module designed to elicit feedback-related ERPs. The features of interests for the oddball paradigm were the P3 and N2 components. The features of interests for the interactive module were the P3, N2, and FRN components elicited in response to positive, neutral, and two types of negative feedback. The FRN was calculated by subtracting the positive feedback response from the negative feedback responses. Results: The P3 and N2 components of the oddball paradigm indicated statistically significant differences between infrequent targets and frequent targets which is in line with current literature. The P3 and N2 components elicited in the interactive module indicated statistically significant differences between positive, neutral, and negative feedback responses. There were no significant differences between the FRN types and significant interactions with channel group and FRN type. Conclusion: The OpenBCI Cyton, after some modifications, shows potential for eliciting and assessing P3, N2, and FRN components, which are important indicators for performance monitoring, in an interactive setting.
Collapse
Affiliation(s)
- Jenny M. Qiu
- Thayer School of Engineering, Dartmouth College, Hanover, NH, United States
| | - Michael A. Casey
- Department of Music, Dartmouth College, Hanover, NH, United States
| | - Solomon G. Diamond
- Thayer School of Engineering, Dartmouth College, Hanover, NH, United States
| |
Collapse
|
31
|
Thompson K. Committing Crimes with BCIs: How Brain-Computer Interface Users can Satisfy Actus Reus and be Criminally Responsible. NEUROETHICS-NETH 2019. [DOI: 10.1007/s12152-019-09416-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
32
|
|
33
|
A conceptual space for EEG-based brain-computer interfaces. PLoS One 2019; 14:e0210145. [PMID: 30605482 PMCID: PMC6317819 DOI: 10.1371/journal.pone.0210145] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2017] [Accepted: 11/29/2018] [Indexed: 12/11/2022] Open
Abstract
Brain-Computer Interfaces (BCIs) have become more and more popular these last years. Researchers use this technology for several types of applications, including attention and workload measures but also for the direct control of objects by the means of BCIs. In this work we present a first, multidimensional feature space for EEG-based BCI applications to help practitioners to characterize, compare and design systems, which use EEG-based BCIs. Our feature space contains 4 axes and 9 sub-axes and consists of 41 options in total as well as their different combinations. We presented the axes of our feature space and we positioned our feature space regarding the existing BCI and HCI taxonomies and we showed how our work integrates the past works, and/or complements them.
Collapse
|
34
|
Hong J, Qin X, Li J, Niu J, Wang W. Signal processing algorithms for motor imagery brain-computer interface: State of the art. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2018. [DOI: 10.3233/jifs-181309] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Affiliation(s)
- Jie Hong
- School of Mechanical Engineering, Northwestern Polytechnical University, Xi’an, China
| | - Xiansheng Qin
- School of Mechanical Engineering, Northwestern Polytechnical University, Xi’an, China
| | - Jing Li
- School of Mechanical Engineering, Northwestern Polytechnical University, Xi’an, China
| | - Junlong Niu
- School of Mechanical Engineering, Northwestern Polytechnical University, Xi’an, China
| | - Wenjie Wang
- School of Mechanical Engineering, Northwestern Polytechnical University, Xi’an, China
| |
Collapse
|
35
|
AlSaleh M, Moore R, Christensen H, Arvaneh M. Discriminating Between Imagined Speech and Non-Speech Tasks Using EEG. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2018; 2018:1952-1955. [PMID: 30440780 DOI: 10.1109/embc.2018.8512681] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
People who are severely disabled (e.g Locked-in patients) need a communication tool translating their thoughts using their brain signals. This technology should be intuitive and easy to use. To this line, this study investigates the possibility of discriminating between imagined speech and two types of non-speech tasks related to either a visual stimulus or relaxation. In comparison to previous studies, this work examines a variety of different words with only single imagination in each trial. Moreover, EEG data are recorded from a small number of electrodes using a low-cost portable EEG device. Thus, our experiment is closer to what we want to achieve in the future as communication tool for locked-in patients. However, this design makes the EEG classification more challenging due to a higher level of noise and variations in EEG signals. Spectral and temporal features, with and without common spatial filtering, were used for classifying every imagined word (and for a group of words) against the non-speech tasks. The results show the potential for discriminating between each imagined word and non-speech tasks. Importantly, the results are different between subjects using different features showing the need for having subject specific features.
Collapse
|
36
|
Ghersi I, Mariño M, Miralles MT. Smart medical beds in patient-care environments of the twenty-first century: a state-of-art survey. BMC Med Inform Decis Mak 2018; 18:63. [PMID: 29986684 PMCID: PMC6038300 DOI: 10.1186/s12911-018-0643-5] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2017] [Accepted: 06/26/2018] [Indexed: 11/19/2022] Open
Abstract
Background Recent scientific achievements and technological advances have brought forward a massive display of new or updated medical devices, enabled with highly-developed embedded-control functions and interactivity. From the final decade of the twentieth century, medical beds have particularly been affected by this surge, taking on new forms and functions, while accommodating to established properties that have become well-known for these devices. The past fifteen years have also brought forward changes to conceptual frameworks, concerning the product design and manufacturing processes (standards), as well as the patient (perspectives on patient-care environments and accessibility). This work presents a state-of-art survey on electric medical beds, representing what is defined as the time of “smart beds”, as part of an increasingly comprehensive patient-care environment. Methods A survey and assessment of market trends, research efforts and standards related to smart medical beds was performed, covering a wide range of public records of intellectual property, models and related healthcare solutions, as well as relevant research efforts in the field between 2000 and 2016. Contextual topics, necessary for the understanding of this subject, on novel technologies, disability and the reach of healthcare systems, were also researched and interpreted. Results The new generation of electric medical beds is defined, with the final stage of the proposed timeline for these devices being covered. Functional, aesthetic and interactive features are presented, and the current global market for medical beds and related standards are also assessed. Finally, discussions concerning rising challenges and opportunities for these systems are explored, with the potential for adding further monitoring and assistive implementations into medical devices and environments being highlighted. Conclusions Smart medical beds are integrated solutions for patient care, assistance and monitoring, based on a comprehensive, multidisciplinary design approach. Research in this field is critical in a context of global ageing, and powered by a surge in opportunities for accessibility solutions. Smart beds, seamlessly integrated into the healthcare system, have a unique opportunity in enabling more efficient efforts for caregivers, and more responsive environments for patients.
Collapse
Affiliation(s)
- Ignacio Ghersi
- Centro de Investigación en Diseño Industrial de Productos Complejos (CIDI-FADU-UBA), Facultad de Arquitectura, Diseño y Urbanismo, Universidad de Buenos Aires, 2160 Intendente Güiraldes Ave, Buenos Aires, Argentina. .,Laboratorio de Biomecánica e Ingeniería para la Salud (LaBIS-FI-UCA), Facultad de Ingeniería y Ciencias Agrarias, Pontificia Universidad Católica Argentina, 1600 Alicia Moreau de Justo Ave, Buenos Aires, Argentina.
| | - Mario Mariño
- Centro de Investigación en Diseño Industrial de Productos Complejos (CIDI-FADU-UBA), Facultad de Arquitectura, Diseño y Urbanismo, Universidad de Buenos Aires, 2160 Intendente Güiraldes Ave, Buenos Aires, Argentina
| | - Mónica Teresita Miralles
- Centro de Investigación en Diseño Industrial de Productos Complejos (CIDI-FADU-UBA), Facultad de Arquitectura, Diseño y Urbanismo, Universidad de Buenos Aires, 2160 Intendente Güiraldes Ave, Buenos Aires, Argentina.,Laboratorio de Biomecánica e Ingeniería para la Salud (LaBIS-FI-UCA), Facultad de Ingeniería y Ciencias Agrarias, Pontificia Universidad Católica Argentina, 1600 Alicia Moreau de Justo Ave, Buenos Aires, Argentina
| |
Collapse
|
37
|
Semprini M, Laffranchi M, Sanguineti V, Avanzino L, De Icco R, De Michieli L, Chiappalone M. Technological Approaches for Neurorehabilitation: From Robotic Devices to Brain Stimulation and Beyond. Front Neurol 2018; 9:212. [PMID: 29686644 PMCID: PMC5900382 DOI: 10.3389/fneur.2018.00212] [Citation(s) in RCA: 36] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2017] [Accepted: 03/16/2018] [Indexed: 12/30/2022] Open
Abstract
Neurological diseases causing motor/cognitive impairments are among the most common causes of adult-onset disability. More than one billion of people are affected worldwide, and this number is expected to increase in upcoming years, because of the rapidly aging population. The frequent lack of complete recovery makes it desirable to develop novel neurorehabilitative treatments, suited to the patients, and better targeting the specific disability. To date, rehabilitation therapy can be aided by the technological support of robotic-based therapy, non-invasive brain stimulation, and neural interfaces. In this perspective, we will review the above methods by referring to the most recent advances in each field. Then, we propose and discuss current and future approaches based on the combination of the above. As pointed out in the recent literature, by combining traditional rehabilitation techniques with neuromodulation, biofeedback recordings and/or novel robotic and wearable assistive devices, several studies have proven it is possible to sensibly improve the amount of recovery with respect to traditional treatments. We will then discuss the possible applied research directions to maximize the outcome of a neurorehabilitation therapy, which should include the personalization of the therapy based on patient and clinician needs and preferences.
Collapse
Affiliation(s)
| | | | - Vittorio Sanguineti
- Department of Informatics, Bioengineering, Robotics and Systems Engineering (DIBRIS), University of Genova, Genova, Italy
| | - Laura Avanzino
- Section of Human Physiology, Department of Experimental Medicine (DIMES), University of Genova, Genova, Italy
| | - Roberto De Icco
- Department of Neurology and Neurorehabilitation, Istituto Neurologico Nazionale C. Mondino, Pavia, Italy.,Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy
| | | | | |
Collapse
|
38
|
Ekanayake J, Hutton C, Ridgway G, Scharnowski F, Weiskopf N, Rees G. Real-time decoding of covert attention in higher-order visual areas. Neuroimage 2018; 169:462-472. [PMID: 29247807 PMCID: PMC5864512 DOI: 10.1016/j.neuroimage.2017.12.019] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2017] [Revised: 12/06/2017] [Accepted: 12/09/2017] [Indexed: 12/21/2022] Open
Abstract
Brain-computer-interfaces (BCI) provide a means of using human brain activations to control devices for communication. Until now this has only been demonstrated in primary motor and sensory brain regions, using surgical implants or non-invasive neuroimaging techniques. Here, we provide proof-of-principle for the use of higher-order brain regions involved in complex cognitive processes such as attention. Using realtime fMRI, we implemented an online 'winner-takes-all approach' with quadrant-specific parameter estimates, to achieve single-block classification of brain activations. These were linked to the covert allocation of attention to real-world images presented at 4-quadrant locations. Accuracies in three target regions were significantly above chance, with individual decoding accuracies reaching upto 70%. By utilising higher order mental processes, 'cognitive BCIs' access varied and therefore more versatile information, potentially providing a platform for communication in patients who are unable to speak or move due to brain injury.
Collapse
Affiliation(s)
- Jinendra Ekanayake
- Wellcome Trust Centre for Interventional and Surgical Sciences, University College London, London, United Kingdom; Wellcome Trust Centre for Neuroimaging, University College London, London, United Kingdom; Institute of Cognitive Neuroscience, University College London, London, United Kingdom.
| | - Chloe Hutton
- Siemens Molecular Imaging, Oxford, United Kingdom
| | | | - Frank Scharnowski
- Psychiatric University Hospital, University of Zürich, Lenggstrasse 31, 8032 Zürich, Switzerland; Neuroscience Center Zürich, University of Zürich and Swiss Federal Institute of Technology, Winterthurerstr. 190, 8057 Zürich, Switzerland; Zürich Center for Integrative Human Physiology (ZIHP), University of Zürich, Winterthurerstr. 190, 8057 Zürich, Switzerland
| | - Nikolaus Weiskopf
- Wellcome Trust Centre for Neuroimaging, University College London, London, United Kingdom; Department of Neurophysics, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Geraint Rees
- Wellcome Trust Centre for Neuroimaging, University College London, London, United Kingdom; Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| |
Collapse
|
39
|
An Adaptive Calibration Framework for mVEP-Based Brain-Computer Interface. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2018; 2018:9476432. [PMID: 29682000 PMCID: PMC5846352 DOI: 10.1155/2018/9476432] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/29/2017] [Revised: 01/10/2018] [Accepted: 01/24/2018] [Indexed: 11/17/2022]
Abstract
Electroencephalogram signals and the states of subjects are nonstationary. To track changing states effectively, an adaptive calibration framework is proposed for the brain-computer interface (BCI) with the motion-onset visual evoked potential (mVEP) as the control signal. The core of this framework is to update the training set adaptively for classifier training. The updating procedure consists of two operations, that is, adding new samples to the training set and removing old samples from the training set. In the proposed framework, a support vector machine (SVM) and fuzzy C-mean clustering (fCM) are combined to select the reliable samples for the training set from the blocks close to the current blocks to be classified. Because of the complementary information provided by SVM and fCM, they can guarantee the reliability of information fed into classifier training. The removing procedure will aim to remove those old samples recorded a relatively long time before current new blocks. These two operations could yield a new training set, which could be used to calibrate the classifier to track the changing state of the subjects. Experimental results demonstrate that the adaptive calibration framework is effective and efficient and it could improve the performance of online BCI systems.
Collapse
|
40
|
Xu B, Song A, Zhao G, Liu J, Xu G, Pan L, Yang R, Li H, Cui J. EEG-modulated robotic rehabilitation system for upper extremity. BIOTECHNOL BIOTEC EQ 2018. [DOI: 10.1080/13102818.2018.1437569] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022] Open
Affiliation(s)
- Baoguo Xu
- Laboratory of Robot Sensing and Control, School of Instrument Science and Engineering, Southeast University, Nanjing, PR China
| | - Aiguo Song
- Laboratory of Robot Sensing and Control, School of Instrument Science and Engineering, Southeast University, Nanjing, PR China
| | - Guopu Zhao
- Jiangsu Siming Engineering Machinery Co. Ltd., Yangzhou, PR China
| | - Jia Liu
- Jiangsu Collaborative Innovation Center of Atmospheric Environment and Equipment Technology (CICAEET), Nanjing University of Information Science & Technology, Nanjing, PR China
| | - Guozheng Xu
- College of Automation, Nanjing University of Posts and Telecommunications, Nanjing, PR China
| | - Lizheng Pan
- School of Mechanical Engineering, Changzhou University, Changzhou, PR China
| | - Renhuan Yang
- College of Information Science and Technology, Jinan University, Guangzhou, PR China
| | - Huijun Li
- Laboratory of Robot Sensing and Control, School of Instrument Science and Engineering, Southeast University, Nanjing, PR China
| | - Jianwei Cui
- Laboratory of Robot Sensing and Control, School of Instrument Science and Engineering, Southeast University, Nanjing, PR China
| |
Collapse
|
41
|
Nicolae IE, Acqualagna L, Blankertz B. Assessing the Depth of Cognitive Processing as the Basis for Potential User-State Adaptation. Front Neurosci 2017; 11:548. [PMID: 29046625 PMCID: PMC5632679 DOI: 10.3389/fnins.2017.00548] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2017] [Accepted: 09/20/2017] [Indexed: 11/23/2022] Open
Abstract
Objective: Decoding neurocognitive processes on a single-trial basis with Brain-Computer Interface (BCI) techniques can reveal the user's internal interpretation of the current situation. Such information can potentially be exploited to make devices and interfaces more user aware. In this line of research, we took a further step by studying neural correlates of different levels of cognitive processes and developing a method that allows to quantify how deeply presented information is processed in the brain. Methods/Approach: Seventeen participants took part in an EEG study in which we evaluated different levels of cognitive processing (no processing, shallow, and deep processing) within three distinct domains (memory, language, and visual imagination). Our investigations showed gradual differences in the amplitudes of event-related potentials (ERPs) and in the extend and duration of event-related desynchronization (ERD) which both correlate with task difficulty. We performed multi-modal classification to map the measured correlates of neurocognitive processing to the corresponding level of processing. Results: Successful classification of the neural components was achieved, which reflects the level of cognitive processing performed by the participants. The results show performances above chance level for each participant and a mean performance of 70-90% for all conditions and classification pairs. Significance: The successful estimation of the level of cognition on a single-trial basis supports the feasibility of user-state adaptation based on ongoing neural activity. There is a variety of potential use cases such as: a user-friendly adaptive design of an interface or the development of assistance systems in safety critical workplaces.
Collapse
Affiliation(s)
- Irina-Emilia Nicolae
- Department of Applied Electronics and Information Engineering, Politehnica University of Bucharest, Bucharest, Romania
- Department of Neurotechnology, Technische Universität Berlin, Berlin, Germany
| | - Laura Acqualagna
- Department of Neurotechnology, Technische Universität Berlin, Berlin, Germany
| | - Benjamin Blankertz
- Department of Neurotechnology, Technische Universität Berlin, Berlin, Germany
| |
Collapse
|
42
|
Frontoparietal neurostimulation modulates working memory training benefits and oscillatory synchronization. Brain Res 2017; 1667:28-40. [PMID: 28502585 DOI: 10.1016/j.brainres.2017.05.005] [Citation(s) in RCA: 37] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2017] [Revised: 05/01/2017] [Accepted: 05/03/2017] [Indexed: 11/24/2022]
Abstract
There is considerable interest in maintaining working memory (WM) because it is essential to accomplish most cognitive tasks, and it is correlated with fluid intelligence and ecologically valid measures of daily living. Toward this end, WM training protocols aim to improve WM capacity and extend improvements to unpracticed domains, yet success is limited. One emerging approach is to couple WM training with transcranial direct current stimulation (tDCS). This pairing of WM training with tDCS in longitudinal designs promotes behavioral improvement and evidence of transfer of performance gains to untrained WM tasks. However, the mechanism(s) underlying tDCS-linked training benefits remain unclear. Our goal was to gain purchase on this question by recording high-density EEG before and after a weeklong WM training+tDCS study. Participants completed four sessions of frontoparietal tDCS (active anodal or sham) during which they performed a visuospatial WM change detection task. Participants who received active anodal tDCS demonstrated significant improvement on the WM task, unlike those who received sham stimulation. Importantly, this pattern was mirrored by neural correlates in spectral and phase synchrony analyses of the HD-EEG data. Notably, the behavioral interaction was echoed by interactions in frontal-posterior alpha band power, and theta and low alpha oscillations. These findings indicate that one mechanism by which paired tDCS+WM training operates is to enhance cortical efficiency and connectivity in task-relevant networks.
Collapse
|
43
|
Implications for a Wireless, External Device System to Study Electrocorticography. SENSORS 2017; 17:s17040761. [PMID: 28375161 PMCID: PMC5421721 DOI: 10.3390/s17040761] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/13/2017] [Revised: 03/23/2017] [Accepted: 03/27/2017] [Indexed: 11/30/2022]
Abstract
Implantable neuronal interfaces to the brain are an important keystone for future medical applications. However, entering this field of research is difficult since such an implant requires components from many different areas of technology. Since the complete avoidance of wires is important due to the risk of infections and other long-term problems, means for wirelessly transmitting data and energy are a necessity which adds to the requirements. In recent literature, many high-tech components for such implants are presented with remarkable properties. However, these components are typically not freely available for such a system. Every group needs to re-develop their own solution. This raises the question if it is possible to create a reusable design for an implant and its external base-station, such that it allows other groups to use it as a starting point. In this article, we try to answer this question by presenting a design based exclusively on commercial off-the-shelf components and studying the properties of the resulting system. Following this idea, we present a fully wireless neuronal implant for simultaneously measuring electrocorticography signals at 128 locations from the surface of the brain. All design files are available as open source.
Collapse
|
44
|
Myrden A, Chau T. A Passive EEG-BCI for Single-Trial Detection of Changes in Mental State. IEEE Trans Neural Syst Rehabil Eng 2017; 25:345-356. [DOI: 10.1109/tnsre.2016.2641956] [Citation(s) in RCA: 51] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
45
|
García-Prieto J, Bajo R, Pereda E. Efficient Computation of Functional Brain Networks: toward Real-Time Functional Connectivity. Front Neuroinform 2017; 11:8. [PMID: 28220071 PMCID: PMC5292573 DOI: 10.3389/fninf.2017.00008] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2016] [Accepted: 01/20/2017] [Indexed: 11/13/2022] Open
Abstract
Functional Connectivity has demonstrated to be a key concept for unraveling how the brain balances functional segregation and integration properties while processing information. This work presents a set of open-source tools that significantly increase computational efficiency of some well-known connectivity indices and Graph-Theory measures. PLV, PLI, ImC, and wPLI as Phase Synchronization measures, Mutual Information as an information theory based measure, and Generalized Synchronization indices are computed much more efficiently than prior open-source available implementations. Furthermore, network theory related measures like Strength, Shortest Path Length, Clustering Coefficient, and Betweenness Centrality are also implemented showing computational times up to thousands of times faster than most well-known implementations. Altogether, this work significantly expands what can be computed in feasible times, even enabling whole-head real-time network analysis of brain function.
Collapse
Affiliation(s)
- Juan García-Prieto
- Department of Industrial Engineering, Laboratory of Electrical Engineering and Bioengineering, Universidad de La LagunaTenerife, Spain; Laboratory of Computational and Cognitive Neuroscience, Centre of Biomedical Technology, UPMMadrid, Spain
| | - Ricardo Bajo
- Laboratory of Computational and Cognitive Neuroscience, Centre of Biomedical Technology, UPMMadrid, Spain; Department of Statistics and Operative Research, Faculty of Medicine, Universidad Complutense de MadridMadrid, Spain
| | - Ernesto Pereda
- Department of Industrial Engineering, Laboratory of Electrical Engineering and Bioengineering, Universidad de La LagunaTenerife, Spain; Laboratory of Computational and Cognitive Neuroscience, Centre of Biomedical Technology, UPMMadrid, Spain; Institute of Biomedical Technology (CIBICAN), Universidad de La LagunaTenerife, Spain
| |
Collapse
|
46
|
Brain-Computer Interface-Based Communication in the Completely Locked-In State. PLoS Biol 2017; 15:e1002593. [PMID: 28141803 PMCID: PMC5283652 DOI: 10.1371/journal.pbio.1002593] [Citation(s) in RCA: 131] [Impact Index Per Article: 16.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2016] [Accepted: 12/27/2016] [Indexed: 12/13/2022] Open
Abstract
Despite partial success, communication has remained impossible for persons suffering from complete motor paralysis but intact cognitive and emotional processing, a state called complete locked-in state (CLIS). Based on a motor learning theoretical context and on the failure of neuroelectric brain–computer interface (BCI) communication attempts in CLIS, we here report BCI communication using functional near-infrared spectroscopy (fNIRS) and an implicit attentional processing procedure. Four patients suffering from advanced amyotrophic lateral sclerosis (ALS)—two of them in permanent CLIS and two entering the CLIS without reliable means of communication—learned to answer personal questions with known answers and open questions all requiring a “yes” or “no” thought using frontocentral oxygenation changes measured with fNIRS. Three patients completed more than 46 sessions spread over several weeks, and one patient (patient W) completed 20 sessions. Online fNIRS classification of personal questions with known answers and open questions using linear support vector machine (SVM) resulted in an above-chance-level correct response rate over 70%. Electroencephalographic oscillations and electrooculographic signals did not exceed the chance-level threshold for correct communication despite occasional differences between the physiological signals representing a “yes” or “no” response. However, electroencephalogram (EEG) changes in the theta-frequency band correlated with inferior communication performance, probably because of decreased vigilance and attention. If replicated with ALS patients in CLIS, these positive results could indicate the first step towards abolition of complete locked-in states, at least for ALS. "Locked in" patients suffering from advanced amyotrophic lateral sclerosis, with no reliable means of communication, can learn to answer questions requiring a “yes” or “no” thought using frontocentral oxygenation changes measurable by functional near-infrared spectroscopy. Despite scientific and technological advances, communication has remained impossible for persons suffering from complete motor paralysis but intact cognitive and emotional processing, a condition that is called completely locked-in state. Brain–computer interfaces based on neuroelectrical technology (like an electroencephalogram) have failed at providing patients in a completely locked-in state with means to communicate. Therefore, here we explored if a brain–computer interface based on functional near infrared spectroscopy (fNIRS)—which measures brain hemodynamic responses associated with neuronal activity—could overcome this barrier. Four patients suffering from advanced amyotrophic lateral sclerosis (ALS), two of them in permanent completely locked-in state and two entering the completely locked-in state without reliable means of communication, learned to answer personal questions with known answers and open questions requiring a “yes” or “no” by using frontocentral oxygenation changes measured with fNIRS. These results are, potentially, the first step towards abolition of completely locked-in states, at least for patients with ALS.
Collapse
|
47
|
Shin J, Müller KR, Hwang HJ. Near-infrared spectroscopy (NIRS)-based eyes-closed brain-computer interface (BCI) using prefrontal cortex activation due to mental arithmetic. Sci Rep 2016; 6:36203. [PMID: 27824089 PMCID: PMC5099935 DOI: 10.1038/srep36203] [Citation(s) in RCA: 41] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2016] [Accepted: 10/12/2016] [Indexed: 11/11/2022] Open
Abstract
We propose a near-infrared spectroscopy (NIRS)-based brain-computer interface (BCI) that can be operated in eyes-closed (EC) state. To evaluate the feasibility of NIRS-based EC BCIs, we compared the performance of an eye-open (EO) BCI paradigm and an EC BCI paradigm with respect to hemodynamic response and classification accuracy. To this end, subjects performed either mental arithmetic or imagined vocalization of the English alphabet as a baseline task with very low cognitive loading. The performances of two linear classifiers were compared; resulting in an advantage of shrinkage linear discriminant analysis (LDA). The classification accuracy of EC paradigm (75.6 ± 7.3%) was observed to be lower than that of EO paradigm (77.0 ± 9.2%), which was statistically insignificant (p = 0.5698). Subjects reported they felt it more comfortable (p = 0.057) and easier (p < 0.05) to perform the EC BCI tasks. The different task difficulty may become a cause of the slightly lower classification accuracy of EC data. From the analysis results, we could confirm the feasibility of NIRS-based EC BCIs, which can be a BCI option that may ultimately be of use for patients who cannot keep their eyes open consistently.
Collapse
Affiliation(s)
- Jaeyoung Shin
- Machine Learning Group, Berlin Institute of Technology (TU Berlin), Marchstr. 23, 10587 Berlin, Germany
| | - Klaus-R Müller
- Machine Learning Group, Berlin Institute of Technology (TU Berlin), Marchstr. 23, 10587 Berlin, Germany
- Department of Brain and Cognitive Engineering, Korea University, 136-713 Seoul, Korea
| | - Han-Jeong Hwang
- Department of Medical IT Convergence Engineering, Kumoh National Institute of Technology, 730-701 Gumi, Korea
| |
Collapse
|
48
|
Ordikhani-Seyedlar M, Lebedev MA, Sorensen HBD, Puthusserypady S. Neurofeedback Therapy for Enhancing Visual Attention: State-of-the-Art and Challenges. Front Neurosci 2016; 10:352. [PMID: 27536212 PMCID: PMC4971093 DOI: 10.3389/fnins.2016.00352] [Citation(s) in RCA: 40] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2016] [Accepted: 07/12/2016] [Indexed: 11/17/2022] Open
Abstract
We have witnessed a rapid development of brain-computer interfaces (BCIs) linking the brain to external devices. BCIs can be utilized to treat neurological conditions and even to augment brain functions. BCIs offer a promising treatment for mental disorders, including disorders of attention. Here we review the current state of the art and challenges of attention-based BCIs, with a focus on visual attention. Attention-based BCIs utilize electroencephalograms (EEGs) or other recording techniques to generate neurofeedback, which patients use to improve their attention, a complex cognitive function. Although progress has been made in the studies of neural mechanisms of attention, extraction of attention-related neural signals needed for BCI operations is a difficult problem. To attain good BCI performance, it is important to select the features of neural activity that represent attentional signals. BCI decoding of attention-related activity may be hindered by the presence of different neural signals. Therefore, BCI accuracy can be improved by signal processing algorithms that dissociate signals of interest from irrelevant activities. Notwithstanding recent progress, optimal processing of attentional neural signals remains a fundamental challenge for the development of efficient therapies for disorders of attention.
Collapse
Affiliation(s)
- Mehdi Ordikhani-Seyedlar
- Division of Biomedical Engineering, Department of Electrical Engineering, Technical University of Denmark Lyngby, Denmark
| | - Mikhail A Lebedev
- Department of Neurobiology, Duke UniversityDurham, NC, USA; Center for Neuroengineering, Duke UniversityDurham, NC, USA
| | - Helge B D Sorensen
- Division of Biomedical Engineering, Department of Electrical Engineering, Technical University of Denmark Lyngby, Denmark
| | - Sadasivan Puthusserypady
- Division of Biomedical Engineering, Department of Electrical Engineering, Technical University of Denmark Lyngby, Denmark
| |
Collapse
|
49
|
Roijendijk L, Gielen S, Farquhar J. Classifying Regularized Sensor Covariance Matrices: An Alternative to CSP. IEEE Trans Neural Syst Rehabil Eng 2016; 24:893-900. [DOI: 10.1109/tnsre.2015.2477687] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
50
|
Lopez-Gordo MA, Grima Murcia MD, Padilla P, Pelayo F, Fernandez E. Asynchronous Detection of Trials Onset from Raw EEG Signals. Int J Neural Syst 2016; 26:1650034. [PMID: 27377663 DOI: 10.1142/s0129065716500349] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Clinical processing of event-related potentials (ERPs) requires a precise synchrony between the stimulation and the acquisition units that are guaranteed by means of a physical link between them. This precise synchrony is needed since temporal misalignments during trial averaging can lead to high deviations of peak times, thus causing error in diagnosis or inefficiency in classification in brain-computer interfaces (BCIs). Out of the laboratory, mobile EEG systems and BCI headsets are not provided with the physical link, thus being inadequate for acquisition of ERPs. In this study, we propose a method for the asynchronous detection of trials onset from raw EEG without physical links. We validate it with a BCI application based on the dichotic listening task. The user goal was to attend the cued auditory message and to report three keywords contained in it while ignoring the other message. The BCI goal was to detect the attended message from the analysis of auditory ERPs. The rate of successful onset detection in both synchronous (using the real onset) and asynchronous (blind detection of trial onset from raw EEG) was 73% with a synchronization error of less than 1[Formula: see text]ms. The level of synchronization provided by this proposal would allow home-based acquisition of ERPs with low cost BCI headsets and any media player unit without physical links between them.
Collapse
Affiliation(s)
- M. A. Lopez-Gordo
- Department of Signal Theory, Telematics and Communications, University of Granada, Spain
- Nicolo Association, Churriana de la Vega, Granada, Spain
| | - M. D. Grima Murcia
- Institute of Bioengineering, University Miguel Hernández and CIBER BBN Av. de la Universidad 03202, Elche, Spain
| | - Pablo Padilla
- Department of Signal Theory, Communications and Networking, University of Granada 18071, Spain
| | - F. Pelayo
- Department of Computer Architecture and Technology, University of Granada, c/Periodista Daniel Saucedo 18071, Granada, Spain
| | - E. Fernandez
- Institute of Bioengineering, University Miguel Hernández and CIBER BBN Av. de la Universidad 03202, Elche, Spain
| |
Collapse
|