The Human Factors and Ergonomics of P300-Based Brain-Computer Interfaces

Analyzing and computing humans by means of the brain using Brain-Computer Interfaces - understanding the user - previous evidence, self-relevance and the user's self-concept as potential superordinate human factors of relevance

Brain-computer interfaces (BCIs) are well-known instances of how technology can convert a user's brain activity taken from non-invasive electroencephalography (EEG) into computer commands for the purpose of computer-assisted communication and interaction. However, not all users are attaining the accuracy required to use a BCI consistently, despite advancements in technology. Accordingly, previous research suggests that human factors could be responsible for the variance in BCI performance among users. Therefore, the user's internal mental states and traits including motivation, affect or cognition, personality traits, or the user's satisfaction, beliefs or trust in the technology have been investigated. Going a step further, this manuscript aims to discuss which human factors could be potential superordinate factors that influence BCI performance, implicitly, explicitly as well as inter- and intraindividually. Based on the results of previous studies that used comparable protocols to examine the motivational, affective, cognitive state or personality traits of healthy and vulnerable EEG-BCI users within and across well-investigated BCIs (P300-BCIs or SMR-BCIs, respectively), it is proposed that the self-relevance of tasks and stimuli and the user's self-concept provide a huge potential for BCI applications. As potential key human factors self-relevance and the user's self-concept (self-referential knowledge and beliefs about one's self) guide information processing and modulate the user's motivation, attention, or feelings of ownership, agency, and autonomy. Changes in the self-relevance of tasks and stimuli as well as self-referential processing related to one's self (self-concept) trigger changes in neurophysiological activity in specific brain networks relevant to BCI. Accordingly, concrete examples will be provided to discuss how past and future research could incorporate self-relevance and the user's self-concept in the BCI setting - including paradigms, user instructions, and training sessions.

Multi-information improves the performance of CCA-based SSVEP classification

The target recognition algorithm based on canonical correlation analysis (CCA) has been widely used in steady-state visual evoked potential (SSVEP)-based brain-computer interfaces. To reduce visual fatigue and improve the information transfer rate (ITR), how to improve the accuracy of algorithms within a short time window has become one of the main problems at present. There were filter bank CCA (FBCCA), individual template CCA (ITCCA), and temporally local CCA (TCCA), which improve the CCA algorithm from different aspects.This paper proposed to consider individual, frequency, and time information at the same time, so as to extract features more effectively. A comparison of the various methods was performed using benchmark dataset. Classification accuracy and ITR were used for performance evaluation. In the different extensions of CCA, the method incorporating the above three kinds of information simultaneously achieved the best performance within a short time window. This study explores the effect of using a variety of information to improve the CCA algorithm.

State-of-the-Art on Brain-Computer Interface Technology

This paper provides a comprehensive overview of the state-of-the-art in brain-computer interfaces (BCI). It begins by providing an introduction to BCIs, describing their main operation principles and most widely used platforms. The paper then examines the various components of a BCI system, such as hardware, software, and signal processing algorithms. Finally, it looks at current trends in research related to BCI use for medical, educational, and other purposes, as well as potential future applications of this technology. The paper concludes by highlighting some key challenges that still need to be addressed before widespread adoption can occur. By presenting an up-to-date assessment of the state-of-the-art in BCI technology, this paper will provide valuable insight into where this field is heading in terms of progress and innovation.

Usability of a Hybrid System Combining P300-Based Brain-Computer Interface and Commercial Assistive Technologies to Enhance Communication in People With Multiple Sclerosis

Brain-computer interface (BCI) can provide people with motor disabilities with an alternative channel to access assistive technology (AT) software for communication and environmental interaction. Multiple sclerosis (MS) is a chronic disease of the central nervous system that mostly starts in young adulthood and often leads to a long-term disability, possibly exacerbated by the presence of fatigue. Patients with MS have been rarely considered as potential BCI end-users. In this pilot study, we evaluated the usability of a hybrid BCI (h-BCI) system that enables both a P300-based BCI and conventional input devices (i.e., muscular dependent) to access mainstream applications through the widely used AT software for communication “Grid 3.” The evaluation was performed according to the principles of the user-centered design (UCD) with the aim of providing patients with MS with an alternative control channel (i.e., BCI), potentially less sensitive to fatigue. A total of 13 patients with MS were enrolled. In session I, participants were presented with a widely validated P300-based BCI (P3-speller); in session II, they had to operate Grid 3 to access three mainstream applications with (1) an AT conventional input device and (2) the h-BCI. Eight patients completed the protocol. Five out of eight patients with MS were successfully able to access the Grid 3 via the BCI, with a mean online accuracy of 83.3% (± 14.6). Effectiveness (online accuracy), satisfaction, and workload were comparable between the conventional AT inputs and the BCI channel in controlling the Grid 3. As expected, the efficiency (time for correct selection) resulted to be significantly lower for the BCI with respect to the AT conventional channels (Z = 0.2, p < 0.05). Although cautious due to the limited sample size, these preliminary findings indicated that the BCI control channel did not have a detrimental effect with respect to conventional AT channels on the ability to operate an AT software (Grid 3). Therefore, we inferred that the usability of the two access modalities was comparable. The integration of BCI with commercial AT input devices to access a widely used AT software represents an important step toward the introduction of BCIs into the AT centers’ daily practice.

Direct Communication Between Brains: A Systematic PRISMA Review of Brain-To-Brain Interface

This paper aims to review the current state of brain-to-brain interface (B2BI) technology and its potential. B2BIs function via a brain-computer interface (BCI) to read a sender's brain activity and a computer-brain interface (CBI) to write a pattern to a receiving brain, transmitting information. We used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) to systematically review current literature related to B2BI, resulting in 15 relevant publications. Experimental papers primarily used transcranial magnetic stimulation (tMS) for the CBI portion of their B2BI. Most targeted the visual cortex to produce phosphenes. In terms of study design, 73.3% (11) are unidirectional and 86.7% (13) use only a 1:1 collaboration model (subject to subject). Limitations are apparent, as the CBI method varied greatly between studies indicating no agreed upon neurostimulatory method for transmitting information. Furthermore, only 12.4% (2) studies are more complicated than a 1:1 model and few researchers studied direct bidirectional B2BI. These studies show B2BI can offer advances in human communication and collaboration, but more design and experiments are needed to prove potential. B2BIs may allow rehabilitation therapists to pass information mentally, activating a patient's brain to aid in stroke recovery and adding more complex bidirectionality may allow for increased behavioral synchronization between users. The field is very young, but applications of B2BI technology to neuroergonomics and human factors engineering clearly warrant more research.

Advancing Brain-Computer Interface Applications for Severely Disabled Children Through a Multidisciplinary National Network: Summary of the Inaugural Pediatric BCI Canada Meeting

Thousands of youth suffering from acquired brain injury or other early-life neurological disease live, mature, and learn with only limited communication and interaction with their world. Such cognitively capable children are ideal candidates for brain-computer interfaces (BCI). While BCI systems are rapidly evolving, a fundamental gap exists between technological innovators and the patients and families who stand to benefit. Forays into translating BCI systems to children in recent years have revealed that kids can learn to operate simple BCI with proficiency akin to adults. BCI could bring significant boons to the lives of many children with severe physical impairment, supporting their complex physical and social needs. However, children have been neglected in BCI research and a collaborative BCI research community is required to unite and push pediatric BCI development forward. To this end, the pediatric BCI Canada collaborative network (BCI-CAN) was formed, under a unified goal to cooperatively drive forward pediatric BCI innovation and impact. This article reflects on the topics and discussions raised in the foundational BCI-CAN meeting held in Toronto, ON, Canada in November 2019 and suggests the next steps required to see BCI impact the lives of children with severe neurological disease and their families.

Designing a flexible tool for rapid implementation of brain-computer interfaces (BCI) in game development

Early neurological injury or disease can lead to severe life-long physical impairments, despite normal cognitive function. For such individuals, brain-computer interfaces (BCI) may provide a means to regain access to the world by offering control of systems through directly processing brain patterns. However, current BCI applications are often research driven and consequently seen as uninteresting, particularly for prolonged use and younger BCI-users. To help mitigate this concern, this paper establishes a tool for researchers and game developers alike to rapidly incorporate a BCI control scheme (the P300 oddball response) into a gaming environment. Preliminary results indicate the proposed P300 Dynamic Cube (PDC) asset works in online BCI environments (n=20, healthy adult participants), resulting in median classification accuracy of 75 ± 3.28%. Additionally, the PDC tool can be rapidly adapted for a variety of game designs, evidenced by its incorporation into submissions to the Brain-Computer Interface (BCI) Game Jam 2019 competition. These findings support the PDC as a useful asset in the design and development of BCI-based games.

Brain-computer interfaces for communication

Locked-in syndrome (LIS) is characterized by an inability to move or speak in the presence of intact cognition and can be caused by brainstem trauma or neuromuscular disease. Quality of life (QoL) in LIS is strongly impaired by the inability to communicate, which cannot always be remedied by traditional augmentative and alternative communication (AAC) solutions if residual muscle activity is insufficient to control the AAC device. Brain-computer interfaces (BCIs) may offer a solution by employing the person's neural signals instead of relying on muscle activity. Here, we review the latest communication BCI research using noninvasive signal acquisition approaches (electroencephalography, functional magnetic resonance imaging, functional near-infrared spectroscopy) and subdural and intracortical implanted electrodes, and we discuss current efforts to translate research knowledge into usable BCI-enabled communication solutions that aim to improve the QoL of individuals with LIS.

EEG Signals Feature Extraction Based on DWT and EMD Combined with Approximate Entropy

The classification recognition rate of motor imagery is a key factor to improve the performance of brain-computer interface (BCI). Thus, we propose a feature extraction method based on discrete wavelet transform (DWT), empirical mode decomposition (EMD), and approximate entropy. Firstly, the electroencephalogram (EEG) signal is decomposed into a series of narrow band signals with DWT, then the sub-band signal is decomposed with EMD to get a set of stationary time series, which are called intrinsic mode functions (IMFs). Secondly, the appropriate IMFs for signal reconstruction are selected. Thus, the approximate entropy of the reconstructed signal can be obtained as the corresponding feature vector. Finally, support vector machine (SVM) is used to perform the classification. The proposed method solves the problem of wide frequency band coverage during EMD and further improves the classification accuracy of EEG signal motion imaging.

EEG-Based Brain-Computer Interfaces

Brain-Computer Interfaces (BCIs) are real-time computer-based systems that translate brain signals into useful commands. To date most applications have been demonstrations of proof-of-principle; widespread use by people who could benefit from this technology requires further development. Improvements in current EEG recording technology are needed. Better sensors would be easier to apply, more confortable for the user, and produce higher quality and more stable signals. Although considerable effort has been devoted to evaluating classifiers using public datasets, more attention to real-time signal processing issues and to optimizing the mutually adaptive interaction between the brain and the BCI are essential for improving BCI performance. Further development of applications is also needed, particularly applications of BCI technology to rehabilitation. The design of rehabilitation applications hinges on the nature of BCI control and how it might be used to induce and guide beneficial plasticity in the brain.

A systematic review of hybrid brain-computer interfaces: Taxonomy and usability perspectives

A new Brain-Computer Interface (BCI) technique, which is called a hybrid BCI, has recently been proposed to address the limitations of conventional single BCI system. Although some hybrid BCI studies have shown promising results, the field of hybrid BCI is still in its infancy and there is much to be done. Especially, since the hybrid BCI systems are so complicated and complex, it is difficult to understand the constituent and role of a hybrid BCI system at a glance. Also, the complicated and complex systems make it difficult to evaluate the usability of the systems. We systematically reviewed and analyzed the current state-of-the-art hybrid BCI studies, and proposed a systematic taxonomy for classifying the types of hybrid BCIs with multiple taxonomic criteria. After reviewing 74 journal articles, hybrid BCIs could be categorized with respect to 1) the source of brain signals, 2) the characteristics of the brain signal, and 3) the characteristics of operation in each system. In addition, we exhaustively reviewed recent literature on usability of BCIs. To identify the key evaluation dimensions of usability, we focused on task and measurement characteristics of BCI usability. We classified and summarized 31 BCI usability journal articles according to task characteristics (type and description of task) and measurement characteristics (subjective and objective measures). Afterwards, we proposed usability dimensions for BCI and hybrid BCI systems according to three core-constructs: Satisfaction, effectiveness, and efficiency with recommendations for further research. This paper can help BCI researchers, even those who are new to the field, can easily understand the complex structure of the hybrid systems at a glance. Recommendations for future research can also be helpful in establishing research directions and gaining insight in how to solve ergonomics and HCI design issues surrounding BCI and hybrid BCI systems by usability evaluation.

Interfacing brain with computer to improve communication and rehabilitation after brain damage

Communication and control of the external environment can be provided via brain-computer interfaces (BCIs) to replace a lost function in persons with severe diseases and little or no chance of recovery of motor abilities (ie, amyotrophic lateral sclerosis, brainstem stroke). BCIs allow to intentionally modulate brain activity, to train specific brain functions, and to control prosthetic devices, and thus, this technology can also improve the outcome of rehabilitation programs in persons who have suffered from a central nervous system injury (ie, stroke leading to motor or cognitive impairment). Overall, the BCI researcher is challenged to interact with people with severe disabilities and professionals in the field of neurorehabilitation. This implies a deep understanding of the disabled condition on the one hand, and it requires extensive knowledge on the physiology and function of the human brain on the other. For these reasons, a multidisciplinary approach and the continuous involvement of BCI users in the design, development, and testing of new systems are desirable. In this chapter, we will focus on noninvasive EEG-based systems and their clinical applications, highlighting crucial issues to foster BCI translation outside laboratories to eventually become a technology usable in real-life realm.