Learning in brain-computer interface control evidenced by joint decomposition of brain and behavior

Using network control theory to study the dynamics of the structural connectome

Network control theory (NCT) is a simple and powerful tool for studying how network topology informs and constrains dynamics. Compared to other structure-function coupling approaches, the strength of NCT lies in its capacity to predict the patterns of external control signals that may alter dynamics in a desired way. We have extensively developed and validated the application of NCT to the human structural connectome. Through these efforts, we have studied (i) how different aspects of connectome topology affect neural dynamics, (ii) whether NCT outputs cohere with empirical data on brain function and stimulation, and (iii) how NCT outputs vary across development and correlate with behavior and mental health symptoms. In this protocol, we introduce a framework for applying NCT to structural connectomes following two main pathways. Our primary pathway focuses on computing the control energy associated with transitioning between specific neural activity states. Our second pathway focuses on computing average controllability, which indexes nodes' general capacity to control dynamics. We also provide recommendations for comparing NCT outputs against null network models. Finally, we support this protocol with a Python-based software package called network control theory for python (nctpy).

Alprazolam modulates persistence energy during emotion processing in first-degree relatives of individuals with schizophrenia: a network control study

Schizophrenia is marked by deficits in facial affect processing associated with abnormalities in GABAergic circuitry, deficits also found in first-degree relatives. Facial affect processing involves a distributed network of brain regions including limbic regions like amygdala and visual processing areas like fusiform cortex. Pharmacological modulation of GABAergic circuitry using benzodiazepines like alprazolam can be useful for studying this facial affect processing network and associated GABAergic abnormalities in schizophrenia. Here, we use pharmacological modulation and computational modeling to study the contribution of GABAergic abnormalities toward emotion processing deficits in schizophrenia. Specifically, we apply principles from network control theory to model persistence energy - the control energy required to maintain brain activation states - during emotion identification and recall tasks, with and without administration of alprazolam, in a sample of first-degree relatives and healthy controls. Here, persistence energy quantifies the magnitude of theoretical external inputs during the task. We find that alprazolam increases persistence energy in relatives but not in controls during threatening face processing, suggesting a compensatory mechanism given the relative absence of behavioral abnormalities in this sample of unaffected relatives. Further, we demonstrate that regions in the fusiform and occipital cortices are important for facilitating state transitions during facial affect processing. Finally, we uncover spatial relationships (i) between regional variation in differential control energy (alprazolam versus placebo) and (ii) both serotonin and dopamine neurotransmitter systems, indicating that alprazolam may exert its effects by altering neuromodulatory systems. Together, these findings provide a new perspective on the distributed emotion processing network and the effect of GABAergic modulation on this network, in addition to identifying an association between schizophrenia risk and abnormal GABAergic effects on persistence energy during threat processing.

High-density scalp electroencephalogram dataset during sensorimotor rhythm-based brain-computer interfacing

Real-time functional imaging of human neural activity and its closed-loop feedback enable voluntary control of targeted brain regions. In particular, a brain-computer interface (BCI), a direct bridge of neural activities and machine actuation is one promising clinical application of neurofeedback. Although a variety of studies reported successful self-regulation of motor cortical activities probed by scalp electroencephalogram (EEG), it remains unclear how neurophysiological, experimental conditions or BCI designs influence variability in BCI learning. Here, we provide the EEG data during using BCIs based on sensorimotor rhythm (SMR), consisting of 4 separate datasets. All EEG data were acquired with a high-density scalp EEG setup containing 128 channels covering the whole head. All participants were instructed to perform motor imagery of right-hand movement as the strategy to control BCIs based on the task-related power attenuation of SMR magnitude, that is event-related desynchronization. This dataset would allow researchers to explore the potential source of variability in BCI learning efficiency and facilitate follow-up studies to test the explicit hypotheses explored by the dataset.

Control of a Production Manipulator with the Use of BCI in Conjunction with an Industrial PLC

Research in the field of gathering and analyzing biological signals is growing. The sensors are becoming more available and more non-invasive for examining such signals, which in the past required the inconvenient acquisition of data. This was achieved mainly by the fact that biological sensors were able to be built into wearable and portable devices. The representation and analysis of EEGs (electroencephalograms) is nowadays commonly used in various application areas. The application of the use of the EEG signals to the field of automation is still an unexplored area and therefore provides opportunities for interesting research. In our research, we focused on the area of processing automation; especially the use of the EEG signals to bridge the communication between control of individual processes and a human. In this study, the real-time communication between a PLC (programmable logic controller) and BCI (brain computer interface) was investigated and described. In the future, this approach can help people with physical disabilities to control certain machines or devices and therefore it could find applicability in overcoming physical disabilities. The main contribution of the article is, that we have demonstrated the possibility of interaction between a person and a manipulator controlled by a PLC with the help of a BCI. Potentially, with the expansion of functionality, such solutions will allow a person with physical disabilities to participate in the production process.

Thirty-minute motor imagery exercise aided by EEG sensorimotor rhythm neurofeedback enhances morphing of sensorimotor cortices: a double-blind sham-controlled study

Neurofeedback training using electroencephalogram (EEG)-based brain-computer interfaces (BCIs) combined with mental rehearsals of motor behavior has demonstrated successful self-regulation of motor cortical excitability. However, it remains unclear whether the acquisition of skills to voluntarily control neural excitability is accompanied by structural plasticity boosted by neurofeedback. Here, we sought short-term changes in cortical structures induced by 30 min of BCI-based neurofeedback training, which aimed at the regulation of sensorimotor rhythm (SMR) in scalp EEG. When participants performed kinesthetic motor imagery of right finger movement with online feedback of either event-related desynchronisation (ERD) of SMR magnitude from the contralateral sensorimotor cortex (SM1) or those from other participants (i.e. placebo), the learning rate of SMR-ERD control was significantly different. Although overlapped structural changes in gray matter volumes were found in both groups, significant differences revealed by group-by-group comparison were spatially different; whereas the veritable neurofeedback group exhibited sensorimotor area-specific changes, the placebo exhibited spatially distributed changes. The white matter change indicated a significant decrease in the corpus callosum in the verum group. Furthermore, the learning rate of SMR regulation was correlated with the volume changes in the ipsilateral SM1, suggesting the involvement of interhemispheric motor control circuitries in BCI control tasks.

Neural correlates of learning in a linear discriminant analysis brain-computer interface paradigm

Objective.With practice, the control of brain-computer interfaces (BCI) would improve over time; the neural correlate for such learning had not been well studied. We demonstrated here that monkeys controlling a motor BCI using a linear discriminant analysis (LDA) decoder could learn to make the firing patterns of the recorded neurons more distinct over a short period of time for different output classes to improve task performance.Approach.Using an LDA decoder, we studied two Macaque monkeys implanted with microelectrode arrays as they controlled the movement of a mobile robotic platform. The LDA decoder mapped high-dimensional neuronal firing patterns linearly onto a lower-dimensional linear discriminant (LD) space, and we studied the changes in the spatial coordinates of these neural signals in the LD space over time, and their correspondence to trial performance. Direction selectivity was quantified with permutation feature importance (FI).Main results.We observed that, within individual sessions, there was a tendency for the points in the LD space encoding different directions to diverge, leading to fewer misclassification errors, and, hence, improvement in task accuracy. Accuracy was correlated with the presence of channels with strong directional preference (i.e. high FI), as well as a varied population code (i.e. high variance in FI distribution).Significance.We emphasized the importance of studying the short-term/intra-sessional variations in neural representations during the use of BCI. Over the course of individual sessions, both monkeys could modulate their neural activities to create increasingly distinct neural representations.

The expanding horizons of network neuroscience: From description to prediction and control

The field of network neuroscience has emerged as a natural framework for the study of the brain and has been increasingly applied across divergent problems in neuroscience. From a disciplinary perspective, network neuroscience originally emerged as a formal integration of graph theory (from mathematics) and neuroscience (from biology). This early integration afforded marked utility in describing the interconnected nature of neural units, both structurally and functionally, and underscored the relevance of that interconnection for cognition and behavior. But since its inception, the field has not remained static in its methodological composition. Instead, it has grown to use increasingly advanced graph-theoretic tools and to bring in several other disciplinary perspectives-including machine learning and systems engineering-that have proven complementary. In doing so, the problem space amenable to the discipline has expanded markedly. In this review, we discuss three distinct flavors of investigation in state-of-the-art network neuroscience: (i) descriptive network neuroscience, (ii) predictive network neuroscience, and (iii) a perturbative network neuroscience that draws on recent advances in network control theory. In considering each area, we provide a brief summary of the approaches, discuss the nature of the insights obtained, and highlight future directions.

Closed-loop Modulation of the Self-regulating Brain: A Review on Approaches, Emerging Paradigms, and Experimental Designs

Closed-loop approaches, setups, and experimental designs have been applied within the field of neuroscience to enhance the understanding of basic neurophysiology principles (closed-loop neuroscience; CLNS) and to develop improved procedures for modulating brain circuits and networks for clinical purposes (closed-loop neuromodulation; CLNM). The contents of this review are thus arranged into the following sections. First, we describe basic research findings that have been made using CLNS. Next, we provide an overview of the application, rationale, and therapeutic aspects of CLNM for clinical purposes. Finally, we summarize methodological concerns and critics in clinical practice of neurofeedback and novel applications of closed-loop perspective and techniques to improve and optimize its experiments. Moreover, we outline the theoretical explanations and experimental ideas to test animal models of neurofeedback and discuss technical issues and challenges associated with implementing closed-loop systems. We hope this review is helpful for both basic neuroscientists and clinical/ translationally-oriented scientists interested in applying closed-loop methods to improve mental health and well-being.

Long-term brain network reorganization predicts responsive neurostimulation outcomes for focal epilepsy

Responsive neurostimulation (RNS) devices, able to detect imminent seizures and to rapidly deliver electrical stimulation to the brain, are effective in reducing seizures in some patients with focal epilepsy. However, therapeutic response to RNS is often slow, is highly variable, and defies prognostication based on clinical factors. A prevailing view holds that RNS efficacy is primarily mediated by acute seizure termination; yet, stimulations greatly outnumber seizures and occur mostly in the interictal state, suggesting chronic modulation of brain networks that generate seizures. Here, using years-long intracranial neural recordings collected during RNS therapy, we found that patients with the greatest therapeutic benefit undergo progressive, frequency-dependent reorganization of interictal functional connectivity. The extent of this reorganization scales directly with seizure reduction and emerges within the first year of RNS treatment, enabling potential early prediction of therapeutic response. Our findings reveal a mechanism for RNS that involves network plasticity and may inform development of next-generation devices for epilepsy.

BCI learning induces core-periphery reorganization in M/EEG multiplex brain networks

Brain-computer interfaces (BCIs) constitute a promising tool for communication and control. However, mastering non-invasive closed-loop systems remains a learned skill that is difficult to develop for a non-negligible proportion of users. The involved learning process induces neural changes associated with a brain network reorganization that remains poorly understood. To address this inter-subject variability, we adopted a multilayer approach to integrate brain network properties from electroencephalographic (EEG) and magnetoencephalographic (MEG) data resulting from a four-session BCI training program followed by a group of healthy subjects. Our method gives access to the contribution of each layer to multilayer network that tends to be equal with time. We show that regardless the chosen modality, a progressive increase in the integration of somatosensory areas in the α band was paralleled by a decrease of the integration of visual processing and working memory areas in the β band. Notably, only brain network properties in multilayer network correlated with future BCI scores in the α2 band: positively in somatosensory and decision-making related areas and negatively in associative areas. Our findings cast new light on neural processes underlying BCI training. Integrating multimodal brain network properties provides new information that correlates with behavioral performance and could be considered as a potential marker of BCI learning.

Network-based brain computer interfaces: principles and applications

Brain-computer interfaces (BCIs) make possible to interact with the external environment by decoding the mental intention of individuals. BCIs can therefore be used to address basic neuroscience questions but also to unlock a variety of applications from exoskeleton control to neurofeedback (NFB) rehabilitation. In general, BCI usability critically depends on the ability to comprehensively characterize brain functioning and correctly identify the user's mental state. To this end, much of the efforts have focused on improving the classification algorithms taking into account localized brain activities as input features. Despite considerable improvement BCI performance is still unstable and, as a matter of fact, current features represent oversimplified descriptors of brain functioning. In the last decade, growing evidence has shown that the brain works as a networked system composed of multiple specialized and spatially distributed areas that dynamically integrate information. While more complex, looking at how remote brain regions functionally interact represents a grounded alternative to better describe brain functioning. Thanks to recent advances in network science, i.e. a modern field that draws on graph theory, statistical mechanics, data mining and inferential modelling, scientists have now powerful means to characterize complex brain networks derived from neuroimaging data. Notably, summary features can be extracted from these networks to quantitatively measure specific organizational properties across a variety of topological scales. In this topical review, we aim to provide the state-of-the-art supporting the development of a network theoretic approach as a promising tool for understanding BCIs and improve usability.

Models of communication and control for brain networks: distinctions, convergence, and future outlook

Recent advances in computational models of signal propagation and routing in the human brain have underscored the critical role of white-matter structure. A complementary approach has utilized the framework of network control theory to better understand how white matter constrains the manner in which a region or set of regions can direct or control the activity of other regions. Despite the potential for both of these approaches to enhance our understanding of the role of network structure in brain function, little work has sought to understand the relations between them. Here, we seek to explicitly bridge computational models of communication and principles of network control in a conceptual review of the current literature. By drawing comparisons between communication and control models in terms of the level of abstraction, the dynamical complexity, the dependence on network attributes, and the interplay of multiple spatiotemporal scales, we highlight the convergence of and distinctions between the two frameworks. Based on the understanding of the intertwined nature of communication and control in human brain networks, this work provides an integrative perspective for the field and outlines exciting directions for future work.

A practical guide to methodological considerations in the controllability of structural brain networks

OBJECTIVE

Predicting how the brain can be driven to specific states by means of internal or external control requires a fundamental understanding of the relationship between neural connectivity and activity. Network control theory is a powerful tool from the physical and engineering sciences that can provide insights regarding that relationship; it formalizes the study of how the dynamics of a complex system can arise from its underlying structure of interconnected units.

APPROACH

Given the recent use of network control theory in neuroscience, it is now timely to offer a practical guide to methodological considerations in the controllability of structural brain networks. Here we provide a systematic overview of the framework, examine the impact of modeling choices on frequently studied control metrics, and suggest potentially useful theoretical extensions. We ground our discussions, numerical demonstrations, and theoretical advances in a dataset of high-resolution diffusion imaging with 730 diffusion directions acquired over approximately 1 h of scanning from ten healthy young adults.

MAIN RESULTS

Following a didactic introduction of the theory, we probe how a selection of modeling choices affects four common statistics: average controllability, modal controllability, minimum control energy, and optimal control energy. Next, we extend the current state-of-the-art in two ways: first, by developing an alternative measure of structural connectivity that accounts for radial propagation of activity through abutting tissue, and second, by defining a complementary metric quantifying the complexity of the energy landscape of a system. We close with specific modeling recommendations and a discussion of methodological constraints.

SIGNIFICANCE

Our hope is that this accessible account will inspire the neuroimaging community to more fully exploit the potential of network control theory in tackling pressing questions in cognitive, developmental, and clinical neuroscience.