Depth electrode neurofeedback with a virtual reality interface

Intracranial Neurofeedback Modulating Neural Activity in the Mesial Temporal Lobe During Memory Encoding: A Pilot Study

Removal of the mesial temporal lobe (MTL) is an established surgical procedure that leads to seizure freedom in patients with intractable MTL epilepsy; however, it carries the potential risk of memory damage. Neurofeedback (NF), which regulates brain function by converting brain activity into perceptible information and providing feedback, has attracted considerable attention in recent years for its potential as a novel complementary treatment for many neurological disorders. However, no research has attempted to artificially reorganize memory functions by applying NF before resective surgery to preserve memory functions. Thus, this study aimed (1) to construct a memory NF system that used intracranial electrodes to feedback neural activity on the language-dominant side of the MTL during memory encoding and (2) to verify whether neural activity and memory function in the MTL change with NF training. Two intractable epilepsy patients with implanted intracranial electrodes underwent at least five sessions of memory NF training to increase the theta power in the MTL. There was an increase in theta power and a decrease in fast beta and gamma powers in one of the patients in the late stage of memory NF sessions. NF signals were not correlated with memory function. Despite its limitations as a pilot study, to our best knowledge, this study is the first to report that intracranial NF may modulate neural activity in the MTL, which is involved in memory encoding. The findings provide important insights into the future development of NF systems for the artificial reorganization of memory functions.

Paving the Way for Memory Enhancement: Development and Examination of a Neurofeedback System Targeting the Medial Temporal Lobe

Neurofeedback (NF) shows promise in enhancing memory, but its application to the medial temporal lobe (MTL) still needs to be studied. Therefore, we aimed to develop an NF system for the memory function of the MTL and examine neural activity changes and memory task score changes through NF training. We created a memory NF system using intracranial electrodes to acquire and visualise the neural activity of the MTL during memory encoding. Twenty trials of a tug-of-war game per session were employed for NF and designed to control neural activity bidirectionally (Up/Down condition). NF training was conducted with three patients with drug-resistant epilepsy, and we observed an increasing difference in NF signal between conditions (Up-Down) as NF training progressed. Similarities and negative correlation tendencies between the transition of neural activity and the transition of memory function were also observed. Our findings demonstrate NF's potential to modulate MTL activity and memory encoding. Future research needs further improvements to the NF system to validate its effects on memory functions. Nonetheless, this study represents a crucial step in understanding NF's application to memory and provides valuable insights into developing more efficient memory enhancement strategies.

Development and validation of an fMRI-informed EEG model of reward-related ventral striatum activation

Reward processing is essential for our mental-health and well-being. In the current study, we developed and validated a scalable, fMRI-informed EEG model for monitoring reward processing related to activation in the ventral-striatum (VS), a significant node in the brain's reward system. To develop this EEG-based model of VS-related activation, we collected simultaneous EEG/fMRI data from 17 healthy individuals while listening to individually-tailored pleasurable music - a highly rewarding stimulus known to engage the VS. Using these cross-modal data, we constructed a generic regression model for predicting the concurrently acquired Blood-Oxygen-Level-Dependent (BOLD) signal from the VS using spectro-temporal features from the EEG signal (termed hereby VS-related-Electrical Finger Print; VS-EFP). The performance of the extracted model was examined using a series of tests that were applied on the original dataset and, importantly, an external validation dataset collected from a different group of 14 healthy individuals who underwent the same EEG/FMRI procedure. Our results showed that the VS-EFP model, as measured by simultaneous EEG, predicted BOLD activation in the VS and additional functionally relevant regions to a greater extent than an EFP model derived from a different anatomical region. The developed VS-EFP was also modulated by musical pleasure and predictive of the VS-BOLD during a monetary reward task, further indicating its functional relevance. These findings provide compelling evidence for the feasibility of using EEG alone to model neural activation related to the VS, paving the way for future use of this scalable neural probing approach in neural monitoring and self-guided neuromodulation.

Affective Neurofeedback Under Naturalistic Conditions: A Mini-Review of Current Achievements and Open Challenges

Affective neurofeedback training allows for the self-regulation of the putative circuits of emotion regulation. This approach has recently been studied as a possible additional treatment for psychiatric disorders, presenting positive effects in symptoms and behaviors. After neurofeedback training, a critical aspect is the transference of the learned self-regulation strategies to outside the laboratory and how to continue reinforcing these strategies in non-controlled environments. In this mini-review, we discuss the current achievements of affective neurofeedback under naturalistic setups. For this, we first provide a brief overview of the state-of-the-art for affective neurofeedback protocols. We then discuss virtual reality as a transitional step toward the final goal of "in-the-wild" protocols and current advances using mobile neurotechnology. Finally, we provide a discussion of open challenges for affective neurofeedback protocols in-the-wild, including topics such as convenience and reliability, environmental effects in attention and workload, among others.

Musical Auditory Alpha Wave Neurofeedback: Validation and Cognitive Perspectives

Neurofeedback through visual, auditory, or tactile sensations improves cognitive functions and alters the activities of daily living. However, some people, such as children and the elderly, have difficulty concentrating on neurofeedback for a long time. Constant stressless neurofeedback for a long time may be achieved with auditory neurofeedback using music. The primary purpose of this study was to clarify whether music-based auditory neurofeedback increases the power of the alpha wave in healthy subjects. During neurofeedback, white noise was superimposed on classical music, with the noise level inversely correlating with normalized alpha wave power. This was a single-blind, randomized control crossover trial in which 10 healthy subjects underwent, in an assigned order, normal and random feedback (NF and RF), either of which was at least 4 weeks long. Cognitive functions were evaluated before, between, and after each neurofeedback period. The secondary purpose was to assess neurofeedback-induced changes in cognitive functions. A crossover analysis showed that normalized alpha-power was significantly higher in NF than in RF; therefore, music-based auditory neurofeedback facilitated alpha wave induction. A composite category-based analysis of cognitive functions revealed greater improvements in short-term memory in subjects whose alpha-power increased in response to NF. The present study employed a long period of auditory alpha neurofeedback and achieved successful alpha wave induction and subsequent improvements in cognitive functions. Although this was a pilot study that validated a music-based alpha neurofeedback system for healthy subjects, the results obtained are encouraging for those with difficulty in concentrating on conventional alpha neurofeedback.

Trial registration: 2018077NI, date of registration: 2018/11/27

Towards semantic fMRI neurofeedback: navigating among mental states using real-time representational similarity analysis

Objective. Real-time functional magnetic resonance imaging neurofeedback (rt-fMRI-NF) is a non-invasive MRI procedure allowing examined participants to learn to self-regulate brain activity by performing mental tasks. A novel two-step rt-fMRI-NF procedure is proposed whereby the feedback display is updated in real-time based on high-level representations of experimental stimuli (e.g. objects to imagine) via real-time representational similarity analysis of multi-voxel patterns of brain activity.Approach. In a localizer session, the stimuli become associated with anchored points on a two-dimensional representational space where distances approximate between-pattern (dis)similarities. In the NF session, participants modulate their brain response, displayed as a movable point, to engage in a specific neural representation. The developed method pipeline is verified in a proof-of-concept rt-fMRI-NF study at 7 T involving a single healthy participant imagining concrete objects. Based on this data and artificial data sets with similar (simulated) spatio-temporal structure and variable (injected) signal and noise, the dependence on noise is systematically assessed.Main results. The participant in the proof-of-concept study exhibited robust activation patterns in the localizer session and managed to control the neural representation of a stimulus towards the selected target in the NF session. The offline analyses validated the rt-fMRI-NF results, showing that the rapid convergence to the target representation is noise-dependent.Significance. Our proof-of-concept study introduces a new NF method allowing the participant to navigate among different mental states. Compared to traditional NF designs (e.g. using a thermometer display to set the level of the neural signal), the proposed approach provides content-specific feedback to the participant and extra degrees of freedom to the experimenter enabling real-time control of the neural activity towards a target brain state without suggesting a specific mental strategy to the subject.

A P300-Based BCI System Using Stereoelectroencephalography and Its Application in a Brain Mechanistic Study

Stereoelectroencephalography (SEEG) signals can be obtained by implanting deep intracranial electrodes. SEEG depth electrodes can record brain activity from the shallow cortical layer and deep brain structures, which is not achievable through other recording techniques. Moreover, SEEG has the advantage of a high signal-to-noise ratio (SNR). Therefore, it provides a potential way to establish a highly efficient brain-computer interface (BCI) and aid in understanding human brain activity. In this study, we implemented a P300-based BCI using SEEG signals. A single-character oddball paradigm was applied to elicit P300. To predict target characters, we fed the feature vectors extracted from the signals collected by five SEEG contacts into a Bayesian linear discriminant analysis (BLDA) classifier. Thirteen epileptic patients implanted with SEEG electrodes participated in the experiment and achieved an average online spelling accuracy of 93.85%. Moreover, through single-contact decoding analysis and simulated online analysis, we found that the SEEG-based BCI system achieved a high performance even when using a single signal channel. Furthermore, contacts with high decoding accuracies were mainly distributed in the visual ventral pathway, especially the fusiform gyrus (FG) and lingual gyrus (LG), which played an important role in building P300-based SEEG BCIs. These results might provide new insights into P300 mechanistic studies and the corresponding BCIs.

Prefrontal Asymmetry BCI Neurofeedback Datasets

Prefrontal cortex (PFC) asymmetry is an important marker in affective neuroscience and has attracted significant interest, having been associated with studies of motivation, eating behavior, empathy, risk propensity, and clinical depression. The data presented in this paper are the result of three different experiments using PFC asymmetry neurofeedback (NF) as a Brain-Computer Interface (BCI) paradigm, rather than a therapeutic mechanism aiming at long-term effects, using functional near-infrared spectroscopy (fNIRS) which is known to be particularly well-suited to the study of PFC asymmetry and is less sensitive to artifacts. From an experimental perspective the BCI context brings more emphasis on individual subjects' baselines, successful and sustained activation during epochs, and minimal training. The subject pool is also drawn from the general population, with less bias toward specific behavioral patterns, and no inclusion of any patient data. We accompany our datasets with a detailed description of data formats, experiment and protocol designs, as well as analysis of the individualized metrics for definitions of success scores based on baseline thresholds as well as reference tasks. The work presented in this paper is the result of several experiments in the domain of BCI where participants are interacting with continuous visual feedback following a real-time NF paradigm, arising from our long-standing research in the field of affective computing. We offer the community access to our fNIRS datasets from these experiments. We specifically provide data drawn from our empirical studies in the field of affective interactions with computer-generated narratives as well as interfacing with algorithms, such as heuristic search, which all provide a mechanism to improve the ability of the participants to engage in active BCI due to their realistic visual feedback. Beyond providing details of the methodologies used where participants received real-time NF of left-asymmetric increase in activation in their dorsolateral prefrontal cortex (DLPFC), we re-establish the need for carefully designing protocols to ensure the benefits of NF paradigm in BCI are enhanced by the ability of the real-time visual feedback to adapt to the individual responses of the participants. Individualized feedback is paramount to the success of NF in BCIs.

Short-delay neurofeedback facilitates training of the parietal alpha rhythm

OBJECTIVE

Feedback latency was shown to be a critical parameter in a range of applications that imply learning. The therapeutic effects of neurofeedback (NFB) remain controversial. We hypothesized that often encountered unreliable results of NFB intervention could be associated with large feedback latency values that are often uncontrolled and may preclude the efficient learning.

APPROACH

We engaged our subjects into a parietal alpha power unpregulating paradigm faciliated by visual neurofeedback based on the invidually extracted envelope of the alpha-rhythm at P4 electrode. NFB was displayed either as soon as EEG envelope was processed, or with an extra 250 or 500-ms delay. The feedback training consisted of 15 two-minute long blocks interleaved with 15s pauses. We have also recorded two minute long baselines immediately before and after the training.

MAIN RESULTS

The time course of NFB-induced changes in the alpha rhythm power clearly depended on NFB latency, as shown with the adaptive Neyman test. NFB had a strong effect on the alpha-spindle incidence rate, but not on their duration or amplitude. The sustained changes in alpha activity measured after the completion of NFB training were negatively correlated to latency, with the maximum change for the shortest tested latency and no change for the longest.

SIGNIFICANCE

Here we for the first time show that visual NFB of parietal electroencephalographic (EEG) alpha-activity is efficient only when delivered to human subjects at short latency, which guarantees that NFB arrives when an alpha spindle is still ongoing. Such a considerable effect of NFB latency on the alpha-activity temporal structure could explain some of the previous inconsistent results, where latency was neither controlled nor documented. Clinical practitioners and manufacturers of NFB equipment should add latency to their specifications while enabling latency monitoring and supporting short-latency operations.

The Potential of Stereotactic-EEG for Brain-Computer Interfaces: Current Progress and Future Directions

Stereotactic electroencephalogaphy (sEEG) utilizes localized, penetrating depth electrodes to measure electrophysiological brain activity. It is most commonly used in the identification of epileptogenic zones in cases of refractory epilepsy. The implanted electrodes generally provide a sparse sampling of a unique set of brain regions including deeper brain structures such as hippocampus, amygdala and insula that cannot be captured by superficial measurement modalities such as electrocorticography (ECoG). Despite the overlapping clinical application and recent progress in decoding of ECoG for Brain-Computer Interfaces (BCIs), sEEG has thus far received comparatively little attention for BCI decoding. Additionally, the success of the related deep-brain stimulation (DBS) implants bodes well for the potential for chronic sEEG applications. This article provides an overview of sEEG technology, BCI-related research, and prospective future directions of sEEG for long-term BCI applications.

A P300-based Brain Computer Interface Using Stereo-electroencephalography Signals

Stereo-electroencephalography (SEEG) signals can be obtained by implanting deep intracranial electrodes, which are currently used for epileptic diagnosis. In this study, we implemented a P300-based Brain Computer Interface (BCI) using SEEG signals. 40 buttons corresponding to 40 numbers displayed in a graphical user interface (GUI) were intensified in a random order. To select a number, the user could focus on the corresponding button when it was flashing. Five epileptic patients implanted with SEEG electrodes attended the experiment and achieved an average online accuracy of 97.33%. Moreover, through single contact decoding and simulated online analysis, we found that these subjects achieved an average accuracy of 82.00% using a single channel of signal. These results indicated that our SEEG-based BCI had a high performance, which was mainly because of the high quality of SEEG signals.