Dual array EEG-fMRI: An approach for motion artifact suppression in EEG recorded simultaneously with fMRI

Two is better? combining EEG and fMRI for BCI and neurofeedback: a systematic review

Electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) are two commonly used non-invasive techniques for measuring brain activity in neuroscience and brain-computer interfaces (BCI).Objective. In this review, we focus on the use of EEG and fMRI in neurofeedback (NF) and discuss the challenges of combining the two modalities to improve understanding of brain activity and achieve more effective clinical outcomes. Advanced technologies have been developed to simultaneously record EEG and fMRI signals to provide a better understanding of the relationship between the two modalities. However, the complexity of brain processes and the heterogeneous nature of EEG and fMRI present challenges in extracting useful information from the combined data.Approach. We will survey existing EEG-fMRI combinations and recent studies that exploit EEG-fMRI in NF, highlighting the experimental and technical challenges.Main results. We made a classification of the different combination of EEG-fMRI for NF, we provide a review of multimodal analysis methods for EEG-fMRI features. We also survey the current state of research on EEG-fMRI in the different existing NF paradigms. Finally, we also identify some of the remaining challenges in this field.Significance. By exploring EEG-fMRI combinations in NF, we are advancing our knowledge of brain function and its applications in clinical settings. As such, this review serves as a valuable resource for researchers, clinicians, and engineers working in the field of neural engineering and rehabilitation, highlighting the promising future of EEG-fMRI-based NF.

The Feature, Performance, and Prospect of Advanced Electrodes for Electroencephalogram

Recently, advanced electrodes have been developed, such as semi-dry, dry contact, dry non-contact, and microneedle array electrodes. They can overcome the issues of wet electrodes and maintain high signal quality. However, the variations in these electrodes are still unclear and not explained, and there is still confusion regarding the feasibility of electrodes for different application scenarios. In this review, the physical features and electroencephalogram (EEG) signal performances of these advanced EEG electrodes are introduced in view of the differences in contact between the skin and electrodes. Specifically, contact features, biofeatures, impedance, signal quality, and artifacts are discussed. The application scenarios and prospects of different types of EEG electrodes are also elucidated.

EEG-fMRI of epileptiform discharges: non-invasive investigation of the whole brain

Simultaneous EEG-fMRI is a unique and non-invasive method for investigating epileptic activity. Interictal epileptiform discharge-related EEG-fMRI provides cortical and subcortical blood oxygen level-dependent (BOLD) signal changes specific to epileptic discharges. As a result, EEG-fMRI has revealed insights into generators and networks involved in epileptic activity in different types of epilepsy, demonstrating-for instance-the implication of the thalamus in human generalized spike and wave discharges and the role of the Default Mode Network (DMN) in absences and focal epilepsy, and proposed a mechanism for the cortico-subcortical interactions in Lennox-Gastaut syndrome discharges. EEG-fMRI can find deep sources of epileptic activity not available to scalp EEG or MEG and provides critical new information to delineate the epileptic focus when considering surgical treatment or electrode implantation. In recent years, methodological advances, such as artifact removal and automatic detection of events have rendered this method easier to implement, and its clinical potential has since been established by evidence of the impact of BOLD response on clinical decision-making and of the relationship between concordance of BOLD responses with extent of resection and surgical outcome. This review presents the recent developments in EEG-fMRI methodology and EEG-fMRI studies in different types of epileptic disorders as follows: EEG-fMRI acquisition, gradient and pulse artifact removal, statistical analysis, clinical applications, pre-surgical evaluation, altered physiological state in generalized genetic epilepsy, and pediatric EEG-fMRI studies.

Reference-Free Adaptive Filtering of Extracellular Neural Signals Recording in Ultra-High Field Magnetic Resonance Imaging Scanners: Removal of Periodic Interferences

This paper focuses on the removal of periodic artifacts from neural signals recorded in rats in ultra-high field (UHF) MRI scanners, using a reference free adaptive feedforward method. Recording extracellular neural signals in the UHF environment is motivated by the desire to combine neural recording and UHF functional magnetic resonance imaging (fMRI) to better understand brain function. However, the neural signals are found to have extremely high noise artifacts of a periodic nature due to electromagnetic interference and due to small oscillatory motions. In particular, noise at 60 Hz and several harmonics of 60 Hz, sinusoidal noise from a pump, and low frequency breathing motion artifacts are observed. Due to significant overlap between the noise frequencies and the neural frequency region of interest, band pass filters cannot be effectively utilized in this application. Hence, this paper develops adaptive least squares feedforward cancellation filters to remove the periodic artifacts. The interference fundamental frequency is identified precisely using an implementation of k-means in an iterative approach. The paper includes significant animal data from rats recorded in an IACUC-approved procedure in 9.4T and 16.4T MRI machines. For breathing artifacts filtered from 4 rats, the mean signal cancellation values at the harmonic interference frequencies are 5.18, 12.97, and 20.87 dB/Hz for a sliding template subtraction, a single-stage impulse reference method, and the cascaded adaptive filtering approach respectively. For pump artifacts filtered from 2 chronically implanted rats, mean signal cancellation values are 2.85, 9.52 and 12.06 dB/Hz respectively. The experimental results show that periodic noise is very effectively removed by the developed cascaded adaptive least squares feedforward algorithm.

Bilateral epileptic networks in congenital and acquired corpus callosum defects: EEG-fMRI study

OBJECTIVES

Electroencephalography-correlated functional magnetic resonance imaging (EEG-fMRI) allows imaging of brain-wide epileptic networks, and demonstrates that focal interictal epileptic activity is sometimes accompanied by bilateral functional activations. The corpus callosum (CC) facilitates bilateral spread of epileptic activity and at times targeted surgically for drug-resistant epilepsy (DRE). We hypothesized that focal epileptic networks are more unilateral in patients lacking intact CC.

METHODS

We included focal DRE patients who underwent pre-surgical EEG-fMRI and had CC agenesis (group A, n = 5), patients who previously underwent anterior callosotomy as treatment for drop attacks and continued having seizures (group B, n = 6), and control group of patients with focal epilepsy and intact CC (group C, n = 9). Blood-oxygenation-level-dependent (BOLD) signal maps were generated for interictal epileptic discharges. To quantify bi-hemispheric distribution of epileptic networks, laterality indices were compared between groups. Anatomical and diffusion-weighted imaging demonstrated white matter pathways.

RESULTS

96% of studies demonstrated bilateral activations. Laterality indices were similar in groups A and C, whereas group B demonstrated a more bilateral network than group C (p = 0.028). Diffusion-weighted and anatomical imaging showed aberrant white matter pathways and larger anterior commissure in groups A and B. 68% of studies showed maximal activation cluster concordant with the presumed epileptic focus, 28% showed non-maximal activation at presumed focus.

SIGNIFICANCE

Focal epileptic activity is associated with bilateral functional activations despite lack of intact CC, and is associated with stronger contralateral activation in patients after anterior callosotomy compared to controls. These findings disprove our initial hypothesis, and combined with white matter structural imaging, may indicate that the CC is not a sole route of propagation of epileptic activity, which might spread via anterior commissure. Our study demonstrates the utility of EEG-fMRI in assessing epileptic networks and potentially aiding in tailoring surgical treatments in DRE patients with callosal anomalies, and in callosal surgeries.

Interictal Epileptiform Discharge Dynamics in Peri-sylvian Polymicrogyria Using EEG-fMRI

Polymicrogyria (PMG) is a common malformation of cortical development associated with a higher susceptibility to epileptic seizures. Seizures secondary to PMG are characterized by difficult-to-localize cerebral sources due to the complex and widespread lesion structure. Tracing the dynamics of interictal epileptiform discharges (IEDs) in patients with epilepsy has been shown to reveal the location of epileptic activity sources, crucial for successful treatment in cases of focal drug-resistant epilepsy. In this case series IED dynamics were evaluated with simultaneous EEG-fMRI recordings in four patients with unilateral peri-sylvian polymicrogyria (PSPMG) by tracking BOLD activations over time: before, during and following IED appearance on scalp EEG. In all cases, focal BOLD activations within the lesion itself preceded the activity associated with the time of IED appearance on EEG, which showed stronger and more widespread activations. We therefore propose that early hemodynamic activity corresponding to IEDs may hold important localizing information potentially leading to the cerebral sources of epileptic activity. IEDs are suggested to develop within a small area in the PSPMG lesion with structural properties obscuring the appearance of their electric field on the scalp and only later engage widespread structures which allow the production of large currents which are recognized as IEDs on EEG.

Localization of Epileptic Foci Based on Simultaneous EEG-fMRI Data

Combining functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) enables a non-invasive investigation of the human brain function and evaluation of the correlation of these two important modalities of brain activity. This paper explores recent reports on using advanced simultaneous EEG–fMRI methods proposed to map the regions and networks involved in focal epileptic seizure generation. One of the applications of EEG and fMRI combination as a valuable clinical approach is the pre-surgical evaluation of patients with epilepsy to map and localize the precise brain regions associated with epileptiform activity. In the process of conventional analysis using EEG–fMRI data, the interictal epileptiform discharges (IEDs) are visually extracted from the EEG data to be convolved as binary events with a predefined hemodynamic response function (HRF) to provide a model of epileptiform BOLD activity and use as a regressor for general linear model (GLM) analysis of the fMRI data. This review examines the methodologies involved in performing such studies, including techniques used for the recording of EEG inside the scanner, artifact removal, and statistical analysis of the fMRI signal. It then discusses the results reported for patients with primary generalized epilepsy and patients with different types of focal epileptic disorders. An important matter that these results have brought to light is that the brain regions affected by interictal epileptic discharges might not be limited to the ones where they have been generated. The developed methods can help reveal the regions involved in or affected by a seizure onset zone (SOZ). As confirmed by the reviewed literature, EEG–fMRI provides information that comes particularly useful when evaluating patients with refractory epilepsy for surgery.

Artifact Reduction in Simultaneous EEG-fMRI: A Systematic Review of Methods and Contemporary Usage

Simultaneous electroencephalography-functional MRI (EEG-fMRI) is a technique that combines temporal (largely from EEG) and spatial (largely from fMRI) indicators of brain dynamics. It is useful for understanding neuronal activity during many different event types, including spontaneous epileptic discharges, the activity of sleep stages, and activity evoked by external stimuli and decision-making tasks. However, EEG recorded during fMRI is subject to imaging, pulse, environment and motion artifact, causing noise many times greater than the neuronal signals of interest. Therefore, artifact removal methods are essential to ensure that artifacts are accurately removed, and EEG of interest is retained. This paper presents a systematic review of methods for artifact reduction in simultaneous EEG-fMRI from literature published since 1998, and an additional systematic review of EEG-fMRI studies published since 2016. The aim of the first review is to distill the literature into clear guidelines for use of simultaneous EEG-fMRI artifact reduction methods, and the aim of the second review is to determine the prevalence of artifact reduction method use in contemporary studies. We find that there are many published artifact reduction techniques available, including hardware, model based, and data-driven methods, but there are few studies published that adequately compare these methods. In contrast, recent EEG-fMRI studies show overwhelming use of just one or two artifact reduction methods based on literature published 15–20 years ago, with newer methods rarely gaining use outside the group that developed them. Surprisingly, almost 15% of EEG-fMRI studies published since 2016 fail to adequately describe the methods of artifact reduction utilized. We recommend minimum standards for reporting artifact reduction techniques in simultaneous EEG-fMRI studies and suggest that more needs to be done to make new artifact reduction techniques more accessible for the researchers and clinicians using simultaneous EEG-fMRI.

Preoperative localization of seizure onset zones by magnetic source imaging, EEG-correlated functional MRI, and their combination

OBJECTIVE

Preoperative localization of seizure onset zones (SOZs) is an evolving field in the treatment of refractory epilepsy. Both magnetic source imaging (MSI), and the more recent EEG-correlated functional MRI (EEG-fMRI), have shown applicability in assisting surgical planning. The purpose of this study was to evaluate the capability of each method and their combination in localizing the seizure onset lobe (SL).

METHODS

The study included 14 patients who underwent both MSI and EEG-fMRI before undergoing implantation of intracranial EEG (icEEG) as part of the presurgical planning of the resection of an epileptogenic zone (EZ) during the years 2012-2018. The estimated location of the SL by each method was compared with the location determined by icEEG. Identification rates of the SL were compared between the different methods.

RESULTS

MSI and EEG-fMRI showed similar identification rates of SL locations in relation to icEEG results (88% ± 31% and 73% ± 42%, respectively; p = 0.281). The additive use of the coverage lobes of both methods correctly identified 100% of the SL, significantly higher than EEG-fMRI alone (p = 0.039) and nonsignificantly higher than MSI (p = 0.180). False-identification rates of the additive coverage lobes were significantly higher than MSI (p = 0.026) and EEG-fMRI (p = 0.027). The intersecting lobes of both methods showed the lowest false identification rate (13% ± 6%, p = 0.01).

CONCLUSIONS

Both MSI and EEG-fMRI can assist in the presurgical evaluation of patients with refractory epilepsy. The additive use of both tests confers a high identification rate in finding the SL. This combination can help in focusing implantation of icEEG electrodes targeting the SOZ.

Conductive gel bridge sensor for motion tracking in simultaneous EEG-fMRI recordings

EEG-fMRI allows the localization of the hemodynamic correlates of neural activity and has been shown to be useful as a diagnostic tool in pre-surgical evaluation of refractory epilepsy. However, EEG recordings may be highly contaminated by artifacts induced by movements inside the magnetic field thus rendering the scan difficult for interpretation. Existing methods for motion correction require additional equipment or hardware modification. We introduce a simple method for motion artifact detection, the conductive gel bridge sensor (CGBS), easily applicable using the standard setup. We report examples of CGBS use in two patients with epilepsy and demonstrate the method's ability to successfully differentiate between epochs of brain activity and those of movement.

DeepIED: An epileptic discharge detector for EEG-fMRI based on deep learning

Presurgical evaluation that can precisely delineate the epileptogenic zone (EZ) is one important step for successful surgical resection treatment of refractory epilepsy patients. The noninvasive EEG-fMRI recording technique combined with general linear model (GLM) analysis is considered an important tool for estimating the EZ. However, the manual marking of interictal epileptic discharges (IEDs) needed in this analysis is challenging and time-consuming because the quality of the EEG recorded inside the scanner is greatly deteriorated compared to the usual EEG obtained outside the scanner. This is one of main impediments to the widespread use of EEG-fMRI in epilepsy. We propose a deep learning based semi-automatic IED detector that can find the candidate IEDs in the EEG recorded inside the scanner which resemble sample IEDs marked in the EEG recorded outside the scanner. The manual marking burden is greatly reduced as the expert need only edit candidate IEDs. The model is trained on data from 30 patients. Validation of IEDs detection accuracy on another 37 consecutive patients shows our method can improve the median sensitivity from 50.0% for the previously proposed template-based method to 84.2%, with false positive rate as 5 events/min. Reproducibility validation on 15 patients is applied to evaluate if our method can produce similar hemodynamic response maps compared with the manual marking ground truth results. We explore the concordance between the maximum hemodynamic response and the intracerebral EEG defined EZ and find that both methods produce similar percentage of concordance (76.9%, 10 out of 13 patients, electrode was absent in the maximum hemodynamic response in two patients). This tool will make EEG-fMRI analysis more practical for clinical usage.

•

A deep learning based epileptic discharge detector for EEG-fMRI is proposed.

•

The burden of manually marking epileptic discharges is greatly reduced.

•

Our method can produce similar EEG-fMRI results compared with traditional method.

How to Build a Hybrid Neurofeedback Platform Combining EEG and fMRI

Multimodal neurofeedback estimates brain activity using information acquired with more than one neurosignal measurement technology. In this paper we describe how to set up and use a hybrid platform based on simultaneous electroencephalography (EEG) and functional magnetic resonance imaging (fMRI), then we illustrate how to use it for conducting bimodal neurofeedback experiments. The paper is intended for those willing to build a multimodal neurofeedback system, to guide them through the different steps of the design, setup, and experimental applications, and help them choose a suitable hardware and software configuration. Furthermore, it reports practical information from bimodal neurofeedback experiments conducted in our lab. The platform presented here has a modular parallel processing architecture that promotes real-time signal processing performance and simple future addition and/or replacement of processing modules. Various unimodal and bimodal neurofeedback experiments conducted in our lab showed high performance and accuracy. Currently, the platform is able to provide neurofeedback based on electroencephalography and functional magnetic resonance imaging, but the architecture and the working principles described here are valid for any other combination of two or more real-time brain activity measurement technologies.