Reference layer artefact subtraction (RLAS): a novel method of minimizing EEG artefacts during simultaneous fMRI

Sleep neuroimaging: Review and future directions

Sleep research has evolved considerably since the first sleep electroencephalography recordings in the 1930s and the discovery of well-distinguishable sleep stages in the 1950s. While electrophysiological recordings have been used to describe the sleeping brain in much detail, since the 1990s neuroimaging techniques have been applied to uncover the brain organization and functional connectivity of human sleep with greater spatial resolution. The combination of electroencephalography with different neuroimaging modalities such as positron emission tomography, structural magnetic resonance imaging and functional magnetic resonance imaging imposes several challenges for sleep studies, for instance, the need to combine polysomnographic recordings to assess sleep stages accurately, difficulties maintaining and consolidating sleep in an unfamiliar and restricted environment, scanner-induced distortions with physiological artefacts that may contaminate polysomnography recordings, and the necessity to account for all physiological changes throughout the sleep cycles to ensure better data interpretability. Here, we review the field of sleep neuroimaging in healthy non-sleep-deprived populations, from early findings to more recent developments. Additionally, we discuss the challenges of applying concurrent electroencephalography and imaging techniques to sleep, which consequently have impacted the sample size and generalizability of studies, and possible future directions for the field.

Brainwide hemodynamics predict neural rhythms across sleep and wakefulness in humans

The brain exhibits rich oscillatory dynamics that play critical roles in vigilance and cognition, such as the neural rhythms that define sleep. These rhythms continuously fluctuate, signaling major changes in vigilance, but the brainwide dynamics underlying these oscillations are unknown. Using simultaneous EEG and fast fMRI in humans drifting between sleep and wakefulness, we developed a machine learning approach to investigate which brainwide fMRI networks predict alpha (8-12 Hz) and delta (1-4 Hz) fluctuations. We predicted moment-to-moment EEG power variations from fMRI activity in held-out subjects, and found that information about alpha rhythms was highly separable in two networks linked to arousal and visual systems. Conversely, delta rhythms were diffusely represented on a large spatial scale across the cortex. These results identify the large-scale network patterns that underlie alpha and delta rhythms, and establish a novel framework for investigating multimodal, brainwide dynamics.

NeuXus open-source tool for real-time artifact reduction in simultaneous EEG-fMRI

The simultaneous acquisition of electroencephalography and functional magnetic resonance imaging (EEG-fMRI) allows the complementary study of the brain's electrophysiology and hemodynamics with high temporal and spatial resolution. One application with great potential is neurofeedback training of targeted brain activity, based on the real-time analysis of the EEG and/or fMRI signals. This depends on the ability to reduce in real time the severe artifacts affecting the EEG signal acquired with fMRI, mainly the gradient and pulse artifacts. A few methods have been proposed for this purpose, but they are either slow, hardware-dependent, publicly unavailable, or proprietary software. Here, we present a fully open-source and publicly available tool for real-time EEG artifact reduction in simultaneous EEG-fMRI recordings that is fast and applicable to any hardware. Our tool is integrated in the Python toolbox NeuXus for real-time EEG processing and adapts to a real-time scenario well-established artifact average subtraction methods combined with a long short-term memory network for R peak detection. We benchmarked NeuXus on three different datasets, in terms of artifact power reduction and background signal preservation in resting state, alpha-band power reactivity to eyes closure, and event-related desynchronization during motor imagery. We showed that NeuXus performed at least as well as the only available real-time tool for conventional hardware setups (BrainVision's RecView) and a well-established offline tool (EEGLAB's FMRIB plugin). We also demonstrated NeuXus' real-time ability by reporting execution times under 250 ms. In conclusion, we present and validate the first fully open-source and hardware-independent solution for real-time artifact reduction in simultaneous EEG-fMRI studies.

iCanClean Removes Motion, Muscle, Eye, and Line-Noise Artifacts from Phantom EEG

The goal of this study was to test a novel approach (iCanClean) to remove non-brain sources from scalp EEG data recorded in mobile conditions. We created an electrically conductive phantom head with 10 brain sources, 10 contaminating sources, scalp, and hair. We tested the ability of iCanClean to remove artifacts while preserving brain activity under six conditions: Brain, Brain + Eyes, Brain + Neck Muscles, Brain + Facial Muscles, Brain + Walking Motion, and Brain + All Artifacts. We compared iCanClean to three other methods: Artifact Subspace Reconstruction (ASR), Auto-CCA, and Adaptive Filtering. Before and after cleaning, we calculated a Data Quality Score (0-100%), based on the average correlation between brain sources and EEG channels. iCanClean consistently outperformed the other three methods, regardless of the type or number of artifacts present. The most striking result was for the condition with all artifacts simultaneously present. Starting from a Data Quality Score of 15.7% (before cleaning), the Brain + All Artifacts condition improved to 55.9% after iCanClean. Meanwhile, it only improved to 27.6%, 27.2%, and 32.9% after ASR, Auto-CCA, and Adaptive Filtering. For context, the Brain condition scored 57.2% without cleaning (reasonable target). We conclude that iCanClean offers the ability to clear multiple artifact sources in real time and could facilitate human mobile brain-imaging studies with EEG.

EEG-LLAMAS: A low-latency neurofeedback platform for artifact reduction in EEG-fMRI

Simultaneous EEG-fMRI is a powerful multimodal technique for imaging the brain, but its use in neurofeedback experiments has been limited by EEG noise caused by the MRI environment. Neurofeedback studies typically require analysis of EEG in real time, but EEG acquired inside the scanner is heavily contaminated with ballistocardiogram (BCG) artifact, a high-amplitude artifact locked to the cardiac cycle. Although techniques for removing BCG artifacts do exist, they are either not suited to real-time, low-latency applications, such as neurofeedback, or have limited efficacy. We propose and validate a new open-source artifact removal software called EEG-LLAMAS (Low Latency Artifact Mitigation Acquisition Software), which adapts and advances existing artifact removal techniques for low-latency experiments. We first used simulations to validate LLAMAS in data with known ground truth. We found that LLAMAS performed better than the best publicly-available real-time BCG removal technique, optimal basis sets (OBS), in terms of its ability to recover EEG waveforms, power spectra, and slow wave phase. To determine whether LLAMAS would be effective in practice, we then used it to conduct real-time EEG-fMRI recordings in healthy adults, using a steady state visual evoked potential (SSVEP) task. We found that LLAMAS was able to recover the SSVEP in real time, and recovered the power spectra collected outside the scanner better than OBS. We also measured the latency of LLAMAS during live recordings, and found that it introduced a lag of less than 50 ms on average. The low latency of LLAMAS, coupled with its improved artifact reduction, can thus be effectively used for EEG-fMRI neurofeedback. A limitation of the method is its use of a reference layer, a piece of EEG equipment which is not commercially available, but can be assembled in-house. This platform enables closed-loop experiments which previously would have been prohibitively difficult, such as those that target short-duration EEG events, and is shared openly with the neuroscience community.

Neural activity induced by sensory stimulation can drive large-scale cerebrospinal fluid flow during wakefulness in humans

Cerebrospinal fluid (CSF) flow maintains healthy brain homeostasis, facilitating solute transport and the exchange of brain waste products. CSF flow is thus important for brain health, but the mechanisms that control its large-scale movement through the ventricles are not well understood. While it is well established that CSF flow is modulated by respiratory and cardiovascular dynamics, recent work has also demonstrated that neural activity is coupled to large waves of CSF flow in the ventricles during sleep. To test whether the temporal coupling between neural activity and CSF flow is in part due to a causal relationship, we investigated whether CSF flow could be induced by driving neural activity with intense visual stimulation. We manipulated neural activity with a flickering checkerboard visual stimulus and found that we could drive macroscopic CSF flow in the human brain. The timing and amplitude of CSF flow was matched to the visually evoked hemodynamic responses, suggesting neural activity can modulate CSF flow via neurovascular coupling. These results demonstrate that neural activity can contribute to driving CSF flow in the human brain and that the temporal dynamics of neurovascular coupling can explain this effect.

A temporal sequence of thalamic activity unfolds at transitions in behavioral arousal state

Awakening from sleep reflects a profound transformation in neural activity and behavior. The thalamus is a key controller of arousal state, but whether its diverse nuclei exhibit coordinated or distinct activity at transitions in behavioral arousal state is unknown. Using fast fMRI at ultra-high field (7 Tesla), we measured sub-second activity across thalamocortical networks and within nine thalamic nuclei to delineate these dynamics during spontaneous transitions in behavioral arousal state. We discovered a stereotyped sequence of activity across thalamic nuclei and cingulate cortex that preceded behavioral arousal after a period of inactivity, followed by widespread deactivation. These thalamic dynamics were linked to whether participants subsequently fell back into unresponsiveness, with unified thalamic activation reflecting maintenance of behavior. These results provide an outline of the complex interactions across thalamocortical circuits that orchestrate behavioral arousal state transitions, and additionally, demonstrate that fast fMRI can resolve sub-second subcortical dynamics in the human brain.

Evaluation and comparison of most prevalent artifact reduction methods for EEG acquired simultaneously with fMRI

Multimodal neuroimaging using EEG and fMRI provides deeper insights into brain function by improving the spatial and temporal resolution of the acquired data. However, simultaneous EEG-fMRI inevitably compromises the quality of the EEG and fMRI signals due to the high degree of interaction between the two systems. Fluctuations in the magnetic flux flowing through the participant and the EEG system, whether due to movement within the magnetic field of the scanner or to changes in magnetic field strength, induce electrical potentials in the EEG recordings that mask the much weaker electrical activity of the neuronal populations. A number of different methods have been proposed to reduce MR artifacts. We present an overview of the most commonly used methods and an evaluation of the methods using three sets of diverse EEG data. We limited the evaluation to open-access and easy-to-use methods and a reference signal regression method using a set of six carbon-wire loops (CWL), which allowed evaluation of their added value. The evaluation was performed by comparing EEG signals recorded outside the MRI scanner with artifact-corrected EEG signals recorded simultaneously with fMRI. To quantify and evaluate the quality of artifact reduction methods in terms of the spectral content of the signal, we analyzed changes in oscillatory activity during a resting-state and a finger tapping motor task. The quality of artifact reduction in the time domain was assessed using data collected during a visual stimulation task. In the study we utilized hierarchical Bayesian probabilistic modeling for statistical inference and observed significant differences between the evaluated methods in the success of artifact reduction and associated signal quality in both the frequency and time domains. In particular, the CWL system proved superior to the other methods evaluated in improving spectral contrast in the alpha and beta bands and in recovering visual evoked responses. Based on the results of the evaluation study, we proposed guidelines for selecting the optimal method for MR artifact reduction.

Ballistocardiogram suppression in concurrent EEG-MRI by dynamic modeling of heartbeats

The ballistocardiogram (BCG), the induced electric potentials by the head motion originating from heartbeats, is a prominent source of noise in electroencephalography (EEG) data during magnetic resonance imaging (MRI). Although methods have been proposed to suppress the BCG artifact, more work considering the variability of cardiac cycles and head motion across time and subjects is needed to provide highly robust correction. Here, a method called "dynamic modeling of heartbeats" (DMH) is proposed to reduce BCG artifacts in EEG data recorded inside an MRI system. The DMH method models BCG artifacts by combining EEG points at time instants with similar dynamics. The modeled BCG artifact is then subtracted from the EEG recording to suppress the BCG artifact. Performance of DMH was tested and specifically compared with the Optimal Basis Set (OBS) method on EEG data recorded inside a 3T MRI system with either no MRI acquisition (Inside-MRI), echo-planar imaging (EPI-EEG), or fast MRI acquisition using simultaneous multi-slice and inverse imaging methods (SMS-InI-EEG). In a steady-state visual evoked response (SSVEP) paradigm, the 15-Hz oscillatory neuronal activity at the visual cortex after DMH processing was about 130% of that achieved by OBS processing for Inside-MRI, SMS-InI-EEG, and EPI-EEG conditions. The DMH method is computationally efficient for suppressing BCG artifacts and in the future may help to improve the quality of EEG data recorded in high-field MRI systems for neuroscientific and clinical applications.

Conflict- and error-related theta activities are coupled to BOLD signals in different brain regions

Both conflict and error processing have been linked to the midfrontal theta power (4-8 Hz) increase as indicated by EEG studies and greater hemodynamic activity in the anterior midcingulate cortex (aMCC) as indicated by fMRI studies. Conveniently, the source of the midfrontal theta power was estimated in or nearby aMCC. However, previous studies using concurrent EEG and fMRI recordings in resting-state or other cognitive tasks observed only a negative relationship between theta power and BOLD signal in the brain regions typically showing task-related deactivations. In this study, we used a simultaneous EEG-fMRI technique to investigate a trial-by-trial coupling between theta power and hemodynamic activity during the performance of two conflict tasks. Independent component analysis (ICA) was applied to denoise the EEG signal and select individual midfrontal EEG components, whereas group ICA was applied to fMRI data to obtain a functional parcellation of the frontal cortex. Using a linear mixed-effect model, theta power was coupled with the peak of hemodynamic responses from various frontal, cingulate, and insular cortical sites to unravel the potential brain sources that contribute to conflict- and error-related theta variability. Although several brain regions exhibited conflict-related increases in hemodynamic activity, the conflict pre-response theta showed only a negative correlation to BOLD signal in the midline area 9 (MA9), a region exhibiting conflict-sensitive deactivation. Conversely, and more expectedly, error-related theta showed a positive relationship to activity in the aMCC. Our results provide novel evidence suggesting that the amplitude of pre-response theta reflects the process of active inhibition that suppresses the MA9 activity. This process is affected independently by the stimulus congruency, reaction times variance, and is susceptible to the time-on-task effect. Finally, it predicts the commitment of an omission error. Together, our findings highlight that conflict- and error-related theta oscillations represent fundamentally different processes.

Simultaneous EEG-fMRI: What Have We Learned and What Does the Future Hold?

Simultaneous EEG-fMRI has developed into a mature measurement technique in the past 25 years. During this time considerable technical and analytical advances have been made, enabling valuable scientific contributions to a range of research fields. This review will begin with an introduction to the measurement principles involved in EEG and fMRI and the advantages of combining these methods. The challenges faced when combining the two techniques will then be considered. An overview of the leading application fields where EEG-fMRI has made a significant contribution to the scientific literature and emerging applications in EEG-fMRI research trends is then presented.

EEG-fMRI: Ballistocardiogram Artifact Reduction by Surrogate Method for Improved Source Localization

For the analysis of simultaneous EEG-fMRI recordings, it is vital to use effective artifact removal tools. This applies in particular to the ballistocardiogram (BCG) artifact which is difficult to remove without distorting signals of interest related to brain activity. Here, we documented the use of surrogate source models to separate the artifact-related signals from brain signals with minimal distortion of the brain activity of interest. The artifact topographies used for surrogate separation were created automatically using principal components analysis (PCA-S) or by manual selection of artifact components utilizing independent components analysis (ICA-S). Using real resting-state data from 55 subjects superimposed with simulated auditory evoked potentials (AEP), both approaches were compared with three established BCG artifact removal methods: Blind Source Separation (BSS), Optimal Basis Set (OBS), and a mixture of both (OBS-ICA). Each method was evaluated for its applicability for ERP and source analysis using the following criteria: the number of events surviving artifact threshold scans, signal-to-noise ratio (SNR), error of source localization, and signal variance explained by the dipolar model. Using these criteria, PCA-S and ICA-S fared best overall, with highly significant differences to the established methods, especially in source localization. The PCA-S approach was also applied to a single subject Berger experiment performed in the MRI scanner. Overall, the removal of BCG artifacts by the surrogate methods provides a substantial improvement for the analysis of simultaneous EEG-fMRI data compared to the established methods.

Mobile Electroencephalography for Studying Neural Control of Human Locomotion

Walking or running in real-world environments requires dynamic multisensory processing within the brain. Studying supraspinal neural pathways during human locomotion provides opportunities to better understand complex neural circuity that may become compromised due to aging, neurological disorder, or disease. Knowledge gained from studies examining human electrical brain dynamics during gait can also lay foundations for developing locomotor neurotechnologies for rehabilitation or human performance. Technical barriers have largely prohibited neuroimaging during gait, but the portability and precise temporal resolution of non-invasive electroencephalography (EEG) have expanded human neuromotor research into increasingly dynamic tasks. In this narrative mini-review, we provide a (1) brief introduction and overview of modern neuroimaging technologies and then identify considerations for (2) mobile EEG hardware, (3) and data processing, (4) including technical challenges and possible solutions. Finally, we summarize (5) knowledge gained from human locomotor control studies that have used mobile EEG, and (6) discuss future directions for real-world neuroimaging research.

Unified Retrospective EEG Motion Educated Artefact Suppression for EEG-fMRI to Suppress Magnetic Field Gradient Artefacts During Motion

The data quality of simultaneously acquired electroencephalography and functional magnetic resonance imaging (EEG-fMRI) can be strongly affected by motion. Recent work has shown that the quality of fMRI data can be improved by using a Moiré-Phase-Tracker (MPT)-camera system for prospective motion correction. The use of the head position acquired by the MPT-camera-system has also been shown to correct motion-induced voltages, ballistocardiogram (BCG) and gradient artefact residuals separately. In this work we show the concept of an integrated framework based on the general linear model to provide a unified motion informed model of in-MRI artefacts. This model (retrospective EEG motion educated gradient artefact suppression, REEG-MEGAS) is capable of correcting voltage-induced, BCG and gradient artefact residuals of EEG data acquired simultaneously with prospective motion corrected fMRI. In our results, we have verified that applying REEG-MEGAS correction to EEG data acquired during subject motion improves the data quality in terms of motion induced voltages and also GA residuals in comparison to standard Artefact Averaging Subtraction and Retrospective EEG Motion Artefact Suppression. Besides that, we provide preliminary evidence that although adding more regressors to a model may slightly affect the power of physiological signals such as the alpha-rhythm, its application may increase the overall quality of a dataset, particularly when strongly affected by motion. This was verified by analysing the EEG traces, power spectra density and the topographic distribution from two healthy subjects. We also have verified that the correction by REEG-MEGAS improves higher frequency artefact correction by decreasing the power of Gradient Artefact harmonics. Our method showed promising results for decreasing the power of artefacts for frequencies up to 250 Hz. Additionally, REEG-MEGAS is a hybrid framework that can be implemented for real time prospective motion correction of EEG and fMRI data. Among other EEG-fMRI applications, the approach described here may benefit applications such as EEG-fMRI neurofeedback and brain computer interface, which strongly rely on the prospective acquisition and application of motion artefact removal.

Measurement of stretch-evoked brainstem function using fMRI

Knowledge on the organization of motor function in the reticulospinal tract (RST) is limited by the lack of methods for measuring RST function in humans. Behavioral studies suggest the involvement of the RST in long latency responses (LLRs). LLRs, elicited by precisely controlled perturbations, can therefore act as a viable paradigm to measure motor-related RST activity using functional Magnetic Resonance Imaging (fMRI). Here we present StretchfMRI, a novel technique developed to study RST function associated with LLRs. StretchfMRI combines robotic perturbations with electromyography and fMRI to simultaneously quantify muscular and neural activity during stretch-evoked LLRs without loss of reliability. Using StretchfMRI, we established the muscle-specific organization of LLR activity in the brainstem. The observed organization is partially consistent with animal models, with activity primarily in the ipsilateral medulla for flexors and in the contralateral pons for extensors, but also includes other areas, such as the midbrain and bilateral pontomedullary contributions.

Data-driven beamforming technique to attenuate ballistocardiogram artefacts in electroencephalography-functional magnetic resonance imaging without detecting cardiac pulses in electrocardiography recordings

Simultaneous recording of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) is a very promising non‐invasive neuroimaging technique. However, EEG data obtained from the simultaneous EEG–fMRI are strongly influenced by MRI‐related artefacts, namely gradient artefacts (GA) and ballistocardiogram (BCG) artefacts. When compared to the GA correction, the BCG correction is more challenging to remove due to its inherent variabilities and dynamic changes over time. The standard BCG correction (i.e., average artefact subtraction [AAS]), require detecting cardiac pulses from simultaneous electrocardiography (ECG) recording. However, ECG signals are also distorted and will become problematic for detecting reliable cardiac peaks. In this study, we focused on a beamforming spatial filtering technique to attenuate all unwanted source activities outside of the brain. Specifically, we applied the beamforming technique to attenuate the BCG artefact in EEG–fMRI, and also to recover meaningful task‐based neural signals during an attentional network task (ANT) which required participants to identify visual cues and respond accurately. We analysed EEG–fMRI data in 20 healthy participants during the ANT, and compared four different BCG corrections (non‐BCG corrected, AAS BCG corrected, beamforming + AAS BCG corrected, beamforming BCG corrected). We demonstrated that the beamforming approach did not only significantly reduce the BCG artefacts, but also significantly recovered the expected task‐based brain activity when compared to the standard AAS correction. This data‐driven beamforming technique appears promising especially for longer data acquisition of sleep and resting EEG–fMRI. Our findings extend previous work regarding the recovery of meaningful EEG signals by an optimized suppression of MRI‐related artefacts.

Inferring Macroscale Brain Dynamics via Fusion of Simultaneous EEG-fMRI

Advances in the instrumentation and signal processing for simultaneously acquired electroencephalography and functional magnetic resonance imaging (EEG-fMRI) have enabled new ways to observe the spatiotemporal neural dynamics of the human brain. Central to the utility of EEG-fMRI neuroimaging systems are the methods for fusing the two data streams, with machine learning playing a key role. These methods can be dichotomized into those that are symmetric and asymmetric in terms of how the two modalities inform the fusion. Studies using these methods have shown that fusion yields new insights into brain function that are not possible when each modality is acquired separately. As technology improves and methods for fusion become more sophisticated, the future of EEG-fMRI for noninvasive measurement of brain dynamics includes mesoscale mapping at ultrahigh magnetic resonance fields, targeted perturbation-based neuroimaging, and using deep learning to uncover nonlinear representations that link the electrophysiological and hemodynamic measurements.

Artifact Reduction in Simultaneous EEG-fMRI: A Systematic Review of Methods and Contemporary Usage

Simultaneous electroencephalography-functional MRI (EEG-fMRI) is a technique that combines temporal (largely from EEG) and spatial (largely from fMRI) indicators of brain dynamics. It is useful for understanding neuronal activity during many different event types, including spontaneous epileptic discharges, the activity of sleep stages, and activity evoked by external stimuli and decision-making tasks. However, EEG recorded during fMRI is subject to imaging, pulse, environment and motion artifact, causing noise many times greater than the neuronal signals of interest. Therefore, artifact removal methods are essential to ensure that artifacts are accurately removed, and EEG of interest is retained. This paper presents a systematic review of methods for artifact reduction in simultaneous EEG-fMRI from literature published since 1998, and an additional systematic review of EEG-fMRI studies published since 2016. The aim of the first review is to distill the literature into clear guidelines for use of simultaneous EEG-fMRI artifact reduction methods, and the aim of the second review is to determine the prevalence of artifact reduction method use in contemporary studies. We find that there are many published artifact reduction techniques available, including hardware, model based, and data-driven methods, but there are few studies published that adequately compare these methods. In contrast, recent EEG-fMRI studies show overwhelming use of just one or two artifact reduction methods based on literature published 15–20 years ago, with newer methods rarely gaining use outside the group that developed them. Surprisingly, almost 15% of EEG-fMRI studies published since 2016 fail to adequately describe the methods of artifact reduction utilized. We recommend minimum standards for reporting artifact reduction techniques in simultaneous EEG-fMRI studies and suggest that more needs to be done to make new artifact reduction techniques more accessible for the researchers and clinicians using simultaneous EEG-fMRI.

Ballistocardiogram Artifact Reduction in Simultaneous EEG-fMRI Using Deep Learning

OBJECTIVE

The concurrent recording of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) is a technique that has received much attention due to its potential for combined high temporal and spatial resolution. However, the ballistocardiogram (BCG), a large-amplitude artifact caused by cardiac induced movement contaminates the EEG during EEG-fMRI recordings. Removal of BCG in software has generally made use of linear decompositions of the corrupted EEG. This is not ideal as the BCG signal propagates in a manner which is non-linearly dependent on the electrocardiogram (ECG). In this paper, we present a novel method for BCG artifact suppression using recurrent neural networks (RNNs).

METHODS

EEG signals were recovered by training RNNs on the nonlinear mappings between ECG and the BCG corrupted EEG. We evaluated our model's performance against the commonly used Optimal Basis Set (OBS) method at the level of individual subjects, and investigated generalization across subjects.

RESULTS

We show that our algorithm can generate larger average power reduction of the BCG at critical frequencies, while simultaneously improving task relevant EEG based classification.

CONCLUSION

The presented deep learning architecture can be used to reduce BCG related artifacts in EEG-fMRI recordings.

SIGNIFICANCE

We present a deep learning approach that can be used to suppress the BCG artifact in EEG-fMRI without the use of additional hardware. This method may have scope to be combined with current hardware methods, operate in real-time and be used for direct modeling of the BCG.

Schrödinger filtering: a precise EEG despiking technique for EEG-fMRI gradient artifact

In EEG data acquired in the presence of fMRI, gradient-related spike artifacts contaminate the signal following the common preprocessing step of average artifact subtraction. Spike artifacts compromise EEG data quality since they overlap with the EEG signal in frequency, thereby confounding frequency-based inferences on activity. As well, spike artifacts can inflate or deflate correlations among time series, thereby confounding inferences on functional connectivity. We present Schrödinger filtering, which uses the Schrödinger equation to decompose the spike-containing input. The basis functions of the decomposition are localized and pulse-shaped, and selectively capture the various input peaks, with the spike components clustered at the beginning of the spectrum. Schrödinger filtering automatically subtracts the spike components from the data. On real and simulated data, we show that Schrödinger filtering (1) simultaneously accomplishes high spike removal and high signal preservation without affecting evoked activity, and (2) reduces spurious pairwise correlations in spontaneous activity. In these regards, Schrödinger filtering was significantly better than three other despiking techniques: median filtering, amplitude thresholding, and wavelet denoising. These results encourage the use of Schrödinger filtering in future EEG-fMRI pipelines, as well as in other spike-related applications (e.g., fMRI motion artifact removal or action potential extraction).

Coupled electrophysiological, hemodynamic, and cerebrospinal fluid oscillations in human sleep

Sleep is essential for both cognition and maintenance of healthy brain function. Slow waves in neural activity contribute to memory consolidation, whereas cerebrospinal fluid (CSF) clears metabolic waste products from the brain. Whether these two processes are related is not known. We used accelerated neuroimaging to measure physiological and neural dynamics in the human brain. We discovered a coherent pattern of oscillating electrophysiological, hemodynamic, and CSF dynamics that appears during non-rapid eye movement sleep. Neural slow waves are followed by hemodynamic oscillations, which in turn are coupled to CSF flow. These results demonstrate that the sleeping brain exhibits waves of CSF flow on a macroscopic scale, and these CSF dynamics are interlinked with neural and hemodynamic rhythms.

Direct modelling of gradient artifacts for EEG-fMRI denoising and motion tracking

OBJECTIVE

Simultaneous electroencephalography and functional magnetic resonance imaging recording (EEG-fMRI) has been widely used in neuroscientific and clinical research. The artifacts in the recorded EEG resulting from rapidly switching magnetic field gradients are usually corrected by average-artifact subtraction (AAS) due to their repetitive nature. But the performance of AAS is often disrupted by altered artifact waveforms across epochs, notably due to head motion.

APPROACH

Here, a method is proposed to make use of the known MR sequence gradient waveforms for a direct modelling of gradient artifacts. After accounting for filtering effects on the gradient artifacts, a continuous modulation of the gradient waveforms superimposed on the EEG signal is obtained.

MAIN RESULTS

Although a moving AAS template can adjust to slow drifts in gradient artifact variation, it fails to adapt to abrupt motion, resulting in residual noise. We demonstrate how this modelling approach can reduce motion-affected gradient artifacts without distorting the underlying neuronal signals. Moreover, the method provides useful head motion information highly correlated with motion tracked by an optical camera.

SIGNIFICANCE

Our work provides a novel way to improve gradient artifact removal in EEG-fMRI, and shows a potential to detect head motion without requiring additional hardware.

Simultaneous EEG-fMRI: Evaluating the Effect of the EEG Cap-Cabling Configuration on the Gradient Artifact

Electroencephalography (EEG) data recorded during simultaneous EEG-fMRI experiments are contaminated by large gradient artifacts (GA). The amplitude of the GA depends on the area of the wire loops formed by the EEG leads, as well as on the rate of switching of the magnetic field gradients, which are essential for MR imaging. Average artifact subtraction (AAS), the most commonly used method for GA correction, relies on the EEG amplifier having a large enough dynamic range to characterize the artifact voltages. Low-pass filtering (250 Hz cut-off) is generally used to attenuate the high-frequency voltage fluctuations of the GA, but even with this precaution channel saturation can occur, particularly during acquisition of high spatial resolution MRI data. Previous work has shown that the ribbon cable, used to connect the EEG cap and amplifier, makes a significant contribution to the GA, since the cable geometry produces large effective wire-loop areas. However, by appropriately connecting the wires of the ribbon cable to the EEG cap it should be possible to minimize the overall range and root mean square (RMS) amplitude of the GA by producing partial cancelation of the cap and cable contributions. Here by modifying the connections of the EEG cap to a 1 m ribbon cable we were able to reduce the range of the GA for a high-resolution coronal echo planar Imaging (EPI) acquisition by a factor of ∼ 1.6 and by a factor of ∼ 1.15 for a standard axial EPI acquisition. These changes could potentially be translated into a reduction in the required dynamic range, an increase in the EEG bandwidth or an increase in the achievable image resolution without saturation, all of which could be beneficially exploited in EEG-fMRI studies. The re-wiring could also prevent the system from saturating when small subject movements occur using the standard recording bandwidth.

Combined head phantom and neural mass model validation of effective connectivity measures

OBJECTIVE

Due to its high temporal resolution, electroencephalography (EEG) has become a promising tool for quantifying cortical dynamics and effective connectivity in a mobile setting. While many connectivity estimators are available, the efficacy of these measures has not been rigorously validated in real-world scenarios. The goal of this study was to quantify the accuracy of independent component analysis and multiple connectivity measures on ground-truth connections while exposed real-world volume conduction and head motion.

APPROACH

We collected high-density EEG from a phantom head with embedded antennae, using neural mass models to generate transiently interconnected signals. The head was mounted upon a motion platform that mimicked recorded human head motion at various walking speeds. We used cross-correlation and signal to noise ratio to determine how well independent component analysis recovered the original antenna signals. For connectivity measures, we computed the average and standard deviation across frequency of each estimated connectivity peak.

MAIN RESULTS

Independent component analysis recovered most antenna signals, as evidenced by cross-correlations primarily above 0.8, and maintained consistent signal to noise ratio values near 10 dB across walking speeds compared to scalp channel data, which had decreased signal to noise ratios of ~2 dB at fast walking speeds. The connectivity measures used were generally able to identify the true interconnections, but some measures were susceptible to spurious high-frequency connections inducing large standard deviations of ~10 Hz.

SIGNIFICANCE

Our results indicate that independent component analysis and some connectivity measures can be effective at recovering underlying connections among brain areas. These results highlight the utility of validating EEG processing techniques with a combination of complex signals, phantom head use, and realistic head motion.

Human electrocortical dynamics while stepping over obstacles

To better understand human brain dynamics during visually guided locomotion, we developed a method of removing motion artifacts from mobile electroencephalography (EEG) and studied human subjects walking and running over obstacles on a treadmill. We constructed a novel dual-layer EEG electrode system to isolate electrocortical signals, and then validated the system using an electrical head phantom and robotic motion platform. We collected data from young healthy subjects walking and running on a treadmill while they encountered unexpected obstacles to step over. Supplementary motor area and premotor cortex had spectral power increases within ~200 ms after object appearance in delta, theta, and alpha frequency bands (3–13 Hz). That activity was followed by similar posterior parietal cortex spectral power increase that decreased in lag time with increasing locomotion speed. The sequence of activation suggests that supplementary motor area and premotor cortex interrupted the gait cycle, while posterior parietal cortex tracked obstacle location for planning foot placement nearly two steps ahead of reaching the obstacle. Together, these results highlight advantages of adopting dual-layer mobile EEG, which should greatly facilitate the study of human brain dynamics in physically active real-world settings and tasks.

Investigating the variability of cardiac pulse artifacts across heartbeats in simultaneous EEG-fMRI recordings: A 7T study

Electroencephalography (EEG) recordings performed in magnetic resonance imaging (MRI) scanners are affected by complex artifacts caused by heart function, often termed pulse artifacts (PAs). PAs can strongly compromise EEG data quality, and remain an open problem for EEG-fMRI. This study investigated the properties and mechanisms of PA variability across heartbeats, which has remained largely unaddressed to date, and evaluated its impact on PA correction approaches. Simultaneous EEG-fMRI was performed at 7T on healthy participants at rest or under visual stimulation, with concurrent recordings of breathing and cardiac activity. PA variability was found to contribute to EEG variance with more than 500 μV² at 7T, which extrapolates to 92 μV² at 3T. Clustering analyses revealed that PA variability not only is linked to variations in head position/orientation, as previously hypothesized, but also, and more importantly, to the respiratory cycle and to heart rate fluctuations. The latter mechanisms are associated to short-timescale variability (even across consecutive heartbeats), and their importance varied across EEG channels. In light of this PA variability, three PA correction techniques were compared: average artifact subtraction (AAS), optimal basis sets (OBS), and an approach based on K-means clustering. All methods allowed the recovery of visual evoked potentials from the EEG data; nonetheless, OBS and K-means tended to outperform AAS, likely due to the inability of the latter in modeling short-timescale variability. Altogether, these results offer novel insights into the dynamics and underlying mechanisms of the pulse artifact, with important consequences for its correction, relevant to most EEG-fMRI applications.

Removal of Gross Artifacts of Transcranial Alternating Current Stimulation in Simultaneous EEG Monitoring

Transcranial electrical stimulation is a widely used non-invasive brain stimulation approach. To date, EEG has been used to evaluate the effect of transcranial Direct Current Stimulation (tDCS) and transcranial Alternating Current Stimulation (tACS), but most studies have been limited to exploring changes in EEG before and after stimulation due to the presence of stimulation artifacts in the EEG data. This paper presents two different algorithms for removing the gross tACS artifact from simultaneous EEG recordings. These give different trade-offs in removal performance, in the amount of data required, and in their suitability for closed loop systems. Superposition of Moving Averages and Adaptive Filtering techniques are investigated, with significant emphasis on verification. We present head phantom testing results for controlled analysis, together with on-person EEG recordings in the time domain, frequency domain, and Event Related Potential (ERP) domain. The results show that EEG during tACS can be recovered free of large scale stimulation artifacts. Previous studies have not quantified the performance of the tACS artifact removal procedures, instead focusing on the removal of second order artifacts such as respiration related oscillations. We focus on the unresolved challenge of removing the first order stimulation artifact, presented with a new multi-stage validation strategy.

Conductive gel bridge sensor for motion tracking in simultaneous EEG-fMRI recordings

EEG-fMRI allows the localization of the hemodynamic correlates of neural activity and has been shown to be useful as a diagnostic tool in pre-surgical evaluation of refractory epilepsy. However, EEG recordings may be highly contaminated by artifacts induced by movements inside the magnetic field thus rendering the scan difficult for interpretation. Existing methods for motion correction require additional equipment or hardware modification. We introduce a simple method for motion artifact detection, the conductive gel bridge sensor (CGBS), easily applicable using the standard setup. We report examples of CGBS use in two patients with epilepsy and demonstrate the method's ability to successfully differentiate between epochs of brain activity and those of movement.

Adaptive and Wireless Recordings of Electrophysiological Signals During Concurrent Magnetic Resonance Imaging

Strong electromagnetic fields that occur during functional magnetic resonance imaging (fMRI) presents a challenging environment for concurrent electrophysiological recordings. Here, we present a miniaturized, wireless platform-"MR-Link" (Multimodal Recording Link) that provides a hardware solution for simultaneous electrophysiological and fMRI signal acquisition. The device detects the changes in the electromagnetic field during fMRI to synchronize amplification and sampling of electrophysiological signals with minimal artifacts. It wirelessly transmits the recorded data at a frequency detectable by the MR-receiver coil. The transmitted data is readily separable from MRI in the frequency domain. To demonstrate its efficacy, we used this device to record electrocardiograms and somatosensory evoked potential during concurrent fMRI scans. The device minimized the fMRI-induced artifacts in electrophysiological data and wirelessly transmitted the data back to the receiver coil without compromising the fMRI signal quality. The device is compact (22 mm dia., 2 gms) and can be placed within the MRI bore to precisely synchronize with fMRI. Therefore, MR-Link offers an inexpensive system by eliminating the need for amplifiers with a high dynamic range, high-speed sampling, additional storage, or synchronization hardware for electrophysiological signal acquisition. It is expected to enable a broader range of applications of simultaneous fMRI and electrophysiology in animals and humans.

Exploring the relative efficacy of motion artefact correction techniques for EEG data acquired during simultaneous fMRI

Simultaneous EEG‐fMRI allows multiparametric characterisation of brain function, in principle enabling a more complete understanding of brain responses; unfortunately the hostile MRI environment severely reduces EEG data quality. Simply eliminating data segments containing gross motion artefacts [MAs] (generated by movement of the EEG system and head in the MRI scanner's static magnetic field) was previously believed sufficient. However recently the importance of removal of all MAs has been highlighted and new methods developed. A systematic comparison of the ability to remove MAs and retain underlying neuronal activity using different methods of MA detection and post‐processing algorithms is needed to guide the neuroscience community. Using a head phantom, we recorded MAs while simultaneously monitoring the motion using three different approaches: Reference Layer Artefact Subtraction (RLAS), Moiré Phase Tracker (MPT) markers and Wire Loop Motion Sensors (WLMS). These EEG recordings were combined with EEG responses to simple visual tasks acquired on a subject outside the MRI environment. MAs were then corrected using the motion information collected with each of the methods combined with different analysis pipelines. All tested methods retained the neuronal signal. However, often the MA was not removed sufficiently to allow accurate detection of the underlying neuronal signal. We show that the MA is best corrected using the RLAS combined with post‐processing using a multichannel, recursive least squares (M‐RLS) algorithm. This method needs to be developed further to enable practical utility; thus, WLMS combined with M‐RLS currently provides the best compromise between EEG data quality and practicalities of motion detection.

Adaptive optimal basis set for BCG artifact removal in simultaneous EEG-fMRI

Electroencephalography (EEG) signals recorded during simultaneous functional magnetic resonance imaging (fMRI) are contaminated by strong artifacts. Among these, the ballistocardiographic (BCG) artifact is the most challenging, due to its complex spatio-temporal dynamics associated with ongoing cardiac activity. The presence of BCG residuals in EEG data may hide true, or generate spurious correlations between EEG and fMRI time-courses. Here, we propose an adaptive Optimal Basis Set (aOBS) method for BCG artifact removal. Our method is adaptive, as it can estimate the delay between cardiac activity and BCG occurrence on a beat-to-beat basis. The effective creation of an optimal basis set by principal component analysis (PCA) is therefore ensured by a more accurate alignment of BCG occurrences. Furthermore, aOBS can automatically estimate which components produced by PCA are likely to be BCG artifact-related and therefore need to be removed. The aOBS performance was evaluated on high-density EEG data acquired with simultaneous fMRI in healthy subjects during visual stimulation. As aOBS enables effective reduction of BCG residuals while preserving brain signals, we suggest it may find wide application in simultaneous EEG-fMRI studies.

Electrophysiological Source Imaging: A Noninvasive Window to Brain Dynamics

Brain activity and connectivity are distributed in the three-dimensional space and evolve in time. It is important to image brain dynamics with high spatial and temporal resolution. Electroencephalography (EEG) and magnetoencephalography (MEG) are noninvasive measurements associated with complex neural activations and interactions that encode brain functions. Electrophysiological source imaging estimates the underlying brain electrical sources from EEG and MEG measurements. It offers increasingly improved spatial resolution and intrinsically high temporal resolution for imaging large-scale brain activity and connectivity on a wide range of timescales. Integration of electrophysiological source imaging and functional magnetic resonance imaging could further enhance spatiotemporal resolution and specificity to an extent that is not attainable with either technique alone. We review methodological developments in electrophysiological source imaging over the past three decades and envision its future advancement into a powerful functional neuroimaging technology for basic and clinical neuroscience applications.

Exploring the origins of EEG motion artefacts during simultaneous fMRI acquisition: Implications for motion artefact correction

Motion artefacts (MAs) are induced within EEG data collected simultaneously with fMRI when the subject's head rotates relative to the magnetic field. The effects of these artefacts have generally been ameliorated by removing periods of data during which large artefact voltages appear in the EEG traces. However, even when combined with other standard post-processing methods, this strategy does not remove smaller MAs which can dominate the neuronal signals of interest. A number of methods are therefore being developed to characterise the MA by measuring reference signals and then using these in artefact correction. These methods generally assume that the head and EEG cap, plus any attached sensors, form a rigid body which can be characterised by a standard set of six motion parameters. Here we investigate the motion of the head/EEG cap system to provide a better understanding of MAs. We focus on the reference layer artefact subtraction (RLAS) approach, as this allows measurement of a separate reference signal for each electrode that is being used to measure brain activity.

Through a series of experiments on phantoms and subjects, we find that movement of the EEG cap relative to the phantom and skin on the forehead is relatively small and that this non-rigid body movement does not appear to cause considerable discrepancy in artefacts between the scalp and reference signals. However, differences in the amplitude of these signals is observed which may be due to differences in geometry of the system from which the reference signals are measured compared with the brain signals. In addition, we find that there is non-rigid body movement of the skull and skin which produces an additional MA component for a head shake, which is not present for a head nod. This results in a large discrepancy in the amplitude and temporal profile of the MA measured on the scalp and reference layer, reducing the efficacy of MA correction based on the reference signals.

Together our data suggest that the efficacy of the correction of MA using any reference-based system is likely to differ for different types of head movement with head shake being the hardest to correct. This provides new information to inform the development of hardware and post-processing methods for removing MAs from EEG data acquired simultaneously with fMRI data.

EEG-Informed fMRI: A Review of Data Analysis Methods

The simultaneous acquisition of electroencephalography (EEG) with functional magnetic resonance imaging (fMRI) is a very promising non-invasive technique for the study of human brain function. Despite continuous improvements, it remains a challenging technique, and a standard methodology for data analysis is yet to be established. Here we review the methodologies that are currently available to address the challenges at each step of the data analysis pipeline. We start by surveying methods for pre-processing both EEG and fMRI data. On the EEG side, we focus on the correction for several MR-induced artifacts, particularly the gradient and pulse artifacts, as well as other sources of EEG artifacts. On the fMRI side, we consider image artifacts induced by the presence of EEG hardware inside the MR scanner, and the contamination of the fMRI signal by physiological noise of non-neuronal origin, including a review of several approaches to model and remove it. We then provide an overview of the approaches specifically employed for the integration of EEG and fMRI when using EEG to predict the blood oxygenation level dependent (BOLD) fMRI signal, the so-called EEG-informed fMRI integration strategy, the most commonly used strategy in EEG-fMRI research. Finally, we systematically review methods used for the extraction of EEG features reflecting neuronal phenomena of interest.

EEG synchronization measures predict epilepsy-related BOLD-fMRI fluctuations better than commonly used univariate metrics

OBJECTIVE

We hypothesize that the hypersynchronization associated with epileptic activity is best described by EEG synchronization measures, and propose to use these as predictors of epilepsy-related BOLD fluctuations.

METHODS

We computed the phase synchronization index (PSI) and global field synchronization (GFS), within two frequency bands, a broadband (1-45 Hz) and a narrower band focused on the presence of epileptic activity (3-10 Hz). The associated epileptic networks were compared with those obtained using conventional unitary regressors and two power-weighted metrics (total power and root mean square frequency), on nine simultaneous EEG-fMRI datasets from four epilepsy patients, exhibiting inter-ictal epileptiform discharges (IEDs).

RESULTS

The average PSI within 3-10 Hz achieved the best performance across several measures reflecting reliability in all datasets. The results were cross-validated through electrical source imaging of the IEDs. The applicability of PSI when no IEDs are recorded on the EEG was evaluated on three additional patients, yielding partially plausible networks in all cases.

CONCLUSIONS

Epileptic networks can be mapped based on the EEG PSI metric within an IED-specific frequency band, performing better than commonly used EEG metrics.

SIGNIFICANCE

This is the first study to investigate EEG synchronization measures as potential predictors of epilepsy-related BOLD fluctuations.

Online Reduction of Artifacts in EEG of Simultaneous EEG-fMRI Using Reference Layer Adaptive Filtering (RLAF)

Simultaneous electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) allow us to study the active human brain from two perspectives concurrently. Signal processing based artifact reduction techniques are mandatory for this, however, to obtain reasonable EEG quality in simultaneous EEG-fMRI. Current artifact reduction techniques like average artifact subtraction (AAS), typically become less effective when artifact reduction has to be performed on-the-fly. We thus present and evaluate a new technique to improve EEG quality online. This technique adds up with online AAS and combines a prototype EEG-cap for reference recordings of artifacts, with online adaptive filtering and is named reference layer adaptive filtering (RLAF). We found online AAS + RLAF to be highly effective in improving EEG quality. Online AAS + RLAF outperformed online AAS and did so in particular online in terms of the chosen performance metrics, these being specifically alpha rhythm amplitude ratio between closed and opened eyes (3-45% improvement), signal-to-noise-ratio of visual evoked potentials (VEP) (25-63% improvement), and VEPs variability (16-44% improvement). Further, we found that EEG quality after online AAS + RLAF is occasionally even comparable with the offline variant of AAS at a 3T MRI scanner. In conclusion RLAF is a very effective add-on tool to enable high quality EEG in simultaneous EEG-fMRI experiments, even when online artifact reduction is necessary.

A Channel Rejection Method for Attenuating Motion-Related Artifacts in EEG Recordings during Walking

Recording scalp electroencephalography (EEG) during human motion can introduce motion artifacts. Repetitive head movements can generate artifact patterns across scalp EEG sensors. There are many methods for identifying and rejecting bad channels and independent components from EEG datasets, but there is a lack of methods dedicated to evaluate specific intra-channel amplitude patterns for identifying motion-related artifacts. In this study, we proposed a template correlation rejection (TCR) as a novel method for identifying and rejecting EEG channels and independent components carrying motion-related artifacts. We recorded EEG data from 10 subjects during treadmill walking. The template correlation rejection method consists of creating templates of amplitude patterns and determining the fraction of total epochs presenting relevant correlation to the template. For EEG channels, the template correlation rejection removed channels presenting the majority of epochs (>75%) correlated to the template, and presenting pronounced amplitude in comparison to all recorded channels. For independent components, the template correlation rejection removed components presenting the majority of epochs correlated to the template. Evaluation of scalp maps and power spectra confirmed low neural content for the rejected components. We found that channels identified for rejection contained ~60% higher delta power, and had spectral properties locked to the gait phases. After rejecting the identified channels and running independent component analysis on the EEG datasets, the proposed method identified 4.3 ± 1.8 independent components (out of 198 ± 12) with substantive motion-related artifacts. These results indicate that template correlation rejection is an effective method for rejecting EEG channels contaminated with motion-related artifact during human locomotion.

Dynamic spatiotemporal variability of alpha-BOLD relationships during the resting-state and task-evoked responses

Accurate characterization of the spatiotemporal relationship between two of the most prominent neuroimaging measures of neuronal activity, the 8-13Hz, occipito-parietal EEG alpha oscillation and the BOLD fMRI signal, must encompass the intrinsically dynamic nature of both alpha power and brain function. Here, during the eyes-open resting state, we use a 16s sliding-window analysis and demonstrate that the mean spatial network of dynamic alpha-BOLD correlations is highly comparable to the static network calculated over six minutes. However, alpha-BOLD correlations showed substantial spatiotemporal variability within-subjects and passed through many different configurations such that the static network was fully represented in only ~10% of 16s epochs, with visual and parietal regions (coherent on average) often opposingly correlated with each other or with alpha. We find that the common assumption of static-alpha BOLD correlations greatly oversimplifies temporal variation in brain network dynamics. Fluctuations in alpha-BOLD coupling significantly depended upon the instantaneous amplitude of alpha power, and primary and lateral visual areas were most strongly negatively correlated with alpha during different alpha power states, possibly suggesting the action of multiple alpha mechanisms. Dynamic alpha-BOLD correlations could not be explained by eye-blinks/movements, head motion or non-neuronal physiological variability. Individual's mean alpha power and frequency were found to contribute to between-subject variability in alpha-BOLD correlations. Additionally, application to a visual stimulation dataset showed that dynamic alpha-BOLD correlations provided functional information pertaining to the brain's response to stimulation by exhibiting spatiotemporal fluctuations related to variability in the trial-by-trial BOLD response magnitude. Significantly weaker visual alpha-BOLD correlations were found both preceding and following small amplitude BOLD response trials compared to large response trials.

Prediction of advertisement preference by fusing EEG response and sentiment analysis

This paper presents a novel approach to predict rating of video-advertisements based on a multimodal framework combining physiological analysis of the user and global sentiment-rating available on the internet. We have fused Electroencephalogram (EEG) waves of user and corresponding global textual comments of the video to understand the user's preference more precisely. In our framework, the users were asked to watch the video-advertisement and simultaneously EEG signals were recorded. Valence scores were obtained using self-report for each video. A higher valence corresponds to intrinsic attractiveness of the user. Furthermore, the multimedia data that comprised of the comments posted by global viewers, were retrieved and processed using Natural Language Processing (NLP) technique for sentiment analysis. Textual contents from review comments were analyzed to obtain a score to understand sentiment nature of the video. A regression technique based on Random forest was used to predict the rating of an advertisement using EEG data. Finally, EEG based rating is combined with NLP-based sentiment score to improve the overall prediction. The study was carried out using 15 video clips of advertisements available online. Twenty five participants were involved in our study to analyze our proposed system. The results are encouraging and these suggest that the proposed multimodal approach can achieve lower RMSE in rating prediction as compared to the prediction using only EEG data.

Reference layer adaptive filtering (RLAF) for EEG artifact reduction in simultaneous EEG-fMRI

OBJECTIVE

Simultaneous electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) combines advantages of both methods, namely high temporal resolution of EEG and high spatial resolution of fMRI. However, EEG quality is limited due to severe artifacts caused by fMRI scanners.

APPROACH

To improve EEG data quality substantially, we introduce methods that use a reusable reference layer EEG cap prototype in combination with adaptive filtering. The first method, reference layer adaptive filtering (RLAF), uses adaptive filtering with reference layer artifact data to optimize artifact subtraction from EEG. In the second method, multi band reference layer adaptive filtering (MBRLAF), adaptive filtering is performed on bandwidth limited sub-bands of the EEG and the reference channels.

MAIN RESULTS

The results suggests that RLAF outperforms the baseline method, average artifact subtraction, in all settings and also its direct predecessor, reference layer artifact subtraction (RLAS), in lower (<35 Hz) frequency ranges. MBRLAF is computationally more demanding than RLAF, but highly effective in all EEG frequency ranges. Effectivity is determined by visual inspection, as well as root-mean-square voltage reduction and power reduction of EEG provided that physiological EEG components such as occipital EEG alpha power and visual evoked potentials (VEP) are preserved. We demonstrate that both, RLAF and MBRLAF, improve VEP quality. For that, we calculate the mean-squared-distance of single trial VEP to the mean VEP and estimate single trial VEP classification accuracies. We found that the average mean-squared-distance is lowest and the average classification accuracy is highest after MBLAF. RLAF was second best.

SIGNIFICANCE

In conclusion, the results suggests that RLAF and MBRLAF are potentially very effective in improving EEG quality of simultaneous EEG-fMRI. Highlights We present a new and reusable reference layer cap prototype for simultaneous EEG-fMRI We introduce new algorithms for reducing EEG artifacts due to simultaneous fMRI The algorithms combine a reference layer and adaptive filtering Several evaluation criteria suggest superior effectivity in terms of artifact reduction We demonstrate that physiological EEG components are preserved.

Effectiveness of Reference Signal-Based Methods for Removal of EEG Artifacts Due to Subtle Movements During fMRI Scanning

OBJECTIVE

Subtle motion of an epileptic patient examined with co-registered EEG and functional MRI (EEG-fMRI) may often lead to spurious fMRI activation patterns when true epileptic spikes are contaminated with motion artefacts. In recent years, methods relying on reference signals for correcting these subtle movements in the EEG have emerged. In this study, the performance of two reference-based devices are compared to the template-based method with regard to their ability to remove movement-related artifacts in EEG measured during scanning.

METHODS

Measurements were performed with a novel double layer cap consisting of 29 EEG and 29 reference electrodes, and with a current loop cap consisting of 60 electrodes and three current loop wires attached to the cap. EEG was acquired inside the scanner during resting state, as well as when the subject was performing a cued movement task. For the double layer cap recordings, newly developed artifact removal algorithms are introduced and both reference signal-based methods are compared to a template-based correction method.

RESULTS

The BCG artifacts occurring at resting state could be removed successfully by both the reference signal-based methods as well as by the template-based method. However, the reference signal-based methods were also capable of removing EEG artifacts induced by subtle movements, whereas the template-based method failed to remove these artifacts.

CONCLUSION

Reference signal-based methods enable to correct for artifacts due to subtle movements, which are not removed by commonly used template-based removal algorithms.

SIGNIFICANCE

Sensitivity of EEG-fMRI analysis in patients with focal epilepsy is improved by avoiding erroneous detections of subtle movements as epileptic spikes in the EEG.

EEG-fMRI Gradient Artifact Correction by Multiple Motion-Related Templates

OBJECTIVES

In simultaneous electroencephalography (EEG) and functional magnetic resonance imaging (fMRI), artifacts on the EEG arise from the switching of magnetic field gradients in the MR scanner. These artifacts depend on head position, and are, therefore, difficult to remove in the presence of subject motion. In this study, gradient artifacts are modeled by multiple templates extracted from externally recorded motion information.

METHODS

Gradient artifact correction was performed in EEG-fMRI recordings by estimating artifactual templates modulated by slowly varying splines, as well as head position information. The EEG signal quality was then compared following two common methods: averaged artifact subtraction (AAS) and optimal basis sets (OBS).

RESULTS

Artifact correction using multiple templates estimated from splines or motion time courses outperformed the existing AAS and OBS approaches, as quantified by root-mean-square power across gradient epochs. Improvements were mostly seen in posterior EEG channels, where most of the residual artifacts are seen following the AAS and OBS methods. Residual spectral power was comparable to that of EEG signals recorded without fMRI scanning.

CONCLUSION

Gradient artifacts can be well modeled by multiple templates estimated from head position information, resulting in an effective artifact removal.

SIGNIFICANCE

This method can facilitate EEG-fMRI of uncooperative subjects in whom motion is inevitable, for example, to investigate high-frequency EEG activity in which gradient artifacts are particularly prominent.

Dual array EEG-fMRI: An approach for motion artifact suppression in EEG recorded simultaneously with fMRI

OBJECTIVE

Although simultaneous recording of EEG and MRI has gained increasing popularity in recent years, the extent of its clinical use remains limited by various technical challenges. Motion interference is one of the major challenges in EEG-fMRI. Here we present an approach which reduces its impact with the aid of an MR compatible dual-array EEG (daEEG) in which the EEG itself is used both as a brain signal recorder and a motion sensor.

METHODS

We implemented two arrays of EEG electrodes organized into two sets of nearly orthogonally intersecting wire bundles. The EEG was recorded using referential amplifiers inside a 3T MR-scanner. Virtual bipolar measurements were taken both along bundles (creating a small wire loop and therefore minimizing artifact) and across bundles (creating a large wire loop and therefore maximizing artifact). Independent component analysis (ICA) was applied. The resulting ICA components were classified into brain signal and noise using three criteria: 1) degree of two-dimensional spatial correlation between ICA coefficients along bundles and across bundles; 2) amplitude along bundles vs. across bundles; 3) correlation with ECG. The components which passed the criteria set were transformed back to the channel space. Motion artifact suppression and the ability to detect interictal epileptic spikes following daEEG and Optimal Basis Set (OBS) procedures were compared in 10 patients with epilepsy.

RESULTS

The SNR achieved by daEEG was 11.05±3.10 and by OBS was 8.25±1.01 (p<0.00001). In 9 of 10 patients, more spikes were detected after daEEG than after OBS (p<0.05).

SIGNIFICANCE

daEEG improves signal quality in EEG-fMRI recordings, expanding its clinical and research potential.

Gradient Artefact Correction and Evaluation of the EEG Recorded Simultaneously with fMRI Data Using Optimised Moving-Average

Over the past years, coregistered EEG-fMRI has emerged as a powerful tool for neurocognitive research and correlated studies, mainly because of the possibility of integrating the high temporal resolution of the EEG with the high spatial resolution of fMRI. However, additional work remains to be done in order to improve the quality of the EEG signal recorded simultaneously with fMRI data, in particular regarding the occurrence of the gradient artefact. We devised and presented in this paper a novel approach for gradient artefact correction based upon optimised moving-average filtering (OMA). OMA makes use of the iterative application of a moving-average filter, which allows estimation and cancellation of the gradient artefact by integration. Additionally, OMA is capable of performing the attenuation of the periodic artefact activity without accurate information about MRI triggers. By using our proposed approach, it is possible to achieve a better balance than the slice-average subtraction as performed by the established AAS method, regarding EEG signal preservation together with effective suppression of the gradient artefact. Since the stochastic nature of the EEG signal complicates the assessment of EEG preservation after application of the gradient artefact correction, we also propose a simple and effective method to account for it.

Marker-based ballistocardiographic artifact correction improves spike identification in EEG-fMRI of focal epilepsy patients

OBJECTIVES

Ballistocardiographic (BCG) artifacts resemble interictal epileptic discharges (IEDs) and can lead to incorrect IED identification in EEG-fMRI. This study investigates IEDs marked in EEGs corrected using information from a moiré phase tracking (MPT) marker.

METHODS

EEG-fMRI from 18 patients was processed with conventional methods for BCG removal, while 9 patients used a MPT marker. IEDs were marked first without ECG information. In a second review, suspicious IEDs synchronous with the BCG were discarded. After each review, an event-related fMRI analysis was performed on the marked IEDs.

RESULTS

No difference was found in the proportion of suspicious IEDs in the 2 patient groups. However, the distribution of IED timings was significantly related to the cardiac cycle in 11 of 18 patients recorded without MPT marker, but only 2 of 9 patients with marker. In patients recorded without marker, failing to discard suspicious IEDs led to more inaccurate fMRI maps and more distant activations.

CONCLUSIONS

BCG artifact correction based on MPT recordings allowed a more straightforward identification of IEDs that did not require ECG information in the large majority of patients.

SIGNIFICANCE

Marker-based ballistocardiographic artifact correction greatly facilitates the study of the generators of interictal discharges with EEG-fMRI.

Towards motion insensitive EEG-fMRI: Correcting motion-induced voltages and gradient artefact instability in EEG using an fMRI prospective motion correction (PMC) system

The simultaneous acquisition of electroencephalography and functional magnetic resonance imaging (EEG-fMRI) is a multimodal technique extensively applied for mapping the human brain. However, the quality of EEG data obtained within the MRI environment is strongly affected by subject motion due to the induction of voltages in addition to artefacts caused by the scanning gradients and the heartbeat. This has limited its application in populations such as paediatric patients or to study epileptic seizure onset. Recent work has used a Moiré-phase grating and a MR-compatible camera to prospectively update image acquisition and improve fMRI quality (prospective motion correction: PMC). In this study, we use this technology to retrospectively reduce the spurious voltages induced by motion in the EEG data acquired inside the MRI scanner, with and without fMRI acquisitions. This was achieved by modelling induced voltages from the tracking system motion parameters; position and angles, their first derivative (velocities) and the velocity squared. This model was used to remove the voltages related to the detected motion via a linear regression. Since EEG quality during fMRI relies on a temporally stable gradient artefact (GA) template (calculated from averaging EEG epochs matched to scan volume or slice acquisition), this was evaluated in sessions both with and without motion contamination, and with and without PMC. We demonstrate that our approach is capable of significantly reducing motion-related artefact with a magnitude of up to 10mm of translation, 6° of rotation and velocities of 50mm/s, while preserving physiological information. We also demonstrate that the EEG-GA variance is not increased by the gradient direction changes associated with PMC. Provided a scan slice-based GA template is used (rather than a scan volume GA template) we demonstrate that EEG variance during motion can be supressed towards levels found when subjects are still. In summary, we show that PMC can be used to dramatically improve EEG quality during large amplitude movements, while benefiting from previously reported improvements in fMRI quality, and does not affect EEG data quality in the absence of large amplitude movements.