The BOLD correlates of the visual P1 and N1 in single-trial analysis of simultaneous EEG-fMRI recordings during a spatial detection task

Mothers' and fathers' neural responses toward gender-stereotype violations by their own children

Gender stereotypes facilitate people's processing of social information by providing assumptions about expected behaviors and preferences. When gendered expectations are violated, people often respond negatively, both on a behavioral and neural level. Little is known about the impact of family kinship on the behavioral and neural reactions to gender-stereotype violations. Therefore, we examined whether parents show different responses when gender stereotypes are violated by their own children vs unknown children. The sample comprised 74 Dutch families with a father (Mage = 37.54), mother (Mage = 35.83), son, and daughter aged 3-6 years. Electroencephalography measurements were obtained while parents viewed pictures of their own and unknown children paired with toy or problem behavior words that violated or confirmed gender stereotypes. In half of the trials, parents evaluated the appropriateness of toy-gender and behavior-gender combinations. Parents showed stronger late positive potential amplitudes toward gender stereotype-violating behaviors by own children compared to unknown children. Moreover, parents' P1 responses toward gender stereotype-violating child behaviors were stronger for boys than for girls and for parents who evaluated gender-stereotype violations as less appropriate than gender-stereotype confirmations. These findings indicated that gender-stereotype violations by parents' own children are particularly salient and viewed as less appropriate than gender-stereotype confirmations.

Relationship between function and structure in the visual cortex in healthy individuals and in patients with severe mental disorders

Patients with schizophrenia spectrum disorders (SCZ_spect) and bipolar disorders (BD) show impaired function in the primary visual cortex (V1), indicated by altered visual evoked potential (VEP). While the neural substrate for altered VEP in these patients remains elusive, altered V1 structure may play a role. One previous study found a positive relationship between the amplitude of the P100 component of the VEP and V1 surface area, but not V1 thickness, in a small sample of healthy individuals. Here, we aimed to replicate these findings in a larger healthy control (HC) sample (n = 307) and to examine the same relationship in patients with SCZ_spect (n = 30) or BD (n = 45). We also compared the mean P100 amplitude, V1 surface area and V1 thickness between controls and patients and found no significant group differences. In HC only, we found a significant positive P100-V1 surface area association, while there were no significant P100-V1 thickness relationships in HC, SCZ_spect or BD. Together, our results confirm previous findings of a positive P100-V1 surface area association in HC, whereas larger patient samples are needed to further clarify the function-structure relationship in V1 in SCZ_spect and BD.

Hierarchy of Intra- and Cross-modal Redundancy Gains in Visuo-tactile Search: Evidence from the Posterior Contralateral Negativity

Redundant combination of target features from separable dimensions can expedite visual search. The dimension-weighting account explains these "redundancy gains" by assuming that the attention-guiding priority map integrates the feature-contrast signals generated by targets within the respective dimensions. The present study investigated whether this hierarchical architecture is sufficient to explain the gains accruing from redundant targets defined by features in different modalities, or whether an additional level of modality-specific priority coding is necessary, as postulated by the modality-weighting account (MWA). To address this, we had observers perform a visuo-tactile search task in which targets popped out by a visual feature (color or shape) or a tactile feature (vibro-tactile frequency) as well as any combination of these features. The RT gains turned out larger for visuo-tactile versus visual redundant targets, as predicted by the MWA. In addition, we analyzed two lateralized event-related EEG components: the posterior (PCN) and central (CCN) contralateral negativities, which are associated with visual and tactile attentional selection, respectively. The CCN proved to be a stable somatosensory component, unaffected by cross-modal redundancies. In contrast, the PCN was sensitive to cross-modal redundancies, evidenced by earlier onsets and higher amplitudes, which could not be explained by linear superposition of the earlier CCN onto the later PCN. Moreover, linear mixed-effect modeling of the PCN amplitude and timing parameters accounted for approximately 25% of the behavioral RT variance. Together, these behavioral and PCN effects support the hierarchy of priority-signal computation assumed by the MWA.

The complexity of simple counting: ERP findings reveal early perceptual and late numerical processes in different arrangements

The counting process can only be fully understood when taking into account the visual characteristics of the sets counted. Comparing behavioral data as well as event-related brain potentials (ERPs) evoked by different task-irrelevant arrangements of dots during an exact enumeration task, we aimed to investigate the effect of illusory contour detection on the counting process while other grouping cues like proximity were controlled and dot sparsity did not provide a cue to the numerosity of sets. Adult participants (N = 37) enumerated dots (8–12) in irregular and two different types of regular arrangements which differed in the shape of their illusory dot lattices. Enumeration speed was affected by both arrangement and magnitude. The type of arrangement influenced an early ERP negativity peaking at about 270 ms after stimulus onset, whereas numerosity only affected later ERP components (> 300 ms). We also observed that without perceptual cues, magnitude was constructed at a later stage of cognitive processing. We suggest that chunking is a prerequisite for more fluent counting which influences automatic processing (< 300 ms) during enumeration. We conclude that the procedure of exact enumeration depends on the interaction of several perceptual and numerical processes that are influenced by magnitude and arrangement.

Investigating neural dynamics in autism spectrum conditions outside of the laboratory using mobile electroencephalography

There is currently a paucity of neuroscientific data recorded from more severely affected individuals with autism spectrum conditions (ASC). Enabling data collection to take place in a more familiar environment, that is, at home, may increase access to research participation in this group. Here, we present a new accessible method of studying brain activity of autistic individuals outside the laboratory in their home environment, using mobile electroencephalography (EEG) technology. The primary aim of the present study was to test the feasibility of acquiring good quality EEG data from autistic children at home, assessed via a set of objective data quality metrics, and to develop a list of practical guidelines on how to successfully conduct an EEG experiment in such a naturalistic setting based directly upon participants' views. To demonstrate the utility of this method, we evaluated the EEG signal quality recorded from 69 children with ASC at home using a gel-based Eego Sports mobile EEG system. Five key indicators of data quality were assessed. Our results demonstrate that it is possible to record high quality EEG signal from children with ASC at home, generating data that could address a number of research questions. A user experience survey identified areas of good practice, which researchers should take into consideration when designing mobile EEG studies aiming to acquire data from children with ASC at a home environment.

During natural viewing, neural processing of visual targets continues throughout saccades

Relatively little is known about visual processing during free-viewing visual search in realistic dynamic environments. Free-viewing is characterized by frequent saccades. During saccades, visual processing is thought to be suppressed, yet we know that the presaccadic visual content can modulate postsaccadic processing. To better understand these processes in a realistic setting, we study here saccades and neural responses elicited by the appearance of visual targets in a realistic virtual environment. While subjects were being driven through a 3D virtual town, they were asked to discriminate between targets that appear on the road. Using a system identification approach, we separated overlapping and correlated activity evoked by visual targets, saccades, and button presses. We found that the presence of a target enhances early occipital as well as late frontocentral saccade-related responses. The earlier potential, shortly after 125 ms post-saccade onset, was enhanced for targets that appeared in the peripheral vision as compared to the central vision, suggesting that fast peripheral processing initiated before saccade onset. The later potential, at 195 ms post-saccade onset, was strongly modulated by the visibility of the target. Together these results suggest that, during natural viewing, neural processing of the presaccadic visual stimulus continues throughout the saccade, apparently unencumbered by saccadic suppression.

When Is Simultaneous Recording Necessary? A Guide for Researchers Considering Combined EEG-fMRI

Electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) provide non-invasive measures of brain activity at varying spatial and temporal scales, offering different views on brain function for both clinical and experimental applications. Simultaneous recording of these measures attempts to maximize the respective strengths of each method, while compensating for their weaknesses. However, combined recording is not necessary to address all research questions of interest, and experiments may have greater statistical power to detect effects by maximizing the signal-to-noise ratio in separate recording sessions. While several existing papers discuss the reasons for or against combined recording, this article aims to synthesize these arguments into a flow chart of questions that researchers can consider when deciding whether to record EEG and fMRI separately or simultaneously. Given the potential advantages of simultaneous EEG-fMRI, the aim is to provide an initial overview of the most important concepts and to direct readers to relevant literature that will aid them in this decision.

Data-driven beamforming technique to attenuate ballistocardiogram artefacts in electroencephalography-functional magnetic resonance imaging without detecting cardiac pulses in electrocardiography recordings

Simultaneous recording of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) is a very promising non‐invasive neuroimaging technique. However, EEG data obtained from the simultaneous EEG–fMRI are strongly influenced by MRI‐related artefacts, namely gradient artefacts (GA) and ballistocardiogram (BCG) artefacts. When compared to the GA correction, the BCG correction is more challenging to remove due to its inherent variabilities and dynamic changes over time. The standard BCG correction (i.e., average artefact subtraction [AAS]), require detecting cardiac pulses from simultaneous electrocardiography (ECG) recording. However, ECG signals are also distorted and will become problematic for detecting reliable cardiac peaks. In this study, we focused on a beamforming spatial filtering technique to attenuate all unwanted source activities outside of the brain. Specifically, we applied the beamforming technique to attenuate the BCG artefact in EEG–fMRI, and also to recover meaningful task‐based neural signals during an attentional network task (ANT) which required participants to identify visual cues and respond accurately. We analysed EEG–fMRI data in 20 healthy participants during the ANT, and compared four different BCG corrections (non‐BCG corrected, AAS BCG corrected, beamforming + AAS BCG corrected, beamforming BCG corrected). We demonstrated that the beamforming approach did not only significantly reduce the BCG artefacts, but also significantly recovered the expected task‐based brain activity when compared to the standard AAS correction. This data‐driven beamforming technique appears promising especially for longer data acquisition of sleep and resting EEG–fMRI. Our findings extend previous work regarding the recovery of meaningful EEG signals by an optimized suppression of MRI‐related artefacts.

Blind Visualization of Task-Related Networks From Visual Oddball Simultaneous EEG-fMRI Data: Spectral or Spatiospectral Model?

Various disease conditions can alter EEG event-related responses and fMRI-BOLD signals. We hypothesized that event-related responses and their clinical alterations are imprinted in the EEG spectral domain as event-related (spatio)spectral patterns (ERSPat). We tested four EEG-fMRI fusion models utilizing EEG power spectra fluctuations (i.e., absolute spectral model - ASM; relative spectral model - RSM; absolute spatiospectral model - ASSM; and relative spatiospectral model - RSSM) for fully automated and blind visualization of task-related neural networks. Two (spatio)spectral patterns (high δ 4 band and low β 1 band) demonstrated significant negative linear relationship (p FWE < 0.05) to the frequent stimulus and three patterns (two low δ 2 and δ 3 bands, and narrow θ 1 band) demonstrated significant positive relationship (p < 0.05) to the target stimulus. These patterns were identified as ERSPats. EEG-fMRI F-map of each δ 4 model showed strong engagement of insula, cuneus, precuneus, basal ganglia, sensory-motor, motor and dorsal part of fronto-parietal control (FPCN) networks with fast HRF peak and noticeable trough. ASM and RSSM emphasized spatial statistics, and the relative power amplified the relationship to the frequent stimulus. For the δ 4 model, we detected a reduced HRF peak amplitude and a magnified HRF trough amplitude in the frontal part of the FPCN, default mode network (DMN) and in the frontal white matter. The frequent-related β 1 patterns visualized less significant and distinct suprathreshold spatial associations. Each θ 1 model showed strong involvement of lateralized left-sided sensory-motor and motor networks with simultaneous basal ganglia co-activations and reduced HRF peak and amplified HRF trough in the frontal part of the FPCN and DMN. The ASM θ 1 model preserved target-related EEG-fMRI associations in the dorsal part of the FPCN. For δ 4, β 1, and θ 1 bands, all models provided high local F-statistics in expected regions. The most robust EEG-fMRI associations were observed for ASM and RSSM.

Priming of grasp affordance in an ambiguous object: evidence from ERPs, source localization, and motion tracking

Object affordance refers to possibilities to interact with the objects in our environment, such as grasping. Previous research shows that objects that afford an action activate the motor system and attract attention, for example they elicit an enhanced frontal negativity and posterior P1 in the event-related potential. An effect on posterior N1 is discussed. However, previous findings might have resulted from physical differences between affording and non-affording stimuli, rather than affordance per se. Here we replicated the frontal negativity and posterior P1 effects and further explored the posterior N1 in affordance processing under constant visual input. An ambiguous target was primed either with an affording (pencils) or non-affording (trees) context. Although physically always identical, the target elicited an enhanced frontal negativity and posterior P1 in the pencil prime condition. Posterior N1 was reduced and grip aperture in a grasping task was smaller in the affording context. Source localization revealed stronger activation in occipital and parietal regions for targets in pencil versus tree prime trials. Thus, we successfully show that an ambiguous object primed with an affording context is processed differently than when primed with a non-affording context. This could be related to the ambiguous object acquiring a potential for action through priming.

Attentional bias during emotional processing: Behavioral and electrophysiological evidence from an Emotional Flanker Task

Threatening stimuli seem to capture attention more swiftly than neutral stimuli. This attention bias has been observed under different experimental conditions and with different types of stimuli. It remains unclear whether this adaptive behaviour reflects the function of automatic or controlled attention mechanisms. Additionally, the spatiotemporal dynamics of its neural correlates are largely unknown. The present study investigates these issues using an Emotional Flanker Task synchronized with EEG recordings. A group of 32 healthy participants saw response-relevant images (emotional scenes from IAPS or line drawings of objects) flanked by response-irrelevant distracters (i.e., emotional scenes flanked by line drawings or vice versa). We assessed behavioural and ERP responses drawn from four task conditions (Threat-Central, Neutral-Central, Threat-Peripheral, and Neutral-Peripheral) and subjected these responses to repeated-measures ANOVA models. When presented as response-relevant targets, threatening images attracted faster and more accurate responses. They did not affect response accuracy to targets when presented as response-irrelevant flankers. However, response times were significantly slower when threatening images flanked objects than when neutral images were shown as flankers. This result replicated the well-known Emotional Flanker Effect. Behavioural responses to response-relevant threatening targets were accompanied by significant modulations of ERP activity across all time-windows and regions of interest and displayed some meaningful correlations. The Emotional Flanker Effect was accompanied by a modulation over parietal and central-parietal regions within a time-window between 550-690ms. Such a modulation suggests that the attentional disruption to targets caused by response-irrelevant threatening flankers appears to reflect less neural resources available, which are seemingly drawn away by distracting threatening flankers. The observed spatiotemporal dynamics seem to concur with understanding of the important adaptive role attributed to threat-related attention bias.

Slow Resting State Fluctuations Enhance Neuronal and Behavioral Responses to Looming Sounds

We investigate both experimentally and using a computational model how the power of the electroencephalogram (EEG) recorded in human subjects tracks the presentation of sounds with acoustic intensities that increase exponentially (looming) or remain constant (flat). We focus on the link between this EEG tracking response, behavioral reaction times and the time scale of fluctuations in the resting state, which show considerable inter-subject variability. Looming sounds are shown to generally elicit a sustained power increase in the alpha and beta frequency bands. In contrast, flat sounds only elicit a transient upsurge at frequencies ranging from 7 to 45 Hz. Likewise, reaction times (RTs) in an audio-tactile task at different latencies from sound onset also present significant differences between sound types. RTs decrease with increasing looming intensities, i.e. as the sense of urgency increases, but remain constant with stationary flat intensities. We define the reaction time variation or "gain" during looming sound presentation, and show that higher RT gains are associated with stronger correlations between EEG power responses and sound intensity. Higher RT gain further entails higher relative power differences between loom and flat in the alpha and beta bands. The full-width-at-half-maximum of the autocorrelation function of the eyes-closed resting state EEG also increases with RT gain. The effects are topographically located over the central and frontal electrodes. A computational model reveals that the increase in stimulus-response correlation in subjects with slower resting state fluctuations is expected when EEG power fluctuations at each electrode and in a given band are viewed as simple coupled low-pass filtered noise processes jointly driven by the sound intensity. The model assumes that the strength of stimulus-power coupling is proportional to RT gain in different coupling scenarios, suggesting a mechanism by which slower resting state fluctuations enhance EEG response and shorten reaction times.

Inferring Macroscale Brain Dynamics via Fusion of Simultaneous EEG-fMRI

Advances in the instrumentation and signal processing for simultaneously acquired electroencephalography and functional magnetic resonance imaging (EEG-fMRI) have enabled new ways to observe the spatiotemporal neural dynamics of the human brain. Central to the utility of EEG-fMRI neuroimaging systems are the methods for fusing the two data streams, with machine learning playing a key role. These methods can be dichotomized into those that are symmetric and asymmetric in terms of how the two modalities inform the fusion. Studies using these methods have shown that fusion yields new insights into brain function that are not possible when each modality is acquired separately. As technology improves and methods for fusion become more sophisticated, the future of EEG-fMRI for noninvasive measurement of brain dynamics includes mesoscale mapping at ultrahigh magnetic resonance fields, targeted perturbation-based neuroimaging, and using deep learning to uncover nonlinear representations that link the electrophysiological and hemodynamic measurements.

Interhemispheric differences in P1 and N1 amplitude in EEG and MEG differ across older individuals with a concussion compared with age-matched controls

We studied the effects of mild traumatic brain injury (mTBI) in an aging population. We examined visual search with event-related potentials (ERPs) and event-related fields (ERF) for a lateral color singleton focusing on the P1 and N1 in each hemisphere. Forty participants (19 mTBI and 21 controls) aged 50 to 72 performed a visual search task, while we recorded their magnetoencephalogram (MEG) with simultaneous electroencephalogram (EEG). We compared visual ERPs and ERFs and associated cortical activity estimated using MEG source localization. Relative to matched controls, participants with an mTBI had a smaller P1 in the left hemisphere and a smaller N1 in the right hemisphere. Also, mTBI participants showed inversed activation patterns across the hemispheres during the N1 in MEG compared with controls. This is the first study to investigate the impact of mTBI on neuronal source activations during early visual processing in an aging population. Results showed that when aging individuals suffer from an mTBI, there are perturbations in the amplitude and hemispheric dominance patterns in the visual P1 and N1 responses that are visible for months to years following the injury. Our findings indicate that mTBI can lead to modifications of sensory and/or perceptual responses, suggesting possible adaptive functional reorganization following mTBI.

Neural association between non-verbal number sense and arithmetic fluency

Non‐verbal number sense has been shown to significantly correlate with arithmetic fluency. Accumulated behavioral evidence indicates that the cognitive mechanism relies on visual perception. However, few studies have investigated the neural mechanism underlying this association. Following the visual perception account, we hypothesized that there would be a neural association in occipital areas of the brain between non‐verbal number sense, arithmetic fluency, and visual perception. We analyzed event‐related potentials that are sensitive to neural responses while participants performed five cognitive tasks: simple addition, simple subtraction, numerosity comparison, figure matching, and character rhyming. The single‐trial ERP‐behavior correlation approach was used to enhance the statistical power. The results showed that the N1 component significantly correlated with reaction time at occipital electrodes on all tasks except for character rhyming. The N1 component for arithmetic fluency (simple addition and subtraction) and character rhyming correlated with the reaction time for numerosity comparison and figure matching. The results suggest that there are neural associations between arithmetic fluency, non‐verbal number sense, and visual perception in the occipital cortex, and that visual perception is the shared mechanism for both non‐verbal number sense and arithmetic fluency.

Effects of galvanic vestibular stimulation on resting state brain activity in patients with bilateral vestibulopathy

We examined the effect of galvanic vestibular stimulation (GVS) on resting state brain activity using fMRI (rs‐fMRI) in patients with bilateral vestibulopathy. Based on our previous findings, we hypothesized that GVS, which excites the vestibular nerve fibers, (a) increases functional connectivity in temporoparietal regions processing vestibular signals, and (b) alleviates abnormal visual–vestibular interaction. Rs‐fMRI of 26 patients and 26 age‐matched healthy control subjects was compared before and after GVS. The stimulation elicited a motion percept in all participants. Using different analyses (degree centrality, DC; fractional amplitude of low frequency fluctuations [fALFF] and seed‐based functional connectivity, FC), group comparisons revealed smaller rs‐fMRI in the right Rolandic operculum of patients. After GVS, rs‐fMRI increased in the right Rolandic operculum in both groups and in the patients' cerebellar Crus 1 which was related to vestibular hypofunction. GVS elicited a fALFF increase in the visual cortex of patients that was inversely correlated with the patients' rating of perceived dizziness. After GVS, FC between parietoinsular cortex and higher visual areas increased in healthy controls but not in patients. In conclusion, short‐term GVS is able to modulate rs‐fMRI in healthy controls and BV patients. GVS elicits an increase of the reduced rs‐fMRI in the patients' right Rolandic operculum, which may be an important contribution to restore the disturbed visual–vestibular interaction. The GVS‐induced changes in the cerebellum and the visual cortex were associated with lower dizziness‐related handicaps in patients, possibly reflecting beneficial neural plasticity that might subserve visual–vestibular compensation of deficient self‐motion perception.

Dynamics of the straight-ahead preference in human visual cortex

The objects located straight-ahead of the body are preferentially processed by the visual system. They are more rapidly detected and evoke stronger BOLD responses in early visual areas than elements that are retinotopically identical but located at eccentric spatial positions. To characterize the dynamics of the underlying neural mechanisms, we recorded in 29 subjects the EEG responses to peripheral targets differing solely by their locations with respect to the body. Straight-ahead stimuli led to stronger responses than eccentric stimuli for several components whose latencies ranged between 70 and 350 ms after stimulus onset. The earliest effects were found at 70 ms for a component that originates from occipital areas, the contralateral P1. To determine whether the straight-ahead direction affects primary visual cortex responses, we performed an additional experiment (n = 29) specifically designed to generate two robust components, the C1 and C2, whose cortical origins are constrained within areas V1, V2 and V3. Our analyses confirmed all the results of the first experiment and also revealed that the C2 amplitude between 130 and 160 ms after stimulus onset was significantly stronger for straight-ahead stimuli. A frequency analysis of the pre-stimulus baseline revealed that gaze-driven alterations in the visual hemi-field containing the straight-ahead direction were associated with a decrease in alpha power in the contralateral hemisphere, suggesting the implication of specific neural modulations before stimulus onset. Altogether, our EEG data demonstrate that preferential responses to the straight-ahead direction can be detected in the visual cortex as early as about 70 ms after stimulus onset.

Functional MRI and EEG Index Complementary Attentional Modulations

Functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) are two noninvasive methods commonly used to study neural mechanisms supporting visual attention in humans. Studies using these tools, which have complementary spatial and temporal resolutions, implicitly assume they index similar underlying neural modulations related to external stimulus and internal attentional manipulations. Accordingly, they are often used interchangeably for constraining understanding about the impact of bottom-up and top-down factors on neural modulations. To test this core assumption, we simultaneously manipulated bottom-up sensory inputs by varying stimulus contrast and top-down cognitive modulations by changing the focus of spatial attention. Each of the male and female subjects participated in both fMRI and EEG sessions performing the same experimental paradigm. We found categorically different patterns of attentional modulation on fMRI activity in early visual cortex and early stimulus-evoked potentials measured via EEG (e.g., the P1 component and steady-state visually-evoked potentials): fMRI activation scaled additively with attention, whereas evoked EEG components scaled multiplicatively with attention. However, across longer time scales, a contralateral negative-going potential and oscillatory EEG signals in the alpha band revealed additive attentional modulation patterns like those observed with fMRI. These results challenge prior assumptions that fMRI and early stimulus-evoked potentials measured with EEG can be interchangeably used to index the same neural mechanisms of attentional modulations at different spatiotemporal scales. Instead, fMRI measures of attentional modulations are more closely linked with later EEG components and alpha-band oscillations. Considered together, hemodynamic and electrophysiological signals can jointly constrain understanding of the neural mechanisms supporting cognition.SIGNIFICANCE STATEMENT fMRI and EEG have been used as tools to measure the location and timing of attentional modulations in visual cortex and are often used interchangeably for constraining computational models under the assumption that they index similar underlying neural processes. However, by varying attentional and stimulus parameters, we found differential patterns of attentional modulations of fMRI activity in early visual cortex and commonly used stimulus-evoked potentials measured via EEG. Instead, across longer time scales, a contralateral negative-going potential and EEG oscillations in the alpha band exhibited attentional modulations similar to those observed with fMRI. Together, these results suggest that different physiological processes assayed by these complementary techniques must be jointly considered when making inferences about the neural underpinnings of cognitive operations.

Altered neural dynamics in people who report spontaneous out of body experiences

It has been suggested that individual differences in cortical excitability leading to disruption of the timing and integration of sensory information processing may explain why some people have out of body experiences (OBE) in the absence of any known pathological or psychiatric condition. Here we recorded EEG from people who either had, or had not experienced an OBE in order to investigate the neural dynamics of OBE in the non-clinical population. A screening questionnaire was completed by 551 people, 24% of whom reported having at least one OBE. Participants who were free of any psychiatric or neurological diagnoses, including migraines, were invited to take part in subsequent EEG recording. EEG data were obtained from 19 people who had had an OBE and 20 who had not. Amplitude of the visual P1 ERP deflection and consistency of alpha-band phase locking were significantly reduced in the participants who had had an OBE. We did not find any group differences in resting state power or in visually induced gamma oscillations. These results provide support for the claim that cortical differences, particularly with respect to the timing of visual information processing, may give rise to OBE in clinically healthy individuals. To our knowledge, this study is the first to compare EEG variables obtained from people who have, and have not, had an OBE.

Exploring the advantages of multiband fMRI with simultaneous EEG to investigate coupling between gamma frequency neural activity and the BOLD response in humans

We established an optimal combination of EEG recording during sparse multiband (MB) fMRI that preserves high-resolution, whole-brain fMRI coverage while enabling broad-band EEG recordings which are uncorrupted by MRI gradient artefacts (GAs). We first determined the safety of simultaneous EEG recording during MB fMRI. Application of MB factor = 4 produced <1°C peak heating of electrode/hardware during 20 min of GE-EPI data acquisition. However, higher SAR sequences require specific safety testing, with greater heating observed using PCASL with MB factor = 4. Heating was greatest in the electrocardiogram channel, likely due to it possessing longest lead length. We investigated the effect of MB factor on the temporal signal-to-noise ratio for a range of GE-EPI sequences (varying MB factor and temporal interval between slice acquisitions). We found that, for our experimental purpose, the optimal acquisition was achieved with MB factor = 3, 3mm isotropic voxels, and 33 slices providing whole head coverage. This sequence afforded a 2.25 s duration quiet period (without GAs) in every 3 s TR. Using this sequence, we demonstrated the ability to record gamma frequency (55-80 Hz) EEG oscillations, in response to right index finger abduction, that are usually obscured by GAs during continuous fMRI data acquisition. In this novel application of EEG-MB fMRI to a motor task, we observed a positive correlation between gamma and BOLD responses in bilateral motor regions. These findings support and extend previous work regarding coupling between neural and hemodynamic measures of brain activity in humans and showcase the utility of EEG-MB fMRI for future investigations.

Enhanced Brain Network Activity in Complex Movement Rhythms: A Simultaneous Functional Magnetic Resonance Imaging and Electroencephalography Study

Generating movement rhythms is known to involve a network of distributed brain regions associated with motor planning, control, execution, and perception of timing for the repertoire of motor actions. What brain areas are bound in the network and how the network activity is modulated by rhythmic complexity have not been completely explored. To contribute to answering these questions, we designed a study in which nine healthy participants performed simple to complex rhythmic finger movement tasks while undergoing simultaneous functional magnetic resonance imaging and electroencephalography (fMRI-EEG) recordings of their brain activity during the tasks and rest. From fMRI blood oxygenation-level-dependent (BOLD) measurements, we found that the complexity of rhythms was associated with brain activations in the primary motor cortex (PMC), supplementary motor area (SMA), and cerebellum (Cb), and with network interactions from these cortical regions to the cerebellum. The spectral analysis of single-trial EEG source waveforms at the cortical regions further showed that there were bidirectional interactions between PMC and SMA, and the complexity of rhythms was associated with power spectra and Granger causality spectra in the beta (13-30 Hz) frequency band, not in the alpha (8-12 Hz) and gamma (30-58 Hz) bands. These results provide us new insights into the mechanisms for movement rhythm complexity.

A multimodal encoding model applied to imaging decision-related neural cascades in the human brain

Perception and cognition in the brain are naturally characterized as spatiotemporal processes. Decision-making, for example, depends on coordinated patterns of neural activity cascading across the brain, running in time from stimulus to response and in space from primary sensory regions to the frontal lobe. Measuring this cascade is key to developing an understanding of brain function. Here we report on a novel methodology that employs multi-modal imaging for inferring this cascade in humans at unprecedented spatiotemporal resolution. Specifically, we develop an encoding model to link simultaneously measured electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) signals to infer high-resolution spatiotemporal brain dynamics during a perceptual decision. After demonstrating replication of results from the literature, we report previously unobserved sequential reactivation of a substantial fraction of the pre-response network whose magnitude correlates with a proxy for decision confidence. Our encoding model, which temporally tags BOLD activations using time localized EEG variability, identifies a coordinated and spatially distributed neural cascade that is associated with a perceptual decision. In general the methodology illuminates complex brain dynamics that would otherwise be unobservable using fMRI or EEG acquired separately.

A Comparative Study of Average, Linked Mastoid, and REST References for ERP Components Acquired during fMRI

In simultaneous electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI) studies, average reference (AR), and digitally linked mastoid (LM) are popular re-referencing techniques in event-related potential (ERP) analyses. However, they may introduce their own physiological signals and alter the EEG/ERP outcome. A reference electrode standardization technique (REST) that calculated a reference point at infinity was proposed to solve this problem. To confirm the advantage of REST in ERP analyses of synchronous EEG-fMRI studies, we compared the reference effect of AR, LM, and REST on task-related ERP results of a working memory task during an fMRI scan. As we hypothesized, we found that the adopted reference did not change the topography map of ERP components (N1 and P300 in the present study), but it did alter the task-related effect on ERP components. LM decreased or eliminated the visual working memory (VWM) load effect on P300, and the AR distorted the distribution of VWM location-related effect at left posterior electrodes as shown in the statistical parametric scalp mapping (SPSM) of N1. ERP cortical source estimates, which are independent of the EEG reference choice, were used as the golden standard to infer the relative utility of different references on the ERP task-related effect. By comparison, REST reference provided a more integrated and reasonable result. These results were further confirmed by the results of fMRI activations and a corresponding EEG-only study. Thus, we recommend the REST, especially with a realistic head model, as the optimal reference method for ERP data analysis in simultaneous EEG-fMRI studies.

Hemispheric differences in electrical and hemodynamic responses during hemifield visual stimulation with graded contrasts

A multimodal neuroimaging technique based on electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) was used with horizontal hemifield visual stimuli with graded contrasts to investigate the retinotopic mapping more fully as well as to explore hemispheric differences in neuronal activity, the hemodynamic response, and the neurovascular coupling relationship in the visual cortex. The fNIRS results showed the expected activation over the contralateral hemisphere for both the left and right hemifield visual stimulations. However, the EEG results presented a paradoxical lateralization, with the maximal response located over the ipsilateral hemisphere but with the polarity inversed components located over the contralateral hemisphere. Our results suggest that the polarity inversion as well as the latency advantage over the contralateral hemisphere cause the amplitude of the VEP over the contralateral hemisphere to be smaller than that over the ipsilateral hemisphere. Both the neuronal and hemodynamic responses changed logarithmically with the level of contrast in the hemifield visual stimulations. Moreover, the amplitudes and latencies of the visual evoked potentials (VEPs) were linearly correlated with the hemodynamic responses despite differences in the slopes.

Simultaneous EEG-fMRI for working memory of the human brain

Memory plays an important role in human life. Memory can be divided into two categories, i.e., long term memory and short term memory (STM). STM or working memory (WM) stores information for a short span of time and it is used for information manipulations and fast response activities. WM is generally involved in the higher cognitive functions of the brain. Different studies have been carried out by researchers to understand the WM process. Most of these studies were based on neuroimaging modalities like fMRI, EEG, MEG etc., which use standalone processes. Each neuroimaging modality has some pros and cons. For example, EEG gives high temporal resolution but poor spatial resolution. On the other hand, the fMRI results have a high spatial resolution but poor temporal resolution. For a more in depth understanding and insight of what is happening inside the human brain during the WM process or during cognitive tasks, high spatial as well as high temporal resolution is desirable. Over the past decade, researchers have been working to combine different modalities to achieve a high spatial and temporal resolution at the same time. Developments of MRI compatible EEG equipment in recent times have enabled researchers to combine EEG-fMRI successfully. The research publications in simultaneous EEG-fMRI have been increasing tremendously. This review is focused on the WM research involving simultaneous EEG-fMRI data acquisition and analysis. We have covered the simultaneous EEG-fMRI application in WM and data processing. Also, it adds to potential fusion methods which can be used for simultaneous EEG-fMRI for WM and cognitive tasks.

Ballistocardiogram artifact correction taking into account physiological signal preservation in simultaneous EEG-fMRI

The ballistocardiogram (BCG) artifact is currently one of the most challenging in the EEG acquired concurrently with fMRI, with correction invariably yielding residual artifacts and/or deterioration of the physiological signals of interest. In this paper, we propose a family of methods whereby the EEG is decomposed using Independent Component Analysis (ICA) and a novel approach for the selection of BCG-related independent components (ICs) is used (PROJection onto Independent Components, PROJIC). Three ICA-based strategies for BCG artifact correction are then explored: 1) BCG-related ICs are removed from the back-reconstruction of the EEG (PROJIC); and 2-3) BCG-related ICs are corrected for the artifact occurrences using an Optimal Basis Set (OBS) or Average Artifact Subtraction (AAS) framework, before back-projecting all ICs onto EEG space (PROJIC-OBS and PROJIC-AAS, respectively). A novel evaluation pipeline is also proposed to assess the methods performance, which takes into account not only artifact but also physiological signal removal, allowing for a flexible weighting of the importance given to physiological signal preservation. This evaluation is used for the group-level parameter optimization of each algorithm on simultaneous EEG-fMRI data acquired using two different setups at 3T and 7T. Comparison with state-of-the-art BCG correction methods showed that PROJIC-OBS and PROJIC-AAS outperformed the others when priority was given to artifact removal or physiological signal preservation, respectively, while both PROJIC-AAS and AAS were in general the best choices for intermediate trade-offs. The impact of the BCG correction on the quality of event-related potentials (ERPs) of interest was assessed in terms of the relative reduction of the standard error (SE) across trials: 26/66%, 32/62% and 18/61% were achieved by, respectively, PROJIC, PROJIC-OBS and PROJIC-AAS, for data collected at 3T/7T. Although more significant improvements were achieved at 7T, the results were qualitatively comparable for both setups, which indicate the wide applicability of the proposed methodologies and recommendations.

Spurious correlations in simultaneous EEG-fMRI driven by in-scanner movement

Simultaneous EEG-fMRI provides an increasingly attractive research tool to investigate cognitive processes with high temporal and spatial resolution. However, artifacts in EEG data introduced by the MR scanner still remain a major obstacle. This study, employing commonly used artifact correction steps, shows that head motion, one overlooked major source of artifacts in EEG-fMRI data, can cause plausible EEG effects and EEG-BOLD correlations. Specifically, low-frequency EEG (<20Hz) is strongly correlated with in-scanner movement. Accordingly, minor head motion (<0.2mm) induces spurious effects in a twofold manner: Small differences in task-correlated motion elicit spurious low-frequency effects, and, as motion concurrently influences fMRI data, EEG-BOLD correlations closely match motion-fMRI correlations. We demonstrate these effects in a memory encoding experiment showing that obtained theta power (~3-7Hz) effects and channel-level theta-BOLD correlations reflect motion in the scanner. These findings highlight an important caveat that needs to be addressed by future EEG-fMRI studies.

Ensemble Empirical Mode Decomposition Analysis of EEG Data Collected during a Contour Integration Task

We discuss a data-driven analysis of EEG data recorded during a combined EEG/fMRI study of visual processing during a contour integration task. The analysis is based on an ensemble empirical mode decomposition (EEMD) and discusses characteristic features of event related modes (ERMs) resulting from the decomposition. We identify clear differences in certain ERMs in response to contour vs noncontour Gabor stimuli mainly for response amplitudes peaking around 100 [ms] (called P100) and 200 [ms] (called N200) after stimulus onset, respectively. We observe early P100 and N200 responses at electrodes located in the occipital area of the brain, while late P100 and N200 responses appear at electrodes located in frontal brain areas. Signals at electrodes in central brain areas show bimodal early/late response signatures in certain ERMs. Head topographies clearly localize statistically significant response differences to both stimulus conditions. Our findings provide an independent proof of recent models which suggest that contour integration depends on distributed network activity within the brain.

Recursive approach of EEG-segment-based principal component analysis substantially reduces cryogenic pump artifacts in simultaneous EEG-fMRI data

Electroencephalography (EEG) data simultaneously acquired with functional magnetic resonance imaging (fMRI) data are preprocessed to remove gradient artifacts (GAs) and ballistocardiographic artifacts (BCAs). Nonetheless, these data, especially in the gamma frequency range, can be contaminated by residual artifacts produced by mechanical vibrations in the MRI system, in particular the cryogenic pump that compresses and transports the helium that chills the magnet (the helium-pump). However, few options are available for the removal of helium-pump artifacts. In this study, we propose a recursive approach of EEG-segment-based principal component analysis (rsPCA) that enables the removal of these helium-pump artifacts. Using the rsPCA method, feature vectors representing helium-pump artifacts were successfully extracted as eigenvectors, and the reconstructed signals of the feature vectors were subsequently removed. A test using simultaneous EEG-fMRI data acquired from left-hand (LH) and right-hand (RH) clenching tasks performed by volunteers found that the proposed rsPCA method substantially reduced helium-pump artifacts in the EEG data and significantly enhanced task-related gamma band activity levels (p=0.0038 and 0.0363 for LH and RH tasks, respectively) in EEG data that have had GAs and BCAs removed. The spatial patterns of the fMRI data were estimated using a hemodynamic response function (HRF) modeled from the estimated gamma band activity in a general linear model (GLM) framework. Active voxel clusters were identified in the post-/pre-central gyri of motor area, only from the rsPCA method (uncorrected p<0.001 for both LH/RH tasks). In addition, the superior temporal pole areas were consistently observed (uncorrected p<0.001 for the LH task and uncorrected p<0.05 for the RH task) in the spatial patterns of the HRF model for gamma band activity when the task paradigm and movement were also included in the GLM.

Data-driven analysis of simultaneous EEG/fMRI using an ICA approach

Due to its millisecond-scale temporal resolution, EEG allows to assess neural correlates with precisely defined temporal relationship relative to a given event. This knowledge is generally lacking in data from functional magnetic resonance imaging (fMRI) which has a temporal resolution on the scale of seconds so that possibilities to combine the two modalities are sought. Previous applications combining event-related potentials (ERPs) with simultaneous fMRI BOLD generally aimed at measuring known ERP components in single trials and correlate the resulting time series with the fMRI BOLD signal. While it is a valuable first step, this procedure cannot guarantee that variability of the chosen ERP component is specific for the targeted neurophysiological process on the group and single subject level. Here we introduce a newly developed data-driven analysis procedure that automatically selects task-specific electrophysiological independent components (ICs). We used single-trial simultaneous EEG/fMRI analysis of a visual Go/Nogo task to assess inhibition-related EEG components, their trial-to-trial amplitude variability, and the relationship between this variability and the fMRI. Single-trial EEG/fMRI analysis within a subgroup of 22 participants revealed positive correlations of fMRI BOLD signal with EEG-derived regressors in fronto-striatal regions which were more pronounced in an early compared to a late phase of task execution. In sum, selecting Nogo-related ICs in an automated, single subject procedure reveals fMRI-BOLD responses correlated to different phases of task execution. Furthermore, to illustrate utility and generalizability of the method beyond detecting the presence or absence of reliable inhibitory components in the EEG, we show that the IC selection can be extended to other events in the same dataset, e.g., the visual responses.

Evidence that the negative BOLD response is neuronal in origin: a simultaneous EEG-BOLD-CBF study in humans

Unambiguous interpretation of changes in the BOLD signal is challenging because of the complex neurovascular coupling that translates changes in neuronal activity into the subsequent haemodynamic response. In particular, the neurophysiological origin of the negative BOLD response (NBR) remains incompletely understood. Here, we simultaneously recorded BOLD, EEG and cerebral blood flow (CBF) responses to 10 s blocks of unilateral median nerve stimulation (MNS) in order to interrogate the NBR. Both negative BOLD and negative CBF responses to MNS were observed in the same region of the ipsilateral primary sensorimotor cortex (S1/M1) and calculations showed that MNS induced a decrease in the cerebral metabolic rate of oxygen consumption (CMRO2) in this NBR region. The ∆CMRO2/∆CBF coupling ratio (n) was found to be significantly larger in this ipsilateral S1/M1 region (n=0.91±0.04, M=10.45%) than in the contralateral S1/M1 (n=0.65±0.03, M=10.45%) region that exhibited a positive BOLD response (PBR) and positive CBF response, and a consequent increase in CMRO2 during MNS. The fMRI response amplitude in ipsilateral S1/M1 was negatively correlated with both the power of the 8-13 Hz EEG mu oscillation and somatosensory evoked potential amplitude. Blocks in which the largest magnitude of negative BOLD and CBF responses occurred therefore showed greatest mu power, an electrophysiological index of cortical inhibition, and largest somatosensory evoked potentials. Taken together, our results suggest that a neuronal mechanism underlies the NBR, but that the NBR may originate from a different neurovascular coupling mechanism to the PBR, suggesting that caution should be taken in assuming the NBR simply represents the neurophysiological inverse of the PBR.

Attention to detail: why considering task demands is essential for single-trial analysis of BOLD correlates of the visual P1 and N1

Single-trial fluctuations in the EEG signal have been shown to temporally correlate with the fMRI BOLD response and are valuable for modeling trial-to-trial fluctuations in responses. The P1 and N1 components of the visual ERP are sensitive to different attentional modulations, suggesting that different aspects of stimulus processing can be modeled with these ERP parameters. As such, different patterns of BOLD covariation for P1 and N1 informed regressors would be expected; however, current findings are equivocal. We investigate the effects of variations in attention on P1 and N1 informed BOLD activation in a visual oddball task. Simultaneous EEG-fMRI data were recorded from 13 healthy participants during three conditions of a visual oddball task: Passive, Count, and Respond. We show that the P1 and N1 components of the visual ERP can be used in the integration-by-prediction method of EEG-fMRI data integration to highlight brain regions related to target detection and response production. Our data suggest that the P1 component of the ERP reflects changes in sensory encoding of stimulus features and is more informative for the Passive and Count conditions. The N1, on the other hand, was more informative for the Respond condition, suggesting that it can be used to model the processing of stimulus, meaning specifically discriminating one type of stimulus from another, and processes involved in integrating sensory information with response selection. Our results show that an understanding of the underlying electrophysiology is necessary for a thorough interpretation of EEG-informed fMRI analysis.

Simultaneous EEG-fMRI reveals a temporal cascade of task-related and default-mode activations during a simple target detection task

Focused attention continuously and inevitably fluctuates, and to completely understand the mechanisms responsible for these modulations it is necessary to localize the brain regions involved. During a simple visual oddball task, neural responses measured by electroencephalography (EEG) modulate primarily with attention, but source localization of the correlates is a challenge. In this study we use single-trial analysis of simultaneously-acquired scalp EEG and functional magnetic resonance image (fMRI) data to investigate the blood oxygen level dependent (BOLD) correlates of modulations in task-related attention, and we unravel the temporal cascade of these transient activations. We hypothesize that activity in brain regions associated with various task-related cognitive processes modulates with attention, and that their involvements occur transiently in a specific order. We analyze the fMRI BOLD signal by first regressing out the variance linked to observed stimulus and behavioral events. We then correlate the residual variance with the trial-to-trial variation of EEG discriminating components for identical stimuli, estimated at a sequence of times during a trial. Post-stimulus and early in the trial, we find activations in right-lateralized frontal regions and lateral occipital cortex, areas that are often linked to task-dependent processes, such as attentional orienting, and decision certainty. After the behavioral response we see correlates in areas often associated with the default-mode network and introspective processing, including precuneus, angular gyri, and posterior cingulate cortex. Our results demonstrate that during simple tasks both task-dependent and default-mode networks are transiently engaged, with a distinct temporal ordering and millisecond timescale.

EEG-fMRI integration for the study of human brain function

Electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) have proved to be extremely valuable tools for the non-invasive study of human brain function. Moreover, due to a notable degree of complementarity between the two modalities, the combination of EEG and fMRI data has been actively sought in the last two decades. Although initially focused on epilepsy, EEG-fMRI applications were rapidly extended to the study of healthy brain function, yielding new insights into its underlying mechanisms and pathways. Nevertheless, EEG and fMRI have markedly different spatial and temporal resolutions, and probe neuronal activity through distinct biophysical processes, many aspects of which are still poorly understood. The remarkable conceptual and methodological challenges associated with EEG-fMRI integration have motivated the development of a wide range of analysis approaches over the years, each relying on more or less restrictive assumptions, and aiming to shed further light on the mechanisms of brain function along with those of the EEG-fMRI coupling itself. Here, we present a review of the most relevant EEG-fMRI integration approaches yet proposed for the study of brain function, supported by a general overview of our current understanding of the biophysical mechanisms coupling the signals obtained from the two modalities.

An event-related potential examination of contour integration deficits in schizophrenia

Perceptual organization, which refers to the ability to integrate fragments of stimuli to form a representation of a whole edge, part, or object, is impaired in schizophrenia. A contour integration paradigm, involving detection of a set of Gabor patches forming an oval contour pointing to the right or left embedded in a field of randomly oriented Gabors, has been developed for use in clinical trials of schizophrenia. The purpose of the present study was to assess contributions of early and later stages of processing to deficits in contour integration, as well as to develop an event-related potential (ERP) analog of this task. Twenty-one patients with schizophrenia and 28 controls participated. The Gabor elements forming the contours were given a low or high degree of orientational jitter, making it either easy or difficult to identify the direction in which the contour was pointing. ERP results showed greater negative peaks at ~165 (N1 component) and ~270 ms for the low-jitter versus the high-jitter contours, with a much greater difference between jitter conditions at 270 ms. This later ERP component was previously termed N_cl for closure negativity. Source localization identified the N_cl in the lateral occipital object recognition area. Patients showed a significant decrease in the N_cl, but not N1, compared to controls, and this was associated with impaired behavioral ability to identify contours. In addition, an earlier negative peak was found at ~120 ms (termed N120) that differentiated jitter conditions, had a dorsal stream source, and differed between patients and controls. Patients also showed a deficit in the dorsal stream sensory P1 component. These results are in accord with impairments in distributed circuitry contributing to perceptual organization deficits and provide an ERP analog to the behavioral contour integration task.

Exploring the effects of antisocial personality traits on brain potentials during face processing

Antisocial individuals are characterized to display self-determined and inconsiderate behavior during social interaction. Furthermore, recognition deficits regarding fearful facial expressions have been observed in antisocial populations. These observations give rise to the question whether or not antisocial behavioral tendencies are associated with deficits in basic processing of social cues. The present study investigated early visual stimulus processing of social stimuli in a group of healthy female individuals with antisocial behavioral tendencies compared to individuals without these tendencies while measuring event-related potentials (P1, N170). To this end, happy and angry faces served as feedback stimuli which were embedded in a gambling task. Results showed processing differences as early as 88–120 ms after feedback onset. Participants low on antisocial traits displayed larger P1 amplitudes than participants high on antisocial traits. No group differences emerged for N170 amplitudes. Attention allocation processes, individual arousal levels as well as face processing are discussed as possible causes of the observed group differences in P1 amplitudes. In summary, the current data suggest that sensory processing of facial stimuli is functionally intact but less ready to respond in healthy individuals with antisocial tendencies.

Sex differences in event-related potential components during the solution of complex mental rotation tasks

The objective of the study was to evaluate the factor of sex in terms of its influence on event-related potential components during the solution of a complex mental rotation task. To evaluate the factor of sex, independent of differences in ability levels and hormonal changes, women and men were equalized with respect to general intelligence and spatial ability. In addition, all women were tested during the low-estrogen phase of the menstrual cycle. The event-related potential analysis indicated that men showed shorter P3 and longer P1 latencies, as well as lower N1 amplitudes. These results suggest that men devoted more time to the analysis of irrelevant information presented in the rotation tasks, which resulted in mental rotation taking place earlier in men than in women. It can be concluded that, even though men and women showed similar performances on complex rotation tasks, they differed in their solution processes.

Emotional perception: correspondence of early and late event-related potentials with cortical and subcortical functional MRI

This research examines the relationship between brain activity recorded with functional magnetic resonance imaging (fMRI) and event related potentials (ERP) as these responses varied over a series of emotionally evocative and neutral pictures. We investigate the relationship of early occipitotemporal and later centroparietal emotion-modulated ERPs in one sample to fMRI estimates of neural activity in another sample in a replicated experiment. Using this approach, we aimed to link effects found in time-resolved electrocortical measures to specific neural structures across individual emotional and nonemotional picture stimuli. The centroparietal late positive potential (LPP) showed covariation with emotion-modulated regions of hemodynamic activation across multiple dorsal and ventral visual cortical structures, while the early occipitotemporal potential was not reliably associated. Subcortical and corticolimbic structures involved in the perception of motivationally relevant stimuli also related to modulation of the LPP, and were modestly associated to the amplitude of the early occipitotemporal potential. These data suggest that early occipitotemporal potentials may reflect multiple sources of modulation including motivational relevance, and supports the perspective that the slow-wave LPP represents aggregate cortical and subcortical structures involved in emotional discrimination.

Hippocampal involvement in processing of indistinct visual motion stimuli

Perception of known patterns results from the interaction of current sensory input with existing internal representations. It is unclear how perceptual and mnemonic processes interact when visual input is dynamic and structured such that it does not allow immediate recognition of obvious objects and forms. In an fMRI experiment, meaningful visual motion stimuli depicting movement through a virtual tunnel and indistinct, meaningless visual motion stimuli, achieved through phase scrambling of the same stimuli, were presented while participants performed an optic flow task. We found that our indistinct visual motion stimuli evoked hippocampal activation, whereas the corresponding meaningful stimuli did not. Using independent component analysis, we were able to demonstrate a functional connectivity between the hippocampus and early visual areas, with increased activity for indistinct stimuli. In a second experiment, we used the same stimuli to test whether our results depended on the participants' task. We found task-independent bilateral hippocampal activation in response to indistinct motion stimuli. For both experiments, psychophysiological interaction analysis revealed a coupling from posterior hippocampus to dorsal visuospatial and ventral visual object processing areas when viewing indistinct stimuli. These results indicate a close functional link between stimulus-dependent perceptual and mnemonic processes. The observed pattern of hippocampal functional connectivity, in the absence of an explicit memory task, suggests that cortical-hippocampal networks are recruited when visual stimuli are temporally uncertain and do not immediately reveal a clear meaning.

A simultaneous ERP/fMRI investigation of the P300 aging effect

One of the most reliable psychophysiological markers of aging is a linear decrease in the amplitude of the P300 potential, accompanied by a more frontal topographical orientation, but the precise neural origins of these differences have yet to be explored. We acquired simultaneous electroencephalogram (EEG)/functional magnetic resonance imaging (fMRI) recordings from 14 older and 15 younger adults who performed a 3-stimulus visual oddball task designed to elicit P3a and P3b components. As in previous reports, older adults had significantly reduced P3a/P3b amplitudes over parietal electrodes but larger amplitudes over frontal scalp with no between-group differences in accuracy or reaction time. Electroencephalogram/functional magnetic resonance imaging fusion revealed that the P3a age effects were driven by increased activation of left inferior frontal and cingulate cortex and decreased activation of inferior parietal cortex in the older group. P3b differences were driven by increased activation of left temporal regions, right hippocampus, and right dorsolateral prefrontal cortex in the older group. Our results support the proposal that the age-related P300 anterior shift arises from an increased reliance on prefrontal structures to support target and distractor processing.

Correlation between single-trial visual evoked potentials and the blood oxygenation level dependent response in simultaneously recorded electroencephalography-functional magnetic resonance imaging

To compare different electroencephalography (EEG)-based regressors and their ability to predict the simultaneously recorded blood oxygenation level dependent response during blocked visual stimulation, simultaneous EEG-functional magnetic resonance imaging in 10 healthy volunteers was performed. The performance of different single-trial EEG regressors was compared in terms of predicting the measured blood oxygenation level dependent response. The EEG-based regressors were the amplitude and latency of the primary positive (P1) and negative (N2) peaks of the visual evoked potential, the combined P1-N2 amplitude, and the alpha power. Apart from peak latencies, all regressors showed significant positive or negative correlation with the blood oxygenation level dependent response in visual cortex. In addition, several EEG-based regressors were found to predict blood oxygenation level dependent variations in different occipital and extraoccipital cortical areas not explained by the boxcar regressor. The results suggest that the P1-N2 regressor is the best EEG-based regressor to model the visual paradigm, but when looking for additional effects like habituation or attention modulation that cannot be modeled by the boxcar regressor, it is better to include regressors based on individual peaks or alpha power.

Ketamine effects on brain function--simultaneous fMRI/EEG during a visual oddball task

BACKGROUND

Behavioral and electrophysiological human ketamine models of schizophrenia are used for testing compounds that target the glutamatergic system. However, corresponding functional neuroimaging models are difficult to reconcile with functional imaging and electrophysiological findings in schizophrenia. Resolving the discrepancies between different observational levels is critical to understand the complex pharmacological ketamine action and its usefulness for modeling schizophrenia pathophysiology.

METHODS

We conducted a within-subject, randomized, placebo-controlled pharmacoimaging study in twenty-four male volunteers. Subjects were given low-dose S-ketamine (bolus prior to functional imaging: 0.1mg/kg during 5min, thereafter continuous infusion: 0.015625mg/kg/min reduced by 10% every ten minutes) or placebo while performing a visual oddball task during simultaneous functional magnetic resonance imaging (fMRI) with continuous recording of event-related potentials (P300) and electrodermal activity (EDA). Before and after intervention, psychopathological status was assessed using the Positive and Negative Syndrome Scale (PANSS) and the Altered State of Consciousness (5D-ASC) Rating Scale.

RESULTS

P300 amplitude and corresponding BOLD responses were diminished in the ketamine condition in cortical regions being involved in sensory processing/selective attention. In both measurement modalities separation of drug conditions was achieved with area under the curve (AUC) values of up to 0.8-0.9. Ketamine effects were also observed in the clinical, behavioral and peripheral physiological domains (Positive and Negative Syndrome Scale, reaction hit and false alarm rate, electrodermal activity and heart rate) which were in part related to the P300/fMRI measures.

CONCLUSION

The findings from our ketamine experiment are consistent across modalities and directly related to observations in schizophrenia supporting the validity of the model. Our investigation provides the first prototypic example of a pharmacoimaging study using simultaneously acquired fMRI/EEG.

Adaptive Thresholding for Improving Sensitivity in Single-Trial Simultaneous EEG/fMRI

A common approach used to fuse simultaneously recorded EEG and fMRI is to correlate trial-by-trial variability in the EEG, or variability of components derived therefrom, with the blood oxygenation level dependent response. When this correlation is done using the conventional univariate approach, for example with the general linear model, there is the usual problem of correcting the statistics for multiple comparisons. Cluster thresholding is often used as the correction of choice, though in many cases it is utilized in an ad hoc way, for example by employing the same cluster thresholds for both traditional regressors (stimulus or behaviorally derived) and EEG-derived regressors. In this paper we describe a resampling procedure that takes into account the a priori statistics of the trial-to-trial variability of the EEG-derived regressors in a way that trades off cluster size and maximum voxel Z-score to properly correct for multiple comparisons. We show that this data adaptive procedure improves sensitivity for smaller clusters of activation, without sacrificing the specificity of the results. Our results suggest that extra care is needed in correcting statistics when the regressor model is derived from noisy and/or uncertain measurements, as is the case for regressors constructed from single-trial variations in the EEG.