A Tutorial on Data-Driven Methods for Statistically Assessing ERP Topographies

Mental rotation of sequentially presented 3D figures: sex and sex hormones related differences in behavioural and ERP measures

Mental rotation of 3D objects demonstrates one of the largest sex differences. We investigated sex and sex hormones-related differences in behaviour and event related potentials (ERP) using a modified Shepard and Metzler task composed of sequentially presented 3D figures in 29 men and 32 women. We demonstrated a significant increase in response time and decrease in both accuracy and positivity of the parietal ERP with increasing angular disparity between the figures. Higher angular disparity evoked an increase of global field power (GFP) from 270 to 460 ms and different activation topographies from 470 to 583 ms with lower parietal, but higher left frontal positivity. Flatter slopes in higher angular disparity condition suggest distinct strategies being implemented depending on the difficulty of the rotation. Men performed the task more accurately than women. Performance accuracy in women tended to be negatively related to estradiol while the response time tended to increase with increasing progesterone. There were no associations with testosterone. Women demonstrated higher GFP and an increased positivity over the parietal scalp area, while men showed higher activation in the left frontal cortex. Together these findings indicate dynamic angular disparity- and sex-related differences in brain activity during mental rotation of 3D figures.

Neural dynamics of the production of newly acquired words relative to well-known words

An adult continues acquiring new lexical entries in everyday life. Brain networks and processes at play when producing newly learnt words might be similar to well-known words, yet some processes are bound to be slower. Here, we compared the neural dynamics of producing newly acquired words with those of well-known frequent words, both qualitatively and quantitatively, using event-related potentials (ERPs) associated to high-density microstate analyses. ERPs revealed several temporal windows with differences in waveform amplitudes, which correspond to enhanced duration of similar microstates for newly acquired words compared to well-known words. The time-periods of these ERP modulations converged to suggest that both lexical processes and word form encoding are slowed down for words that have been learned recently, but that the same brain processes are implemented as for well-known words.

Oxytocin modulates the temporal dynamics of resting EEG networks

Oxytocin is a key modulator of social interaction, but we possess little knowledge of its underlying effects on neuropsychological processes. We used a spatio-temporal EEG microstates analysis to reveal oxytocin's effects on the temporal dynamics of intrinsically generated activity in neural networks. Given oxytocin's known anxiolytic effects, we hypothesized that it increases the temporal stability of the four archetypal EEG resting networks. Eighty-six male participants had received oxytocin or placebo intranasally before we recorded their resting EEG. As hypothesized, oxytocin globally increased the average duration of the four archetypal resting networks and specifically decreased the occurrence and coverage of an autonomic processing-related network to benefit greater coverage of an attention-related network. Moreover, these neurophysiological changes were more pronounced in participants with high anxiety levels and strong subjectively experienced effects of the oxytocin administration. In sum, our study shows that oxytocin reduces rapid switching among neural resting networks by increasing their temporal stability. Specifically, it seems to reduce the brain's need for preparing the internally-oriented processing of autonomic information, thus enabling the externally-oriented processing of social information. Changes in the temporal dynamics of resting networks might underlie oxytocin's anxiolytic effects - potentially informing innovative psychobiological treatment strategies.

Mindfulness meditators show altered distributions of early and late neural activity markers of attention in a response inhibition task

Attention is vital for optimal behavioural performance in every-day life. Mindfulness meditation has been shown to enhance attention. However, the components of attention altered by meditation and the related neural activities are underexplored. In particular, the contributions of inhibitory processes and sustained attention are not well understood. To address these points, 34 meditators were compared to 28 age and gender matched controls during electroencephalography (EEG) recordings of neural activity during a Go/Nogo response inhibition task. This task generates a P3 event related potential, which is related to response inhibition processes in Nogo trials, and attention processes across both trial types. Compared with controls, meditators were more accurate at responding to Go and Nogo trials. Meditators showed a more frontally distributed P3 to both Go and Nogo trials, suggesting more frontal involvement in sustained attention rather than activity specific to response inhibition. Unexpectedly, meditators also showed increased positivity over the right parietal cortex prior to visual information reaching the occipital cortex (during the pre-C1 window). Both results were positively related to increased accuracy across both groups. The results suggest that meditators show altered engagement of neural regions related to attention, including both higher order processes generated by frontal regions, and sensory anticipation processes generated by poster regions. This activity may reflect an increased capacity to modulate a range of neural processes in order to meet task requirements. This increased capacity may underlie the improved attentional function observed in mindfulness meditators.

Learning to resist the urge: a double-blind, randomized controlled trial investigating alcohol-specific inhibition training in abstinent patients with alcohol use disorder

Background

Alcohol use disorder (AUD) leads to a significant individual and societal burden. To achieve higher therapy success rates, therapeutic interventions still need to be improved. Most current neuroscientific conceptualizations of AUD focus on the imbalance between an enhanced automatic reaction to alcohol cues and impaired inhibition. Complementary to traditional relapse prevention strategies, novel computerized training interventions aim to directly alter these processes. This study tests a computerized alcohol-specific inhibition training in a large clinical sample and investigates its effects on behavioral, experimental and neurophysiological outcomes. It also analyzes whether variations in inhibition difficulty and/or endogenous cortisol levels during training impact these effects.

Methods

This is a double-blind, randomized controlled trial (RCT) with 246 inpatients with AUD participating. After baseline assessment, participants are randomly assigned to one of three computerized Go-NoGo-based inhibition training interventions (two alcohol-specific versions with different Go/NoGo ratios, or neutral control training) and one of two intervention times (morning/afternoon), resulting in six study arms. All patients perform six training sessions within 2 weeks. Endogenous cortisol is measured in 80 patients before and after the first training session. Inhibitory control and implicit associations towards alcohol are assessed pre and post training, at which point electroencephalography (EEG) is additionally measured in 60 patients. Patients’ alcohol consumption and relevant psychological constructs (e.g., craving, self-efficacy, treatment motivation) are measured at discharge and at 3-, 6- and 12-month follow-ups. Fifty healthy participants are assessed (20 with EEG) at one time point as a healthy control group.

Discussion

This study investigates the effects of a computerized, alcohol-specific inhibition training for the first time in patients with AUD. Results should give insight into the effectiveness of this potential add-on to standard AUD treatment, including proximal and distal measures and effects on behavioral, experimental and neurophysiological measures. Information about working mechanisms and potential optimizations of this training are gathered through variations regarding difficulty of inhibition training and training time. This study may thus contribute to a deepened understanding of AUD and the improvement of its evidence-based treatment.

Trial registration

ClinicalTrials.gov, ID: NCT02968537. Registered on 18 November 2016.

Electronic supplementary material

The online version of this article (10.1186/s13063-019-3505-2) contains supplementary material, which is available to authorized users.

Interference in speaking while hearing and vice versa

Even when speakers are not actively doing another task, they can be interfered in their speech planning by concurrent auditory stimuli. In this study, we used picture naming with passive hearing, or active listening, combined to high-density electroencephalographic (EEG) recordings to investigate the locus and origin of interference on speech production. Participants named pictures while ignoring (or paying attention to) auditory syllables presented at different intervals (+150 ms, +300 ms or +450 ms). Interference of passive hearing was observed at all positive stimulus onset asynchronies (SOA) including when distractors appeared 450 ms after picture onset. Analyses of ERPs and microstates revealed modulations appearing in a time-window close to verbal response onset likely relating to post-lexical planning processes. A shift of latency of the N1 auditory component for syllables displayed 450 ms after picture onset relative to hearing in isolation was also observed. Data from picture naming with active listening to auditory syllables also pointed to post-lexical interference. The present study suggests that, beyond the lexical stage, post-lexical processes can be interfered and that the reciprocal interference between utterance planning and hearing relies on attentional demand and possibly competing neural substrates.

Electrical Neuroimaging of Music Processing in Pianists With and Without True Absolute Pitch

True absolute pitch (AP), labeling of pitches with semitone precision without a reference, is classically studied using isolated tones. However, AP is acquired and has its function within complex dynamic musical contexts. Here we examined event-related brain responses and underlying cerebral sources to endings of short expressive string quartets, investigating a homogeneous population of young highly trained pianists with half of them possessing true-AP. The pieces ended regularly or contained harmonic transgressions at closure that participants appraised. Given the millisecond precision of ERP analyses, this experimental plan allowed examining whether AP alters music processing at an early perceptual, or later cognitive level, or both, and which cerebral sources underlie differences with non-AP musicians. We also investigated the impact of AP on general auditory cognition. Remarkably, harmonic transgression sensitivity did not differ between AP and non-AP participants, and differences for auditory cognition were only marginal. The key finding of this study is the involvement of a microstate peaking around 60 ms after musical closure, characterizing AP participants. Concurring sources were estimated in secondary auditory areas, comprising the planum temporale, all transgression conditions collapsed. These results suggest that AP is not a panacea to become a proficient musician, but a rare perceptual feature.

A fine-grained time course investigation of brain dynamics during conflict monitoring

The conflict monitoring model predicting higher anterior cingulate cortex (ACC) neuronal activity on incongruent trials has been recently challenged by a model predicting longer neuronal activity in incongruent trials characterized by longer RTs. To clarify this issue, brain dynamics were explored through event-related-potential (ERP) recordings during a Stroop task. We assessed differences between experimental conditions by combining complementary methods sensitive to the temporality of events including microstate, TANOVA and source localization analysis. The analysis demonstrated the same electrical dynamics only differed in duration towards the end of information processing in the incongruent condition. Specifically, the activation strength of the ACC region did not differ significantly between congruent and incongruent conditions but lasted longer in the incongruent condition. Taken together, our results support the model predicting longer neuronal activity in incongruent trials characterized by longer RTs. They highlight that brain dynamics can dramatically change through periods of interest and that caution is required when interpreting fMRI results. To conclude, these results indicate how time-sensitive measures can contribute to a better understanding of the mechanisms underlying information processing, and thus offer new venues to explore conflict monitoring.

Single-Trial Recognition of Imagined Forces and Speeds of Hand Clenching Based on Brain Topography and Brain Network

To provide optional force and speed control parameters for brain-computer interfaces (BCIs), an effective feature extraction method of imagined force and speed of hand clenching based on electroencephalography (EEG) was explored. Twenty subjects were recruited to participate in the experiment. They were instructed to perform three different actual/imagined hand clenching force tasks (4 kg, 10 kg, and 16 kg) and three different hand clenching speed tasks (0.5 Hz, 1 Hz, and 2 Hz). Topographical maps parameters and brain network parameters of EEG were calculated as new features of imagined force and speed of hand clenching, which were classified by three classifiers: linear discrimination analysis, extreme learning machines and support vector machines. Topographical maps parameters were better for recognition of the hand clenching force task, while brain network parameters were better for recognition of the hand clenching speed task. After a combination of five types of features (energy, power spectrum of the autoregressive model, wavelet packet coefficients, topographical maps parameters and brain network parameters), the recognition rate of the hand clenching force task was 97%, and that of the hand clenching speed task was as high as 100%. The brain topographical and the brain network parameters are expected to improve the accuracy of decoding the EEG signal of imagined force and speed of hand clenching. A more efficient brain network may facilitate the recognition of force/speed of hand clenching. Combined features could significantly improve the single-trial recognition rate of imagined forces and speeds of hand clenching. The current study provides a new idea for the imagined force and speed of hand clenching that offers more control intention instructions for BCIs.

Sounds enhance visual completion processes

Everyday vision includes the detection of stimuli, figure-ground segregation, as well as object localization and recognition. Such processes must often surmount impoverished or noisy conditions; borders are perceived despite occlusion or absent contrast gradients. These illusory contours (ICs) are an example of so-called mid-level vision, with an event-related potential (ERP) correlate at ∼100-150 ms post-stimulus onset and originating within lateral-occipital cortices (the IC_effect). Presently, visual completion processes supporting IC perception are considered exclusively visual; any influence from other sensory modalities is currently unknown. It is now well-established that multisensory processes can influence both low-level vision (e.g. detection) as well as higher-level object recognition. By contrast, it is unknown if mid-level vision exhibits multisensory benefits and, if so, through what mechanisms. We hypothesized that sounds would impact the IC_effect. We recorded 128-channel ERPs from 17 healthy, sighted participants who viewed ICs or no-contour (NC) counterparts either in the presence or absence of task-irrelevant sounds. The IC_effect was enhanced by sounds and resulted in the recruitment of a distinct configuration of active brain areas over the 70-170 ms post-stimulus period. IC-related source-level activity within the lateral occipital cortex (LOC), inferior parietal lobe (IPL), as well as primary visual cortex (V1) were enhanced by sounds. Moreover, the activity in these regions was correlated when sounds were present, but not when absent. Results from a control experiment, which employed amodal variants of the stimuli, suggested that sounds impact the perceived brightness of the IC rather than shape formation per se. We provide the first demonstration that multisensory processes augment mid-level vision and everyday visual completion processes, and that one of the mechanisms is brightness enhancement. These results have important implications for the design of treatments and/or visual aids for low-vision patients.

Calculation and Analysis of Microstate Related to Variation in Executed and Imagined Movement of Force of Hand Clenching

Objective

In order to investigate electroencephalogram (EEG) instantaneous activity states related to executed and imagined movement of force of hand clenching (grip force: 4 kg, 10 kg, and 16 kg), we utilized a microstate analysis in which the spatial topographic map of EEG behaves in a certain number of discrete and stable global brain states.

Approach

Twenty subjects participated in EEG collection; the global field power of EEG and its local maximum were calculated and then clustered using cross validation and statistics; the 4 parameters of each microstate (duration, occurrence, time coverage, and amplitude) were calculated from the clustering results and statistically analyzed by analysis of variance (ANOVA); finally, the relationship between the microstate and frequency band was analyzed.

Main Results

The experimental results showed that all microstates related to executed and imagined grip force tasks were clustered into 3 microstate classes (A, B, and C); these microstates generally transitioned from A to B and then from B to C. With the increase of the target value of executed and imagined grip force, the duration and time coverage of microstate B gradually decreased, while these parameters of microstate C gradually increased. The occurrence times of microstate B and C related to executed grip force were significantly more than those related to imagined grip force; furthermore, the amplitudes of these 3 microstates related to executed grip force were significantly greater than those related to imagined grip force. The correlation coefficients between the microstates and the frequency bands indicated that the microstates were correlated to mu rhythm and beta frequency bands, which are consistent with event-related desynchronization/synchronization (ERD/ERS) phenomena of sensorimotor rhythm.

Significance

It is expected that this microstate analysis may be used as a new method for observing EEG instantaneous activity patterns related to variation in executed and imagined grip force and also for extracting EEG features related to these tasks. This study may lay a foundation for the application of executed and imagined grip force training for rehabilitation of hand movement disorders in patients with stroke in the future.

Brain mechanisms for perceiving illusory lines in humans

Illusory contours (ICs) are perceptions of visual borders despite absent contrast gradients. The psychophysical and neurobiological mechanisms of IC processes have been studied across species and diverse brain imaging/mapping techniques. Nonetheless, debate continues regarding whether IC sensitivity results from a (presumably) feedforward process within low-level visual cortices (V1/V2) or instead are processed first within higher-order brain regions, such as lateral occipital cortices (LOC). Studies in animal models, which generally favour a feedforward mechanism within V1/V2, have typically involved stimuli inducing IC lines. By contrast, studies in humans generally favour a mechanism where IC sensitivity is mediated by LOC and have typically involved stimuli inducing IC forms or shapes. Thus, the particular stimulus features used may strongly contribute to the model of IC sensitivity supported. To address this, we recorded visual evoked potentials (VEPs) while presenting human observers with an array of 10 inducers within the central 5°, two of which could be oriented to induce an IC line on a given trial. VEPs were analysed using an electrical neuroimaging framework. Sensitivity to the presence vs. absence of centrally-presented IC lines was first apparent at ∼200 ms post-stimulus onset and was evident as topographic differences across conditions. We also localized these differences to the LOC. The timing and localization of these effects are consistent with a model of IC sensitivity commencing within higher-level visual cortices. We propose that prior observations of effects within lower-tier cortices (V1/V2) are the result of feedback from IC sensitivity that originates instead within higher-tier cortices (LOC).

A Student's Guide to Randomization Statistics for Multichannel Event-Related Potentials Using Ragu

In this paper, we present a multivariate approach to analyze multi-channel event-related potential (ERP) data using randomization statistics¹. The MATLAB-based open source toolbox Randomization Graphical User interface (Ragu) provides, among other methods, a test for topographic consistency, a topographic analysis of variance, t-mapping and microstate analyses. Up to two within-subject factors and one between-subject factor, each with an open number of levels, can be defined and analyzed in Ragu. Ragu analyses include all sensor signals and no a-priori models have to be applied during the analyses. Additionally, periods of significant effects can be controlled for multiple testing using global overall statistics over time. Here, we introduce the different alternatives to apply Ragu, based on a step by step analysis of an example study. This example study examined the neural activity in response to semantic unexpected sentence endings in exchange students at the beginning of their stay and after staying in a foreign-language country for 5 months.

EEG microstates as a tool for studying the temporal dynamics of whole-brain neuronal networks: A review

The present review discusses a well-established method for characterizing resting-state activity of the human brain using multichannel electroencephalography (EEG). This method involves the examination of electrical microstates in the brain, which are defined as successive short time periods during which the configuration of the scalp potential field remains semi-stable, suggesting quasi-simultaneity of activity among the nodes of large-scale networks. A few prototypic microstates, which occur in a repetitive sequence across time, can be reliably identified across participants. Researchers have proposed that these microstates represent the basic building blocks of the chain of spontaneous conscious mental processes, and that their occurrence and temporal dynamics determine the quality of mentation. Several studies have further demonstrated that disturbances of mental processes associated with neurological and psychiatric conditions manifest as changes in the temporal dynamics of specific microstates. Combined EEG-fMRI studies and EEG source imaging studies have indicated that EEG microstates are closely associated with resting-state networks as identified using fMRI. The scale-free properties of the time series of EEG microstates explain why similar networks can be observed at such different time scales. The present review will provide an overview of these EEG microstates, available methods for analysis, the functional interpretations of findings regarding these microstates, and their behavioral and clinical correlates.

The impact of hearing aids and age-related hearing loss on auditory plasticity across three months - An electrical neuroimaging study

The present study investigates behavioral and electrophysiological auditory and cognitive-related plasticity in three groups of healthy older adults (60-77 years). Group 1 was moderately hearing-impaired, experienced hearing aid users, and fitted with new hearing aids using non-linear frequency compression (NLFC on); Group 2, also moderately hearing-impaired, used the same type of hearing aids but NLFC was switched off during the entire period of study duration (NLFC off); Group 3 represented individuals with age-appropriate hearing (NHO) as controls, who were not different in IQ, gender, or age from Group 1 and 2. At five measurement time points (M1-M5) across three months, a series of active oddball tasks were administered while EEG was recorded. The stimuli comprised syllables consisting of naturally high-pitched fricatives (/sh/, /s/, and /f/), which are hard to distinguish for individuals with presbycusis. By applying a data-driven microstate approach to obtain global field power (GFP) as a measure of processing effort, the modulations of perceptual (P50, N1, P2) and cognitive-related (N2b, P3b) auditory evoked potentials were calculated and subsequently related to behavioral changes (accuracy and reaction time) across time. All groups improved their performance across time, but NHO showed consistently higher accuracy and faster reaction times than the hearing-impaired groups, especially under difficult conditions. Electrophysiological results complemented this finding by demonstrating longer latencies in the P50 and the N1 peak in hearing aid users. Furthermore, the GFP of cognitive-related evoked potentials decreased from M1 to M2 in the NHO group, while a comparable decrease in the hearing-impaired group was only evident at M5. After twelve weeks of hearing aid use of eight hours each day, we found a significantly lower GFP in the P3b of the group with NLFC on as compared to the group with NLFC off. These findings suggest higher processing effort, as evidenced by higher GFP, in hearing-impaired individuals when compared to those with normal hearing, although the hearing-impaired show a decrease of processing effort after repeated stimulus exposure. In addition, our findings indicate that the acclimatization to a new hearing aid algorithm may take several weeks.

Electrophysiological characterization of facilitation and interference in the picture-word interference paradigm

The picture-word interference paradigm is often used to investigate the processes underlying word production. In this paradigm, participants name pictures while ignoring distractor words. The aim of this study is to investigate the processes underlying this task and how/when they differ from those involved in simple picture naming. It examines the electrophysiological signature of general interference (longer response times with than without distractors) and facilitation (shorter response times for distractor-word stimuli overlapping in phonemes/orthography) effects. Mass univariate analyses are used to determine the temporal boundaries and spatial distribution of these effects without a priori restrictions in the time/space dimensions. Topographic pattern analyses complement this information by indicating whether (and when) the neural networks differ across conditions. Results suggest that the general interference effect has two loci, the grammatical encoding and the phonological encoding of the target word, with different neural networks involved in the two tasks during part of the grammatical encoding process. Furthermore, the electrophysiological signature of interference and facilitation effects in the time window of phonological encoding is highly similar, suggesting that the two effects could result from the same underlying mechanism. These findings are discussed in the light of existing accounts of interference and facilitation effects.

Neurophysiological Modulations of Non-Verbal and Verbal Dual-Tasks Interference during Word Planning

Running a concurrent task while speaking clearly interferes with speech planning, but whether verbal vs. non-verbal tasks interfere with the same processes is virtually unknown. We investigated the neural dynamics of dual-task interference on word production using event-related potentials (ERPs) with either tones or syllables as concurrent stimuli. Participants produced words from pictures in three conditions: without distractors, while passively listening to distractors and during a distractor detection task. Production latencies increased for tasks with higher attentional demand and were longer for syllables relative to tones. ERP analyses revealed common modulations by dual-task for verbal and non-verbal stimuli around 240 ms, likely corresponding to lexical selection. Modulations starting around 350 ms prior to vocal onset were only observed when verbal stimuli were involved. These later modulations, likely reflecting interference with phonological-phonetic encoding, were observed only when overlap between tasks was maximal and the same underlying neural circuits were engaged (cross-talk).

Longitudinal auditory learning facilitates auditory cognition as revealed by microstate analysis

The current study investigates cognitive processes as reflected in late auditory-evoked potentials as a function of longitudinal auditory learning. A normal hearing adult sample (n=15) performed an active oddball task at three consecutive time points (TPs) arranged at two week intervals, and during which EEG was recorded. The stimuli comprised of syllables consisting of a natural fricative (/sh/,/s/,/f/) embedded between two /a/ sounds, as well as morphed transitions of the two syllables that served as deviants. Perceptual and cognitive modulations as reflected in the onset and the mean global field power (GFP) of N2b- and P3b-related microstates across four weeks were investigated. We found that the onset of P3b-like microstates, but not N2b-like microstates decreased across TPs, more strongly for difficult deviants leading to similar onsets for difficult and easy stimuli after repeated exposure. The mean GFP of all N2b-like and P3b-like microstates increased more in spectrally strong deviants compared to weak deviants, leading to a distinctive activation for each stimulus after learning. Our results indicate that longitudinal training of auditory-related cognitive mechanisms such as stimulus categorization, attention and memory updating processes are an indispensable part of successful auditory learning. This suggests that future studies should focus on the potential benefits of cognitive processes in auditory training.

Spatio-temporal Dynamics of Referential and Inferential Naming: Different Brain and Cognitive Operations to Lexical Selection

Picture naming tasks are largely used to elicit the production of specific words and sentences in psycholinguistic and neuroimaging research. However, the generation of lexical concepts from a visual input is clearly not the exclusive way speech production is triggered. In inferential speech encoding, the concept is not provided from a visual input, but is elaborated though semantic and/or episodic associations. It is therefore likely that the cognitive operations leading to lexical selection and word encoding are different in inferential and referential expressive language. In particular, in picture naming lexical selection might ensue from a simple association between a perceptual visual representation and a word with minimal semantic processes, whereas richer semantic associations are involved in lexical retrieval in inferential situations. Here we address this hypothesis by analyzing ERP correlates during word production in a referential and an inferential task. The participants produced the same words elicited from pictures or from short written definitions. The two tasks displayed similar electrophysiological patterns only in the time-period preceding the verbal response. In the stimulus-locked ERPs waveform amplitudes and periods of stable global electrophysiological patterns differed across tasks after the P100 component and until 400-500 ms, suggesting the involvement of different, task-specific neural networks. Based on the analysis of the time-windows affected by specific semantic and lexical variables in each task, we conclude that lexical selection is underpinned by a different set of conceptual and brain processes, with semantic processes clearly preceding word retrieval in naming from definition whereas the semantic information is enriched in parallel with word retrieval in picture naming.

Clocking the social mind by identifying mental processes in the IAT with electrical neuroimaging

Why do people take longer to associate the word "love" with outgroup words (incongruent condition) than with ingroup words (congruent condition)? Despite the widespread use of the implicit association test (IAT), it has remained unclear whether this IAT effect is due to additional mental processes in the incongruent condition, or due to longer duration of the same processes. Here, we addressed this previously insoluble issue by assessing the spatiotemporal evolution of brain electrical activity in 83 participants. From stimulus presentation until response production, we identified seven processes. Crucially, all seven processes occurred in the same temporal sequence in both conditions, but participants needed more time to perform one early occurring process (perceptual processing) and one late occurring process (implementing cognitive control to select the motor response) in the incongruent compared with the congruent condition. We also found that the latter process contributed to individual differences in implicit bias. These results advance understanding of the neural mechanics of response time differences in the IAT: They speak against theories that explain the IAT effect as due to additional processes in the incongruent condition and speak in favor of theories that assume a longer duration of specific processes in the incongruent condition. More broadly, our data analysis approach illustrates the potential of electrical neuroimaging to illuminate the temporal organization of mental processes involved in social cognition.

The role of auditory cortices in the retrieval of single-trial auditory-visual object memories

Single-trial encounters with multisensory stimuli affect both memory performance and early-latency brain responses to visual stimuli. Whether and how auditory cortices support memory processes based on single-trial multisensory learning is unknown and may differ qualitatively and quantitatively from comparable processes within visual cortices due to purported differences in memory capacities across the senses. We recorded event-related potentials (ERPs) as healthy adults (n = 18) performed a continuous recognition task in the auditory modality, discriminating initial (new) from repeated (old) sounds of environmental objects. Initial presentations were either unisensory or multisensory; the latter entailed synchronous presentation of a semantically congruent or a meaningless image. Repeated presentations were exclusively auditory, thus differing only according to the context in which the sound was initially encountered. Discrimination abilities (indexed by d') were increased for repeated sounds that were initially encountered with a semantically congruent image versus sounds initially encountered with either a meaningless or no image. Analyses of ERPs within an electrical neuroimaging framework revealed that early stages of auditory processing of repeated sounds were affected by prior single-trial multisensory contexts. These effects followed from significantly reduced activity within a distributed network, including the right superior temporal cortex, suggesting an inverse relationship between brain activity and behavioural outcome on this task. The present findings demonstrate how auditory cortices contribute to long-term effects of multisensory experiences on auditory object discrimination. We propose a new framework for the efficacy of multisensory processes to impact both current multisensory stimulus processing and unisensory discrimination abilities later in time.

Does my brain want what my eyes like? - How food liking and choice influence spatio-temporal brain dynamics of food viewing

How food valuation and decision-making influence the perception of food is of major interest to better understand food intake behavior and, by extension, body weight management. Our study investigated behavioral responses and spatio-temporal brain dynamics by means of visual evoked potentials (VEPs) in twenty-two normal-weight participants when viewing pairs of food photographs. Participants rated how much they liked each food item (valuation) and subsequently chose between the two alternative food images. Unsurprisingly, strongly liked foods were also chosen most often. Foods were rated faster as strongly liked than as mildly liked or disliked irrespective of whether they were subsequently chosen over an alternative. Moreover, strongly liked foods were subsequently also chosen faster than the less liked alternatives. Response times during valuation and choice were positively correlated, but only when foods were liked; the faster participants rated foods as strongly liked, the faster they were in choosing the food item over an alternative. VEP modulations by the level of liking attributed as well as the subsequent choice were found as early as 135-180ms after food image onset. Analyses of neural source activity patterns over this time interval revealed an interaction between liking and the subsequent choice within the insula, dorsal frontal and superior parietal regions. The neural responses to food viewing were found to be modulated by the attributed level of liking only when foods were chosen, not when they were dismissed for an alternative. Therein, the responses to disliked foods were generally greater than those to foods that were liked more. Moreover, the responses to disliked but chosen foods were greater than responses to disliked foods which were subsequently dismissed for an alternative offer. Our findings show that the spatio-temporal brain dynamics to food viewing are immediately influenced both by how much foods are liked and by choices taken on them. These valuation and choice processes are subserved by brain regions involved in salience and reward attribution as well as in decision-making processes, which are likely to influence prospective dietary choices in everyday life.

Do speakers have access to a mental syllabary? ERP comparison of high frequency and novel syllable production

The transformation of an abstract phonological code into articulation has been hypothesized to involve the retrieval of stored syllable-sized motor plans. Accordingly, gestural scores for frequently used syllables are retrieved from memory whereas gestural scores for novel and possibly low frequency syllables are assembled on-line. The present study was designed to test this hypothesis. Participants produced disyllabic pseudowords with high frequency, low frequency and non-existent (novel) initial syllables. Behavioral results revealed slower production latencies for novel than for high frequency syllables. Event-related potentials diverged in waveform amplitudes and global topographic patterns between high frequency and low frequency/novel syllables around 170 ms before the onset of articulation. These differences indicate the recruitment of different brain networks during the production of frequent and infrequent/novel syllables, in line with the hypothesis that speakers store syllabic-sized motor programs for frequent syllables and assemble these motor plans on-line for low frequency and novel syllables.

Contextual factors multiplex to control multisensory processes

This study analyzed high-density event-related potentials (ERPs) within an electrical neuroimaging framework to provide insights regarding the interaction between multisensory processes and stimulus probabilities. Specifically, we identified the spatiotemporal brain mechanisms by which the proportion of temporally congruent and task-irrelevant auditory information influences stimulus processing during a visual duration discrimination task. The spatial position (top/bottom) of the visual stimulus was indicative of how frequently the visual and auditory stimuli would be congruent in their duration (i.e., context of congruence). Stronger influences of irrelevant sound were observed when contexts associated with a high proportion of auditory-visual congruence repeated and also when contexts associated with a low proportion of congruence switched. Context of congruence and context transition resulted in weaker brain responses at 228 to 257 ms poststimulus to conditions giving rise to larger behavioral cross-modal interactions. Importantly, a control oddball task revealed that both congruent and incongruent audiovisual stimuli triggered equivalent non-linear multisensory interactions when congruence was not a relevant dimension. Collectively, these results are well explained by statistical learning, which links a particular context (here: a spatial location) with a certain level of top-down attentional control that further modulates cross-modal interactions based on whether a particular context repeated or changed. The current findings shed new light on the importance of context-based control over multisensory processing, whose influences multiplex across finer and broader time scales.

Dynamic spatiotemporal brain analyses using high-performance electrical neuroimaging, Part II: A step-by-step tutorial

Our recently published analytic toolbox (Cacioppo et al., 2014), running under MATLAB environment and Brainstorm, offered a theoretical framework and set of validation studies for the automatic detection of event-related changes in the global pattern and global field power of electrical brain activity. Here, we provide a step-by-step tutorial of this toolbox along with a detailed description of analytical plans (aka the Chicago Electrical Neuroimaging Analytics, CENA) for the statistical analysis of brain microstate configuration and global field power in within and between-subject designs. Available CENA functions include: (1) a difference wave function; (2) a high-performance microsegmentation suite (HPMS), which consists of three specific analytic tools: (i) a root mean square error (RMSE) metric for identifying stable states and transition states across discrete event-related brain microstates; (ii) a similarity metric based on cosine distance in n dimensional sensor space to determine whether template maps for successive brain microstates differ in configuration of brain activity, and (iii) global field power (GFP) metrics for identifying changes in the overall level of activation of the brain; (3) a bootstrapping function for assessing the extent to which the solutions identified in the HPMS are robust (reliable, generalizable) and for empirically deriving additional experimental hypotheses; and (4) step-by-step procedures for performing a priori contrasts for data analysis. CENA is freely available for brain data spatiotemporal analyses at https://hpenlaboratory.uchicago.edu/page/cena, with sample data, user tutorial videos, and documentation.

The multisensory function of the human primary visual cortex

It has been nearly 10 years since Ghazanfar and Schroeder (2006) proposed that the neocortex is essentially multisensory in nature. However, it is only recently that sufficient and hard evidence that supports this proposal has accrued. We review evidence that activity within the human primary visual cortex plays an active role in multisensory processes and directly impacts behavioural outcome. This evidence emerges from a full pallet of human brain imaging and brain mapping methods with which multisensory processes are quantitatively assessed by taking advantage of particular strengths of each technique as well as advances in signal analyses. Several general conclusions about multisensory processes in primary visual cortex of humans are supported relatively solidly. First, haemodynamic methods (fMRI/PET) show that there is both convergence and integration occurring within primary visual cortex. Second, primary visual cortex is involved in multisensory processes during early post-stimulus stages (as revealed by EEG/ERP/ERFs as well as TMS). Third, multisensory effects in primary visual cortex directly impact behaviour and perception, as revealed by correlational (EEG/ERPs/ERFs) as well as more causal measures (TMS/tACS). While the provocative claim of Ghazanfar and Schroeder (2006) that the whole of neocortex is multisensory in function has yet to be demonstrated, this can now be considered established in the case of the human primary visual cortex.

Differential recruitment of brain networks during visuospatial and color processing: Evidence from ERP microstates

Recent functional magnetic resonance imaging (fMRI) studies consistently revealed contributions of fronto-parietal and related networks to the execution of a visuospatial judgment task, the so-called "Clock Task". However, due to the low temporal resolution of fMRI, the exact cortical dynamics and timing of processing during task performance could not be resolved until now. In order to clarify the detailed cortical activity and temporal dynamics, 14 healthy subjects performed an established version of the "Clock Task", which comprises a visuospatial task (angle discrimination) and a control task (color discrimination) with the same stimulus material, in an electroencephalography (EEG) experiment. Based on the time-resolved analysis of network activations (microstate analysis), differences in timing between the angle compared to the color discrimination task were found after sensory processing in a time window starting around 200 ms. Significant differences between the two tasks were observed in an analysis window from 192 ms to 776 ms. We divided this window in two parts: an early phase - from 192 ms to ∼440 ms, and a late phase - from ∼440 ms to 776 ms. For both tasks, the order of network activations and the types of networks were the same, but, in each phase, activations for the two conditions were dominated by differing network states with divergent temporal dynamics. Our results provide an important basis for the assessment of deviations in processing dynamics during visuospatial tasks in clinical populations.

Schizophrenia patients and 22q11.2 deletion syndrome adolescents at risk express the same deviant patterns of resting state EEG microstates: A candidate endophenotype of schizophrenia

Schizophrenia is a complex psychiatric disorder and many of the factors contributing to its pathogenesis are poorly understood. In addition, identifying reliable neurophysiological markers would improve diagnosis and early identification of this disease. The 22q11.2 deletion syndrome (22q11DS) is one major risk factor for schizophrenia. Here, we show further evidence that deviant temporal dynamics of EEG microstates are a potential neurophysiological marker by showing that the resting state patterns of 22q11DS are similar to those found in schizophrenia patients. The EEG microstates are recurrent topographic distributions of the ongoing scalp potential fields with temporal stability of around 80 ms that are mapping the fast reconfiguration of resting state networks. Five minutes of high-density EEG recordings was analysed from 27 adult chronic schizophrenia patients, 27 adult controls, 30 adolescents with 22q11DS, and 28 adolescent controls. In both patient groups we found increased class C, but decreased class D presence and high transition probabilities towards the class C microstates. Moreover, these aberrant temporal dynamics in the two patient groups were also expressed by perturbations of the long-range dependency of the EEG microstates. These findings point to a deficient function of the salience and attention resting state networks in schizophrenia and 22q11DS as class C and class D microstates were previously associated with these networks, respectively. These findings elucidate similarities between individuals at risk and schizophrenia patients and support the notion that abnormal temporal patterns of EEG microstates might constitute a marker for developing schizophrenia.

An exploratory analysis of Go/Nogo event-related potentials in major depression and depression following traumatic brain injury

Rates of major depressive disorder (MDD) following traumatic brain injury (TBI) are estimated to be between 20% and 45%, a higher prevalence than that seen in the general population. These increased rates may be due to specific changes in brain function following TBI. Event related potentials (ERPs) are well suited for measuring the electrophysiological differences between groups in areas of cognitive processing impaired in both MDD and TBI, such as response inhibition. The current study presented an emotional Go/Nogo task (with schematic emotional faces as stimuli) to participants with TBI, participants with MDD, and participants with both TBI and MDD (TBI-MDD). Topographical distribution of activity and global field power comparisons were made across stimulus-locked epochs between these groups and healthy controls. The results indicated that ERPs were not altered by TBI alone. Both MDD and TBI-MDD groups showed similar alterations in topographical distribution and global field power in the N2 window, as well as late epoch alterations. The MDD and TBI-MDD groups showed significantly less fronto-central negativity during the N2 window in Nogo trials compared with the control group. The MDD and TBI-MDD groups also showed significantly less global field power in Nogo trials than Go trials during the N2 window while the control group showed the opposite pattern. The MDD and TBI-MDD groups showed no mood-congruent bias in behavioural or ERP measures. The results suggest that TBI-MDD displays similar electrophysiological changes to those found in the MDD group without TBI.

Submillisecond unmasked subliminal visual stimuli evoke electrical brain responses

Subliminal perception is strongly associated to the processing of meaningful or emotional information and has mostly been studied using visual masking. In this study, we used high density 256-channel EEG coupled with an liquid crystal display (LCD) tachistoscope to characterize the spatio-temporal dynamics of the brain response to visual checkerboard stimuli (Experiment 1) or blank stimuli (Experiment 2) presented without a mask for 1 ms (visible), 500 µs (partially visible), and 250 µs (subliminal) by applying time-wise, assumption-free nonparametric randomization statistics on the strength and on the topography of high-density scalp-recorded electric field. Stimulus visibility was assessed in a third separate behavioral experiment. Results revealed that unmasked checkerboards presented subliminally for 250 µs evoked weak but detectable visual evoked potential (VEP) responses. When the checkerboards were replaced by blank stimuli, there was no evidence for the presence of an evoked response anymore. Furthermore, the checkerboard VEPs were modulated topographically between 243 and 296 ms post-stimulus onset as a function of stimulus duration, indicative of the engagement of distinct configuration of active brain networks. A distributed electrical source analysis localized this modulation within the right superior parietal lobule near the precuneus. These results show the presence of a brain response to submillisecond unmasked subliminal visual stimuli independently of their emotional saliency or meaningfulness and opens an avenue for new investigations of subliminal stimulation without using visual masking.

Electrophysiological evidence for a specific neural correlate of musical violation expectation in primary-school children

The majority of studies on music processing in children used simple musical stimuli. Here, primary schoolchildren judged the appropriateness of musical closure in expressive polyphone music, while high-density electroencephalography was recorded. Stimuli ended either regularly or contained refined in-key harmonic transgressions at closure. The children discriminated the transgressions well above chance. Regular and transgressed endings evoked opposite scalp voltage configurations peaking around 400ms after stimulus onset with bilateral frontal negativity for regular and centro-posterior negativity (CPN) for transgressed endings. A positive correlation could be established between strength of the CPN response and rater sensitivity (d-prime). We also investigated whether the capacity to discriminate the transgressions was supported by auditory domain specific or general cognitive mechanisms, and found that working memory capacity predicted transgression discrimination. Latency and distribution of the CPN are reminiscent of the N400, typically observed in response to semantic incongruities in language. Therefore our observation is intriguing, as the CPN occurred here within an intra-musical context, without any symbols referring to the external world. Moreover, the harmonic in-key transgressions that we implemented may be considered syntactical as they transgress structural rules. Such structural incongruities in music are typically followed by an early right anterior negativity (ERAN) and an N5, but not so here. Putative contributive sources of the CPN were localized in left pre-motor, mid-posterior cingulate and superior parietal regions of the brain that can be linked to integration processing. These results suggest that, at least in children, processing of syntax and meaning may coincide in complex intra-musical contexts.

ERP topographic analyses from concept to articulation in word production studies

Most ERP studies using overt speech production tasks have analyzed fixed time-windows of stimulus-aligned ERPs, not exceeding the fastest production latency. These fixed ERP time-windows may cover the whole speech planning process for fast trials or participants, but only part of the planning processes for trials or participants with production latencies exceeding the analyzed period. Two core questions thus emerge when analysing fixed time-windows in overt language production, namely (1) to what extent do ERPs capture "later" encoding processes, especially phonological and phonetic encoding, and (2) how to account for different production latencies across conditions or individuals. Here we review a methodological approach combining waveform and topographic analyses on integrated stimulus- and response-aligned ERPs according to response latencies in each participant and condition. Then we illustrate the approach with a picture naming task. Crucially for the purpose of the methodological illustration, the separate analysis of fixed stimulus- and response-locked ERPs led to a counter-intuitive result (longer lasting periods of stable global electrophysiological activity for the fastest condition). Coherent results with longer lasting periods of topographic stability in the slower condition only appeared when combining stimulus- and response-aligned ERPs in order to cover the actual word planning time-windows. Thus this combined analysis enabled to disentangle the possible interpretations of the neurophysiological processes underlying differences across conditions observed on waveforms and on topographies in the fixed ERP periods.

Whole-scalp EEG mapping of somatosensory evoked potentials in macaque monkeys

High-density scalp EEG recordings are widely used to study whole-brain neuronal networks in humans non-invasively. Here, we validate EEG mapping of somatosensory evoked potentials (SSEPs) in macaque monkeys (Macaca fascicularis) for the long-term investigation of large-scale neuronal networks and their reorganisation after lesions requiring a craniotomy. SSEPs were acquired from 33 scalp electrodes in five adult anaesthetized animals after electrical median or tibial nerve stimulation. SSEP scalp potential maps were identified by cluster analysis and identified in individual recordings. A distributed, linear inverse solution was used to estimate the intracortical sources of the scalp potentials. SSEPs were characterised by a sequence of components with unique scalp topographies. Source analysis confirmed that median nerve SSEP component maps were in accordance with the somatotopic organisation of the sensorimotor cortex. Most importantly, SSEP recordings were stable both intra- and interindividually. We aim to apply this method to the study of recovery and reorganisation of large-scale neuronal networks following a focal cortical lesion requiring a craniotomy. As a prerequisite, the present study demonstrated that a 300-mm² unilateral craniotomy over the sensorimotor cortex necessary to induce a cortical lesion, followed by bone flap repositioning, suture and gap plugging with calcium phosphate cement, did not induce major distortions of the SSEPs. In conclusion, SSEPs can be successfully and reproducibly recorded from high-density EEG caps in macaque monkeys before and after a craniotomy, opening new possibilities for the long-term follow-up of the cortical reorganisation of large-scale networks in macaque monkeys after a cortical lesion.

Very early processing of emotional words revealed in temporoparietal junctions of both hemispheres by EEG and TMS

We investigate the contribution of both hemispheres in a lateralised lexical decision paradigm with emotional and neutral words in healthy volunteers. In a first experiment, high-density EEG analysis using source imaging methods revealed early specific participation of the temporoparietal junctions (TPJ) in both hemispheres for the detection of words. Then, in an event-related transcranial magnetic stimulation experiment with the same task, the disruption of left or right TPJ compared with a control stimulation over the vertex showed a slowing that is more pronounced when words are emotional and presented in the left visual field (LVF). This indicates that interference with both left and right TPJ results in impaired processing of words that were presented to the LVF. In addition, these results point to a specific cooperative contribution of the right hemisphere in the processing of words with emotional content compared with neutral words at very early stages. Results from the two experiments can be integrated in a brain-based spatiotemporal model of the early detection of written words.

Using Dynamic Bayesian Networks for modeling EEG topographic sequences

In this work we present a methodology for modeling the trajectory of EEG topography over time, using Dynamic Bayesian Networks (DBNs). Based on the microstate model we are using DBNs to model the evolution of the EEG topography. Analysis of the microstate model is being usually limited in the wide band signal or an isolated band. We are using Coupled Hidden Markov Models (CHMM) and a two level influence model in order to model the temporal evolution and the coupling of the topography states in three bands, delta, theta and alpha. We are applying this methodology for the classification of target and non-target single trial from a visual detection task. The results indicate that taking under consideration the interaction among the different bands improves the classification of single trials.