Simultaneous EEG-fMRI reveals attention-dependent coupling of early face processing with a distributed cortical network

Linking tonic and phasic pupil responses to P300 amplitude in an emotional face-word Stroop task

The locus coeruleus-norepinephrine (LC-NE) system, which regulates arousal levels, is important for cognitive control, including emotional conflict resolution. Additionally, the LC-NE system is implicated in P300 generation. If the P300 is mediated by the LC-NE system, and considering the established correlations between LC activity and pupil dilation, P300 amplitude should correlate with task-evoked (phasic) pupil dilation on a trial-by-trial basis. However, prior studies, predominantly utilizing oddball-type paradigms, have not demonstrated correlations between concurrently recorded task-evoked pupil dilation and P300 responses. Using a recently developed emotional face-word Stroop task that links pupil dilation to the LC-NE system, here, we examined both intra- and inter-individual correlations between task-evoked pupil dilation and P300 amplitude. We found that lower accuracy, slower reaction times, and larger task-evoked pupil dilation were obtained in the incongruent compared to the congruent condition. Furthermore, we observed intra-individual correlations between task-evoked pupil dilation and P300 amplitude, with larger pupil dilation correlating with a greater P300 amplitude. In contrast, pupil dilation did not exhibit consistent correlations with N450 and N170 amplitudes. Baseline (tonic) pupil size also showed correlations with P300 and N170 amplitudes, with smaller pupil size corresponding to larger amplitude. Moreover, inter-individual differences in task-evoked pupil dilation between the congruent and incongruent conditions correlated with differences in reaction time and P300 amplitude, though these effects only approached significance. To summarize, our study provides evidence for a connection between task-evoked pupil dilation and P300 amplitude at the single-trial level, suggesting the involvement of the LC-NE system in P300 generation.

Using multi-modal neuroimaging to characterise social brain specialisation in infants

The specialised regional functionality of the mature human cortex partly emerges through experience-dependent specialisation during early development. Our existing understanding of functional specialisation in the infant brain is based on evidence from unitary imaging modalities and has thus focused on isolated estimates of spatial or temporal selectivity of neural or haemodynamic activation, giving an incomplete picture. We speculate that functional specialisation will be underpinned by better coordinated haemodynamic and metabolic changes in a broadly orchestrated physiological response. To enable researchers to track this process through development, we develop new tools that allow the simultaneous measurement of coordinated neural activity (EEG), metabolic rate, and oxygenated blood supply (broadband near-infrared spectroscopy) in the awake infant. In 4- to 7-month-old infants, we use these new tools to show that social processing is accompanied by spatially and temporally specific increases in coupled activation in the temporal-parietal junction, a core hub region of the adult social brain. During non-social processing, coupled activation decreased in the same region, indicating specificity to social processing. Coupling was strongest with high-frequency brain activity (beta and gamma), consistent with the greater energetic requirements and more localised action of high-frequency brain activity. The development of simultaneous multimodal neural measures will enable future researchers to open new vistas in understanding functional specialisation of the brain.

Beyond facial expressions: A systematic review on effects of emotional relevance of faces on the N170

The N170 is the most prominent electrophysiological signature of face processing. While facial expressions reliably modulate the N170, there is considerable variance in N170 modulations by other sources of emotional relevance. Therefore, we systematically review and discuss this research area using different methods to manipulate the emotional relevance of inherently neutral faces. These methods were categorized into (1) existing pre-experimental affective person knowledge (e.g., negative attitudes towards outgroup faces), (2) experimentally instructed affective person knowledge (e.g., negative person information), (3) contingency-based affective learning (e.g., fear-conditioning), or (4) the immediate affective context (e.g., emotional information directly preceding the face presentation). For all categories except the immediate affective context category, the majority of studies reported significantly increased N170 amplitudes depending on the emotional relevance of faces. Furthermore, the potentiated N170 was observed across different attention conditions, supporting the role of the emotional relevance of faces on the early prioritized processing of configural facial information, regardless of low-level differences. However, we identified several open research questions and suggest venues for further research.

Multiple functions of the angular gyrus at high temporal resolution

Here, the functions of the angular gyrus (AG) are evaluated in the light of current evidence from transcranial magnetic/electric stimulation (TMS/TES) and EEG/MEG studies. 65 TMS/TES and 52 EEG/MEG studies were examined in this review. TMS/TES literature points to a causal role in semantic processing, word and number processing, attention and visual search, self-guided movement, memory, and self-processing. EEG/MEG studies reported AG effects at latencies varying between 32 and 800 ms in a wide range of domains, with a high probability to detect an effect at 300-350 ms post-stimulus onset. A three-phase unifying model revolving around the process of sensemaking is then suggested: (1) early AG involvement in defining the current context, within the first 200 ms, with a bias toward the right hemisphere; (2) attention re-orientation and retrieval of relevant information within 200-500 ms; and (3) cross-modal integration at late latencies with a bias toward the left hemisphere. This sensemaking process can favour accuracy (e.g. for word and number processing) or plausibility (e.g. for comprehension and social cognition). Such functions of the AG depend on the status of other connected regions. The much-debated semantic role is also discussed as follows: (1) there is a strong TMS/TES evidence for a causal semantic role, (2) current EEG/MEG evidence is however weak, but (3) the existing arguments against a semantic role for the AG are not strong. Some outstanding questions for future research are proposed. This review recognizes that cracking the role(s) of the AG in cognition is possible only when its exact contributions within the default mode network are teased apart.

Effects of selective attention on the C1 ERP component: A systematic review and meta-analysis

The C1 event-related potential (ERP) captures the earliest stage of feedforward processing in the primary visual cortex (V1). An ongoing debate is whether top-down selective attention can modulate the C1. One side of the debate pointed out that null findings appear to outnumber positive findings; thus, selective attention does not seem to influence the C1. However, this suggestion is not based on a valid approach to summarizing evidence across studies. Therefore, we conducted a systematic review and meta-analysis investigating the effects of selective attention on the C1, involving 47 experiments and 794 subjects in total. Despite heterogeneity across studies, results suggested that attention has a moderate effect on the C1 (Cohen's d z $$ {d}_z $$  = 0.33, p < .0001); that is, C1 amplitude is larger for visual stimuli that are attended than unattended. These results suggest that C1 is affected by top-down selective attention.

Spatially Adjacent Regions in Posterior Cingulate Cortex Represent Familiar Faces at Different Levels of Complexity

Extensive research has shown that perceptual information of faces is processed in a network of hierarchically-organized areas within ventral temporal cortex. For familiar and famous faces, perceptual processing of faces is normally accompanied by extraction of semantic knowledge about the social status of persons. Semantic processing of familiar faces could entail progressive stages of information abstraction. However, the cortical mechanisms supporting multistage processing of familiar faces have not been characterized. Here, using an event-related fMRI experiment, familiar faces from four celebrity groups (actors, singers, politicians, and football players) and unfamiliar faces were presented to the human subjects (both males and females) while they were engaged in a face categorization task. We systematically explored the cortical representations for faces, familiar faces, subcategories of familiar faces, and familiar face identities using whole-brain univariate analysis, searchlight-based multivariate pattern analysis (MVPA), and functional connectivity analysis. Convergent evidence from all these analyses revealed a set of overlapping regions within posterior cingulate cortex (PCC) that contained decodable fMRI responses for representing different levels of semantic knowledge about familiar faces. Our results suggest a multistage pathway in PCC for processing semantic information of faces, analogous to the multistage pathway in ventral temporal cortex for processing perceptual information of faces.SIGNIFICANCE STATEMENT Recognizing familiar faces is an important component of social communications. Previous research has shown that a distributed network of brain areas is involved in processing the semantic information of familiar faces. However, it is not clear how different levels of semantic information are represented in the brain. Here, we evaluated the multivariate response patterns across the entire cortex to discover the areas that contain information for familiar faces, subcategories of familiar faces, and identities of familiar faces. The searchlight maps revealed that different levels of semantic information are represented in topographically adjacent areas within posterior cingulate cortex (PCC). The results suggest that semantic processing of faces is mediated through progressive stages of information abstraction in PCC.

Inferring Macroscale Brain Dynamics via Fusion of Simultaneous EEG-fMRI

Advances in the instrumentation and signal processing for simultaneously acquired electroencephalography and functional magnetic resonance imaging (EEG-fMRI) have enabled new ways to observe the spatiotemporal neural dynamics of the human brain. Central to the utility of EEG-fMRI neuroimaging systems are the methods for fusing the two data streams, with machine learning playing a key role. These methods can be dichotomized into those that are symmetric and asymmetric in terms of how the two modalities inform the fusion. Studies using these methods have shown that fusion yields new insights into brain function that are not possible when each modality is acquired separately. As technology improves and methods for fusion become more sophisticated, the future of EEG-fMRI for noninvasive measurement of brain dynamics includes mesoscale mapping at ultrahigh magnetic resonance fields, targeted perturbation-based neuroimaging, and using deep learning to uncover nonlinear representations that link the electrophysiological and hemodynamic measurements.

How Does Fearful Emotion Affect Visual Attention?

It has long been suggested that emotion, especially threatening emotion, facilitates early visual perception to promote adaptive responses to potential threats in the environment. Here, we tested whether and how fearful emotion affects the basic visual ability of visual acuity. An adapted Posner’s spatial cueing task was employed, with fearful and neutral faces as cues and a Vernier discrimination task as the probe. The time course of the emotional attention effect was examined by varying the stimulus onset asynchrony (SOA) of the cue and probe. Two independent experiments (Experiments 1 and 3) consistently demonstrated that the brief presentation of a fearful face increased visual acuity at its location. The facilitation of perceptual sensitivity was detected at an SOA around 300 ms when the face cues were presented for both 250 ms (Experiment 1) and 150 ms (Experiment 3). This effect cannot be explained by physical differences between the fearful and neutral faces because no improvement was found when the faces were presented inverted (Experiment 2). In the last experiment (Experiment 4), the face cues were flashed very briefly (17 ms), and we did not find any improvement induced by the fearful face. Overall, we provide evidence that emotion interacts with attention to affect basic visual functions.

Impaired Frontoparietal Connectivity in Traumatic Individuals with Disorders of Consciousness: A Dynamic Brain Network Analysis

Recent advances in neuroimaging have demonstrated that patients with disorders of consciousness (DOC) may retain residual consciousness through activation of a complex functional brain network. However, an understanding of the hierarchy of residual consciousness and dynamic network connectivity in DOC patients is lacking. This study aimed to investigate residual consciousness and the dynamics of neural processing in DOC patients. We included 42 patients with DOC, categorized by aetiology. Event-related potentials combined with time-varying electroencephalography networks were used to probe affective consciousness in DOC and examine the related network mechanisms. The results showed an obvious frontal P3a component among patients in minimally conscious state (MCS), while a prominent N1 was observed in unresponsive wakefulness syndrome (UWS). No late positive potential (LPP) was detected in these patients. Next, we divided the results by aetiology. Patients with nontraumatic injury presented an obvious frontal P3a response compared to those with traumatic injury. With respect to the dynamic network mechanism, patients with UWS, both with and without trauma, exhibited impaired frontoparietal network connectivity during the middle to late emotion processing period (P3a and LPP). Surprisingly, unconscious post-traumatic patients had an evident deficit in top-down connectivity. This, it appears that early automatic sensory identification is preserved in UWS and that exogenous attention was preserved even in MCS. However, high-level cognitive abilities were severely attenuated in unconscious patients. We also speculate that reduced frontoparietal connectivity may be useful as a biomarker to distinguish patients in an MCS from those with UWS given the same aetiology.

Empathy and emotion regulation: An integrative account

How we understand and respond to others' emotions (i.e., empathy) may be influenced by the regulatory processes that are used to shape which emotions we and others have (i.e., emotion regulation). Empathy and emotion regulation are complex multidimensional constructs and the relationship between their component processes is not well characterized. To enable future work to examine their relationship more closely, this chapter presents an integrative framework of empathy and emotion regulation. We begin by delineating the component processes that underlie empathy and emotion regulation, and the neural underpinnings of these processes. We then present an integrative framework describing the processes of empathy and how these may be acted upon by distinct regulatory strategies. We conclude with a brief consideration of contextual influences on empathy and emotion regulation using a reward-based heuristic.