Repetition suppression of face-selective evoked and induced EEG recorded from human cortex

Neurophysiological and Autonomic Dynamics of Threat Processing During Sustained Social Fear Generalization

Survival in dynamic environments requires that organisms learn to predict danger from situational cues. One key facet of threat prediction is generalization from a predictive cue to similar cues, ensuring that a cue-outcome contingency is applied beyond the original learning environment. Generalization has been observed in laboratory studies of aversive conditioning: behavioral and physiological processes generalize responses from a stimulus paired with threat (the CS+) to unpaired stimuli, with response magnitudes varying with CS+ similarity. In contrast, work focusing on sensory responses in visual cortex has found a sharpening pattern, in which responses to stimuli closely resembling the CS+ are maximally suppressed, potentially reflecting lateral inhibitory interactions with the CS+ representation. Originally demonstrated with simple visual cues, changes in visuocortical tuning have also been observed in threat generalization learning across facial identities. It is unclear to what extent these visuocortical changes represent transient or sustained effects and if generalization learning requires prior conditioning to the CS+. The present study addressed these questions using EEG and pupillometry in an aversive generalization paradigm involving hundreds of trials using a gradient of facial identities. Visuocortical ssVEP sharpening occurred after dozens of trials of generalization learning without prior differential conditioning, but diminished as learning continued. By contrast, generalization of alpha power suppression, pupil dilation, and self-reported valence and arousal was seen throughout the experiment. Findings are consistent with threat processing models emphasizing the role of changing visucocortical and attentional dynamics when forming, curating, and shaping fear memories as observers continue learning about stimulus-outcome contingencies.

Reduction or enhancement? Repetition effects on early brain potentials during visual word recognition are frequency dependent

Most studies on word repetition have demonstrated that repeated stimuli yield reductions in brain activity. Despite the well-known repetition reduction effect, some literature reports repetition enhancements in electroencephalogram (EEG) activities. However, although studies of object and face recognition have consistently demonstrated both repetition reduction and enhancement effects, the results of repetition enhancement effects were not consistent in studies of visual word recognition. Therefore, the present study aimed to further investigate the repetition effect on the P200, an early event-related potential (ERP) component that indexes the coactivation of lexical candidates during visual word recognition. To achieve a high signal-to-noise ratio, EEG signals were decomposed into various modes by using the Hilbert-Huang transform. Results demonstrated a repetition enhancement effect on P200 activity in alpha-band oscillation and that lexicality and orthographic neighborhood size would influence the magnitude of the repetition enhancement effect on P200. These findings suggest that alpha activity during visual word recognition might reflect the coactivation of orthographically similar words in the early stages of lexical processing. Meantime, there were repetition reduction effects on ERP activities in theta-delta band oscillation, which might index that the lateral inhibition between lexical candidates would be omitted in repetition.

Dynamic cortical and tractography atlases of proactive and reactive alpha and high-gamma activities

Alpha waves-posterior dominant rhythms at 8-12 Hz reactive to eye opening and closure-are among the most fundamental EEG findings in clinical practice and research since Hans Berger first documented them in the early 20th century. Yet, the exact network dynamics of alpha waves in regard to eye movements remains unknown. High-gamma activity at 70-110 Hz is also reactive to eye movements and a summary measure of local cortical activation supporting sensorimotor or cognitive function. We aimed to build the first-ever brain atlases directly visualizing the network dynamics of eye movement-related alpha and high-gamma modulations, at cortical and white matter levels. We studied 28 patients (age: 5-20 years) who underwent intracranial EEG and electro-oculography recordings. We measured alpha and high-gamma modulations at 2167 electrode sites outside the seizure onset zone, interictal spike-generating areas and MRI-visible structural lesions. Dynamic tractography animated white matter streamlines modulated significantly and simultaneously beyond chance, on a millisecond scale. Before eye-closure onset, significant alpha augmentation occurred at the occipital and frontal cortices. After eye-closure onset, alpha-based functional connectivity was strengthened, while high gamma-based connectivity was weakened extensively in both intra-hemispheric and inter-hemispheric pathways involving the central visual areas. The inferior fronto-occipital fasciculus supported the strengthened alpha co-augmentation-based functional connectivity between occipital and frontal lobe regions, whereas the posterior corpus callosum supported the inter-hemispheric functional connectivity between the occipital lobes. After eye-opening offset, significant high-gamma augmentation and alpha attenuation occurred at occipital, fusiform and inferior parietal cortices. High gamma co-augmentation-based functional connectivity was strengthened, whereas alpha-based connectivity was weakened in the posterior inter-hemispheric and intra-hemispheric white matter pathways involving central and peripheral visual areas. Our results do not support the notion that eye closure-related alpha augmentation uniformly reflects feedforward or feedback rhythms propagating from lower to higher order visual cortex, or vice versa. Rather, proactive and reactive alpha waves involve extensive, distinct white matter networks that include the frontal lobe cortices, along with low- and high-order visual areas. High-gamma co-attenuation coupled to alpha co-augmentation in shared brain circuitry after eye closure supports the notion of an idling role for alpha waves during eye closure. These normative dynamic tractography atlases may improve understanding of the significance of EEG alpha waves in assessing the functional integrity of brain networks in clinical practice; they also may help elucidate the effects of eye movements on task-related brain network measures observed in cognitive neuroscience research.

Distinct interacting cortical networks for stimulus-response and repetition-suppression

Non-invasive studies consider the initial neural stimulus response (SR) and repetition suppression (RS) - the decreased response to repeated sensory stimuli - as engaging the same neurons. That is, RS is a suppression of the SR. We challenge this conjecture using electrocorticographic (ECoG) recordings with high spatial resolution in ten patients listening to task-irrelevant trains of auditory stimuli. SR and RS were indexed by high-frequency activity (HFA) across temporal, parietal, and frontal cortices. HFASR and HFARS were temporally and spatially distinct, with HFARS emerging later than HFASR and showing only a limited spatial intersection with HFASR: most HFASR sites did not demonstrate HFARS, and HFARS was found where no HFASR could be recorded. β activity was enhanced in HFARS compared to HFASR cortical sites. θ activity was enhanced in HFASR compared to HFARS sites. Furthermore, HFASR sites propagated information to HFARS sites via transient θ:β phase-phase coupling. In contrast to predictive coding (PC) accounts our results indicate that HFASR and HFARS are functionally linked but have minimal spatial overlap. HFASR might enable stable and rapid perception of environmental stimuli across extended temporal intervals. In contrast HFARS might support efficient generation of an internal model based on stimulus history.

Developmental organization of neural dynamics supporting auditory perception

Purpose:

A prominent view of language acquisition involves learning to ignore irrelevant auditory signals through functional reorganization, enabling more efficient processing of relevant information. Yet, few studies have characterized the neural spatiotemporal dynamics supporting rapid detection and subsequent disregard of irrelevant auditory information, in the developing brain. To address this unknown, the present study modeled the developmental acquisition of cost-efficient neural dynamics for auditory processing, using intracranial electrocorticographic responses measured in individuals receiving standard-of-care treatment for drug-resistant, focal epilepsy. We also provided evidence demonstrating the maturation of an anterior-to-posterior functional division within the superior-temporal gyrus (STG), which is known to exist in the adult STG.

Methods:

We studied 32 patients undergoing extraoperative electrocorticography (age range: eight months to 28 years) and analyzed 2,039 intracranial electrode sites outside the seizure onset zone, interictal spike-generating areas, and MRI lesions. Patients were given forward (normal) speech sounds, backward-played speech sounds, and signal-correlated noises during a task-free condition. We then quantified sound processing-related neural costs at given time windows using high-gamma amplitude at 70–110 Hz and animated the group-level high-gamma dynamics on a spatially normalized three-dimensional brain surface. Finally, we determined if age independently contributed to high-gamma dynamics across brain regions and time windows.

Results:

Group-level analysis of noise-related neural costs in the STG revealed developmental enhancement of early high-gamma augmentation and diminution of delayed augmentation. Analysis of speech-related high-gamma activity demonstrated an anterior-to-posterior functional parcellation in the STG. The left anterior STG showed sustained augmentation throughout stimulus presentation, whereas the left posterior STG showed transient augmentation after stimulus onset. We found a double dissociation between the locations and developmental changes in speech sound-related high-gamma dynamics. Early left anterior STG high-gamma augmentation (i.e., within 200 ms post-stimulus onset) showed developmental enhancement, whereas delayed left posterior STG high-gamma augmentation declined with development.

Conclusions:

Our observations support the model that, with age, the human STG refines neural dynamics to rapidly detect and subsequently disregard uninformative acoustic noises. Our study also supports the notion that the anterior-to-posterior functional division within the left STG is gradually strengthened for efficient speech sound perception after birth.

Distinct Effects of Stimulus Repetition on Various Temporal Stages of Subject's Own Name Processing

The self is one of the most important concepts in psychology, which is of great significance for human survival and development. As an important self-related stimulus, the subject’s own name (SON) shows great advantages in cognitive and social processing and is widely used as an oddball stimulus in previous studies. However, it remained unknown whether the multiple repetition of stimulus would have similar influence on the neural response to SON and the other names under equal probability. In this study, adopting EEG and an equal–probability paradigm, we first detected the SON-related ERP components which could differentiate SON from other names, and then investigated how these components are influenced by repeated exposure of the stimulus. Our results showed that SON evoked an earlier SON-related negativity (SRN) at the fronto-central region and a late positive potential (LPP) at the centro-parietal region. More intriguingly, the earlier SRN demonstrated reduction after multiple repetitions, whereas LPP did not exhibit significant changes. In conclusion, these findings revealed that multiple repetitions of the stimulus might influence the various temporal stages in SON-related processing and highlighted the robustness of the late stage in this processing.

Temporally and functionally distinct large-scale brain network dynamics supporting task switching

Objective:

Our daily activities require frequent switches among competing responses at the millisecond time scale. We determined the spatiotemporal characteristics and functional significance of rapid, large-scale brain network dynamics during task switching.

Methods:

This cross-sectional study investigated patients with drug-resistant focal epilepsy who played a Lumosity cognitive flexibility training game during intracranial electroencephalography (iEEG) recording. According to a given task rule, unpredictably switching across trials, participants had to swipe the screen in the direction the stimulus was pointing or moving. Using this data, we described the spatiotemporal characteristics of iEEG high-gamma augmentation occurring more intensely during switch than repeat trials, unattributable to the effect of task rule (pointing or moving), within-stimulus congruence (the direction of stimulus pointing and moving was same or different in a given trial), or accuracy of an immediately preceding response. Diffusion-weighted imaging (DWI) tractography determined whether distant cortical regions showing enhanced activation during task switch trials were directly connected by white matter tracts. Trial-by-trial iEEG analysis deduced whether the intensity of task switch-related high-gamma augmentation was altered through practice and whether high-gamma amplitude predicted the accuracy of an upcoming response among switch trials.

Results:

The average number of completed trials during five-minute gameplay was 221.4 per patient (range: 171–285). Task switch trials increased the response times, whereas later trials reduced them. Analysis of iEEG signals sampled from 860 brain sites effectively elucidated the distinct spatiotemporal characteristics of task switch, task rule, and post-error-specific high-gamma modulations. Post-cue, task switch-related high-gamma augmentation was initiated in the right calcarine cortex after 260 ms, right precuneus after 330 ms, right entorhinal after 420 ms, and bilateral anterior middle-frontal gyri after 450 ms. DWI tractography successfully showed the presence of direct white matter tracts connecting the right visual areas to the precuneus and anterior middle-frontal regions but not between the right precuneus and anterior middle-frontal regions. Task-related high-gamma amplitudes in later trials were reduced in the calcarine, entorhinal and anterior middle-frontal regions, but increased in the precuneus. Functionally, enhanced post-cue precuneus high-gamma augmentation improved the accuracy of subsequent responses among switch trials.

Conclusions:

Our multimodal analysis uncovered two temporally and functionally distinct network dynamics supporting task switching. High-gamma augmentation in the visual-precuneus pathway may reflect the neural process facilitating an attentional shift to a given updated task rule. High-gamma activity in the visual-dorsolateral prefrontal pathway, rapidly reduced through practice, may reflect the cost of executing appropriate stimulus-response translation.

Oscillatory signatures of Repetition Suppression and Novelty Detection reveal altered induced visual responses in early deafness

The ability to differentiate between repeated and novel events represents a fundamental property of the visual system. Neural responses are typically reduced upon stimulus repetition, a phenomenon called Repetition Suppression (RS). On the contrary, following a novel visual stimulus, the neural response is generally enhanced, a phenomenon referred to as Novelty Detection (ND). Here, we aimed to investigate the impact of early deafness on the oscillatory signatures of RS and ND brain responses. To this aim, electrophysiological data were acquired in early deaf and hearing control individuals during processing of repeated and novel visual events unattended by participants. By studying evoked and induced oscillatory brain activities, as well as inter-trial phase coherence, we linked response modulations to feedback and/or feedforward processes. Results revealed selective experience-dependent changes on both RS and ND mechanisms. Compared to hearing controls, early deaf individuals displayed: (i) greater attenuation of the response following stimulus repetition, selectively in the induced theta-band (4-7 Hz); (ii) reduced desynchronization following the onset of novel visual stimuli, in the induced alpha and beta bands (8-12 and 13-25 Hz); (iii) comparable modulation of evoked responses and inter-trial phase coherence. The selectivity of the effects in the induced responses parallels findings observed in the auditory cortex of deaf animal models following intracochlear electric stimulation. The present results support the idea that early deafness alters induced oscillatory activity and the functional tuning of basic visual processing.

Your verbal questions beginning with 'what' will rapidly deactivate the left prefrontal cortex of listeners

The left prefrontal cortex is essential for verbal communication. It remains uncertain at what timing, to what extent, and what type of phrase initiates left-hemispheric dominant prefrontal activation during comprehension of spoken sentences. We clarified this issue by measuring event-related high-gamma activity during a task to respond to three-phrase questions configured in different orders. Questions beginning with a wh-interrogative deactivated the left posterior prefrontal cortex right after the 1st phrase offset and the anterior prefrontal cortex after the 2nd phrase offset. Left prefrontal high-gamma activity augmented subsequently and maximized around the 3rd phrase offset. Conversely, questions starting with a concrete phrase deactivated the right orbitofrontal region and then activated the left posterior prefrontal cortex after the 1st phrase offset. Regardless of sentence types, high-gamma activity emerged earlier, by one phrase, in the left posterior prefrontal than anterior prefrontal region. Sentences beginning with a wh-interrogative may initially deactivate the left prefrontal cortex to prioritize the bottom-up processing of upcoming auditory information. A concrete phrase may obliterate the inhibitory function of the right orbitofrontal region and facilitate top-down lexical prediction by the left prefrontal cortex. The left anterior prefrontal regions may be recruited for semantic integration of multiple concrete phrases.

Diverse Temporal Dynamics of Repetition Suppression Revealed by Intracranial Recordings in the Human Ventral Temporal Cortex

Repeated stimulus presentations commonly produce decreased neural responses-a phenomenon known as repetition suppression (RS) or adaptation-in ventral temporal cortex (VTC) of humans and nonhuman primates. However, the temporal features of RS in human VTC are not well understood. To fill this gap in knowledge, we utilized the precise spatial localization and high temporal resolution of electrocorticography (ECoG) from nine human subjects implanted with intracranial electrodes in the VTC. The subjects viewed nonrepeated and repeated images of faces with long-lagged intervals and many intervening stimuli between repeats. We report three main findings: 1) robust RS occurs in VTC for activity in high-frequency broadband (HFB), but not lower-frequency bands; 2) RS of the HFB signal is associated with lower peak magnitude (PM), lower total responses, and earlier peak responses; and 3) RS effects occur early within initial stages of stimulus processing and persist for the entire stimulus duration. We discuss these findings in the context of early and late components of visual perception, as well as theoretical models of repetition suppression.

Four-dimensional map of direct effective connectivity from posterior visual areas

Lower- and higher-order visual cortices in the posterior brain, ranging from the medial- and lateral-occipital to fusiform regions, are suggested to support visual object recognition, whereas the frontal eye field (FEF) plays a role in saccadic eye movements which optimize visual processing. Previous studies using electrophysiology and functional MRI techniques have reported that tasks requiring visual object recognition elicited cortical activation sequentially in the aforementioned posterior visual regions and FEFs. The present study aims to provide unique evidence of direct effective connectivity outgoing from the posterior visual regions by measuring the early component (10-50 ​ms) of cortico-cortical spectral responses (CCSRs) elicited by weak single-pulse direct cortical electrical stimulation. We studied 22 patients who underwent extraoperative intracranial EEG recording for clinical localization of seizure foci and functionally-important brain regions. We used animations to visualize the spatiotemporal dynamics of gamma band CCSRs elicited by stimulation of three different posterior visual regions. We quantified the strength of CCSR-defined effective connectivity between the lower- and higher-order posterior visual regions as well as from the posterior visual regions to the FEFs. We found that effective connectivity within the posterior visual regions was larger in the feedforward (i.e., lower-to higher-order) direction compared to the opposite direction. Specifically, connectivity from the medial-occipital region was largest to the lateral-occipital region, whereas that from the lateral-occipital region was largest to the fusiform region. Among the posterior visual regions, connectivity to the FEF was largest from the lateral-occipital region and the mean peak latency of CCSR propagation from the lateral-occipital region to FEF was 26 ​ms. Our invasive study of the human brain using a stimulation-based intervention supports the model that the posterior visual regions have direct cortico-cortical connectivity pathways in which neural activity is transferred preferentially from the lower-to higher-order areas. The human brain has direct cortico-cortical connectivity allowing a rapid transfer of neural activity from the lateral-occipital region to the FEF.

Measurement of ultra-fast signal progression related to face processing by 7T fMRI

Given that the brain is a dynamic system, the temporal characteristics of brain function are important. Previous functional magnetic resonance imaging (fMRI) studies have attempted to overcome the limitations of temporal resolution to investigate dynamic states of brain activity. However, finding an fMRI method with sufficient temporal resolution to keep up with the progress of neuronal signals in the brain is challenging. This study aimed to detect between‐hemisphere signal progression, occurring on a timescale of tens of milliseconds, in the ventral brain regions involved in face processing. To this end, we devised an inter‐stimulus interval (ISI) stimulation scheme and used a 7T MRI system to obtain fMRI signals with a high signal‐to‐noise ratio. We conducted two experiments: one to measure signal suppression depending on the ISI and another to measure the relationship between the amount of suppression and the ISI. These two experiments enabled us to measure the signal transfer time from a brain region in the ventral visual stream to its counterpart in the opposite hemisphere through the corpus callosum. These findings demonstrate the feasibility of using fMRI to measure ultra‐fast signals (tens of milliseconds) and could facilitate the elucidation of further aspects of dynamic brain function.

Affective interoceptive inference: Evidence from heart-beat evoked brain potentials

The perception of internal bodily signals (interoception) is central to many theories of emotion and embodied cognition. According to recent theoretical views, the sensory processing of visceral signals such as one's own heartbeat is determined by top-down predictions about the expected interoceptive state of the body (interoceptive inference). In this EEG study we examined neural responses to heartbeats following expected and unexpected emotional stimuli. We used a modified stimulus repetition task in which pairs of facial expressions were presented with repeating or alternating emotional content, and we manipulated the emotional valence and the likelihood of stimulus repetition. We found that affective predictions of external socially relevant information modulated the heartbeat-evoked potential, a marker of cardiac interoception. Crucially, the HEP changes highly relied on the expected emotional content of the facial expression. Thus, expected negative faces led to a decreased HEP amplitude, whereas such an effect was not observed after an expected neutral face. These results suggest that valence-specific affective predictions, and their uniquely associated predicted bodily sensory state, can reduce or amplify cardiac interoceptive responses. In addition, the affective repetition effects were dependent on repetition probability, highlighting the influence of top-down exteroceptive predictions on interoception. Our results are in line with recent models of interoception supporting the idea that predicted bodily states influence sensory processing of salient external information.

Perceptual Expectations of Object Stimuli Modulate Repetition Suppression in a Delayed Repetition Design

Several fMRI and EEG/MEG studies show that repetition suppression (RS) effects are stronger when a stimulus repetition is expected compared to when a stimulus repetition is less expected. To date, the prevalent way to assess the influence of expectations on RS is via immediate stimulus repetition designs, that is, no intervening stimuli appear between the initial and repeated presentation of a stimulus. Since there is evidence that repetition lag may alter RS effects in a qualitative manner, the current study investigated how perceptual expectations modify RS effects on object stimuli when repetition lag is relatively long. Region of interest analyses in the left occipital cortex revealed a similar activation pattern as identified in previous studies on immediate lag: RS effects were strongest when repetitions were expected compared to decreased RS effects when repetitions were less expected. Therefore, the current study expands previous research in two ways: First, we replicate prior studies showing that perceptual expectation effects can be observed in object-sensitive occipital areas. Second, the finding that expectation effects can be found even for several-minute lags proposes that Bayesian inference processes are a relatively robust component in visual stimulus processing.

MEG adaptation reveals action representations in posterior occipitotemporal regions

When we observe other people's actions, a number of parietal and precentral regions known to be involved in the planning and execution of actions are recruited for example seen as power decreases in alpha and beta frequencies indicative of increased activation. It has been argued that this recruitment reflects the process of simulating the observed action, thereby providing access to the meaning of the action. Alternatively, it has been suggested that rather than providing access to the meaning of an action, parietal and precentral regions might be recruited as a consequence of action understanding. A way to distinguish between these alternatives is to examine where in the brain and at which time point it is possible to discriminate between different types of actions (e.g., pointing or grasping) irrespective of the way these are performed. To this aim, we presented participants with videos of simple hand actions performed with the left or right hand towards a target on the left or the right side while recording magnetoencephalography (MEG) data. In each trial, participants were presented with two subsequent videos (S1, S2) depicting either the same (repeat trials) or different (non-repeat trials) actions. We predicted that areas that are sensitive to the type of action should show stronger adaptation (i.e., a smaller decrease in alpha and beta power) in repeat in comparison to non-repeat trials. Indeed, we observed less alpha and beta power decreases during the presentation of S2 when the action was repeated compared to when two different actions were presented indicating adaptation of neuronal populations that are selective for the type of action. Sources were obtained exclusively in posterior occipitotemporal regions, supporting the notion that an early differentiation of actions occurs outside the motor system.

Prior Expectation Modulates Repetition Suppression without Perceptual Awareness

Stimulus repetition induces attenuated brain responses. This phenomenon, termed repetition suppression (RS), is classically held to stem from bottom-up neuronal adaptation. However, recent studies suggest that RS is driven by top-down predictive mechanisms. It remains controversial whether these top-down mechanisms of RS rely on conscious strategies, or if they represent a more fundamental aspect of perception, coding for physical properties of the repeated feature. The presence of top-down effects in the absence of perceptual awareness would indicate that conscious strategies are not sufficient to explain top-down mechanisms of RS. We combined an unconscious priming paradigm with EEG recordings and tested whether RS can be modulated by the probability of encountering a repetition, even in the absence of awareness. Our results show that both behavioural priming and RS near occipital areas are modulated by repetition probability, regardless of prime awareness. This contradicts previous findings that have argued that RS modulation is a by-product of conscious strategies. In contrast, we found that the increase in theta-band power following unrepeated trials – an index of conflict detection – is modulated only by expectations during conscious primes, implicating the use of conscious strategies. Together, our results suggest that the influence of predictions on RS can be either automatic in sensory brain regions or dependent on conscious strategies.

Real-time detection and discrimination of visual perception using electrocorticographic signals

OBJECTIVE

Several neuroimaging studies have demonstrated that the ventral temporal cortex contains specialized regions that process visual stimuli. This study investigated the spatial and temporal dynamics of electrocorticographic (ECoG) responses to different types and colors of visual stimulation that were presented to four human participants, and demonstrated a real-time decoder that detects and discriminates responses to untrained natural images.

APPROACH

ECoG signals from the participants were recorded while they were shown colored and greyscale versions of seven types of visual stimuli (images of faces, objects, bodies, line drawings, digits, and kanji and hiragana characters), resulting in 14 classes for discrimination (experiment I). Additionally, a real-time system asynchronously classified ECoG responses to faces, kanji and black screens presented via a monitor (experiment II), or to natural scenes (i.e. the face of an experimenter, natural images of faces and kanji, and a mirror) (experiment III). Outcome measures in all experiments included the discrimination performance across types based on broadband γ activity.

MAIN RESULTS

Experiment I demonstrated an offline classification accuracy of 72.9% when discriminating among the seven types (without color separation). Further discrimination of grey versus colored images reached an accuracy of 67.1%. Discriminating all colors and types (14 classes) yielded an accuracy of 52.1%. In experiment II and III, the real-time decoder correctly detected 73.7% responses to face, kanji and black computer stimuli and 74.8% responses to presented natural scenes.

SIGNIFICANCE

Seven different types and their color information (either grey or color) could be detected and discriminated using broadband γ activity. Discrimination performance maximized for combined spatial-temporal information. The discrimination of stimulus color information provided the first ECoG-based evidence for color-related population-level cortical broadband γ responses in humans. Stimulus categories can be detected by their ECoG responses in real time within 500 ms with respect to stimulus onset.

Incremental learning of perceptual and conceptual representations and the puzzle of neural repetition suppression

Incremental learning models of long-term perceptual and conceptual knowledge hold that neural representations are gradually acquired over many individual experiences via Hebbian-like activity-dependent synaptic plasticity across cortical connections of the brain. In such models, variation in task relevance of information, anatomic constraints, and the statistics of sensory inputs and motor outputs lead to qualitative alterations in the nature of representations that are acquired. Here, the proposal that behavioral repetition priming and neural repetition suppression effects are empirical markers of incremental learning in the cortex is discussed, and research results that both support and challenge this position are reviewed. Discussion is focused on a recent fMRI-adaptation study from our laboratory that shows decoupling of experience-dependent changes in neural tuning, priming, and repetition suppression, with representational changes that appear to work counter to the explicit task demands. Finally, critical experiments that may help to clarify and resolve current challenges are outlined.

Occipital alpha power reveals fast attentional inhibition of incongruent distractors

Recent associative models of cognitive control hypothesize that cognitive control can be learned (optimized) for task-specific settings via associations between perceptual, motor, and control representations, and, once learned, control can be implemented rapidly. Midfrontal brain areas signal the need for control, and control is subsequently implemented by biasing sensory representations, boosting or suppressing activity in brain areas processing task-relevant or task-irrelevant information. To assess the timescale of this process, we employed EEG. In order to pinpoint control implementation in specific sensory areas, we used a flanker task with incongruent flankers shown in only one hemifield (congruent flankers in the other hemifield) isolating their processing in the contralateral hemisphere. ERPs revealed fast modulations specifically in visual processing areas contralateral to the incongruent flankers. To test whether these modulations reflect increased or decreased processing of incongruent flankers, we investigated alpha power, a marker for attentional inhibition. Importantly, we show increased alpha power over visual areas processing incongruent flankers from 300 to 500 ms poststimulus onset. This suggests fast cognitive control by attentional inhibition for information disrupting goal-oriented actions. Additionally, we show that midfrontal theta earlier in the trial is also modulated by incongruency, and that theta power predicts subsequent alpha power modulations. This supports the hypothesis that midfrontal incongruency detection leads to control implementation, and reveals that these mechanisms take place on a fast, within-trial timescale.

How does gaze direction affect facial processing in social anxiety? -An ERP study

Previous behavioral studies have demonstrated an effect of eye gaze direction on the processing of emotional expressions in adults with social anxiety. However, specific brain responses to the interaction between gaze direction and facial expressions in social anxiety remain unclear. The present study aimed to explore the time course of such interaction using event-related potentials (ERPs) in participants with social anxiety. High socially anxious individuals and low socially anxious individuals were asked to identify the gender of angry or neutral faces with direct or averted gaze while their behavioral performance and electrophysiological data were monitored. We found that identification of angry faces with direct but not averted gaze elicited larger N2 amplitude in high socially anxious individuals compared to low socially anxious individuals, while identification of neutral faces did not produce any gaze modulation effect. Moreover, the N2 was correlated with increased anxiety severity upon exposure to angry faces with direct gaze. Therefore, our results suggest that gaze direction modulates the processing of threatening faces in social anxiety. The N2 component elicited by angry faces with direct gaze could be a state-dependent biomarker of social anxiety and may be an important reference biomarker for social anxiety diagnosis and intervention.

Spatio-temporal dynamics of working memory maintenance and scanning of verbal information

OBJECTIVE

During verbal communication, humans briefly maintain mental representations of speech sounds conveying verbal information, and constantly scan these representations for comparison to incoming information. We determined the spatio-temporal dynamics of such short-term maintenance and subsequent scanning of verbal information, by intracranially measuring high-gamma activity at 70-110Hz during a working memory task.

METHODS

Patients listened to a stimulus set of two or four spoken letters and were instructed to remember those letters over a two-second interval, following which they were asked to determine if a subsequent target letter had been presented earlier in that trial's stimulus set.

RESULTS

Auditory presentation of letter stimuli sequentially elicited high-gamma augmentation bilaterally in the superior-temporal and pre-central gyri. During the two-second maintenance period, high-gamma activity was augmented in the left pre-central gyrus, and this effect was larger during the maintenance of stimulus sets consisting of four compared to two letters. During the scanning period following target presentation, high-gamma augmentation involved the left inferior-frontal and supra-marginal gyri.

CONCLUSIONS

Short-term maintenance of verbal information is, at least in part, supported by the left pre-central gyrus, whereas scanning by the left inferior-frontal and supra-marginal gyri.

SIGNIFICANCE

The cortical structures involved in short-term maintenance and scanning of speech stimuli were segregated with an excellent temporal resolution.

Modeling the N400 ERP component as transient semantic over-activation within a neural network model of word comprehension

The study of the N400 event-related brain potential has provided fundamental insights into the nature of real-time comprehension processes, and its amplitude is modulated by a wide variety of stimulus and context factors. It is generally thought to reflect the difficulty of semantic access, but formulating a precise characterization of this process has proved difficult. Laszlo and colleagues (Laszlo & Plaut, 2012; Laszlo & Armstrong, 2014) used physiologically constrained neural networks to model the N400 as transient over-activation within semantic representations, arising as a consequence of the distribution of excitation and inhibition within and between cortical areas. The current work extends this approach to successfully model effects on both N400 amplitudes and behavior of word frequency, semantic richness, repetition, semantic and associative priming, and orthographic neighborhood size. The account is argued to be preferable to one based on "implicit semantic prediction error" (Rabovsky & McRae, 2014) for a number of reasons, the most fundamental of which is that the current model actually produces N400-like waveforms in its real-time activation dynamics.

Visual adaptation provides objective electrophysiological evidence of facial identity discrimination

Discrimination of facial identities is a fundamental function of the human brain that is challenging to examine with macroscopic measurements of neural activity, such as those obtained with functional magnetic resonance imaging (fMRI) and electroencephalography (EEG). Although visual adaptation or repetition suppression (RS) stimulation paradigms have been successfully implemented to this end with such recording techniques, objective evidence of an identity-specific discrimination response due to adaptation at the level of the visual representation is lacking. Here, we addressed this issue with fast periodic visual stimulation (FPVS) and EEG recording combined with a symmetry/asymmetry adaptation paradigm. Adaptation to one facial identity is induced through repeated presentation of that identity at a rate of 6 images per second (6 Hz) over 10 sec. Subsequently, this identity is presented in alternation with another facial identity (i.e., its anti-face, both faces being equidistant from an average face), producing an identity repetition rate of 3 Hz over a 20 sec testing sequence. A clear EEG response at 3 Hz is observed over the right occipito-temporal (ROT) cortex, indexing discrimination between the two facial identities in the absence of an explicit behavioral discrimination measure. This face identity discrimination occurs immediately after adaptation and disappears rapidly within 20 sec. Importantly, this 3 Hz response is not observed in a control condition without the single-identity 10 sec adaptation period. These results indicate that visual adaptation to a given facial identity produces an objective (i.e., at a pre-defined stimulation frequency) electrophysiological index of visual discrimination between that identity and another, and provides a unique behavior-free quantification of the effect of visual adaptation.

Can predictive coding explain repetition suppression?

While in earlier work various local or bottom-up neural mechanisms were proposed to give rise to repetition suppression (RS), current theories suggest that top-down processes play a role in determining the repetition related reduction of the neural responses. In the current review we summarise those results, which support the role of these top-down processes, concentrating on the Bayesian models of predictive coding (PC). Such models assume that RS is related to the statistical probabilities of prior stimulus occurrences and to the future predictability of these stimuli. Here we review the current results that support or argue against this explanation. We point out that the heterogeneity of experimental manipulations that are thought to reflect predictive processes are likely to measure different processing steps, making their direct comparison difficult. In addition we emphasize the importance of identifying these sub-processes and clarifying their role in explaining RS. Finally, we propose a two-stage model for explaining the relationships of repetition and expectation phenomena in the human cortex.

Repetition priming-induced changes in sensorimotor transmission

When a behavior is repeated performance often improves, i.e., repetition priming occurs. Although repetition priming is ubiquitous, mediating mechanisms are poorly understood. We address this issue in the feeding network ofAplysia Similar to the priming observed elsewhere, priming inAplysiais stimulus specific, i.e., it can be either "ingestive" or "egestive." Previous studies demonstrated that priming alters motor and premotor activity. Here we sought to determine whether sensorimotor transmission is also modified. We report that changes in sensorimotor transmission do occur. We ask how they are mediated and obtain data that strongly suggest a presynaptic mechanism that involves changes in the "background" intracellular Ca(2+)concentration ([Ca(2+)]i) in primary afferents themselves. This form of plasticity has previously been described and generated interest due to its potentially graded nature. Manipulations that alter the magnitude of the [Ca(2+)]iimpact the efficacy of synaptic transmission. It is, however, unclear how graded control is exerted under physiologically relevant conditions. In the feeding system changes in the background [Ca(2+)]iare mediated by the induction of a nifedipine-sensitive current. We demonstrate that the extent to which this current is induced is altered by peptides (i.e., increased by a peptide released during the repetition priming of ingestive activity and decreased by a peptide released during the repetition priming of egestive activity). We suggest that this constitutes a behaviorally relevant mechanism for the graded control of synaptic transmission via the regulation of the [Ca(2+)]iin a neuron.

Object identification leads to a conceptual broadening of object representations in lateral prefrontal cortex

Recent experience identifying objects leads to later improvements in both speed and accuracy ("repetition priming"), along with simultaneous reductions of neural activity ("repetition suppression"). A popular interpretation of these joint behavioral and neural phenomena is that object representations become perceptually "sharper" with stimulus repetition, eliminating cells that are poorly stimulus-selective and responsive and reducing support for competing representations downstream. Here, we test this hypothesis in an fMRI-adaptation experiment using pictures of objects. Prior to fMRI, participants repeatedly named a set of object pictures. During fMRI, participants viewed adaptation sequences composed of rapidly repeated objects (3-6 repetitions over several seconds) that were either named previously or that were new for the fMRI session, followed by single "deviant" object pictures used to measure recovery from adaptation and that shared a relationship to the adapted picture (a different exemplar of the same object, a conceptual associate, or an unrelated picture). Effects of adaptation and recovery were found throughout visually responsive brain regions. Occipitotemporal cortical regions displayed repetition suppression to previously named relative to new adapters but failed to exhibit pronounced changes in neural tuning. In contrast, changes in the slope of the recovery curves were found in the left lateral prefrontal cortex: Greater residual adaptation was observed to exemplar stimuli and conceptual associates following previously named adapting stimuli, consistent with greater rather than reduced neural overlap among representations of conceptually related objects. Furthermore, this change in neural tuning was directly related to the proportion of conceptual errors made by participants in the naming sessions pre- and post-fMRI, establishing that the experience-dependent conceptual broadening of object representations seen in fMRI is also manifest in behavior. In a follow-up behavioral experiment, we further show that recent naming experience leads to greater semantic priming when using the previously named pictures as briefly presented primes. Taken together, our results fail to support perceptual sharpening as the primary mediator between repetition suppression and behavioral priming at durations typically used to study priming and instead highlight an experience-dependent broadening of conceptual representations. We suggest that alternative mechanisms, such as increases in neural synchronization, are more promising in explaining priming in the face of repetition suppression.

Corresponding ECoG and fMRI category-selective signals in human ventral temporal cortex

Functional magnetic resonance imaging (fMRI) and electrocorticography (ECoG) research have been influential in revealing the functional characteristics of category-selective responses in human ventral temporal cortex (VTC). One important, but unanswered, question is how these two types of measurements might be related with respect to the VTC. Here we examined which components of the ECoG signal correspond to the fMRI response by using a rare opportunity to measure both fMRI and ECoG responses from the same individuals to images of exemplars of various categories including faces, limbs, cars and houses. Our data reveal three key findings. First, we discovered that the coupling between fMRI and ECoG responses is frequency and time dependent. The strongest and most sustained correlation is observed between fMRI and high frequency broadband (HFB) ECoG responses (30-160 hz). In contrast, the correlation between fMRI and ECoG signals in lower frequency bands is temporally transient, where the correlation is initially positive, but then tapers off or becomes negative. Second, we find that the strong and positive correlation between fMRI and ECoG signals in all frequency bands emerges rapidly around 100 ms after stimulus onset, together with the onset of the first stimulus-driven neural signals in VTC. Third, we find that the spatial topology and representational structure of category-selectivity in VTC reflected in ECoG HFB responses mirrors the topology and structure observed with fMRI. These findings of a strong and rapid coupling between fMRI and HFB responses validate fMRI measurements of functional selectivity with recordings of direct neural activity and suggest that fMRI category-selective signals in VTC are associated with feed-forward neural processing.

Face, eye, and body selective responses in fusiform gyrus and adjacent cortex: an intracranial EEG study

Functional MRI (fMRI) studies have investigated the degree to which processing of whole faces, face-parts, and bodies are differentially localized within the fusiform gyrus and adjacent ventral occipitotemporal cortex. While some studies have emphasized the spatial differentiation of processing into discrete areas, others have emphasized the overlap of processing and the importance of distributed patterns of activity. Intracranial EEG (iEEG) recorded from subdural electrodes provides excellent temporal and spatial resolution of local neural activity, and thus provides an alternative method to fMRI for studying differences and commonalities in face and body processing. In this study we recorded iEEG from 12 patients while they viewed images of novel faces, isolated eyes, headless bodies, and flowers. Event-related potential analysis identified 69 occipitotemporal sites at which there was a face-, eye-, or body-selective response when contrasted to flowers. However, when comparing faces, eyes, and bodies to each other at these sites, we identified only 3 face-specific, 13 eye-specific, and 1 body-specific electrodes. Thus, at the majority of sites, faces, eyes, and bodies evoked similar responses. However, we identified ten locations at which the amplitude of the responses spatially varied across adjacent electrodes, indicating that the configuration of current sources and sinks were different for faces, eyes, and bodies. Our results also demonstrate that eye-sensitive regions are more abundant and more purely selective than face- or body-sensitive regions, particularly in lateral occipitotemporal cortex.

Intracerebral electrical stimulation of a face-selective area in the right inferior occipital cortex impairs individual face discrimination

During intracerebral stimulation of the right inferior occipital cortex, a patient with refractory epilepsy was transiently impaired at discriminating two simultaneously presented photographs of unfamiliar faces. The critical electrode contact was located in the most posterior face-selective brain area of the human brain (right "occipital face area", rOFA) as shown both by low- (ERP) and high-frequency (gamma) electrophysiological responses as well as a face localizer in fMRI. At this electrode contact, periodic visual presentation of 6 different faces by second evoked a larger electrophysiological periodic response at 6 Hz than when the same face identity was repeated at the same rate. This intracerebral EEG repetition suppression effect was markedly reduced when face stimuli were presented upside-down, a manipulation that impairs individual face discrimination. These findings provide original evidence for a causal relationship between the face-selective right inferior occipital cortex and individual face discrimination, independently of long-term memory representations. More generally, they support the functional value of electrophysiological repetition suppression effects, indicating that these effects can be used as an index of a necessary neural representation of the changing stimulus property.