Intracerebral electrical stimulation of a face-selective area in the right inferior occipital cortex impairs individual face discrimination

Intracerebral electrical stimulation of the face-selective right lateral fusiform gyrus transiently impairs face identity recognition

Neuroimaging and intracranial electrophysiological studies have consistently shown the largest and most consistent face-selective neural activity in the middle portion of the human right lateral fusiform gyrus ('fusiform face area(s)', FFA). Yet, direct evidence for the critical role of this region in face identity recognition (FIR) is still lacking. Here we report the first evidence of transient behavioral impairment of FIR during focal electrical stimulation of the right FFA. Upon stimulation of an electrode contact within this region, subject CJ, who shows typical FIR ability outside of stimulation, was transiently unable to point to pictures of famous faces among strangers and to match pictures of famous or unfamiliar faces presented simultaneously for their identity. Her performance at comparable tasks with other visual materials (written names, pictures of buildings) remained unaffected by stimulation at the same location. During right FFA stimulation, CJ consistently reported that simultaneously presented faces appeared as being the same identity, with little or no distortion of the spatial face configuration. Independent electrophysiological recordings showed the largest neural face-selective and face identity activity at the critical electrode contacts. Altogether, this extensive multimodal case report supports the causal role of the right FFA in FIR.

fMRI reveals overlapping and non-overlapping neural bases of domain-general and emotional conflict control

The present study uses functional magnetic resonance image (fMRI) to examine the overlapping and specific neural correlates of contextualized emotional conflict control and domain-general conflict control. During a performance on emotional and domain-general conflict tasks, conjunction analyses showed that neural areas distributed in the frontoparietal network were engaged in both processes, supporting the notion that similar neural mechanisms are implemented in these two types of control. Importantly, disjunction analyses revealed a broader neural recruitment of emotional conflict control compared to domain-general conflict control as shown by the possible lateralization of the lateral prefrontal cortex (lPFC), such that emotional conflict control significantly involved the left lPFC while domain-general conflict control seemly involved the right lPFC. Results of generalized psychophysiological interaction (gPPI) analyses further demonstrated that emotional conflict control, compared to domain-general conflict control, elicited broader synergistic activities in individuals' brain networks. Together, these findings offer novel and compelling neural evidence that furthers our understanding of the complex relationship between domain-general and emotional conflict control.

Face distortions in prosopometamorphopsia provide new insights into the organization of face perception

Prosopometamorphopsia (PMO) is a striking condition of visual perception in which facial features appear distorted, for example drooping, swelling, or twisting. Although numerous cases have been reported, few of those investigations have carried out formal testing motivated by theories of face perception. However, because PMO involves conscious visual distortions to faces which participants can report, it can be used to probe fundamental questions about face representations. Here we review cases of PMO that address theoretical questions in visual neuroscience including face specificity, inverted face processing, the importance of the vertical midline, dissociable representations for each half of the face, hemispheric specialization, the relationship between face recognition and conscious face perception, and the reference frames that face representations are embedded within. Finally, we list and touch upon eighteen open questions that make clear how much is left to learn about PMO and the potential it has to provide important advances in face perception.

Intracerebral Electrophysiological Recordings to Understand the Neural Basis of Human Face Recognition

Understanding how the human brain recognizes faces is a primary scientific goal in cognitive neuroscience. Given the limitations of the monkey model of human face recognition, a key approach in this endeavor is the recording of electrophysiological activity with electrodes implanted inside the brain of human epileptic patients. However, this approach faces a number of challenges that must be overcome for meaningful scientific knowledge to emerge. Here we synthesize a 10 year research program combining the recording of intracerebral activity (StereoElectroEncephaloGraphy, SEEG) in the ventral occipito-temporal cortex (VOTC) of large samples of participants and fast periodic visual stimulation (FPVS), to objectively define, quantify, and characterize the neural basis of human face recognition. These large-scale studies reconcile the wide distribution of neural face recognition activity with its (right) hemispheric and regional specialization and extend face-selectivity to anterior regions of the VOTC, including the ventral anterior temporal lobe (VATL) typically affected by magnetic susceptibility artifacts in functional magnetic resonance imaging (fMRI). Clear spatial dissociations in category-selectivity between faces and other meaningful stimuli such as landmarks (houses, medial VOTC regions) or written words (left lateralized VOTC) are found, confirming and extending neuroimaging observations while supporting the validity of the clinical population tested to inform about normal brain function. The recognition of face identity - arguably the ultimate form of recognition for the human brain - beyond mere differences in physical features is essentially supported by selective populations of neurons in the right inferior occipital gyrus and the lateral portion of the middle and anterior fusiform gyrus. In addition, low-frequency and high-frequency broadband iEEG signals of face recognition appear to be largely concordant in the human association cortex. We conclude by outlining the challenges of this research program to understand the neural basis of human face recognition in the next 10 years.

Visual phenomena and anatomo-electro-clinical correlations in occipital lobe seizures

BACKGROUND

Occipital lobe seizure are underrepresented in epilepsy surgery cases series. This may reflect the fear for post-surgical functional deficits but also the doubt about the ability of anatomo-electro-clinical correlations to localize precisely the epileptogenic zone in occipital lobe seizure.

METHODS

In this expert opinion paper, we review first the general clinical characteristics of occipital lobe seizures, describe the repertoire of visual phenomena and oculo-motor signes in occipital seizures, describe inter-ictal and ictal EEG and finally the possible schemes of epileptogenic zone organization.

RESULTS

Visual and oculo-motor semiology points towards occipital onset seizures but is neither pathognomonic nor constant. Eyes version and unilateral ictal discharge have a strong lateralizing value but inter-ictal spikes as well as eyes version can be falsely lateralizing.

CONCLUSION

Although visual and oculo-motor phenomena are characteristic of occipital lobe seizures, they may be discrete, overlooked and should therefore be carefully assessed. There are no clear electro-clinical correlations of a sublobar organization of occipital seizures but the clinical pattern of propagation might help to differentiate complex occipito-temporal from occipito-parietal initial epileptogenic network.

The power of rhythms: how steady-state evoked responses reveal early neurocognitive development

Electroencephalography (EEG) is a non-invasive and painless recording of cerebral activity, particularly well-suited for studying young infants, allowing the inspection of cerebral responses in a constellation of different ways. Of particular interest for developmental cognitive neuroscientists is the use of rhythmic stimulation, and the analysis of steady-state evoked potentials (SS-EPs) - an approach also known as frequency tagging. In this paper we rely on the existing SS-EP early developmental literature to illustrate the important advantages of SS-EPs for studying the developing brain. We argue that (1) the technique is both objective and predictive: the response is expected at the stimulation frequency (and/or higher harmonics), (2) its high spectral specificity makes the computed responses particularly robust to artifacts, and (3) the technique allows for short and efficient recordings, compatible with infants' limited attentional spans. We additionally provide an overview of some recent inspiring use of the SS-EP technique in adult research, in order to argue that (4) the SS-EP approach can be implemented creatively to target a wide range of cognitive and neural processes. For all these reasons, we expect SS-EPs to play an increasing role in the understanding of early cognitive processes. Finally, we provide practical guidelines for implementing and analyzing SS-EP studies.

Twenty years of investigation with the case of prosopagnosia PS to understand human face identity recognition. Part II: Neural basis

Patient PS sustained her dramatic brain injury in 1992, the same year as the first report of a neuroimaging study of human face recognition. The present paper complements the review on the functional nature of PS's prosopagnosia (part I), illustrating how her case study directly, i.e., through neuroimaging investigations of her brain structure and activity, but also indirectly, through neural studies performed on other clinical cases and neurotypical individuals, inspired and constrained neural models of human face recognition. In the dominant right hemisphere for face recognition in humans, PS's main lesion concerns (inputs to) the inferior occipital gyrus (IOG), in a region where face-selective activity is typically found in normal individuals ('Occipital Face Area', OFA). Her case study initially supported the criticality of this region for face identity recognition (FIR) and provided the impetus for transcranial magnetic stimulation (TMS), intracerebral electrical stimulation, and cortical surgery studies that have generally supported this view. Despite PS's right IOG lesion, typical face-selectivity is found anteriorly in the middle portion of the fusiform gyrus, a hominoid structure (termed the right 'Fusiform Face Area', FFA) that is widely considered to be the most important region for human face recognition. This finding led to the original proposal of direct anatomico-functional connections from early visual cortices to the FFA, bypassing the IOG/OFA (lulu), a hypothesis supported by further neuroimaging studies of PS, other neurological cases and neuro-typical individuals with original visual stimulation paradigms, data recordings and analyses. The proposal of a lack of sensitivity to face identity in PS's right FFA due to defective reentrant inputs from the IOG/FFA has also been supported by other cases, functional connectivity and cortical surgery studies. Overall, neural studies of, and based on, the case of prosopagnosia PS strongly question the hierarchical organization of the human neural face recognition system, supporting a more flexible and dynamic view of this key social brain function.

Visual Mismatch Negativity Reflects Enhanced Response to the Deviant: Evidence From Event-Related Potentials and Electroencephalogram Time-Frequency Analysis

Automatic detection of information changes in the visual environment is crucial for individual survival. Researchers use the oddball paradigm to study the brain’s response to frequently presented (standard) stimuli and occasionally presented (deviant) stimuli. The component that can be observed in the difference wave is called visual mismatch negativity (vMMN), which is obtained by subtracting event-related potentials (ERPs) evoked by the deviant from ERPs evoked by the standard. There are three hypotheses to explain the vMMN. The sensory fatigue (or refractoriness) hypothesis considers that weakened neural activity caused by repetition results in decreased ERPs of the standard. The memory trace hypothesis proposes that vMMN results from increased responses to the deviant. The predictive coding hypothesis attributes the difference to enhanced responses for deviants and suppression for standards. However, when distinguishing between these effects, previous researchers did not consider the effect of low-level features on the vMMN. In this experiment, we used face sequences composed of different emotions (e.g., neutral and fearful face) and presented an oddball sequence, a reverse oddball sequence, and an equiprobable sequence to participants. The deviant of the oddball sequence was subtracted from the standard of the oddball sequence, the reverse oddball sequence, and the same type of stimulus of the equiprobable sequence to get oddball-vMMN (vMMN1), reverse oddball-vMMN (vMMN2), and equiprobable-vMMN (vMMN3), respectively. The results showed no significant difference between vMMN2 and vMMN3 in 100–350 ms following stimulus onset, while the vMMN effect was significant, indicating that the probability of the standard did not affect vMMN, which supported the memory trace hypothesis. Additionally, the fearful-related vMMN were more negative than the neutral-related vMMN within the range of 100–150 ms, suggesting a negative bias. We analyzed the source location of different vMMNs. There was no significant difference in brain regions between different vMMNs. Time-frequency analysis showed that the deviant had stronger theta-band oscillatory than the standard (visual mismatch oscillatory responses, vMORs). However, there was no difference between vMORs2 and vMORs3, indicating that vMORs reflect an enhanced response to the deviant in terms of neural oscillation, supporting the memory trace hypothesis.

Evidence for a General Neural Signature of Face Familiarity

We explored the neural signatures of face familiarity using cross-participant and cross-experiment decoding of event-related potentials, evoked by unknown and experimentally familiarized faces from a set of experiments with different participants, stimuli, and familiarization-types. Human participants of both sexes were either familiarized perceptually, via media exposure, or by personal interaction. We observed significant cross-experiment familiarity decoding involving all three experiments, predominantly over posterior and central regions of the right hemisphere in the 270-630 ms time window. This shared face familiarity effect was most prominent across the Media and the Personal, as well as between the Perceptual and Personal experiments. Cross-experiment decodability makes this signal a strong candidate for a general neural indicator of face familiarity, independent of familiarization methods, participants, and stimuli. Furthermore, the sustained pattern of temporal generalization suggests that it reflects a single automatic processing cascade that is maintained over time.

Intracerebral electrical stimulation to understand the neural basis of human face identity recognition

Recognizing people's identity by their faces is a key function in the human species, supported by regions of the ventral occipito-temporal cortex (VOTC). In the last decade, there have been several reports of perceptual face distortion during direct electrical stimulation (DES) with subdural electrodes positioned over a well-known face-selective VOTC region of the right lateral middle fusiform gyrus (LatMidFG; i.e., the "Fusiform Face Area", FFA). However, transient impairments of face identity recognition (FIR) have been extremely rare and only behaviorally quantified during DES with intracerebral (i.e., depth) electrodes in stereo-electroencephalography (SEEG). The three detailed cases reported so far, summarized here, were specifically impaired at FIR during DES inside different anatomical VOTC regions of the right hemisphere: the inferior occipital gyrus (IOG) and the LatMidFG, as well as a region that lies at the heart of a large magnetic susceptibility artifact in functional magnetic resonance imaging (fMRI): the anterior fusiform gyrus (AntFG). In the first two regions, the eloquent electrode contacts were systematically associated with the highest face-selective and (unfamiliar) face individuation responses as measured with intracerebral electrophysiology. Stimulation in the right AntFG did not lead to perceptual changes but also caused an inability to remember having been presented face pictures, as if the episode was never recorded in memory. These observations support the view of an extensive network of face-selective VOTC regions subtending human FIR, with at least three critical nodes in the right hemisphere associated with differential intrinsic and extrinsic patterns of reentrant connectivity.

Cognitive and Emotional Mapping With SEEG

Mapping of cortical functions is critical for the best clinical care of patients undergoing epilepsy and tumor surgery, but also to better understand human brain function and connectivity. The purpose of this review is to explore existing and potential means of mapping higher cortical functions, including stimulation mapping, passive mapping, and connectivity analyses. We examine the history of mapping, differences between subdural and stereoelectroencephalographic approaches, and some risks and safety aspects, before examining different types of functional mapping. Much of this review explores the prospects for new mapping approaches to better understand other components of language, memory, spatial skills, executive, and socio-emotional functions. We also touch on brain-machine interfaces, philosophical aspects of aligning tasks to brain circuits, and the study of consciousness. We end by discussing multi-modal testing and virtual reality approaches to mapping higher cortical functions.

Fast periodic visual stimulation to highlight the relationship between human intracerebral recordings and scalp electroencephalography

Despite being of primary importance for fundamental research and clinical studies, the relationship between local neural population activity and scalp electroencephalography (EEG) in humans remains largely unknown. Here we report simultaneous scalp and intracerebral EEG responses to face stimuli in a unique epileptic patient implanted with 27 intracerebral recording contacts in the right occipitotemporal cortex. The patient was shown images of faces appearing at a frequency of 6 Hz, which elicits neural responses at this exact frequency. Response quantification at this frequency allowed to objectively relate the neural activity measured inside and outside the brain. The patient exhibited typical 6 Hz responses on the scalp at the right occipitotemporal sites. Moreover, there was a clear spatial correspondence between these scalp responses and intracerebral signals in the right lateral inferior occipital gyrus, both in amplitude and in phase. Nevertheless, the signal measured on the scalp and inside the brain at nearby locations showed a 10-fold difference in amplitude due to electrical insulation from the head. To further quantify the relationship between the scalp and intracerebral recordings, we used an approach correlating time-varying signals at the stimulation frequency across scalp and intracerebral channels. This analysis revealed a focused and right-lateralized correspondence between the scalp and intracerebral recordings that were specific to the face stimulation is more broadly distributed in various control situations. These results demonstrate the interest of a frequency tagging approach in characterizing the electrical propagation from brain sources to scalp EEG sensors and in identifying the cortical sources of brain functions from these recordings.

Spatially Dissociated Intracerebral Maps for Face- and House-Selective Activity in the Human Ventral Occipito-Temporal Cortex

We report a comprehensive mapping of the human ventral occipito-temporal cortex (VOTC) for selective responses to frequency-tagged faces or landmarks (houses) presented in rapid periodic trains of objects, with intracerebral recordings in a large sample (N = 75). Face-selective contacts are three times more numerous than house-selective contacts and show a larger amplitude, with a right hemisphere advantage for faces. Most importantly, these category-selective contacts are spatially dissociated along the lateral-to-medial VOTC axis, respectively, consistent with neuroimaging evidence. At the minority of "overlap" contacts responding selectively to both faces and houses, response amplitude to the two categories is not correlated, suggesting a contribution of distinct populations of neurons responding selectively to each category. The medio-lateral dissociation also extends into the underexplored anterior temporal lobe (ATL). In this region, a relatively high number of intracerebral recording contacts show category-exclusive responses (i.e., without any response to baseline visual objects) to faces but rarely to houses, in line with the proposed role of this region in processing people-related semantic information. Altogether, these observations shed novel insight on the neural basis of human visual recognition and strengthen the validity of the frequency-tagging approach coupled with intracerebral recordings in epileptic patients to understand human brain function.

Surface-based shared and distinct resting functional connectivity in attention-deficit hyperactivity disorder and autism spectrum disorder

BACKGROUND

Both attention-deficit hyperactivity disorder (ADHD) and autism spectrum disorder (ASD) are neurodevelopmental disorders with a high prevalence. They are often comorbid and both exhibit abnormalities in sustained attention, yet common and distinct neural patterns of ASD and ADHD remain unidentified.AimsTo investigate shared and distinct functional connectivity patterns in a relatively large sample of boys (7- to 15-year-olds) with ADHD, ASD and typical development matched by age, gender and IQ.

METHOD

We applied machine learning techniques to investigate patterns of surface-based brain resting-state connectivity in 86 boys with ASD, 83 boys with ADHD and 125 boys with typical development.

RESULTS

We observed increased functional connectivity within the limbic and somatomotor networks in boys with ASD compared with boys with typical development. We also observed increased functional connectivity within the limbic, visual, default mode, somatomotor, dorsal attention, frontoparietal and ventral attention networks in boys with ADHD compared with boys with ASD. In addition, using a machine learning approach, we were able to discriminate typical development from ASD, typical development from ADHD and ASD from ADHD with accuracy rates of 76.3%, 84.1%, and 79.3%, respectively.

CONCLUSIONS

Our results may shed new light on the underlying mechanisms of ASD and ADHD and facilitate the development of new diagnostic methods for these disorders.Declaration of interestJ.K. holds equity in a startup company, MNT.

Attentional Weighting in the Face Processing Network: A Magnetic Response Image-guided Magnetoencephalography Study Using Multiple Cyclic Entrainments

We recorded magnetoencephalography using a neural entrainment paradigm with compound face stimuli that allowed for entraining the processing of various parts of a face (eyes, mouth) as well as changes in facial identity. Our magnetic response image-guided magnetoencephalography analyses revealed that different subnodes of the human face processing network were entrained differentially according to their functional specialization. Whereas the occipital face area was most responsive to the rate at which face parts (e.g., the mouth) changed, and face patches in the STS were mostly entrained by rhythmic changes in the eye region, the fusiform face area was the only subregion that was strongly entrained by the rhythmic changes in facial identity. Furthermore, top-down attention to the mouth, eyes, or identity of the face selectively modulated the neural processing in the respective area (i.e., occipital face area, STS, or fusiform face area), resembling behavioral cue validity effects observed in the participants' RT and detection rate data. Our results show the attentional weighting of the visual processing of different aspects and dimensions of a single face object, at various stages of the involved visual processing hierarchy.

Investigating the Time Course of Part-Based and Holistic Processing in Face Perception

Human has an exceptional ability for face recognition to keep up social network. However, it is unclear to understand the mechanisms of face recognition until now. Specifically, there is less research to examine the time course of part-based and holistic processing when these two routes trigger and finish. In the present experiments, the exposure time was manipulated to examine the time course of face processing and found evidence suggesting that holistic processing occurs shortly after part-based processing at about 200 ms, and can last for a relatively long duration up to 2,000 ms. These results may support to a dual-route model comprising holistic processing and part-based processing in face perception. Moreover, our findings were inconsistent with the previous study which suggests that no holistic processing was observed at the relatively long duration, and suspected that perceptual discriminability may have been responsible for the discrepancy.

The inferior occipital gyrus is a major cortical source of the face-evoked N170: Evidence from simultaneous scalp and intracerebral human recordings

The sudden onset of a face image leads to a prominent face-selective response in human scalp electroencephalographic (EEG) recordings, peaking 170 ms after stimulus onset at occipito-temporal (OT) scalp sites: the N170 (or M170 in magnetoencephalography). According to a widely held view, the main cortical source of the N170 lies in the fusiform gyrus (FG), whereas the posteriorly located inferior occipital gyrus (IOG) would rather generate earlier face-selective responses. Here, we report neural responses to upright and inverted faces recorded in a unique patient using multicontact intracerebral electrodes implanted in the right IOG and in the OT sulcus above the right lateral FG (LFG). Simultaneous EEG recordings on the scalp identified the N170 over the right OT scalp region. The latency and amplitude of this scalp N170 were correlated at the single-trial level with the N170 recorded in the lateral IOG, close to the scalp lateral occipital surface. In addition, a positive component maximal around the latency of the N170 (a P170) was prominent above the internal LFG, whereas this region typically generates an N170 (or "N200") over its external/ventral surface. This suggests that electrophysiological responses in the LFG manifest as an equivalent dipole oriented mostly along the vertical axis with likely minimal projection to the lateral OT scalp region. Altogether, these observations provide evidence that the IOG is a major cortical generator of the face-selective scalp N170, qualifying the potential contribution of the FG and questioning a strict serial spatiotemporal organization of the human cortical face network.

Language processing from the perspective of electrical stimulation mapping

Electrical Stimulation (ES) is a neurostimulation technique that is used to localize language functions in the brain of people with intractable epilepsy and/or brain tumors. We reviewed 25 ES articles published between 1984 and 2018 and interpreted them from a cognitive neuropsychological perspective. Our aim was to highlight ES as a tool to further our understanding of cognitive models of language. We focused on associations and dissociations between cognitive functions within the framework of two non-neuroanatomically specified models of language. Also, we discussed parallels between the ES and the stroke literatures and showed how ES data can help us to generate hypotheses regarding how language is processed. A good understanding of cognitive models of language is essential to motivate task selection and to tailor surgical procedures, for example, by avoiding testing the same cognitive functions and understanding which functions may be more or less relevant to be tested during surgery.

Sensitivity to Faces with Typical and Atypical Part Configurations within Regions of the Face-processing Network: An fMRI Study

Perception of faces has been shown to engage a domain-specific set of brain regions, including the occipital face area (OFA) and the fusiform face area (FFA). It is commonly held that the OFA is responsible for the detection of faces in the environment, whereas the FFA is responsible for processing the identity of the face. However, an alternative model posits that the FFA is responsible for face detection and subsequently recruits the OFA to analyze the face parts in the service of identification. An essential prediction of the former model is that the OFA is not sensitive to the arrangement of internal face parts. In the current fMRI study, we test the sensitivity of the OFA and FFA to the configuration of face parts. Participants were shown faces in which the internal parts were presented in a typical configuration (two eyes above a nose above a mouth) or in an atypical configuration (the locations of individual parts were shuffled within the face outline). Perception of the atypical faces evoked a significantly larger response than typical faces in the OFA and in a wide swath of the surrounding posterior occipitotemporal cortices. Surprisingly, typical faces did not evoke a significantly larger response than atypical faces anywhere in the brain, including the FFA (although some subthreshold differences were observed). We propose that face processing in the FFA results in inhibitory sculpting of activation in the OFA, which accounts for this region's weaker response to typical than to atypical configurations.

Mapping face categorization in the human ventral occipitotemporal cortex with direct neural intracranial recordings

The neural basis of face categorization has been widely investigated with functional magnetic resonance imaging (fMRI), identifying a set of face-selective local regions in the ventral occipitotemporal cortex (VOTC). However, indirect recording of neural activity with fMRI is associated with large fluctuations of signal across regions, often underestimating face-selective responses in the anterior VOTC. While direct recording of neural activity with subdural grids of electrodes (electrocorticography, ECoG) or depth electrodes (stereotactic electroencephalography, SEEG) offers a unique opportunity to fill this gap in knowledge, these studies rather reveal widely distributed face-selective responses. Moreover, intracranial recordings are complicated by interindividual variability in neuroanatomy, ambiguity in definition, and quantification of responses of interest, as well as limited access to sulci with ECoG. Here, we propose to combine SEEG in large samples of individuals with fast periodic visual stimulation to objectively define, quantify, and characterize face categorization across the whole VOTC. This approach reconciles the wide distribution of neural face categorization responses with their (right) hemispheric and regional specialization, and reveals several face-selective regions in anterior VOTC sulci. We outline the challenges of this research program to understand the neural basis of face categorization and high-level visual recognition in general.

Face Processing Systems: From Neurons to Real-World Social Perception

Primate face processing depends on a distributed network of interlinked face-selective areas composed of face-selective neurons. In both humans and macaques, the network is divided into a ventral stream and a dorsal stream, and the functional similarities of the areas in humans and macaques indicate they are homologous. Neural correlates for face detection, holistic processing, face space, and other key properties of human face processing have been identified at the single neuron level, and studies providing causal evidence have established firmly that face-selective brain areas are central to face processing. These mechanisms give rise to our highly accurate familiar face recognition but also to our error-prone performance with unfamiliar faces. This limitation of the face system has important implications for consequential situations such as eyewitness identification and policing.

Network dynamics of human face perception

Prevailing theories suggests that cortical regions responsible for face perception operate in a serial, feed-forward fashion. Here, we utilize invasive human electrophysiology to evaluate serial models of face-processing via measurements of cortical activation, functional connectivity, and cortico-cortical evoked potentials. We find that task-dependent changes in functional connectivity between face-selective regions in the inferior occipital (f-IOG) and fusiform gyrus (f-FG) are bidirectional, not feed-forward, and emerge following feed-forward input from early visual cortex (EVC) to both of these regions. Cortico-cortical evoked potentials similarly reveal independent signal propagations between EVC and both f-IOG and f-FG. These findings are incompatible with serial models, and support a parallel, distributed network underpinning face perception in humans.

The Functional Neuroanatomy of Human Face Perception

Face perception is critical for normal social functioning and is mediated by a network of regions in the ventral visual stream. In this review, we describe recent neuroimaging findings regarding the macro- and microscopic anatomical features of the ventral face network, the characteristics of white matter connections, and basic computations performed by population receptive fields within face-selective regions composing this network. We emphasize the importance of the neural tissue properties and white matter connections of each region, as these anatomical properties may be tightly linked to the functional characteristics of the ventral face network. We end by considering how empirical investigations of the neural architecture of the face network may inform the development of computational models and shed light on how computations in the face network enable efficient face perception.

Electrical Stimulation of Visual Cortex: Relevance for the Development of Visual Cortical Prosthetics

Electrical stimulation of the cerebral cortex is a powerful tool for exploring cortical function. Stimulation of early visual cortical areas is easily detected by subjects and produces simple visual percepts known as phosphenes. A device implanted in visual cortex that generates patterns of phosphenes could be used as a substitute for natural vision in blind patients. We review the possibilities and limitations of such a device, termed a visual cortical prosthetic. Currently, we can predict the location and size of phosphenes produced by stimulation of single electrodes. A functional prosthetic, however, must produce spatial temporal patterns of activity that will result in the perception of complex visual objects. Although stimulation of later visual cortical areas alone usually does not lead to a visual percept, it can alter visual perception and the performance of visual behaviors, and training subjects to use signals injected into these areas may be possible.

A causal relationship between face-patch activity and face-detection behavior

The primate brain contains distinct areas densely populated by face-selective neurons. One of these, face-patch ML, contains neurons selective for contrast relationships between face parts. Such contrast-relationships can serve as powerful heuristics for face detection. However, it is unknown whether neurons with such selectivity actually support face-detection behavior. Here, we devised a naturalistic face-detection task and combined it with fMRI-guided pharmacological inactivation of ML to test whether ML is of critical importance for real-world face detection. We found that inactivation of ML impairs face detection. The effect was anatomically specific, as inactivation of areas outside ML did not affect face detection, and it was categorically specific, as inactivation of ML impaired face detection while sparing body and object detection. These results establish that ML function is crucial for detection of faces in natural scenes, performing a critical first step on which other face processing operations can build.

DOI:http://dx.doi.org/10.7554/eLife.18558.001

Time course of gamma-band oscillation associated with face processing in the inferior occipital gyrus and fusiform gyrus: A combined fMRI and MEG study

Debate continues over whether the inferior occipital gyrus (IOG) or the fusiform gyrus (FG) represents the first stage of face processing and what role these brain regions play. We investigated this issue by combining functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG) in normal adults. Participants passively observed upright and inverted faces and houses. First, we identified the IOG and FG as face-specific regions using fMRI. We applied beamforming source reconstruction and time-frequency analysis to MEG source signals to reveal the time course of gamma-band activations in these regions. The results revealed that the right IOG showed higher gamma-band activation in response to upright faces than to upright houses at 100 ms from the stimulus onset. Subsequently, the right FG showed greater gamma-band response to upright faces versus upright houses at around 170 ms. The gamma-band activation in the right IOG and right FG was larger in response to inverted faces than to upright faces at the later time window. These results suggest that (1) the gamma-band activities occurs rapidly first in the IOG and next in the FG and (2) the gamma-band activity in the right IOG at later time stages is involved in configuration processing for faces. Hum Brain Mapp 38:2067-2079, 2017. © 2017 Wiley Periodicals, Inc.

Being BOLD: The neural dynamics of face perception

According to a non-hierarchical view of human cortical face processing, selective responses to faces may emerge in a higher-order area of the hierarchy, in the lateral part of the middle fusiform gyrus (fusiform face area [FFA]) independently from face-selective responses in the lateral inferior occipital gyrus (occipital face area [OFA]), a lower order area. Here we provide a stringent test of this hypothesis by gradually revealing segmented face stimuli throughout strict linear descrambling of phase information [Ales et al., 2012]. Using a short sampling rate (500 ms) of fMRI acquisition and single subject statistical analysis, we show a face-selective responses emerging earlier, that is, at a lower level of structural (i.e., phase) information, in the FFA compared with the OFA. In both regions, a face detection response emerging at a lower level of structural information for upright than inverted faces, both in the FFA and OFA, in line with behavioral responses and with previous findings of delayed responses to inverted faces with direct recordings of neural activity were also reported. Overall, these results support the non-hierarchical view of human cortical face processing and open new perspectives for time-resolved analysis at the single subject level of fMRI data obtained during continuously evolving visual stimulation. Hum Brain Mapp 38:120-139, 2017. © 2016 Wiley Periodicals, Inc.

Consecutive TMS-fMRI reveals remote effects of neural noise to the "occipital face area"

The human cortical system for face perception comprises a network of connected regions including the middle fusiform gyrus ("fusiform face area" or FFA), the inferior occipital gyrus ("occipital face area" or OFA), and the posterior superior temporal sulcus (pSTS). Here, we sought to investigate how transcranial magnetic stimulation (TMS) to the OFA affects activity within the face processing network. We used offline repetitive TMS to temporarily introduce neural noise in the right OFA in healthy subjects. We then immediately performed functional magnetic resonance imaging (fMRI) to measure changes in blood oxygenation level dependent (BOLD) signal across the face network using an fMR-adaptation (fMR-A) paradigm. We hypothesized that TMS to the right OFA would induce abnormal face identity coding throughout the face processing network in regions to which it has direct or indirect connections. Indeed, BOLD signal for face identity, but not non-face (butterfly) identity, decreased in the right OFA and FFA following TMS to the right OFA compared to both sham TMS and TMS to a control site, the nearby object-related lateral occipital area (LO). Further, TMS to the right OFA decreased face-related activation in the left FFA, without any effect in the left OFA. Our findings indicate that TMS to the right OFA selectively disrupts face coding at both the stimulation site and bilateral FFA. TMS to the right OFA also decreased BOLD signal for different identity stimuli in the right pSTS. Together with mounting evidence from patient studies, we demonstrate connectivity of the OFA within the face network and that its activity modulates face processing in bilateral FFA as well as the right pSTS. Moreover, this study shows that deep regions within the face network can be remotely probed by stimulating structures closer to the cortical surface.

The Deceptively Simple N170 Reflects Network Information Processing Mechanisms Involving Visual Feature Coding and Transfer Across Hemispheres

A key to understanding visual cognition is to determine “where”, “when”, and “how” brain responses reflect the processing of the specific visual features that modulate categorization behavior—the “what”. The N170 is the earliest Event-Related Potential (ERP) that preferentially responds to faces. Here, we demonstrate that a paradigmatic shift is necessary to interpret the N170 as the product of an information processing network that dynamically codes and transfers face features across hemispheres, rather than as a local stimulus-driven event. Reverse-correlation methods coupled with information-theoretic analyses revealed that visibility of the eyes influences face detection behavior. The N170 initially reflects coding of the behaviorally relevant eye contralateral to the sensor, followed by a causal communication of the other eye from the other hemisphere. These findings demonstrate that the deceptively simple N170 ERP hides a complex network information processing mechanism involving initial coding and subsequent cross-hemispheric transfer of visual features.

Altered spontaneous neural activity in the occipital face area reflects behavioral deficits in developmental prosopagnosia

Individuals with developmental prosopagnosia (DP) exhibit severe difficulties in recognizing faces and to a lesser extent, also exhibit difficulties in recognizing non-face objects. We used fMRI to investigate whether these behavioral deficits could be accounted for by altered spontaneous neural activity. Two aspects of spontaneous neural activity were measured: the intensity of neural activity in a voxel indexed by the fractional amplitude of spontaneous low-frequency fluctuations (fALFF), and the connectivity of a voxel to neighboring voxels indexed by regional homogeneity (ReHo). Compared with normal adults, both the fALFF and ReHo values within the right occipital face area (rOFA) were significantly reduced in DP subjects. Follow-up studies on the normal adults revealed that these two measures indicated further functional division of labor within the rOFA. The fALFF in the rOFA was positively correlated with behavioral performance in recognition of non-face objects, whereas ReHo in the rOFA was positively correlated with processing of faces. When considered together, the altered fALFF and ReHo within the same region (rOFA) may account for the comorbid deficits in both face and object recognition in DPs, whereas the functional division of labor in these two measures helps to explain the relative independency of deficits in face recognition and object recognition in DP.

A face-selective ventral occipito-temporal map of the human brain with intracerebral potentials

Human neuroimaging studies have identified a network of distinct face-selective regions in the ventral occipito-temporal cortex (VOTC), with a right hemispheric dominance. To date, there is no evidence for this hemispheric and regional specialization with direct measures of brain activity. To address this gap in knowledge, we recorded local neurophysiological activity from 1,678 contact electrodes implanted in the VOTC of a large group of epileptic patients (n = 28). They were presented with natural images of objects at a rapid fixed rate (six images per second: 6 Hz), with faces interleaved as every fifth stimulus (i.e., 1.2 Hz). High signal-to-noise ratio face-selective responses were objectively (i.e., exactly at the face stimulation frequency) identified and quantified throughout the whole VOTC. Face-selective responses were widely distributed across the whole VOTC, but also spatially clustered in specific regions. Among these regions, the lateral section of the right middle fusiform gyrus showed the largest face-selective response by far, offering, to our knowledge, the first supporting evidence of two decades of neuroimaging observations with direct neural measures. In addition, three distinct regions with a high proportion of face-selective responses were disclosed in the right ventral anterior temporal lobe, a region that is undersampled in neuroimaging because of magnetic susceptibility artifacts. A high proportion of contacts responding only to faces (i.e., "face-exclusive" responses) were found in these regions, suggesting that they contain populations of neurons involved in dedicated face-processing functions. Overall, these observations provide a comprehensive mapping of visual category selectivity in the whole human VOTC with direct neural measures.

Neuronal codes for visual perception and memory

In this review, I describe and contrast the representation of stimuli in visual cortical areas and in the medial temporal lobe (MTL). While cortex is characterized by a distributed and implicit coding that is optimal for recognition and storage of semantic information, the MTL shows a much sparser and explicit coding of specific concepts that is ideal for episodic memory. I will describe the main characteristics of the coding in the MTL by the so-called concept cells and will then propose a model of the formation and recall of episodic memory based on partially overlapping assemblies.

A Revised Neural Framework for Face Processing

Face perception relies on computations carried out in face-selective cortical areas. These areas have been intensively investigated for two decades, and this work has been guided by an influential neural model suggested by Haxby and colleagues in 2000. Here, we review new findings about face-selective areas that suggest the need for modifications and additions to the Haxby model. We suggest a revised framework based on (a) evidence for multiple routes from early visual areas into the face-processing system, (b) information about the temporal characteristics of these areas, (c) indications that the fusiform face area contributes to the perception of changeable aspects of faces, (d) the greatly elevated responses to dynamic compared with static faces in dorsal face-selective brain areas, and (e) the identification of three new anterior face-selective areas. Together, these findings lead us to suggest that face perception depends on two separate pathways: a ventral stream that represents form information and a dorsal stream driven by motion and form information.

A robust and representative lower bound on object processing speed in humans

How early does the brain decode object categories? Addressing this question is critical to constrain the type of neuronal architecture supporting object categorization. In this context, much effort has been devoted to estimating face processing speed. With onsets estimated from 50 to 150 ms, the timing of the first face-sensitive responses in humans remains controversial. This controversy is due partially to the susceptibility of dynamic brain measurements to filtering distortions and analysis issues. Here, using distributions of single-trial event-related potentials (ERPs), causal filtering, statistical analyses at all electrodes and time points, and effective correction for multiple comparisons, we present evidence that the earliest categorical differences start around 90 ms following stimulus presentation. These results were obtained from a representative group of 120 participants, aged 18-81, who categorized images of faces and noise textures. The results were reliable across testing days, as determined by test-retest assessment in 74 of the participants. Furthermore, a control experiment showed similar ERP onsets for contrasts involving images of houses or white noise. Face onsets did not change with age, suggesting that face sensitivity occurs within 100 ms across the adult lifespan. Finally, the simplicity of the face-texture contrast, and the dominant midline distribution of the effects, suggest the face responses were evoked by relatively simple image properties and are not face specific. Our results provide a new lower benchmark for the earliest neuronal responses to complex objects in the human visual system.

Perturbation of Posterior Inferior Temporal Cortical Activity Impairs Coarse Orientation Discrimination

It is reasonable to assume that the discrimination of simple visual stimuli depends on the activity of early visual cortical neurons, because simple visual features are supposedly coded in these areas whereas more complex features are coded in late visual areas. Recently, we showed that training monkeys in a coarse orientation discrimination task modified the response properties of single neurons in the posterior inferior temporal (PIT) cortex, a late visual area. Here, we examined the contribution of PIT to coarse orientation discrimination using causal perturbation methods. Electrical stimulation (ES) of PIT with currents of at least 100 µA impaired coarse orientation discrimination in monkeys. The performance deterioration did not exclusively reflect a general impairment to perform a difficult perceptual task. However, high current (650 µA) but not low-current (100 µA) ES also impaired fine color discrimination. ES of temporal regions dorsal or anterior to PIT produced less impairment of coarse orientation discrimination than ES of PIT. Injections of the GABA agonist muscimol into PIT also impaired performance. These data suggest that the late cortical area PIT is part of the network that supports coarse orientation discrimination of a simple grating stimulus, at least after extensive training in this task at threshold.

Corresponding ECoG and fMRI category-selective signals in human ventral temporal cortex

Functional magnetic resonance imaging (fMRI) and electrocorticography (ECoG) research have been influential in revealing the functional characteristics of category-selective responses in human ventral temporal cortex (VTC). One important, but unanswered, question is how these two types of measurements might be related with respect to the VTC. Here we examined which components of the ECoG signal correspond to the fMRI response by using a rare opportunity to measure both fMRI and ECoG responses from the same individuals to images of exemplars of various categories including faces, limbs, cars and houses. Our data reveal three key findings. First, we discovered that the coupling between fMRI and ECoG responses is frequency and time dependent. The strongest and most sustained correlation is observed between fMRI and high frequency broadband (HFB) ECoG responses (30-160 hz). In contrast, the correlation between fMRI and ECoG signals in lower frequency bands is temporally transient, where the correlation is initially positive, but then tapers off or becomes negative. Second, we find that the strong and positive correlation between fMRI and ECoG signals in all frequency bands emerges rapidly around 100 ms after stimulus onset, together with the onset of the first stimulus-driven neural signals in VTC. Third, we find that the spatial topology and representational structure of category-selectivity in VTC reflected in ECoG HFB responses mirrors the topology and structure observed with fMRI. These findings of a strong and rapid coupling between fMRI and HFB responses validate fMRI measurements of functional selectivity with recordings of direct neural activity and suggest that fMRI category-selective signals in VTC are associated with feed-forward neural processing.

Beyond the core face-processing network: Intracerebral stimulation of a face-selective area in the right anterior fusiform gyrus elicits transient prosopagnosia

According to neuropsychological evidence, a distributed network of regions of the ventral visual pathway - from the lateral occipital cortex to the temporal pole - supports face recognition. However, functional magnetic resonance imaging (fMRI) studies have generally confined ventral face-selective areas to the posterior section of the occipito-temporal cortex, i.e., the inferior occipital gyrus occipital face area (OFA) and the posterior and middle fusiform gyrus fusiform face area (FFA). There is recent evidence that intracranial electrical stimulation of these areas in the right hemisphere elicits face matching and recognition impairments (i.e., prosopagnosia) as well as perceptual face distortions. Here we report a case of transient inability to recognize faces following electrical stimulation of the right anterior fusiform gyrus, in a region located anteriorly to the FFA. There was no perceptual face distortion reported during stimulation. Although no fMRI face-selective responses were found in this region due to a severe signal drop-out as in previous studies, intracerebral face-selective event-related potentials and gamma range electrophysiological responses were found at the critical site of stimulation. These results point to a causal role in face recognition of the right anterior fusiform gyrus and more generally of face-selective areas located beyond the "core" face-processing network in the right ventral temporal cortex. It also illustrates the diagnostic value of intracerebral electrophysiological recordings and stimulation in understanding the neural basis of face recognition and visual recognition in general.

High-Frequency Transcranial Random Noise Stimulation Enhances Perception of Facial Identity

Recently, a number of studies have demonstrated the utility of transcranial current stimulation as a tool to facilitate a variety of cognitive and perceptual abilities. Few studies, though, have examined the utility of this approach for the processing of social information. Here, we conducted 2 experiments to explore whether a single session of high-frequency transcranial random noise stimulation (tRNS) targeted at lateral occipitotemporal cortices would enhance facial identity perception. In Experiment 1, participants received 20 min of active high-frequency tRNS or sham stimulation prior to completing the tasks examining facial identity perception or trustworthiness perception. Active high-frequency tRNS facilitated facial identity perception, but not trustworthiness perception. Experiment 2 assessed the spatial specificity of this effect by delivering 20 min of active high-frequency tRNS to lateral occipitotemporal cortices or sensorimotor cortices prior to participants completing the same facial identity perception task used in Experiment 1. High-frequency tRNS targeted at lateral occipitotemporal cortices enhanced performance relative to motor cortex stimulation. These findings show that high-frequency tRNS to lateral occipitotemporal cortices produces task-specific and site-specific enhancements in face perception.