The occipital face area is causally involved in the formation of identity-specific face representations

Face yourself: The social neuroscience of mirror gazing

In philosophical and psychological accounts alike, it has been claimed that mirror gazing is like looking at ourselves as others. Social neuroscience and social psychology offer support for this view by showing that we use similar brain and cognitive mechanisms during perception of both others’ and our own face. I analyse these premises to investigate the factors affecting the perception of one’s own mirror image. I analyse mechanisms and processes involved in face perception, mimicry, and emotion recognition, and defend the following argument: because perception of others’ face is affected by our feelings toward them, it is likely that feelings toward ourselves affect our responses to the mirror image. One implication is that negative self-feelings can affect mirror gazing instantiating a vicious cycle where the negative emotional response reflects a previously acquired attitude toward oneself. I conclude by discussing implications of this view for psychology and social studies.

Characterizing the shared signals of face familiarity: Long-term acquaintance, voluntary control, and concealed knowledge

In a recent study using cross-experiment multivariate classification of EEG patterns, we found evidence for a shared familiarity signal for faces, patterns of neural activity that successfully separate trials for familiar and unfamiliar faces across participants and modes of familiarization. Here, our aim was to expand upon this research to further characterize the spatio-temporal properties of this signal. By utilizing the information content present for incidental exposure to personally familiar and unfamiliar faces, we tested how the information content in the neural signal unfolds over time under different task demands - giving truthful or deceptive responses to photographs of genuinely familiar and unfamiliar individuals. For this goal, we re-analyzed data from two previously published experiments using within-experiment leave-one-subject-out and cross-experiment classification of face familiarity. We observed that the general face familiarity signal, consistent with its previously described spatio-temporal properties, is present for long-term personally familiar faces under passive viewing, as well as for acknowledged and concealed familiarity responses. Also, central-posterior regions contain information related to deception. We propose that signals in the 200-400 ms window are modulated by top-down task-related anticipation, while the patterns in the 400-600 ms window are influenced by conscious effort to deceive. To our knowledge, this is the first report describing the representational dynamics of concealed knowledge for faces, using time-resolved multivariate classification.

Twenty years of investigation with the case of prosopagnosia PS to understand human face identity recognition. Part II: Neural basis

Patient PS sustained her dramatic brain injury in 1992, the same year as the first report of a neuroimaging study of human face recognition. The present paper complements the review on the functional nature of PS's prosopagnosia (part I), illustrating how her case study directly, i.e., through neuroimaging investigations of her brain structure and activity, but also indirectly, through neural studies performed on other clinical cases and neurotypical individuals, inspired and constrained neural models of human face recognition. In the dominant right hemisphere for face recognition in humans, PS's main lesion concerns (inputs to) the inferior occipital gyrus (IOG), in a region where face-selective activity is typically found in normal individuals ('Occipital Face Area', OFA). Her case study initially supported the criticality of this region for face identity recognition (FIR) and provided the impetus for transcranial magnetic stimulation (TMS), intracerebral electrical stimulation, and cortical surgery studies that have generally supported this view. Despite PS's right IOG lesion, typical face-selectivity is found anteriorly in the middle portion of the fusiform gyrus, a hominoid structure (termed the right 'Fusiform Face Area', FFA) that is widely considered to be the most important region for human face recognition. This finding led to the original proposal of direct anatomico-functional connections from early visual cortices to the FFA, bypassing the IOG/OFA (lulu), a hypothesis supported by further neuroimaging studies of PS, other neurological cases and neuro-typical individuals with original visual stimulation paradigms, data recordings and analyses. The proposal of a lack of sensitivity to face identity in PS's right FFA due to defective reentrant inputs from the IOG/FFA has also been supported by other cases, functional connectivity and cortical surgery studies. Overall, neural studies of, and based on, the case of prosopagnosia PS strongly question the hierarchical organization of the human neural face recognition system, supporting a more flexible and dynamic view of this key social brain function.

The chronometry of symmetry detection in the lateral occipital (LO) cortex

The lateral occipital cortex (LO) has been shown to code the presence of both vertical and horizontal visual symmetry in dot patterns. However, the specific time window at which LO is causally involved in symmetry encoding has not been investigated. This was assessed using a chronometric transcranial magnetic stimulation (TMS) approach. Participants were presented with a series of dot configurations and instructed to judge whether they were symmetric along the vertical axis or not while receiving a double pulse of TMS over either the right LO (rLO) or the vertex (baseline) at different time windows (ranging from 50 ms to 290 ms from stimulus onset). We found that TMS delivered over the rLO significantly decreased participants' accuracy in discriminating symmetric from non-symmetric patterns when TMS was applied between 130 ms and 250 ms from stimulus onset, suggesting that LO is causally involved in symmetry perception within this time window. These findings confirm and extend prior neuroimaging and ERP evidence by demonstrating not only that LO is causally involved in symmetry encoding but also that its contribution occurs in a relatively large temporal window, at least in tasks requiring fast discrimination of mirror symmetry in briefly (75 ms) presented patterns as in our study.

Evidence for a General Neural Signature of Face Familiarity

We explored the neural signatures of face familiarity using cross-participant and cross-experiment decoding of event-related potentials, evoked by unknown and experimentally familiarized faces from a set of experiments with different participants, stimuli, and familiarization-types. Human participants of both sexes were either familiarized perceptually, via media exposure, or by personal interaction. We observed significant cross-experiment familiarity decoding involving all three experiments, predominantly over posterior and central regions of the right hemisphere in the 270-630 ms time window. This shared face familiarity effect was most prominent across the Media and the Personal, as well as between the Perceptual and Personal experiments. Cross-experiment decodability makes this signal a strong candidate for a general neural indicator of face familiarity, independent of familiarization methods, participants, and stimuli. Furthermore, the sustained pattern of temporal generalization suggests that it reflects a single automatic processing cascade that is maintained over time.

Inhibition of the occipital face area modulates the electrophysiological signals of face familiarity: A combined cTBS-EEG study

The occipital face area (OFA) is hierarchically one of the first stages of the face processing network. It has originally been thought to be involved in early, structural processing steps, but currently more and more studies challenge this view and propose that it also takes part in higher level face processing, such as identification and recognition. Here we tested whether the OFA is involved in the initial steps of recognition memory and plays a causal role in the differential processing of familiar and unfamiliar faces. We used an offline, inhibitory continuous theta-burst stimulation (cTBS) protocol over the right OFA and the vertex as control site. Electroencephalographic (EEG) recording of event-related potentials (ERPs), elicited by visually presented familiar (famous) and unfamiliar faces was performed before and after stimulation. We observed a difference in ERPs for famous and unfamiliar faces in a time-window corresponding to the N250 component. Importantly, this difference was significantly increased by cTBS of the right OFA, suggesting its causal role in the differential processing of familiar and unfamiliar faces. The enhancement occurred focally, at electrodes close to the right hemispheric cTBS site, as well as over similar occipito-temporal sites of the contralateral hemisphere. To the best of our knowledge, this is the first study showing the causal role of the rOFA in the differential processing of familiar and unfamiliar faces, using combined cTBS and EEG recording methods. These results are discussed with respect to the nature of familiar face representations, supported by an extensive, bilateral network.

Getting to Know Someone: Familiarity, Person Recognition, and Identification in the Human Brain

In our everyday life, we continuously get to know people, dominantly through their faces. Several neuroscientific experiments showed that familiarization changes the behavioral processing and underlying neural representation of faces of others. Here, we propose a model of the process of how we actually get to know someone. First, the purely visual familiarization of unfamiliar faces occurs. Second, the accumulation of associated, nonsensory information refines person representation, and finally, one reaches a stage where the effortless identification of very well-known persons occurs. We offer here an overview of neuroimaging studies, first evaluating how and in what ways the processing of unfamiliar and familiar faces differs and, second, by analyzing the fMRI adaptation and multivariate pattern analysis results we estimate where identity-specific representation is found in the brain. The available neuroimaging data suggest that different aspects of the information emerge gradually as one gets more and more familiar with a person within the same network. We propose a novel model of familiarity and identity processing, where the differential activation of long-term memory and emotion processing areas is essential for correct identification.

Non-invasive stimulation in the social brain: the methodological challenges

Use of non-invasive brain stimulation methods (NIBS) has become a common approach to study social processing in addition to behavioural, imaging and lesion studies. However, research using NIBS to investigate social processing faces challenges. Overcoming these is important to allow valid and reliable interpretation of findings in neurotypical cohorts, but also to allow us to tailor NIBS protocols to atypical groups with social difficulties. In this review, we consider the utility of brain stimulation as a technique to study and modulate social processing. We also discuss challenges that face researchers using NIBS to study social processing in neurotypical adults with a view to highlighting potential solutions. Finally, we discuss additional challenges that face researchers using NIBS to study and modulate social processing in atypical groups. These are important to consider given that NIBS protocols are rarely tailored to atypical groups before use. Instead, many rely on protocols designed for neurotypical adults despite differences in brain function that are likely to impact response to NIBS.

The right hemispheric dominance for face perception in preschool children depends on the visual discrimination level

The developmental origin of human adults' right hemispheric dominance in response to face stimuli remains unclear, in particular because young infants' right hemispheric advantage in face-selective response is no longer present in preschool children, before written language acquisition. Here we used fast periodic visual stimulation (FPVS) with scalp electroencephalography (EEG) to test 52 preschool children (5.5 years old) at two different levels of face discrimination: discrimination of faces against objects, measuring face-selectivity, or discrimination between individual faces. While the contrast between faces and nonface objects elicits strictly bilateral occipital responses in children, strengthening previous observations, discrimination of individual faces in the same children reveals a strong right hemispheric lateralization over the occipitotemporal cortex. Picture-plane inversion of the face stimuli significantly decreases the individual discrimination response, although to a much smaller extent than in older children and adults tested with the same paradigm. However, there is only a nonsignificant trend for a decrease in right hemispheric lateralization with inversion. There is no relationship between the right hemispheric lateralization in individual face discrimination and preschool levels of readings abilities. The observed difference in the right hemispheric lateralization obtained in the same population of children with two different paradigms measuring neural responses to faces indicates that the level of visual discrimination is a key factor to consider when making inferences about the development of hemispheric lateralization of face perception in the human brain.

The occipital face area is causally involved in identity-related visual-semantic associations

Faces are processed in a network of areas within regions of the ventral visual stream. However, familiar faces typically are characterized by additional associated information, such as episodic memories or semantic biographical information as well. The acquisition of such non-sensory, identity-specific knowledge plays a crucial role in our ability to recognize and identify someone we know. The occipital face area (OFA), an early part of the core face-processing network, is recently found to be involved in the formation of identity-specific memory traces but it is currently unclear if this role is limited to unimodal visual information. The current experiments used transcranial magnetic stimulation (TMS) to test whether the OFA is involved in the association of a face with identity-specific semantic information, such as the name or job title of a person. We applied an identity-learning task where unfamiliar faces were presented together with a name and a job title in the first encoding phase. Simultaneously, TMS pulses were applied either to the left or right OFA or to Cz, as a control. In the subsequent retrieval phase, the previously seen faces were presented either with two names or with two job titles and the task of the participants was to select the semantic information previously learned. We found that the stimulation of the right or left OFA reduced subsequent retrieval performance for the face-associated job titles. This suggests a causal role of the OFA in the association of faces and related semantic information. Furthermore, in contrast to prior findings, we did not observe hemispherical differences of the TMS intervention, suggesting a similar role of the left and right OFAs in the formation of the visual-semantic associations. Our results suggest the necessity to reconsider the hierarchical face-perception models and support the distributed and recurrent models.

Spatially Dissociated Intracerebral Maps for Face- and House-Selective Activity in the Human Ventral Occipito-Temporal Cortex

We report a comprehensive mapping of the human ventral occipito-temporal cortex (VOTC) for selective responses to frequency-tagged faces or landmarks (houses) presented in rapid periodic trains of objects, with intracerebral recordings in a large sample (N = 75). Face-selective contacts are three times more numerous than house-selective contacts and show a larger amplitude, with a right hemisphere advantage for faces. Most importantly, these category-selective contacts are spatially dissociated along the lateral-to-medial VOTC axis, respectively, consistent with neuroimaging evidence. At the minority of "overlap" contacts responding selectively to both faces and houses, response amplitude to the two categories is not correlated, suggesting a contribution of distinct populations of neurons responding selectively to each category. The medio-lateral dissociation also extends into the underexplored anterior temporal lobe (ATL). In this region, a relatively high number of intracerebral recording contacts show category-exclusive responses (i.e., without any response to baseline visual objects) to faces but rarely to houses, in line with the proposed role of this region in processing people-related semantic information. Altogether, these observations shed novel insight on the neural basis of human visual recognition and strengthen the validity of the frequency-tagging approach coupled with intracerebral recordings in epileptic patients to understand human brain function.

Emotional learning promotes perceptual predictions by remodeling stimulus representation in visual cortex

Emotions exert powerful effects on perception and memory, notably by modulating activity in sensory cortices so as to capture attention. Here, we examine whether emotional significance acquired by a visual stimulus can also change its cortical representation by linking neuronal populations coding for different memorized versions of the same stimulus, a mechanism that would facilitate recognition across different appearances. Using fMRI, we show that after pairing a given face with threat through conditioning, viewing this face activates the representation of another viewpoint of the same person, which itself was never conditioned, leading to robust repetition-priming across viewpoints in the ventral visual stream (including medial fusiform, lateral occipital, and anterior temporal cortex). We also observed a functional-anatomical segregation for coding view-invariant and view-specific identity information. These results indicate emotional signals may induce plasticity of stimulus representations in visual cortex, serving to generate new sensory predictions about different appearances of threat-associated stimuli.

Neuroimaging results suggest the role of prediction in cross-domain priming

The repetition of a stimulus leads to shorter reaction times as well as to the reduction of neural activity. Previous encounters with closely related stimuli (primes) also lead to faster and often to more accurate processing of subsequent stimuli (targets). For instance, if the prime is a name, and the target is a face, the recognition of a persons’ face is facilitated by prior presentation of his/her name. A possible explanation for this phenomenon is that the prime allows predicting the occurrence of the target. To the best of our knowledge, so far, no study tested the neural correlates of such cross-domain priming with fMRI. To fill this gap, here we used names of famous persons as primes, and congruent or incongruent faces as targets. We found that congruent primes not only reduced RT, but also lowered the BOLD signal in bilateral fusiform (FFA) and occipital (OFA) face areas. This suggests that semantic information affects not only behavioral performance, but also neural responses in relatively early processing stages of the occipito-temporal cortex. We interpret our results in the framework of predictive coding theories.

Common framework for "virtual lesion" and state-dependent TMS: The facilitatory/suppressive range model of online TMS effects on behavior

•

Transcranial magnetic stimulation can either facilitate or impair behavior.

•

Nature of behavioral effects depends on factors such as brain state and intensity.

•

We present a common framework to account for these effects.

•

There are distinct intensity ranges for facilitatory and suppressive effects of TMS.

•

Changes in excitability shift these ranges and account for behavioral effects.

The behavioral effects of Transcranial Magnetic Stimulation (TMS) are often nonlinear; factors such as stimulation intensity and brain state can modulate the impact of TMS on observable behavior in qualitatively different manner. Here we propose a theoretical framework to account for these effects. In this model, there are distinct intensity ranges for facilitatory and suppressive effects of TMS – low intensities facilitate neural activity and behavior whereas high intensities induce suppression. The key feature of the model is that these ranges are shifted by changes in neural excitability: consequently, a TMS intensity, which normally induces suppression, can have a facilitatory effect if the stimulated neurons are being inhibited by ongoing task-related processes or preconditioning. For example, adaptation reduces excitability of adapted neurons; the outcome is that TMS intensities which inhibit non-adapted neurons induce a facilitation on adapted neural representations, leading to reversal of adaptation effects. In conventional “virtual lesion” paradigms, similar effects occur because neurons not involved in task-related processes are inhibited by the ongoing task. The resulting reduction in excitability can turn high intensity “inhibitory” TMS to low intensity “facilitatory” TMS for these neurons, and as task-related neuronal representations are in the inhibitory range, the outcome is a reduction in signal-to-noise ratio and behavioral impairment.

Initial activation state, stimulation intensity and timing of stimulation interact in producing behavioral effects of TMS

•

TMS effects depend on various factors such as intensity, brain state and timing.

•

We examined how these factors interact to give rise to behavioral effects.

•

TMS was applied while participants performed a behavioral priming task.

•

State dependency of TMS effect was found to interact with intensity and timing.

Behavioral effects of transcranial magnetic stimulation (TMS) have been shown to depend on various factors, such as neural activation state, stimulation intensity, and timing of stimulation. Here we examined whether these factors interact, by applying TMS at either sub- or suprathreshold intensity (relative to phosphene threshold, PT) and at different time points during a state-dependent TMS paradigm. The state manipulation involved a behavioral task in which a visual prime (color grating) was followed by a target stimulus which could be either congruent, incongruent or partially congruent with the color and orientation of the prime. In Experiment 1, single-pulse TMS was applied over the early visual cortex (V1/V2) or Vertex (baseline) at the onset of the target stimulus – timing often used in state-dependent TMS studies. With both subthreshold and suprathreshold stimulation, TMS facilitated the detection of incongruent stimuli while not significantly affecting other stimulus types. In Experiment 2, TMS was applied at 100 ms after target onset –a time window in which V1/V2 is responding to visual input. Only TMS applied at suprathreshold intensity facilitated the detection of incongruent stimuli, with no effect with subthreshold stimulation. The need for higher stimulation intensity is likely to reflect reduced susceptibility to TMS of neurons responding to visual stimulation. Furthermore, the finding that in Experiment 2 only suprathreshold TMS induced a behavioral facilitation on incongruent targets (whereas facilitations in the absence of priming have been reported with subthreshold TMS) indicates that priming, by reducing neural excitability to incongruent targets, shifts the facilitatory/inhibitory range of TMS effects.