View-independent coding of face identity in frontal and temporal cortices is modulated by familiarity: an event-related fMRI study

Impaired activation of face processing networks revealed by functional magnetic resonance imaging in 22q11.2 deletion syndrome

BACKGROUND

22q11.2 deletion syndrome (22q11DS) is a neurogenetic syndrome associated with a high rate of psychiatric disorders. Previous research has revealed distinctive cognitive deficits, including impaired face processing. However, the neuro-functional substrates underlying these deficits have not been explored. Our aim was to investigate facial and emotional processing in 22q11DS.

METHODS

During event-related functional magnetic resonance imaging, 15 individuals with 22q11DS were compared with age- and gender-matched healthy control subjects on a simple visual categorization task (faces or houses). Each stimulus was presented twice, and faces had either neutral or emotional (fearful) expressions.

RESULTS

Abnormal responses to faces were observed in 22q11DS, including a lack of normal face-selectivity in fusiform gyrus. By contrast, responses to houses were comparable across groups, with preserved selectivity in parahippocampal gyrus. Results also revealed a repetition-suppression effect for fearful faces in the right amygdala, which arose in healthy control subjects only, suggesting a lack of amygdala modulation by fear expression in 22q11DS.

CONCLUSIONS

Our results demonstrate selective anomalies in several brain regions critically implicated in visual and social function in 22q11DS. These findings suggest important new avenues for studying emotional processing and social deficits frequently observed in psychotic patients and establishing their relation to specific phenotypic manifestations in 22q11DS.

Mechanisms of face perception

Faces are among the most informative stimuli we ever perceive: Even a split-second glimpse of a person's face tells us his identity, sex, mood, age, race, and direction of attention. The specialness of face processing is acknowledged in the artificial vision community, where contests for face-recognition algorithms abound. Neurological evidence strongly implicates a dedicated machinery for face processing in the human brain to explain the double dissociability of face- and object-recognition deficits. Furthermore, recent evidence shows that macaques too have specialized neural machinery for processing faces. Here we propose a unifying hypothesis, deduced from computational, neurological, fMRI, and single-unit experiments: that what makes face processing special is that it is gated by an obligatory detection process. We clarify this idea in concrete algorithmic terms and show how it can explain a variety of phenomena associated with face processing.

Abnormal fMRI Adaptation to Unfamiliar Faces in a Case of Developmental Prosopamnesia

In rare cases, damage to the temporal lobe causes a selective impairment in the ability to learn new faces, a condition known as prosopamnesia [1]. Here we present the case of an individual with prosopamnesia in the absence of any acquired structural lesion. "C" shows intact processing of simple and complex nonface objects, but her ability to learn new faces is severely impaired. We used a neural marker of perceptual learning known as repetition suppression to examine functioning within C's fusiform face area (FFA), a region of cortex involved in face perception [2]. For comparison, we examined repetition suppression in the scene-selective parahippocampal place area (PPA) [3]. As expected, normal controls showed significant region-specific attenuation of neural activity across repetitions of each stimulus class. C also showed normal attenuation within the PPA to familiar and unfamiliar scenes, and within the FFA to familiar faces. Critically, however, she failed to show any adaptive change within the FFA for repeated unfamiliar faces, despite a face-specific blood-oxygen-dependent response (BOLD) response in her FFA during viewing of face stimuli. Our findings suggest that in developmental prosopamnesia, the FFA cannot maintain stable representations of new faces for subsequent recall or recognition.

Face adaptation aftereffects reveal anterior medial temporal cortex role in high level category representation

Previous studies have shown reductions of the functional magnetic resonance imaging (fMRI) signal in response to repetition of specific visual stimuli. We examined how adaptation affects the neural responses associated with categorization behavior, using face adaptation aftereffects. Adaptation to a given facial category biases categorization towards non-adapted facial categories in response to presentation of ambiguous morphs. We explored a hypothesis, posed by recent psychophysical studies, that these adaptation-induced categorizations are mediated by activity in relatively advanced stages within the occipitotemporal visual processing stream. Replicating these studies, we find that adaptation to a facial expression heightens perception of non-adapted expressions. Using comparable behavioral methods, we also show that adaptation to a specific identity heightens perception of a second identity in morph faces. We show both expression and identity effects to be associated with heightened anterior medial temporal lobe activity, specifically when perceiving the non-adapted category. These regions, incorporating bilateral anterior ventral rhinal cortices, perirhinal cortex and left anterior hippocampus are regions previously implicated in high-level visual perception. These categorization effects were not evident in fusiform or occipital gyri, although activity in these regions was reduced to repeated faces. The findings suggest that adaptation-induced perception is mediated by activity in regions downstream to those showing reductions due to stimulus repetition.

An ERP study on self-relevant object recognition

We performed an event-related potential study to investigate the self-relevance effect in object recognition. Three stimulus categories were prepared: SELF (participant's own objects), FAMILIAR (disposable and public objects, defined as objects with less-self-relevant familiarity), and UNFAMILIAR (others' objects). The participants' task was to watch the stimuli passively. Results showed that left-lateralized N250 activity differentiated SELF and FAMILIAR from UNFAMILIAR, but SELF and FAMILIAR were not differentiated. In the later time-course, SELF was dissociated from FAMILIAR, indicating the self-relevance effect in object recognition at this stage. This activity did not show consistent lateralization, in contrast to previous studies reporting right lateralization in self-relevant face and name recognition. We concluded that in object recognition, self-relevance was processed by higher-order cognitive functions later than 300ms after stimulus onset.

The role of familiarity in three-dimensional view-transferability of face identity adaptation

Recent studies show that face adaptation effects partially transfer across three-dimensional viewpoint change. Here we investigated whether the degree of adaptation transfer is mediated by experience with a face. We manipulated face familiarity and measured identity aftereffects both within- and across-viewpoint. Familiarity enhanced the overall strength of identity adaptation as well as the degree to which adaptation transferred across-viewpoint change. These findings support the idea that transfer effects in adaptation vary as a function of experience with particular faces, and suggest the use of adaptation as a tool for tracking face representations as they develop.

Representations of familiar and unfamiliar faces as revealed by viewpoint-aftereffects

A viewpoint-dependent aftereffect occurs after prolonged viewing of a stimulus of a particular orientation, with the result that the test image is perceived to be facing away from the adapting orientation. Prior psychophysical work has led to the suggestion that the visual brain encodes a limited range of viewpoint information with regard to complex images. In this study, we investigated whether familiar faces were susceptible to a viewpoint aftereffect. Familiar faces are believed to be represented in a view-invariant manner, whereas unfamiliar faces are represented in a viewpoint-dependent manner. Adaptation to both familiar and unfamiliar faces influenced the perception of viewpoint of subsequent face images. However, category-specific transfer of a repulsive viewpoint-dependent aftereffect was observed with unfamiliar faces. Our results suggest that neural networks that mediate viewpoint information are also involved in view-invariant representation of familiar faces.

The neural bases of prosopagnosia and pure alexia: recent insights from functional neuroimaging

PURPOSE OF REVIEW

To discuss whether recent functional neuroimaging results can account for clinical phenomenology in visual associative agnosias.

RECENT FINDINGS

Functional neuroimaging studies in healthy human subjects have identified only two regions of ventral occipitotemporal cortex that invariantly respond to individual faces and visual words, respectively. The signature of face identity coding in the fusiform neural response was shown to be missing in a patient with prosopagnosia. Another case study established that a surgical lesion close to the region sensitive to visual words can result in pure alexia.

SUMMARY

Evidence is increasing that functional specialization for processing face identity and visual word forms is restricted to two specialized sensory modules in the occipitotemporal cortex. A structural or functional lesion to face-sensitive and word-sensitive regions in the ventral occipitotemporal cortex can provide the most parsimonious account for the clinical syndromes of prosopagnosia and agnosic alexia. This review suggests that functional specialization should be considered in terms of whether exclusively one brain region (instead of many) underpins a defined function and not as whether this brain region underpins exclusively one cognitive function. Such functional specialization seems to exist for at least two higher-order visual perceptual functions, face and word identification.

Attention to Form or Surface Properties Modulates Different Regions of Human Occipitotemporal Cortex

We carried out 2 functional magnetic resonance imaging experiments to investigate the cortical mechanisms underlying the contribution of form and surface properties to object recognition. In experiment 1, participants performed same-different judgments in separate blocks of trials on pairs of unfamiliar "nonsense" objects on the basis of their form, surface properties (i.e., both color and texture), or orientation. Attention to form activated the lateral occipital (LO) area, whereas attention to surface properties activated the collateral sulcus (CoS) and the inferior occipital gyrus (IOG). In experiment 2, participants were required to make same-different judgments on the basis of texture, color, or form. Again attention to form activated area LO, whereas attention to texture activated regions in the IOG and the CoS, as well as regions in the lingual sulcus and the inferior temporal sulcus. Within these last 4 regions, activation associated with texture was higher than activation associated with color. No color-specific cortical areas were identified in these regions, although parts of V1 and the cuneus yielded higher activation for color as opposed to texture. These results suggest that there are separate form and surface-property pathways in extrastriate cortex. The extraction of information about an object's color seems to occur relatively early in visual analysis as compared with the extraction of surface texture, perhaps because the latter requires more complex computations.

Development of a view-invariant representation of the human head

Do infants perceive visual cues as diverse as frontal-view faces, profiles or bodies as being different aspects of the same object, a fellow human? If that is the case, visual exposure to one such cue should facilitate the subsequent processing of the others. To verify this hypothesis, we recorded event-related responses in 4-month-old infants and in adults. Pictures of eyes were interleaved amongst images belonging to three human contexts (frontal-view faces, profiles or bodies) or non-human contexts (houses, cars or pliers). In adults, both profile and frontal-face contexts elicited suppression of the N170 response to eye pictures, indicating an access to a view-invariant representation of faces. In infants, a response suppression of the N290 component was recorded only in the context of frontal faces, while profile context induces a different effect (i.e., a P400 enhancement) on eye processing. This dissociation suggests that the view-invariant representation of faces is learned, as it is for other 3-D objects and needs more than 4 months of exposure to be established. In a follow-up study, where infants were exposed to a short movie showing people rotating their heads, the profile-induced P400 effect was speeded up, indicating that exposure to successive views of the same object is probably a way to build up adult-like face representations.

Portraits or People? Distinct Representations of Face Identity in the Human Visual Cortex

Humans can identify individual faces under different viewpoints, even after a single encounter. We determined brain regions responsible for processing face identity across view changes after variable delays with several intervening stimuli, using event-related functional magnetic resonance imaging during a long-term repetition priming paradigm. Unfamiliar faces were presented sequentially either in a frontal or three-quarter view. Each face identity was repeated once after an unpredictable lag, with either the same or another viewpoint. Behavioral data showed significant priming in response time, irrespective of view changes. Brain imaging results revealed a reduced response in the lateral occipital and fusiform cortex with face repetition. Bilateral face-selective fusiform areas showed view-sensitive repetition effects, generalizing only from three-quarter to front-views. More medial regions in the left (but not in the right) fusiform showed repetition effects across all types of viewpoint changes. These results reveal that distinct regions within the fusiform cortex hold view-sensitive or view-invariant traces of novel faces, and that face identity is represented in a view-sensitive manner in the functionally defined face-selective areas of both hemispheres. In addition, our finding of a better generalization after exposure to a 3/4-view than to a front-view demonstrates for the first time a neural substrate in the fusiform cortex for the common recognition advantage of three-quarter faces. This pattern provides new insights into the nature of face representation in the human visual system.