Pulling Faces: An Investigation of the Face-Distortion Aftereffect

A preference to look closer to the eyes is associated with a position-invariant face neural code

When looking at faces, humans invariably move their eyes to a consistent preferred first fixation location on the face. While most people have the preferred fixation location just below the eyes, a minority have it between the nose-tip and mouth. Not much is known about whether these long-term differences in the preferred fixation location are associated with distinct neural representations of faces. To study this, we used a gaze-contingent face adaptation aftereffect paradigm to test in two groups of observers, one with their mean preferred fixation location closer to the eyes (upper lookers) and the other closer to the mouth (lower lookers). In this task, participants were required to maintain their gaze at either their own group's mean preferred fixation location or that of the other group during adaptation and testing. The two possible fixation locations were 3.6° apart on the face. We measured the face adaptation aftereffects when the adaptation and testing happened while participants maintained fixation at either the same or different locations on the face. Both groups showed equally strong adaptation effects when the adaptation and testing happened at the same fixation location. Crucially, only the upper lookers showed a partial transfer of the FAE across the two fixation locations, when adaptation occurred at the eyes. Lower lookers showed no spatial transfer of the FAE irrespective of the adaptation position. Given the classic finding that neural tuning is increasingly position invariant as one moves higher in the visual hierarchy, this result suggests that differences in the preferred fixation location are associated with distinct neural representations of faces.

Under the sun: adaptation effects to changes in facial complexion

BACKGROUND

Many Western people enjoy sunshine, and through the sun's stimulated increase in melanin, the skin tone or skin complexion will darken (and lighten again during winter). Although the initial salience of such a new look is remarkable - especially in the face - we seem to adapt to this new look relatively quickly. Research on face adaptation in general repeatedly showed that the inspection of manipulated versions of faces (so-called adaptor faces) leads to a change of the perception of subsequently presented faces. The present study investigates face adaptation to very natural changes in faces such as changes in complexion.

METHODS

During the adaptation phase in the present study, participants saw faces with either strongly increased or decreased complexion. After a pause of 5 min, participants had to identify the veridical (non-manipulated) face out of two faces (a face slightly manipulated in complexion combined with the non-manipulated face) during a test phase.

RESULTS

Results show strong adaptation effects to decreased complexion intensities.

DISCUSSION

It seems that we are updating our facial representations in memory quite quickly (i.e., optimizing our processing through adaptation) and seem to sustain those new representations over a certain timespan (at least 5 min). Our results demonstrate that changes in complexion draw our attention for deeper analysis (at least with decreased complexion). However, it loses its informative quality quickly via fast and relatively sustainable adaptation.

Opposing aftereffects between a White male face set and a diverse face set

Opposing aftereffects have been observed for faces categorized by gender, race, and age. In order to form opposing aftereffects, it appears that the two face sets must be both physically distinct and differ in terms of social meaning. The current study tests whether (1) a face set that is diverse with respect to sex and race can produce a coherent aftereffect and (2) whether this diversity itself is socially meaningful enough to support opposing aftereffects. Participants adapted to a homogenous face set consisting of only White male Republican congressmen and a diverse face set consisting of White, Asian, Black, and Latino male and female Democratic congress members. Opposing aftereffects were observed: participants adapted simultaneously and in opposite directions to the face sets. These results are the first evidence of adaptation to a face set that varies based on race and sex, and the first evidence of diversity being perceived as a socially meaningful category marker.

Experience-dependent reshaping of body gender perception

Protracted exposure to specific stimuli causes biased visual aftereffects at both low- and high-level dimensions of a stimulus. Recently, it has been proposed that alterations of these aftereffects could play a role in body misperceptions. However, since previous studies have mainly addressed manipulations of body size, the relative contribution of low-level retinotopic and/or high-level object-based mechanisms is yet to be understood. In three experiments, we investigated visual aftereffects for body-gender perception, testing for the tuning of visual aftereffects across different characters and orientation. We found that exposure to a distinctively female (or male) body makes androgynous bodies appear as more masculine (or feminine) and that these aftereffects were not specific for the individual characteristics of the adapting body (Exp.1). Furthermore, exposure to only upright bodies (Exp.2) biased the perception of upright, but not of inverted bodies, while exposure to both upright and inverted bodies (Exp.3) biased perception for both. Finally, participants' sensitivity to body aftereffects was lower in individuals with greater communication deficits and deeper internalization of a male gender role. Overall, our data reveals the orientation-, but not identity-tuning of body-gender aftereffects and points to the association between alterations of the malleability of body gender perception and social deficits.

Contrast Adaptation in Face Perception Revealed Through EEG and Behavior

Exposure to a face can produce biases in the perception of subsequent faces. Typically, these face aftereffects are studied by adapting to an individual face or category (e.g., faces of a given gender) and can result in renormalization of perceptions such that the adapting face appears more neutral. These shifts are analogous to chromatic adaptation, where a renormalization for the average adapting color occurs. However, in color vision, adaptation can also adjust to the variance or range of colors in the distribution. We examined whether this variance or contrast adaptation also occurs for faces, using an objective EEG measure to assess response changes following adaptation. An average female face was contracted or expanded along the horizontal or vertical axis to form four images. Observers viewed a 20 s sequence of the four images presented in a fixed order at a rate of 6 Hz, while responses to the faces were recorded with EEG. A 6 Hz signal was observed over right occipito-temporal channels, indicating symmetric responses to the four images. This test sequence was repeated after 20 s adaptation to alternations between two of the faces (e.g., horizontal contracted and expanded). This adaptation resulted in an additional signal at 3 Hz, consistent with asymmetric responses to adapted and non-adapted test faces. Adapting pairs have the same mean (undistorted) as the test sequence and thus should not bias responses driven only by the mean. Instead, the results are consistent with selective adaptation to the distortion axis. A 3 Hz signal was also observed after adapting to face pairs selected to induce a mean bias (e.g., expanded vertical and expanded horizontal), and this signal was not significantly different from that observed following adaption to a single image that did not form part of the test sequence (e.g., a single image expanded both vertically and horizontally). In a further experiment, we found that this variance adaptation can also be observed behaviorally. Our results suggest that adaptation calibrates face perception not only for the average characteristics of the faces we experience but also for the gamut of faces to which we are exposed.

Size aftereffect is non-local

It is well known that prolonged exposure to a certain size stimulus alters the perceived size of a subsequently presented stimulus at the same location. How the rest of the visual space is affected by this size adaptation, however, has not been systematically studied before. Here, to fill this gap in literature, we tested size adaptation at the adapter location as well as the rest of the visual space. We used peripherally presented solid discs (Experiment 1) and rings (Experiment 2) as adapter and target (test) stimuli. Observers adapted to a mid-sized stimulus and judged the size of the subsequently presented smaller or larger target stimuli. Results showed that the perceived sizes of target stimuli were repelled away from the adapter size, not only at the adapter location but also at other locations. These findings demonstrate that size adaptation causes widespread distortion of the visual space and alters perceived size. We discuss possible computational models that may underpin the perceptual effect.

Face Adaptation and Face Priming as Tools for Getting Insights Into the Quality of Face Space

During the recognition of faces, the incoming perceptual information is matched against mental representations of familiar faces stored in memory. Face space models describe an abstract concept of face representations and their mental organization, in which facial representations are located on various characteristic dimensions, depending on their specific facial characteristics. However, these models are defined just as incompletely as the general understanding of face recognition. We took two phenomena from face processing to better understand face recognition, and so the nature of face space: face adaptation and face priming. The face literature has mainly focused on face adaptation, largely neglecting face priming when trying to integrate outcomes regarding face recognition into the face space framework. Consequently, the present paper aims to review both phenomena and their contributions to face recognition, representation, and face space.

Are expression aftereffects fully explained by tilt adaptation?

Facial expressions are used as critical social cues in everyday life. Adaptation to expressions causes expression aftereffects. These aftereffects are thought to reflect the operation of face-selective neural mechanisms, and are used by researchers to investigate the nature of those mechanisms. However, recent evidence suggests that expression aftereffects could be at least partially explained by the inheritance of lower-level tilt adaptation through the visual hierarchy. We investigated whether expression aftereffects could be entirely explained by tilt adaptation. Participants completed an expression adaptation task in which we controlled for the influence of tilt by changing the orientation of the adaptor relative to the test stimuli. Although tilt adaptation appeared to make some contribution to the expression aftereffect, robust expression aftereffects still remained after minimizing tilt inheritance, indicating that expression aftereffects cannot be fully explained by tilt adaptation. There was also significant reduction in the expression aftereffects after inverting the adapting face, providing evidence that face-selective processing is involved in these aftereffects.

The Flashed Face Distortion Effect Does Not Depend on Face-Specific Mechanisms

When normal faces are rapidly presented in the visual periphery, they are perceived as grotesque and distorted. This phenomenon, “The flashed-face distortion effect” (FFDE) is a powerful illusion that may reveal important properties of how faces are coded in peripheral vision. Despite the strength of the illusion (and its popularity), there has been almost no follow-up work to examine what governs the strength of the illusion or to develop a clear account of its phenomenology. Presently, our goal was to address this by manipulating aspects of facial appearance and spatial/temporal properties of the flashed-face stimulus to determine what factors modulate the illusion’s strength. In three experiments, we investigated the extent to which local contrast (operationalized by the presence or absence of makeup), image eccentricity, image size, face inversion, and presentation rate of images within the sequence each contributed to the strength of the FFDE. We found that some of these factors (eccentricity and presentation rate) mattered a great deal, while others (makeup, face inversion and image size) made little contribution to the strength of the FFDE. We discuss the implications of these results for a mechanistic account of the FFDE, and suggest several avenues for future research based on this compelling visual illusion.

Adaptation Aftereffects in the Perception of Crabs and Lobsters as Examples of Complex Natural Objects

To recognize a familiar object, incoming perceptual information is matched against object representations in memory. Mounting evidence suggests that these representations are not stable, but adapt flexibly to recently encountered perceptual information. This is evident in the form of aftereffects, where prolonged exposure to one object (adaptor) influences perception of the next (test stimulus). So far, adaptation aftereffects have been mainly shown for human faces and simple geometric shapes, and it has been concluded that face aftereffects partially derive from shape adaptation. However, it is largely unknown whether adaptation aftereffects generalize to other categories of complex, naturalistic biological objects, and if so, whether these effects can be explained by shape adaptation. To answer these questions, we conducted three experiments in which images of crabs and lobsters were presented in two versions: as complex, naturalistic images, or reduced to their simplified geometric shapes. In Experiment 1, we found robust adaptation aftereffects for the complex versions of the images, indicating that adaptation aftereffects generalize to animate objects other than faces. Experiment 2 showed adaptation aftereffects for the simplified stimuli, replicating previous findings on geometric shapes. Experiment 3 demonstrated that adaptation to the simplified animal shapes results in aftereffects on the complex naturalistic stimuli. Comparisons between experiments revealed that aftereffects were largest in the first experiment, in which complex stimuli served as adaptor and test stimuli. Together, these experiments show that the magnitude of adaptation aftereffects depends on the complexity of the adaptor, but not on that of the test stimuli, and that shape adaptation plays a role in - but cannot entirely account for - the object aftereffects.

Asymmetric neural responses for facial expressions and anti-expressions

Face recognition requires identifying both the invariant characteristics that distinguish one individual from another and the variations within the individual that correspond to emotional expressions. Both have been postulated to be represented via a norm-based code, in which identity or expression are represented as deviations from an average or neutral prototype. We used Fast Periodic Visual Stimulation (FPVS) with electroencephalography (EEG) to compare neural responses for neutral faces, expressions and anti-expressions. Anti-expressions are created by projecting an expression (e.g. a happy face) through the neutral face to form the opposite facial shape (anti-happy). Thus expressions and anti-expressions differ from the norm by the same "configural" amount and thus have equivalent but opposite status with regard to their shape, but differ in their ecological validity. We examined whether neural responses to these complementary stimulus pairs were equivalent or asymmetric, and also tested for norm-based coding by comparing whether stronger responses are elicited by expressions and anti-expressions than neutral faces. Observers viewed 20 s sequences of 6 Hz alternations of neutral faces and expressions, neutral faces and anti-expressions, and expressions and anti-expressions. Responses were analyzed in the frequency domain. Significant responses at half the frequency of the presentation rate (3 Hz), indicating asymmetries in responses, were observed for all conditions. Inversion of the images reduced the size of this signal, indicating these asymmetries are not solely due to differences in the low-level properties of the images. While our results do not preclude a norm-based code for expressions, similar to identity, this representation (as measured by the FPVS EEG responses) may also include components sensitive to which configural distortions form meaningful expressions.

The high-level basis of body adaptation

Prolonged visual exposure, or 'adaptation', to thin (wide) bodies causes a perceptual aftereffect such that subsequently seen bodies appear wider (thinner) than they actually are. Here, we conducted two experiments investigating the effect of rotating the orientation of the test stimuli by 90° from that of the adaptor. Aftereffects were maximal when adapting and test bodies had the same orientation. When they differed, the axis of the perceived distortion changed with the orientation of the body. Experiment 1 demonstrated a 58% transfer of the aftereffect across orientations. Experiment 2 demonstrated an even greater degree of aftereffect transfer when the influence of low-level mechanisms was reduced further by using adaptation and test stimuli with different sizes. These results indicate that the body aftereffect is mediated primarily by high-level object-based processes, with low-level retinotopic mechanisms playing only a minor role. The influence of these low-level processes is further reduced when test stimuli differ in size from adaptation stimuli.

Long-Term Exposure to American and European Movies and Television Series Facilitates Caucasian Face Perception in Young Chinese Watchers

Most young Chinese people now learn about Caucasian individuals via media, especially American and European movies and television series (AEMT). The current study aimed to explore whether long-term exposure to AEMT facilitates Caucasian face perception in young Chinese watchers. Before the experiment, we created Chinese, Caucasian, and generic average faces (generic average face was created from both Chinese and Caucasian faces) and tested participants’ ability to identify them. In the experiment, we asked AEMT watchers and Chinese movie and television series (CMT) watchers to complete a facial norm detection task. This task was developed recently to detect norms used in facial perception. The results indicated that AEMT watchers coded Caucasian faces relative to a Caucasian face norm better than they did to a generic face norm, whereas no such difference was found among CMT watchers. All watchers coded Chinese faces by referencing a Chinese norm better than they did relative to a generic norm. The results suggested that long-term exposure to AEMT has the same effect as daily other-race face contact in shaping facial perception.

The Role of Familiarity on Viewpoint Adaptation for Self-Face and Other-Face Images

An adaptation method was used to investigate whether self-face processing is dissociable from general face processing. We explored the viewpoint aftereffect with face images having different degrees of familiarity (never-before-seen faces, recently familiarized faces, personally familiar faces, and the participant’s own face). A face viewpoint aftereffect occurs after prolonged viewing of a face viewed from one side, with the result that the perceived viewing direction of a subsequently presented face image shown near the frontal view is biased in a direction which is the opposite of the adapting orientation. We found that (1) the magnitude of the viewpoint aftereffect depends on the level of familiarity of the adapting and test faces, (2) a cross-identity transfer of the viewpoint aftereffect is found between all categories of faces, but not between an unfamiliar adaptor face and the self-face test, and (3) learning affects the processing of the self-face in greater measure than any other category of faces. These results highlight the importance of familiarity on the face aftereffects, but they also suggest the possibility of separate representations for the self-face, on the one side, and for highly familiar faces, on the other.

View-Specific Coding of Face Shape

Monkey and human cortex contain view-specific face neurons, but it remains unclear whether they code face shape. We tested the view specificity of face-shape coding by inducing figural face aftereffects at one viewpoint (3/4 left) and testing generalization to different viewpoints (front view and 3/4 right). The aftereffects were induced by adaptation to consistent figural distortions (contracted or expanded), which shifts the distortion perceived as most normal toward the adapting distortion. The strong aftereffect that was observed at the adapting view was significantly and substantially reduced for both front-view test faces and mirror-image (3/4 right) test faces, indicating view specificity. The limited transfer across mirror views is strong evidence of view specificity, given their figural similarity. The aftereffects survived a size change between adaptation and test faces (Experiment 2), a result that rules out low-level adaptation as an explanation. These results provide strong evidence that face-shape coding is view-specific.

Probing the Visual Representation of Faces With Adaptation

Sensory adaptation and visual aftereffects have long given insight into the neural codes underlying basic dimensions of visual perception. Recently discovered perceptual adaptation effects for complex shapes like faces can offer similar insight into high-level visual representations. In the experiments reported here, we demonstrated first that face adaptation transfers across a substantial change in viewpoint and that this transfer occurs via processes unlikely to be specific to faces. Next, we probed the visual codes underlying face recognition using face morphs that varied selectively in reflectance or shape. Adaptation to these morphs affected the perception of “opposite” faces both from the same viewpoint and from a different viewpoint. These results are consistent with high-level face representations that pool local shape and reflectance patterns into configurations that specify facial appearance over a range of three-dimensional viewpoints. These findings have implications for computational models of face recognition and for competing neural theories of face and object recognition.

Adults with autism spectrum disorder show evidence of figural aftereffects with male and female faces

The norm-based coding model of face perception posits that face perception involves an implicit comparison of observed faces to a representation of an average face (prototype) that is shaped by experience. Using some methods, observers with autism spectrum disorder (ASD) have shown atypical face perception, but other methods suggest preserved face perception. Here, we used a figural aftereffects paradigm to test whether adults with ASD showed evidence of norm-based coding of faces, and whether they encode separate prototypes for male and female faces, as typical observers do. Following prolonged exposure to distorted faces that differ from their stored prototype, neurotypical adults show aftereffects: their prototype shifts in the direction of the adapting face. We measured aftereffects following adaptation to one distorted gender. There were no significant group differences in the size or direction of the aftereffects; both groups showed sex-selective aftereffects after adapting to expanded female faces but showed aftereffects for both sexes after adapting to contracted face of either sex, demonstrating that adults with and without ASD show evidence of partially dissociable male and female face prototypes. This is the first study to examine sex-selective prototypes using figural aftereffects in adults with ASD and replicates the findings of previous studies examining aftereffects in adults with ASD. The results contrast with studies reporting diminished adaptation in children with ASD.

Visual adaptation of the perception of "life": animacy is a basic perceptual dimension of faces

One critical component of understanding another's mind is the perception of "life" in a face. However, little is known about the cognitive and neural mechanisms underlying this perception of animacy. Here, using a visual adaptation paradigm, we ask whether face animacy is (1) a basic dimension of face perception and (2) supported by a common neural mechanism across distinct face categories defined by age and species. Observers rated the perceived animacy of adult human faces before and after adaptation to (1) adult faces, (2) child faces, and (3) dog faces. When testing the perception of animacy in human faces, we found significant adaptation to both adult and child faces, but not dog faces. We did, however, find significant adaptation when morphed dog images and dog adaptors were used. Thus, animacy perception in faces appears to be a basic dimension of face perception that is species specific but not constrained by age categories.

A Bayesian approach to person perception

Here we propose a Bayesian approach to person perception, outlining the theoretical position and a methodological framework for testing the predictions experimentally. We use the term person perception to refer not only to the perception of others' personal attributes such as age and sex but also to the perception of social signals such as direction of gaze and emotional expression. The Bayesian approach provides a formal description of the way in which our perception combines current sensory evidence with prior expectations about the structure of the environment. Such expectations can lead to unconscious biases in our perception that are particularly evident when sensory evidence is uncertain. We illustrate the ideas with reference to our recent studies on gaze perception which show that people have a bias to perceive the gaze of others as directed towards themselves. We also describe a potential application to the study of the perception of a person's sex, in which a bias towards perceiving males is typically observed.

Does my face FIT?: a face image task reveals structure and distortions of facial feature representation

Despite extensive research on face perception, few studies have investigated individuals' knowledge about the physical features of their own face. In this study, 50 participants indicated the location of key features of their own face, relative to an anchor point corresponding to the tip of the nose, and the results were compared to the true location of the same individual's features from a standardised photograph. Horizontal and vertical errors were analysed separately. An overall bias to underestimate vertical distances revealed a distorted face representation, with reduced face height. Factor analyses were used to identify separable subconfigurations of facial features with correlated localisation errors. Independent representations of upper and lower facial features emerged from the data pattern. The major source of variation across individuals was in representation of face shape, with a spectrum from tall/thin to short/wide representation. Visual identification of one's own face is excellent, and facial features are routinely used for establishing personal identity. However, our results show that spatial knowledge of one's own face is remarkably poor, suggesting that face representation may not contribute strongly to self-awareness.

Face adaptation effects: reviewing the impact of adapting information, time, and transfer

The ability to adapt is essential to live and survive in an ever-changing environment such as the human ecosystem. Here we review the literature on adaptation effects of face stimuli to give an overview of existing findings in this area, highlight gaps in its research literature, initiate new directions in face adaptation research, and help to design future adaptation studies. Furthermore, this review should lead to better understanding of the processing characteristics as well as the mental representations of face-relevant information. The review systematizes studies at a behavioral level in respect of a framework which includes three dimensions representing the major characteristics of studies in this field of research. These dimensions comprise (1) the specificity of adapting face information, e.g., identity, gender, or age aspects of the material to be adapted to (2) aspects of timing (e.g., the sustainability of adaptation effects) and (3) transfer relations between face images presented during adaptation and adaptation tests (e.g., images of the same or different identities). The review concludes with options for how to combine findings across different dimensions to demonstrate the relevance of our framework for future studies.

Processing of fear and anger facial expressions: the role of spatial frequency

Spatial frequency (SF) components encode a portion of the affective value expressed in face images. The aim of this study was to estimate the relative weight of specific frequency spectrum bandwidth on the discrimination of anger and fear facial expressions. The general paradigm was a classification of the expression of faces morphed at varying proportions between anger and fear images in which SF adaptation and SF subtraction are expected to shift classification of facial emotion. A series of three experiments was conducted. In Experiment 1 subjects classified morphed face images that were unfiltered or filtered to remove either low (<8 cycles/face), middle (12-28 cycles/face), or high (>32 cycles/face) SF components. In Experiment 2 subjects were adapted to unfiltered or filtered prototypical (non-morphed) fear face images and subsequently classified morphed face images. In Experiment 3 subjects were adapted to unfiltered or filtered prototypical fear face images with the phase component randomized before classifying morphed face images. Removing mid frequency components from the target images shifted classification toward fear. The same shift was observed under adaptation condition to unfiltered and low- and middle-range filtered fear images. However, when the phase spectrum of the same adaptation stimuli was randomized, no adaptation effect was observed. These results suggest that medium SF components support the perception of fear more than anger at both low and high level of processing. They also suggest that the effect at high-level processing stage is related more to high-level featural and/or configural information than to the low-level frequency spectrum.

Evolving concepts of sensory adaptation

Sensory systems constantly adapt their responses to match the current environment. These adjustments occur at many levels of the system and increasingly appear to calibrate even for highly abstract perceptual representations of the stimulus. The similar effects of adaptation across very different stimulus domains point to common design principles but also continue to raise questions about the purpose of adaptation.

Cross-category adaptation: objects produce gender adaptation in the perception of faces

Adaptation aftereffects have been found for low-level visual features such as colour, motion and shape perception, as well as higher-level features such as gender, race and identity in domains such as faces and biological motion. It is not yet clear if adaptation effects in humans extend beyond this set of higher order features. The aim of this study was to investigate whether objects highly associated with one gender, e.g. high heels for females or electric shavers for males can modulate gender perception of a face. In two separate experiments, we adapted subjects to a series of objects highly associated with one gender and subsequently asked participants to judge the gender of an ambiguous face. Results showed that participants are more likely to perceive an ambiguous face as male after being exposed to objects highly associated to females and vice versa. A gender adaptation aftereffect was obtained despite the adaptor and test stimuli being from different global categories (objects and faces respectively). These findings show that our perception of gender from faces is highly affected by our environment and recent experience. This suggests two possible mechanisms: (a) that perception of the gender associated with an object shares at least some brain areas with those responsible for gender perception of faces and (b) adaptation to gender, which is a high-level concept, can modulate brain areas that are involved in facial gender perception through top-down processes.

Visual adaptation to thin and fat bodies transfers across identity

Visual perception is highly variable and can be influenced by the surrounding world. Previous research has revealed that body perception can be biased due to adaptation to thin or fat body shapes. The aim of the present study was to show that adaptation to certain body shapes and the resulting perceptual biases transfer across different identities of adaptation and test stimuli. We designed two similar adaptation experiments in which healthy female participants adapted to pictures of either thin or fat bodies and subsequently compared more or less distorted pictures of their own body to their actual body shape. In the first experiment (n = 16) the same identity was used as adaptation and test stimuli (i.e. pictures of the participant’s own body) while in the second experiment (n = 16) we used pictures of unfamiliar thin or fat bodies as adaptation stimuli. We found comparable adaptation effects in both experiments: After adaptation to a thin body, participants rated a thinner than actual body picture to be the most realistic and vice versa. We therefore assume that adaptation to certain body shapes transfers across different identities. These results raise the questions of whether some type of natural adaptation occurs in everyday life. Natural and predominant exposure to certain bodily features like body shape – especially the thin ideal in Western societies – could bias perception for these features. In this regard, further research might shed light on aspects of body dissatisfaction and the development of body image disturbances in terms of eating disorders.

View-adaptation reveals coding of face pose along image, not object, axes

High-level adaptation effects reveal important features of the neural coding of objects and faces. View-adaptation in particular is a highly useful means of characterizing how depth rotation of the face is represented and therefore, how view-invariant recognition of the face may be achieved. In the present study, we used view adaptation to determine the extent to which depth rotations of a face are represented in an image-based or object-based manner. Specifically, we dissociated object-based axes from image-based axes via a 90° planar rotation of the adapting face and observed that participants' responses pre- and post-adaptation are most consistent with an image-based representation of depth rotations of the face. We discuss our data in the context of previous results describing the impact of planar rotation on related aspects of face perception.

FIAEs in Famous Faces are Mediated by Type of Processing

An important question regarding face aftereffects is whether it is based on face-specific or lower-level mechanisms. One method for addressing this is to explore how adaptation in upright or inverted, photographic positive or negative faces transfers to test stimuli that are either upright or inverted and normal or negated. A series of studies are reported in which this is tested using a typical face identity aftereffect paradigm in unfamiliar and famous faces. Results showed that aftereffects were strongest when the adaptor matched the test stimuli. In addition, aftereffects did not transfer from upright adaptors to inverted test images, but did transfer from inverted adaptors to upright test images in famous faces. However, in unfamiliar faces, a different pattern was observed. The results are interpreted in terms of how identity adaptation interacts with low-level adaptation and highlight differences in the representation of famous and unfamiliar faces.

The other in me: interpersonal multisensory stimulation changes the mental representation of the self

Background

Recent studies have shown that the well-known effect of multisensory stimulation on body-awareness can be extended to self-recognition. Seeing someone else’s face being touched at the same time as one’s own face elicits changes in the mental representation of the self-face. We sought to further elucidate the underlying mechanisms and the effects of interpersonal multisensory stimulation (IMS) on the mental representation of the self and others.

Methodology/Principal Findings

Participants saw an unfamiliar face being touched synchronously or asynchronously with their own face, as if they were looking in the mirror. Following synchronous, but not asynchronous, IMS, participants assimilated features of the other’s face in the mental representation of their own face as evidenced by the change in the point of subjective equality for morphed pictures of the two faces. Interestingly, synchronous IMS resulted in a unidirectional change in the self-other distinction, affecting recognition of one’s own face, but not recognition of the other’s face. The participants’ autonomic responses to objects approaching the other’s face were higher following synchronous than asynchronous IMS, but this increase was not specific to the pattern of IMS in interaction with the viewed object. Finally, synchronous, as compared to asynchronous, IMS resulted in significant differences in participants’ ratings of their experience, but unlike other bodily illusions, positive changes in subjective experience were related to the perceived physical similarity between the two faces, and not to identification.

Conclusions/Significance

Synchronous IMS produces quantifiable changes in the mental representations of one’s face, as measured behaviorally. Changes in autonomic responses and in the subjective experience of self-identification were broadly consistent with patterns observed in other bodily illusions, but less robust. Overall, shared multisensory experiences between self and other can change the mental representation of one’s identity, and the perceived similarity of others relative to one’s self.

Not all face aftereffects are equal

After prolonged exposure to a female face, faces that had previously seemed androgynous are more likely to be judged as male. Similarly, after prolonged exposure to a face with expanded features, faces that had previously seemed normal are more likely to be judged as having contracted features. These facial aftereffects have both been attributed to the impact of adaptation upon a norm-based opponent code, akin to low-level analyses of colour. While a good deal of evidence is consistent with this, some recent data is contradictory, motivating a more rigorous test. In behaviourally matched tasks we compared the characteristics of aftereffects generated by adapting to colour, to expanded or contracted faces, and to male or female faces. In our experiments opponent coding predicted that the appearance of the adapting image should change and that adaptation should induce symmetrical shifts of two category boundaries. This combination of predictions was firmly supported for colour adaptation, somewhat supported for facial distortion aftereffects, but not supported for facial gender aftereffects. Interestingly, the two face aftereffects we tested generated discrepant patterns of response shifts. Our data suggest that superficially similar aftereffects can ensue from mechanisms that differ qualitatively, and therefore that not all high-level categorical face aftereffects can be attributed to a common coding strategy.

Selectivity of face distortion aftereffects for differences in expression or gender

The perceived configuration of a face can be strongly biased by prior adaptation to a face with a distorted configuration. These aftereffects have been found to be weaker when the adapt and test faces differ along a number of dimensions. We asked whether the adaptation shows more transfer between faces that share a common identity, by comparing the strength of aftereffects when the adapt and test faces differed either in expression (a configural change in the same face identity) or gender (a configural change between identities). Observers adapted to expanded or contracted images of either male or female faces with either happy or fearful expressions, and then judged the perceived configuration in either the same faces or faces with a different gender and/or expression. The adaptation included exposure to a single face (e.g., expanded happy) or to alternated faces where the distortion was contingent on the attribute (e.g., expanded happy versus contracted fearful). In all cases the aftereffects showed strong transfer and thus only weak selectivity. However, selectivity was equal or stronger for the change in expression than gender. Our results thus suggest that the distortion aftereffects between faces can be weakly modulated by both variant and invariant attributes of the face.

Selectivity of face aftereffects for expressions and anti-expressions

Adapting to a facial expression can alter the perceived expression of subsequently viewed faces. However, it remains unclear whether this adaptation affects each expression independently or transfers from one expression to another, and whether this transfer impedes or enhances responses to a different expression. To test for these interactions, we probed the basic expressions of anger, fear, happiness, sadness, surprise, and disgust, adapting to one expression and then testing on all six. Each expression was varied in strength by morphing it with a common neutral facial expression. Observers determined the threshold level required to correctly identify each expression, before or after adapting to a face with a neutral or intense expression. The adaptation was strongly selective for the adapting category; responses to the adapting expression were reduced, while other categories showed little consistent evidence of either suppression or facilitation. In a second experiment we instead compared adaptation to each expression and its anti-expression. The latter are defined by the physically complementary facial configuration, yet appear much more ambiguous as expressions. In this case, for most expressions the opposing faces produced aftereffects of opposite sign in the perceived expression. These biases suggest that the adaptation acts in part by shifting the perceived neutral point for the facial configuration. This is consistent with the pattern of renormalization suggested for adaptation to other facial attributes, and thus may reflect a generic level of configural coding. However, for most categories aftereffects were stronger for expressions than anti-expressions, pointing to the possible influence of an additional component of the adaptation at sites that explicitly represent facial expressions. At either level our results are consistent with other recent work in suggesting that the six expressions are defined by dimensions that are largely independently normalized by adaptation, possibly because the facial configurations conveying different expressions vary in independent ways.

Adaptive face space coding in congenital prosopagnosia: typical figural aftereffects but abnormal identity aftereffects

People with congenital prosopagnosia (CP) report difficulty recognising faces in everyday life and perform poorly on face recognition tests. Here, we investigate whether impaired adaptive face space coding might contribute to poor face recognition in CP. To pinpoint how adaptation may affect face processing, a group of CPs and matched controls completed two complementary face adaptation tasks: the figural aftereffect, which reflects adaptation to general distortions of shape, and the identity aftereffect, which directly taps the mechanisms involved in the discrimination of different face identities. CPs displayed a typical figural aftereffect, consistent with evidence that they are able to process some shape-based information from faces, e.g., cues to discriminate sex. CPs also demonstrated a significant identity aftereffect. However, unlike controls, CPs impression of the identity of the neutral average face was not significantly shifted by adaptation, suggesting that adaptive coding of identity is abnormal in CP. In sum, CPs show reduced aftereffects but only when the task directly taps the use of face norms used to code individual identity. This finding of a reduced face identity aftereffect in individuals with severe face recognition problems is consistent with suggestions that adaptive coding may have a functional role in face recognition.

Enhanced attention amplifies face adaptation

Perceptual adaptation not only produces striking perceptual aftereffects, but also enhances coding efficiency and discrimination by calibrating coding mechanisms to prevailing inputs. Attention to simple stimuli increases adaptation, potentially enhancing its functional benefits. Here we show that attention also increases adaptation to faces. In Experiment 1, face identity aftereffects increased when attention to adapting faces was increased using a change detection task. In Experiment 2, figural (distortion) face aftereffects increased when attention was increased using a snap game (detecting immediate repeats) during adaptation. Both were large effects. Contributions of low-level adaptation were reduced using free viewing (both experiments) and a size change between adapt and test faces (Experiment 2). We suggest that attention may enhance adaptation throughout the entire cortical visual pathway, with functional benefits well beyond the immediate advantages of selective processing of potentially important stimuli. These results highlight the potential to facilitate adaptive updating of face-coding mechanisms by strategic deployment of attentional resources.

Visual adaptation and face perception

The appearance of faces can be strongly affected by the characteristics of faces viewed previously. These perceptual after-effects reflect processes of sensory adaptation that are found throughout the visual system, but which have been considered only relatively recently in the context of higher level perceptual judgements. In this review, we explore the consequences of adaptation for human face perception, and the implications of adaptation for understanding the neural-coding schemes underlying the visual representation of faces. The properties of face after-effects suggest that they, in part, reflect response changes at high and possibly face-specific levels of visual processing. Yet, the form of the after-effects and the norm-based codes that they point to show many parallels with the adaptations and functional organization that are thought to underlie the encoding of perceptual attributes like colour. The nature and basis for human colour vision have been studied extensively, and we draw on ideas and principles that have been developed to account for norms and normalization in colour vision to consider potential similarities and differences in the representation and adaptation of faces.

Seeing faces as objects: no face inversion effect with geometrical discrimination

Inversion dramatically impairs face perception, recognition, and discrimination. Yet it does not interfere with the ability to make precise estimates of facial feature distances. To investigate this discontinuity between facial feature distance estimation and general perception and recognition, we assessed the effect of inversion on the discrimination of differences in facial compression and elongation or expansion using geometrically distorted faces. The results clearly showed that geometrical face discrimination is not subject to the traditional face inversion effect and did not show a benefit for natural faces. Although discrimination thresholds were not affected by inversion, response times to the distance judgments were faster with inversion, especially when the inverted faces contained natural configurations. Based on these counterintuitive results, we suggest that participants used analytical processing to do the discrimination task. Moreover, we suggest that the depth with which a face is holistically encoded depends on the nature of the task, face orientation, and similarity between a face and the prototypical face template.

Position specificity of adaptation-related face aftereffects

It has been shown that prolonged exposure to a human face leads to shape-selective visual aftereffects. It seems that these face-specific aftereffects (FAEs) have multiple components, related to the adaptation of earlier and higher level processing of visual stimuli. The largest magnitude of FAE, using long-term adaptation periods, is usually observed at the retinotopic position of the preceding adaptor stimulus. However, FAE is also detected, to a smaller degree, at other retinal positions in a spatially invariant way and this component depends less on the adaptation duration. Several lines of evidences suggest that while the position-specific FAE involves lower level areas of the ventral processing stream, the position-invariant FAE depends on the activation of higher level face-processing areas and the fusiform gyrus in particular. In the present paper, we summarize the available behavioural, electrophysiological and neuroimaging results regarding the spatial selectivity of FAE and discuss their implications for the visual stability of object representations across saccadic eye movements.

Adaptation and visual coding

Visual coding is a highly dynamic process and continuously adapting to the current viewing context. The perceptual changes that result from adaptation to recently viewed stimuli remain a powerful and popular tool for analyzing sensory mechanisms and plasticity. Over the last decade, the footprints of this adaptation have been tracked to both higher and lower levels of the visual pathway and over a wider range of timescales, revealing that visual processing is much more adaptable than previously thought. This work has also revealed that the pattern of aftereffects is similar across many stimulus dimensions, pointing to common coding principles in which adaptation plays a central role. However, why visual coding adapts has yet to be fully answered.