A new theoretical approach to improving face recognition in disorders of central vision: Face caricaturing

Caricatured facial movements enhance perception of emotional facial expressions

Although faces “in the wild” constantly undergo complicated movements, humans adeptly perceive facial identity and expression. Previous studies, focusing mainly on identity, used photographic caricature to show that distinctive form increases perceived dissimilarity. We tested whether distinctive facial movements showed similar effects, and we focussed on both perception of expression and identity. We caricatured the movements of an animated computer head, using physical motion metrics extracted from videos. We verified that these “ground truth” metrics showed the expected effects: Caricature increased physical dissimilarity between faces differing in expression and those differing in identity. Like the ground truth dissimilarity, participants’ dissimilarity perception was increased by caricature when faces differed in expression. We found these perceived dissimilarities to reflect the “representational geometry” of the ground truth. However, neither of these findings held for faces differing in identity. These findings replicated across two paradigms: pairwise ratings and multiarrangement. In a final study, motion caricature did not improve recognition memory for identity, whether manipulated at study or test. We report several forms of converging evidence for spatiotemporal caricature effects on dissimilarity perception of different expressions. However, more work needs to be done to discover what identity-specific movements can enhance face identification.

Neurocognitive effects of a training program for poor face recognizers using shape and texture caricatures: A pilot investigation

Recent research suggested disproportional usage of shape information by people with poor face recognition, although texture information appears to be more important for familiar face recognition. Here, we tested a training program with faces that were selectively caricatured in either shape or texture parameters. Forty-eight young adults with poor face recognition skills (1 SD below the mean in at least 2/3 face processing tests: CFMT, GFMT, BFFT) were pseudo-randomly assigned to either one of two training groups or a control group (n = 16 each). Training comprised six sessions over three weeks. Per session, participants studied ten unfamiliar facial identities whose shape or texture characteristics were caricatured. Before and after training (or waiting in the control group), all participants completed EEG experiments on face learning and famous face recognition, and behavioral face processing tests. Results showed small but specific training-induced improvements: Whereas shape training improved face matching (training tasks, and to some extent GFMT), texture training elicited marked improvements in face learning (CFMT). Moreover, for the texture training group the N170 ERP was enhanced for novel faces post-training, suggesting training-induced changes in early markers of face processing. Although further research is necessary, this suggests that parameter-specific caricature training is a promising way to improve performance in people with poor face recognition skills.

Simulating Macular Degeneration to Investigate Activities of Daily Living: A Systematic Review

Purpose: Investigating difficulties during activities of daily living is a fundamental first step for the development of vision-related intervention and rehabilitation strategies. One way to do this is through visual impairment simulations. The aim of this review is to synthesize and assess the types of simulation methods that have been used to simulate age-related macular degeneration (AMD) in normally sighted participants, during activities of daily living (e.g., reading, cleaning, and cooking).

Methods: We conducted a systematic literature search in five databases and a critical analysis of the advantages and disadvantages of various AMD simulation methods (following PRISMA guidelines). The review focuses on the suitability of each method for investigating activities of daily living, an assessment of clinical validation procedures, and an evaluation of the adaptation periods for participants.

Results: Nineteen studies met the criteria for inclusion. Contact lenses, computer manipulations, gaze contingent displays, and simulation glasses were the main forms of AMD simulation identified. The use of validation and adaptation procedures were reported in approximately two-thirds and half of studies, respectively.

Conclusions: Synthesis of the methodology demonstrated that the choice of simulation has been, and should continue to be, guided by the nature of the study. While simulations may never completely replicate vision loss experienced during AMD, consistency in simulation methodology is critical for generating realistic behavioral responses under vision impairment simulation and limiting the influence of confounding factors. Researchers could also come to a consensus regarding the length and form of adaptation by exploring what is an adequate amount of time and type of training required to acclimatize participants to vision impairment simulations.

Impacts of impaired face perception on social interactions and quality of life in age-related macular degeneration: A qualitative study and new community resources

Aims

Previous studies and community information about everyday difficulties in age-related macular degeneration (AMD) have focussed on domains such as reading and driving. Here, we provide the first in-depth examination of how impaired face perception impacts social interactions and quality of life in AMD. We also develop a Faces and Social Life in AMD brochure and information sheet, plus accompanying conversation starter, aimed at AMD patients and those who interact with them (family, friends, nursing home staff).

Method

Semi-structured face-to-face interviews were conducted with 21 AMD patients covering the full range from mild vision loss to legally blind. Thematic analysis was used to explore the range of patient experiences.

Results

Patients reported faces appeared blurred and/or distorted. They described recurrent failures to recognise others' identity, facial expressions and emotional states, plus failures of alternative non-face strategies (e.g., hairstyle, voice). They reported failures to follow social nuances (e.g., to pick up that someone was joking), and feelings of missing out ('I can't join in'). Concern about offending others (e.g., by unintentionally ignoring them) was common, as were concerns of appearing fraudulent ('Other people don't understand'). Many reported social disengagement. Many reported specifically face-perception-related reductions in social life, confidence, and quality of life. All effects were observed even with only mild vision loss. Patients endorsed the value of our Faces and Social Life in AMD Information Sheet, developed from the interview results, and supported future technological assistance (digital image enhancement).

Conclusion

Poor face perception in AMD is an important domain contributing to impaired social interactions and quality of life. This domain should be directly assessed in quantitative quality of life measures, and in resources designed to improve community understanding. The identity-related social difficulties mirror those in prosopagnosia, of cortical rather than retinal origin, implying findings may generalise to all low-vision disorders.

Improving face identity perception in age-related macular degeneration via caricaturing

Patients with age-related macular degeneration (AMD) have difficulty recognising people's faces. We tested whether this could be improved using caricaturing: an image enhancement procedure derived from cortical coding in a perceptual 'face-space'. Caricaturing exaggerates the distinctive ways in which an individual's face shape differs from the average. We tested 19 AMD-affected eyes (from 12 patients; ages 66-93 years) monocularly, selected to cover the full range of vision loss. Patients rated how different in identity people's faces appeared when compared in pairs (e.g., two young men, both Caucasian), at four caricature strengths (0, 20, 40, 60% exaggeration). This task gives data reliable enough to analyse statistically at the individual-eye level. All 9 eyes with mild vision loss (acuity ≥ 6/18) showed significant improvement in identity discrimination (higher dissimilarity ratings) with caricaturing. The size of improvement matched that in normal-vision young adults. The caricature benefit became less stable as visual acuity further decreased, but caricaturing was still effective in half the eyes with moderate and severe vision loss (significant improvement in 5 of 10 eyes; at acuities from 6/24 to poorer than <6/360). We conclude caricaturing has the potential to help many AMD patients recognise faces.

Caricaturing faces to improve identity recognition in low vision simulations: How effective is current-generation automatic assignment of landmark points?

PURPOSE

Previous behavioural studies demonstrate that face caricaturing can provide an effective image enhancement method for improving poor face identity perception in low vision simulations (e.g., age-related macular degeneration, bionic eye). To translate caricaturing usefully to patients, assignment of the multiple face landmark points needed to produce the caricatures needs to be fully automatised. Recent development in computer science allows automatic face landmark detection of 68 points in real time and in multiple viewpoints. However, previous demonstrations of the behavioural effectiveness of caricaturing have used higher-precision caricatures with 147 landmark points per face, assigned by hand. Here, we test the effectiveness of the auto-assigned 68-point caricatures. We also compare this to the hand-assigned 147-point caricatures.

METHOD

We assessed human perception of how different in identity pairs of faces appear, when veridical (uncaricatured), caricatured with 68-points, and caricatured with 147-points. Across two experiments, we tested two types of low-vision images: a simulation of blur, as experienced in macular degeneration (testing two blur levels); and a simulation of the phosphenised images seen in prosthetic vision (at three resolutions).

RESULTS

The 68-point caricatures produced significant improvements in identity discrimination relative to veridical. They were approximately 50% as effective as the 147-point caricatures.

CONCLUSION

Realistic translation to patients (e.g., via real time caricaturing with the enhanced signal sent to smart glasses or visual prosthetic) is approaching feasibility. For maximum effectiveness software needs to be able to assign landmark points tracing out all details of feature and face shape, to produce high-precision caricatures.

Enhancement of face-sensitive ERPs in older adults induced by face recognition training

A common cognitive problem reported by older people is compromised face recognition, which is often paralleled by age-related changes in face-sensitive and memory-related components in event-related brain potentials (ERPs). We developed a new training using photorealistic caricatures based on evidence that caricatures are beneficial for people with compromised face processing. Twenty-four older participants (62-75 yrs, 13 female) completed 12 training sessions (3 per week, 60 min each) and 24 older participants (61-76 yrs, 12 female) acted as controls. Before and after training (or waiting), participants took part in a diagnostic test battery for face processing abilities, and in ERP experiments on face learning and recognition. Although performance improvements during the training provided little evidence for generalization to other face processing tasks, ERPs showed substantial training-related enhancements of face-sensitive ERPs. Specifically, we observed marked increases of the N170, P200 and N250 components, which may indicate training-induced enhancement of face detection and activation of identity-specific representations. Thus, neuronal correlates of face processing are plastic in older age, and can be modulated by caricature training.

Face identity recognition in simulated prosthetic vision is poorer than previously reported and can be improved by caricaturing

The visual prosthesis (or "bionic eye") has become a reality but provides a low resolution view of the world. Simulating prosthetic vision in normal-vision observers, previous studies report good face recognition ability using tasks that allow recognition to be achieved on the basis of information that survives low resolution well, including basic category (sex, age) and extra-face information (hairstyle, glasses). Here, we test within-category individuation for face-only information (e.g., distinguishing between multiple Caucasian young men with hair covered). Under these conditions, recognition was poor (although above chance) even for a simulated 40×40 array with all phosphene elements assumed functional, a resolution above the upper end of current-generation prosthetic implants. This indicates that a significant challenge is to develop methods to improve face identity recognition. Inspired by "bionic ear" improvements achieved by altering signal input to match high-level perceptual (speech) requirements, we test a high-level perceptual enhancement of face images, namely face caricaturing (exaggerating identity information away from an average face). Results show caricaturing improved identity recognition in memory and/or perception (degree by which two faces look dissimilar) down to a resolution of 32×32 with 30% phosphene dropout. Findings imply caricaturing may offer benefits for patients at resolutions realistic for some current-generation or in-development implants.

Effects of Caricaturing in Shape or Color on Familiarity Decisions for Familiar and Unfamiliar Faces

Recent evidence suggests that while reflectance information (including color) may be more diagnostic for familiar face recognition, shape may be more diagnostic for unfamiliar face identity processing. Moreover, event-related potential (ERP) findings suggest an earlier onset for neural processing of facial shape compared to reflectance. In the current study, we aimed to explore specifically the roles of facial shape and color in a familiarity decision task using pre-experimentally familiar (famous) and unfamiliar faces that were caricatured either in shape-only, color-only, or both (full; shape + color) by 15%, 30%, or 45%. We recorded accuracies, mean reaction times, and face-sensitive ERPs. Performance data revealed that shape caricaturing facilitated identity processing for unfamiliar faces only. In the ERP data, such effects of shape caricaturing emerged earlier than those of color caricaturing. Unsurprisingly, ERP effects were accentuated for larger levels of caricaturing. Overall, our findings corroborate the importance of shape for identity processing of unfamiliar faces and demonstrate an earlier onset of neural processing for facial shape compared to color.

Artificial faces are harder to remember

Observers interact with artificial faces in a range of different settings and in many cases must remember and identify computer-generated faces. In general, however, most adults have heavily biased experience favoring real faces over synthetic faces. It is well known that face recognition abilities are affected by experience such that faces belonging to "out-groups" defined by race or age are more poorly remembered and harder to discriminate from one another than faces belonging to the "in-group." Here, we examine the extent to which artificial faces form an "out-group" in this sense when other perceptual categories are matched. We rendered synthetic faces using photographs of real human faces and compared performance in a memory task and a discrimination task across real and artificial versions of the same faces. We found that real faces were easier to remember, but only slightly more discriminable than artificial faces. Artificial faces were also equally susceptible to the well-known face inversion effect, suggesting that while these patterns are still processed by the human visual system in a face-like manner, artificial appearance does compromise the efficiency of face processing.