Generalization across view in face memory and face matching

Congruency effects and individual differences in masked face recognition under limited feature visibility

Recognizing masked faces is a challenge. Researchers have explored congruency-based approaches to improve face matching, with promising results. Here, we investigated whether congruency between the encoding and the retrieval conditions can improve masked face recognition when only the eyes are visible under conditions of high and low memory load. Additionally, we explored whether the advantage of congruency varied as a function of general face recognition ability. In three experiments (total N = 316), participants completed a face recognition task that manipulated the congruency between encoding and retrieval conditions. In congruent sets, the images featured either a full face or a partial face at encoding, paired with a full or partial face, respectively, at retrieval. In incongruent sets, the images paired a full face at encoding with a partial face at retrieval or a partial face at encoding with a full face at retrieval. The Cambridge Face Memory Test served as a measure of general face recognition ability. The results supported the hypothesis that contextual congruency improves face recognition (ηp2 ≥ .46), and the effect remained consistent across high- and low-ability face recognition performers. Additionally, memory load shaped the confidence-accuracy relationship, such that confidence was a reliable predictor of accuracy under conditions of low (but not high) memory load. These results show that focusing on originally encoded facial features significantly improves masked target recognition, aiding law enforcement in identifying masked perpetrators and enhancing public safety.

Can face recognition be selectively preserved in some cases of amnesia? A cautionary tale

Evidence suggests that some patients with isolated hippocampal damage appear to present with selective preservation of unfamiliar face recognition relative to other kinds of visual test stimuli (e.g., words). Bird and Burgess (2008) formulated a review and secondary analysis of a group of 10 cases all tested on a clinical assessment of word and face recognition memory (RMT, Warrington, 1984), which confirmed the key memory dissociation at the group level. The current work provides an updated secondary analysis of such cases with a larger published sample (N = 52). In addition to group-level analyses, we also re-evaluate evidence using a single case statistical approach (Crawford & Garthwaite, 2005), enabling us to determine how many would make criteria for a 'classical dissociation' (Crawford, Garthwaite, & Gray, 2003). Overall, group-level analyses indicated the key pattern of significant differences confined to words was limited to small control sample comparisons. When using the large control sample provided by Bird and Burgess (2008), hippocampal cases as a group were significantly poorer for both classes of items. Furthermore, our single-case approach indicated few had a performance pattern of a relative difference across face > word categories that would meet statistical significance; namely within individual differences across categories that would warrant a significant 'classical dissociation'. Moreover, these analyses also found several cases with a 'classical dissociation' in the reverse direction: namely preserved recognition of words. Such analyses serve to demonstrate the need for a more conservative statistical approach to be undertaken when reporting selective 'preservation' of a category in recognition memory. Whilst material specificity has important implications for understanding the role of the hippocampus in memory, our results highlight the need for statistical methods to be unquestionably rigorous before any claims are made. Lastly, we highlight other methodological issues critical to group analyses and make suggestions for future work.

A new Asian version of the CFMT: The Cambridge Face Memory Test - Chinese Malaysian (CFMT-MY)

The Cambridge Face Memory Test (CFMT) is one of the most important measures of individual differences in face recognition and for the diagnosis of prosopagnosia. Having two different CFMT versions using a different set of faces seems to improve the reliability of the evaluation. However, at the present time, there is only one Asian version of the test. In this study, we present the Cambridge Face Memory Test - Chinese Malaysian (CFMT-MY), a novel Asian CFMT using Chinese Malaysian faces. In Experiment 1, Chinese Malaysian participants (N = 134) completed two versions of the Asian CFMT and one object recognition test. The CFMT-MY showed a normal distribution, high internal reliability, high consistency and presented convergent and divergent validity. Additionally, in contrast to the original Asian CFMT, the CFMT-MY showed an increasing level of difficulties across stages. In Experiment 2, Caucasian participants (N = 135) completed the two versions of the Asian CFMT and the original Caucasian CFMT. Results showed that the CFMT-MY exhibited the other-race effect. Overall, the CFMT-MY seems to be suitable for the diagnosis of face recognition difficulties and could be used as a measure of face recognition ability by researchers who wish to examine face-related research questions such as individual differences or the other-race effect.

Null effect of anodal and cathodal transcranial direct current stimulation (tDCS) on own- and other-race face recognition

Successful face recognition is important for social interactions and public security. Although some preliminary evidence suggests that anodal and cathodal transcranial direct current stimulation (tDCS) might modulate own- and other-race face identification, respectively, the findings are largely inconsistent. Hence, we examined the effect of both anodal and cathodal tDCS on the recognition of own- and other-race faces. Ninety participants first completed own- and other-race Cambridge Face Memory Test (CFMT) as baseline measurements. Next, they received either anodal tDCS, cathodal tDCS or sham stimulation and finally they completed alternative versions of the own- and other-race CFMT. No difference in performance, in terms of accuracy and reaction time, for own- and other-race face recognition between anodal tDCS, cathodal tDCS and sham stimulation was found. Our findings cast doubt upon the efficacy of tDCS to modulate performance in face identification tasks.

Stable individual differences in unfamiliar face identification: Evidence from simultaneous and sequential matching tasks

Matching identity in images of unfamiliar faces is difficult: Images of the same person can look different and images of different people can look similar. Recent studies have capitalized on individual differences in the ability to distinguish match (same ID) vs. mismatch (different IDs) face pairs to inform models of face recognition. We addressed two significant gaps in the literature by examining the stability of individual differences in both sensitivity to identity and response bias. In Study 1, 210 participants completed a battery of four tasks in each of two sessions separated by one week. Tasks varied in protocol (same/different, lineup, sorting) and stimulus characteristics (low vs. high within-person variability in appearance). In Study 2, 148 participants completed a battery of three tasks in a single session. Stimuli were presented simultaneously on some trials and sequentially on others, introducing short-term memory demands. Principal components analysis revealed two components that were stable across time and tasks: sensitivity to identity and bias. Analyses of response times suggest that individual differences in bias reflect decision-making processes. We discuss the implications of our findings in applied settings and for models of face recognition.

High-frequency transcranial random noise stimulation enhances unfamiliar face matching of high resolution and pixelated faces

Face identification is useful for social interactions and its impairment can lead to severe social and mental problems. This ability is also remarkably important in applied settings, including eyewitness identification and ID verification. Several studies have demonstrated the potential of Transcranial Random Noise Stimulation (tRNS) to enhance different cognitive skills. However, research has produced inconclusive results about the effectiveness of tRNS to improve face identification. The present study aims to further explore the effect of tRNS on face identification using an unfamiliar face matching task. Observers firstly received either high-frequency bilateral tRNS or sham stimulation for 20 min. The stimulation targeted occipitotemporal areas, which have been previously involved in face processing. In a subsequent stage, observers were asked to perform an unfamiliar face matching task consisting of unaltered and pixelated face pictures. Compared to the sham stimulation group, the high-frequency tRNS group showed better unfamiliar face matching performance with both unaltered and pixelated faces. Our results show that a single high-frequency tRNS session might suffice to improve face identification abilities. These results have important consequences for the treatment of face recognition disorders, and potential applications in those scenarios whereby the identification of faces is primordial.

Effect of mask coverage on face identification in Taiwanese men and women

Mask wearing is the easiest and most effective way to avoid COVID-19 infection; however, it affects interpersonal activities, especially face identification. This study examined the effects of three mask coverage levels (full coverage, FC; coverage up to the middle [MB] or bottom of the nose bridge [BB]) on face identification accuracy and time. A total of 115 university students (60 men and 55 women) were recruited to conduct a computer-based simulation test consisting of 30 questions (10 questions [five face images each of men and women] for the three mask coverage levels). One unmasked target face and four face images with a specified mask coverage level were designed for each question, and the participants were requested to select the same face from the four covered face images on the basis of the target face. The ANOVA results indicated that identification accuracy was significantly affected by sex (p < 0.01) and the mask coverage level (p < 0.001), whereas identification time was only influenced by sex (p < 0.05). The multiple comparison results indicated that the identification accuracy rate for faces wearing a mask with FC (90.3%) was significantly lower than for those wearing masks with coverage up to the MB (93.7%) and BB (94.9%) positions; however, no difference in identification accuracy rate was observed between the MB and BB levels. Women exhibited a higher identification accuracy rate than men (94.1% vs. 91.9%) in identifying unfamiliar faces, even though they may spend less time identifying the images. A smaller mask coverage level (i.e., the BB level) does not facilitate face identification. The findings can be served as a reference for people to trade-off between wearing a mask and interpersonal interaction in their daily activities.

Two face masks are better than one: congruency effects in face matching

Although the positive effects of congruency between stimuli are well replicated in face memory paradigms, mixed findings have been found in face matching. Due to the current COVID-19 pandemic, face masks are now very common during daily life outdoor activities. Thus, the present study aims to further explore congruency effects in matching faces partially occluded by surgical masks. Observers performed a face matching task consisting of pairs of faces presented in full view (i.e., full-view condition), pairs of faces in which only one of the faces had a mask (i.e., one-mask condition), and pairs of faces in which both faces had a mask (i.e., two-mask condition). Although face masks disrupted performance in identity match and identity mismatch trials, in match trials, we found better performance in the two-mask condition compared to the one-mask condition. This finding highlights the importance of congruency between stimuli on face matching when telling faces together.

COVID-19 masks increase the influence of face recognition algorithm decisions on human decisions in unfamiliar face matching

Face masks, recently adopted to reduce the spread of COVID-19, have had the unintended consequence of increasing the difficulty of face recognition. In security applications, face recognition algorithms are used to identify individuals and present results for human review. This combination of human and algorithm capabilities, known as human-algorithm teaming, is intended to improve total system performance. However, prior work has shown that human judgments of face pair similarity-confidence can be biased by an algorithm's decision even in the case of an error by that algorithm. This can reduce team effectiveness, particularly for difficult face pairs. We conducted two studies to examine whether face masks, now routinely present in security applications, impact the degree to which this cognitive bias is experienced by humans. We first compared the influence of algorithm's decisions on human similarity-confidence ratings in the presence and absence of face masks and found that face masks more than doubled the influence of algorithm decisions on human similarity-confidence ratings. We then investigated if this increase in cognitive bias was dependent on perceived algorithm accuracy by also presenting algorithm accuracy rates in the presence of face masks. We found that making humans aware of the potential for algorithm errors mitigated the increase in cognitive bias due to face masks. Our findings suggest that humans reviewing face recognition algorithm decisions should be made aware of the potential for algorithm errors to improve human-algorithm team performance.

Face masks affect emotion categorisation, age estimation, recognition, and gender classification from faces

Although putting on a mask over our nose and mouth is a simple but powerful way to protect ourselves and others during a pandemic, face masks may interfere with how we perceive and recognize one another, and hence, may have far-reaching impacts on communication and social interactions. To date, it remains relatively unknown the extent to which wearing a face mask that conceals the bottom part of the face affects the extraction of different facial information. To address this question, we compared young adults' performance between masked and unmasked faces in four different tasks: (1) emotion recognition task, (2) famous face recognition and naming test, (3) age estimation task, and (4) gender classification task. Results revealed that the presence of face mask has a negative impact on famous face recognition and emotion recognition, but to a smaller extent on age estimation and gender classification tasks. More interestingly, we observed a female advantage in the famous face recognition and emotion recognition tasks and a female own-gender bias in gender categorisation and age estimation tasks. Overall, these findings allude to the lack of malleability of the adulthood face recognition and perceptual systems.

A featural account for own-face processing? Looking for support from face inversion, composite face, and part-whole tasks

It is widely accepted that face perception relies on holistic processing. However, this holistic advantage is not always found in the processing of the own face. Our study aimed to explore the role of holistic and featural processing in the identification of the own face, using three standard, but largely independent measures of holistic face processing: the face inversion task, the composite face task, and the part-whole task. Participants were asked to identify their face, a friend’s face, and an unfamiliar face in three different experimental blocks: (a) inverted versus upright; (b) top and bottom halves of the face aligned versus misaligned; and (c) facial features presented in isolation versus whole foil face context. Inverting a face impaired its identification, regardless of the identity. However, alignment effects were only found when identifying a friend or an unfamiliar face. In addition, a stronger feature advantage (i.e., better recognition for isolated features compared to in a whole-face context) was observed for the own face compared to the friend and unfamiliar faces. Altogether, these findings suggest that the own face is processed in a more featural manner but also relies on holistic processing. This work also highlights the importance of taking into consideration that different holistic processing paradigms could tap different forms of holistic processing.

Masked face identification is improved by diagnostic feature training

To slow the spread of COVID-19, many people now wear face masks in public. Face masks impair our ability to identify faces, which can cause problems for professional staff who identify offenders or members of the public. Here, we investigate whether performance on a masked face matching task can be improved by training participants to compare diagnostic facial features (the ears and facial marks)-a validated training method that improves matching performance for unmasked faces. We show this brief diagnostic feature training, which takes less than two minutes to complete, improves matching performance for masked faces by approximately 5%. A control training course, which was unrelated to face identification, had no effect on matching performance. Our findings demonstrate that comparing the ears and facial marks is an effective means of improving face matching performance for masked faces. These findings have implications for professions that regularly perform face identification.

That person is now with or without a mask: how encoding context modulates identity recognition

Previous research has mostly approached face recognition and target identification by focusing on face perception mechanisms, but memory mechanisms also appear to play a role. Here, we examined how the presence of a mask interferes with the memory mechanisms involved in face recognition, focusing on the dynamic interplay between encoding and recognition processes. We approach two known memory effects: (a) matching study and test conditions effects (i.e., by presenting masked and/or unmasked faces) and (b) testing expectation effects (i.e., knowing in advance that a mask could be put on or taken off). Across three experiments using a yes/no recognition paradigm, the presence of a mask was orthogonally manipulated at the study and the test phases. All data showed no evidence of matching effects. In Experiment 1, the presence of masks either at study or test impaired the correct identification of a target. But in Experiments 2 and 3, in which the presence of masks at study or test was manipulated within participants, only masks presented at test-only impaired face identification. In these conditions, test expectations led participants to use similar encoding strategies to process masked and unmasked faces. Across all studies, participants were more liberal (i.e., used a more lenient criterion) when identifying masked faces presented at the test. We discuss these results and propose that to better understand how people may identify a face wearing a mask, researchers should take into account that memory is an active process of discrimination, in which expectations regarding test conditions may induce an encoding strategy that enables overcoming perceptual deficits.

Psychophysical profiles in super-recognizers

Facial identity matching ability varies widely, ranging from prosopagnosic individuals (who exhibit profound impairments in face cognition/processing) to so-called super-recognizers (SRs), possessing exceptional capacities. Yet, despite the often consequential nature of face matching decisions—such as identity verification in security critical settings—ability assessments tendentially rely on simple performance metrics on a handful of heterogeneously related subprocesses, or in some cases only a single measured subprocess. Unfortunately, methodologies of this ilk leave contributions of stimulus information to observed variations in ability largely un(der)specified. Moreover, they are inadequate for addressing the qualitative or quantitative nature of differences between SRs’ abilities and those of the general population. Here, therefore, we sought to investigate individual differences—among SRs identified using a novel conservative diagnostic framework, and neurotypical controls—by systematically varying retinal availability, bandwidth, and orientation of faces’ spatial frequency content in two face matching experiments. Psychophysical evaluations of these parameters’ contributions to ability reveal that SRs more consistently exploit the same spatial frequency information, rather than suggesting qualitatively different profiles between control observers and SRs. These findings stress the importance of optimizing procedures for SR identification, for example by including measures quantifying the consistency of individuals’ behavior.

Performance of typical and superior face recognizers on a novel interactive face matching procedure

Unfamiliar simultaneous face matching is error prone. Reducing incorrect identification decisions will positively benefit forensic and security contexts. The absence of view-independent information in static images likely contributes to the difficulty of unfamiliar face matching. We tested whether a novel interactive viewing procedure that provides the user with 3D structural information as they rotate a facial image to different orientations would improve face matching accuracy. We tested the performance of 'typical' (Experiment 1) and 'superior' (Experiment 2) face recognizers, comparing their performance using high-quality (Experiment 3) and pixelated (Experiment 4) Facebook profile images. In each trial, participants responded whether two images featured the same person with one of these images being either a static face, a video providing orientation information, or an interactive image. Taken together, the results show that fluid orientation information and interactivity prompt shifts in criterion and support matching performance. Because typical and superior face recognizers both benefited from the structural information provided by the novel viewing procedures, our results point to qualitatively similar reliance on pictorial encoding in these groups. This also suggests that interactive viewing tools can be valuable in assisting face matching in high-performing practitioner groups.

Associations between self-reported and objective face recognition abilities are only evident in above- and below-average recognisers

The 20-Item Prosopagnosia Items (PI-20) was recently introduced as a self-report measure of face recognition abilities and as an instrument to help the diagnosis of prosopagnosia. In general, studies using this questionnaire have shown that observers have moderate to strong insights into their face recognition abilities. However, it remains unknown whether these insights are equivalent for the whole range of face recognition abilities. The present study investigates this issue using the Mandarin version of the PI-20 and the Cambridge Face Memory Test Chinese (CFMT-Chinese). Our results showed a moderate negative association between the PI-20 and the CFMT-Chinese. However, this association was driven by people with low and high face recognition ability, but absent in people within the typical range of face recognition performance. The implications of these results for the study of individual differences and the diagnosis of prosopagnosia are discussed.

Surgical face masks impair human face matching performance for familiar and unfamiliar faces

In response to the COVID-19 pandemic, many governments around the world now recommend, or require, that their citizens cover the lower half of their face in public. Consequently, many people now wear surgical face masks in public. We investigated whether surgical face masks affected the performance of human observers, and a state-of-the-art face recognition system, on tasks of perceptual face matching. Participants judged whether two simultaneously presented face photographs showed the same person or two different people. We superimposed images of surgical masks over the faces, creating three different mask conditions: control (no masks), mixed (one face wearing a mask), and masked (both faces wearing masks). We found that surgical face masks have a large detrimental effect on human face matching performance, and that the degree of impairment is the same regardless of whether one or both faces in each pair are masked. Surprisingly, this impairment is similar in size for both familiar and unfamiliar faces. When matching masked faces, human observers are biased to reject unfamiliar faces as "mismatches" and to accept familiar faces as "matches". Finally, the face recognition system showed very high classification accuracy for control and masked stimuli, even though it had not been trained to recognise masked faces. However, accuracy fell markedly when one face was masked and the other was not. Our findings demonstrate that surgical face masks impair the ability of humans, and naïve face recognition systems, to perform perceptual face matching tasks. Identification decisions for masked faces should be treated with caution.

Differences between and within individuals, and subprocesses of face cognition: implications for theory, research and personnel selection

Recent investigations of individual differences have demonstrated striking variability in performance both within the same subprocess in face cognition (e.g. face perception), but also between two different subprocesses (i.e. face perception versus face recognition) that are assessed using different tasks (face matching versus face memory). Such differences between and within individuals between and within laboratory tests raise practical challenges. This applies in particular to the development of screening tests for the selection of personnel in real-world settings where faces are routinely processed, such as at passport control. The aim of this study, therefore, was to examine the performance profiles of individuals within and across two different subprocesses of face cognition: face perception and face recognition. To this end, 146 individuals completed four different tests of face matching-one novel tool for assessing proficiency in face perception, as well as three established measures-and two benchmark tests of face memory probing face recognition. In addition to correlational analyses, we further scrutinized individual performance profiles of the highest and lowest performing observers identified per test, as well as across all tests. Overall, a number of correlations emerged between tests. However, there was limited evidence at the individual level to suggest that high proficiency in one test generalized to other tests measuring the same subprocess, as well as those that measured a different subprocess. Beyond emphasizing the need to honour inter-individual differences through careful multivariate assessment in the laboratory, our findings have real-world implications: combinations of tests that most accurately map the task(s) and processes of interest are required for personnel selection.

Enhanced Matching of Children's Faces in "Super-Recognisers" But Not High-Contact Controls

Face matching is notoriously error-prone, and some work suggests additional difficulty when matching the faces of children. It is possible that individuals with natural proficiencies in adult face matching ("super-recognisers" [SRs]) will also excel at the matching of children's faces, although other work implicates facilitations in typical perceivers who have high levels of contact with young children (e.g., nursery teachers). This study compared the performance of both of these groups on adult and child face matching to a group of low-contact controls. High- and low-contact control groups performed at a remarkably similar level in both tasks, whereas facilitations for adult and child face matching were observed in some (but not all) SRs. As a group, the SRs performed better in the adult compared with the child task, demonstrating an extended own-age bias compared with controls. These findings suggest that additional exposure to children's faces does not assist the performance in a face matching task, and the mechanisms underpinning superior recognition of adult faces can also facilitate the child face recognition. Real-world security organisations should therefore seek individuals with general facilitations in face matching for both adult and child face matching tasks.

Infants' recognition of their mothers' faces in facial drawings

This study examined the development of ability to recognize familiar face in drawings in infants aged 6-8 months. In Experiment 1, we investigated infants' recognition of their mothers' faces by testing their visual preference for their mother's face over a stranger's face under three conditions: photographs, cartoons produced by online software that simplifies and enhances the contours of facial features of line drawings, and veridical line drawings. We found that 7- and 8-month-old infants showed a significant preference for their mother's face in photographs and cartoons, but not in veridical line drawings. In contrast, 6-month-old infants preferred their mother's face only in photographs. In Experiment 2, we investigated a visual preference for an upright face over an inverted face for cartoons and veridical line drawings in 6- to 8-month-old infants, finding that infants aged older than 6 months showed the inversion effect in face preference in both cartoons and veridical line drawings. Our results imply that the ability to utilize the enhanced information of a face to recognize familiar faces may develop aged around 7 months of age.

The wisdom of the crowd: A case of post- to ante-mortem face matching by police super-recognisers

This case report describes novel methodology used to identify a 43-year-old post-mortem photo of a drowned male recovered from a London river in the 1970s. Embedded in an array of foils, police super-recognisers (n=25) possessing superior simultaneous face matching ability, and police controls (n=139) provided confidence ratings as to the similarity of the post-mortem photo to an ante-mortem photo of a man who went missing at about the same time. Indicative of a match, compared to controls, super-recognisers provided higher ratings to the target than the foils. Effects were enhanced when drawing on the combined wisdom of super-recogniser crowds, but not control crowds. These findings supported additional case evidence allowing the coroner to rule that the deceased male and missing male were likely one and the same person. A description of how similar super-recogniser wisdom of the crowd procedures could be applied to other visual image identification cases when no other method is feasible is provided.

Facial Identification at a Virtual Reality Airport

Person identification at airports requires the comparison of a passport photograph with its bearer. In psychology, this process is typically studied with static pairs of face photographs that require identity-match (same person shown) versus mismatch (two different people) decisions, but this approach provides a limited proxy for studying how environment and social interaction factors affect this task. In this study, we explore the feasibility of virtual reality (VR) as a solution to this problem, by examining the identity matching of avatars in a VR airport. We show that facial photographs of real people can be rendered into VR avatars in a manner that preserves image and identity information (Experiments 1 to 3). We then show that identity matching of avatar pairs reflects similar cognitive processes to the matching of face photographs (Experiments 4 and 5). This pattern holds when avatar matching is assessed in a VR airport (Experiments 6 and 7). These findings demonstrate the feasibility of VR as a new method for investigating face matching in complex environments.

Unfamiliar Face Matching With Driving Licence and Passport Photographs

Matching two different images of an unfamiliar face is difficult, although we rely on this process every day when proving our identity. Although previous work with laboratory photosets has shown that performance is error-prone, few studies have focussed on how accurately people carry out this matching task using photographs taken from official forms of identification. In Experiment 1, participants matched high-resolution, colour face photos with current UK driving licence photos of the same group of people in a sorting task. Averaging 19 mistaken pairings out of 30, our results showed that this task was both difficult and error-prone. In Experiment 2, high-resolution photographs were paired with either driving licence or passport photographs in a typical pairwise matching paradigm. We found no difference in performance levels for the two types of ID image, with both producing unacceptable levels of accuracy (around 75%-79% correct). The current work benefits from increased ecological validity and provides a clear demonstration that these forms of official identification are ineffective and alternatives should be considered.

View specific generalisation effects in face recognition: Front and yaw comparison views are better than pitch

It can be difficult to recognise new instances of an unfamiliar face. Recognition errors in this particular situation appear to be viewpoint dependent with error rates increasing with the angular distance between the face views. Studies using front views for comparison have shown that recognising faces rotated in yaw can be difficult and that recognition of faces rotated in pitch is more challenging still. Here we investigate the extent to which viewpoint dependent face recognition depends on the comparison view. Participants were assigned to one of four different comparison view groups: front, ¾ yaw (right), ¾ pitch-up (above) or ¾ pitch-down (below). On each trial, participants matched their particular comparison view to a range of yaw or pitch rotated test views. Results showed that groups with a front or ¾ yaw comparison view had superior overall performance and more successful generalisation to a broader range of both pitch and yaw test views compared to groups with pitch-up or pitch-down comparison views, both of which had a very restricted generalisation range. Regression analyses revealed the importance of image similarity between views for generalisation, with a lesser role for 3D face depth. These findings are consistent with a view interpolation solution to view generalisation of face recognition, with front and ¾ yaw views being most informative.

Use-inspired basic research on individual differences in face identification: implications for criminal investigation and security

This journal is dedicated to "use-inspired basic research" where a problem in the world shapes the hypotheses for study in the laboratory. This review considers the role of individual variation in face identification and the challenges and opportunities this presents in security and criminal investigations. We show how theoretical work conducted on individual variation in face identification has, in part, been stimulated by situations presented in the real world. In turn, we review the contribution of theoretical work on individual variation in face processing and how this may help shape the practical identification of faces in applied situations. We consider two cases in detail. The first case is that of security officers; gatekeepers who use facial ID to grant entry or deny access. One applied example, where much research has been conducted, is passport control officers who are asked to match a person in front of them to a photograph shown on their ID. What happens if they are poor at making such face matching decisions and can they be trained to improve their performance? Second, we outline the case of "super-recognisers", people who are excellent at face recognition. Here it is interesting to consider whether these individuals can be strategically allocated to security and criminal roles, to maximise the identification of suspects. We conclude that individual differences are one of the largest documented sources of error in face matching and face recognition but more work is needed to account for these differences within theoretical models of face processing.

Person Identification from Drones by Humans: Insights from Cognitive Psychology

The deployment of unmanned aerial vehicles (i.e., drones) in military and police operations implies that drones can provide footage that is of sufficient quality to enable the recognition of strategic targets, criminal suspects, and missing persons. On the contrary, evidence from Cognitive Psychology suggests that such identity judgements by humans are already difficult under ideal conditions, and are even more challenging with drone surveillance footage. In this review, we outline the psychological literature on person identification for readers who are interested in the real-world application of drones. We specifically focus on factors that are likely to affect identification performance from drone-recorded footage, such as image quality, and additional person-related information from the body and gait. Based on this work, we suggest that person identification from drones is likely to be very challenging indeed, and that performance in laboratory settings is still very likely to underestimate the difficulty of this task in real-world settings.

Unfamiliar face matching with photographs of infants and children

BACKGROUND

Infants and children travel using passports that are typically valid for five years (e.g. Canada, United Kingdom, United States and Australia). These individuals may also need to be identified using images taken from videos and other sources in forensic situations including child exploitation cases. However, few researchers have examined how useful these images are as a means of identification.

METHODS

We investigated the effectiveness of photo identification for infants and children using a face matching task, where participants were presented with two images simultaneously and asked whether the images depicted the same child or two different children. In Experiment 1, both images showed an infant (<1 year old), whereas in Experiment 2, one image again showed an infant but the second image of the child was taken at 4-5 years of age. In Experiments 3a and 3b, we asked participants to complete shortened versions of both these tasks (selecting the most difficult trials) as well as the short version Glasgow face matching test. Finally, in Experiment 4, we investigated whether information regarding the sex of the infants and children could be accurately perceived from the images.

RESULTS

In Experiment 1, we found low levels of performance (72% accuracy) for matching two infant photos. For Experiment 2, performance was lower still (64% accuracy) when infant and child images were presented, given the significant changes in appearance that occur over the first five years of life. In Experiments 3a and 3b, when participants completed both these tasks, as well as a measure of adult face matching ability, we found lowest performance for the two infant tasks, along with mixed evidence of within-person correlations in sensitivities across all three tasks. The use of only same-sex pairings on mismatch trials, in comparison with random pairings, had little effect on performance measures. In Experiment 4, accuracy when judging the sex of infants was at chance levels for one image set and above chance (although still low) for the other set. As expected, participants were able to judge the sex of children (aged 4-5) from their faces.

DISCUSSION

Identity matching with infant and child images resulted in low levels of performance, which were significantly worse than for an adult face matching task. Taken together, the results of the experiments presented here provide evidence that child facial photographs are ineffective for use in real-world identification.

Unfamiliar Face Matching With Frontal and Profile Views

Research has systematically examined how laboratory participants and real-world practitioners decide whether two face photographs show the same person or not using frontal images. In contrast, research has not examined face matching using profile images. In Experiment 1, we ask whether matching unfamiliar faces is easier with frontal compared with profile views. Participants completed the original, frontal version of the Glasgow Face Matching Test, and also an adapted version where all face pairs were presented in profile. There was no difference in performance across the two tasks, suggesting that both views were similarly useful for face matching. Experiments 2 and 3 examined whether matching unfamiliar faces is improved when both frontal and profile views are provided. We compared face matching accuracy when both a frontal and a profile image of each face were presented, with accuracy using each view alone. Surprisingly, we found no benefit when both views were presented together in either experiment. Overall, these results suggest that either frontal or profile views provide substantially overlapping information regarding identity or participants are unable to utilise both sources of information when making decisions. Each of these conclusions has important implications for face matching research and real-world identification development.

Person identification from aerial footage by a remote-controlled drone

Remote-controlled aerial drones (or unmanned aerial vehicles; UAVs) are employed for surveillance by the military and police, which suggests that drone-captured footage might provide sufficient information for person identification. This study demonstrates that person identification from drone-captured images is poor when targets are unfamiliar (Experiment 1), when targets are familiar and the number of possible identities is restricted by context (Experiment 2), and when moving footage is employed (Experiment 3). Person information such as sex, race and age is also difficult to access from drone-captured footage (Experiment 4). These findings suggest that such footage provides a particularly poor medium for person identification. This is likely to reflect the sub-optimal quality of such footage, which is subject to factors such as the height and velocity at which drones fly, viewing distance, unfavourable vantage points, and ambient conditions.

Effects of time pressure and time passage on face-matching accuracy

This study investigated the impact of time pressure on matching accuracy with face pairs that combined photographs from student ID cards with high-quality person portraits, and under conditions that provided infrequent identity mismatches. Time pressure was administered via two onscreen displays that observers could use to adjust the amount of time that was allocated to a given trial while completing a block of trials within a required timeframe. Under these conditions, observers matched faces under time pressure that varied from 10 to 2 s (Experiment 1) and 8 to 2 s (Experiment 2). An effect of time pressure was found in each experiment, whereby performance deteriorated under time targets of 4 s. Additionally, a match response bias emerged consistently across blocks, and indicated that separately to time pressure, performance also deteriorated due to time passage. These results therefore indicate that both time passage and pressure exert detrimental effects on face matching.

Matching Faces Against the Clock

This study examined the effect of time pressure on face-matching accuracy. Across two experiments, observers decided whether pairs of faces depict one person or different people. Time pressure was exerted via two additional displays, which were constantly updated to inform observers on whether they were on track to meet or miss a time target. In this paradigm, faces were matched under increasing or decreasing (Experiment 1) and constant time pressure (Experiment 2), which varied from 10 to 2 seconds. In both experiments, time pressure reduced accuracy, but the point at which this declined varied from 8 to 2 seconds. A separate match response bias was found, which developed over the course of the experiments. These results indicate that both time pressure and the repetitive nature of face matching are detrimental to performance.

Efficient visual information for unfamiliar face matching despite viewpoint variations: It's not in the eyes!

Faces are encountered in highly diverse angles in real-world settings. Despite this considerable diversity, most individuals are able to easily recognize familiar faces. The vast majority of studies in the field of face recognition have nonetheless focused almost exclusively on frontal views of faces. Indeed, a number of authors have investigated the diagnostic facial features for the recognition of frontal views of faces previously encoded in this same view. However, the nature of the information useful for identity matching when the encoded face and test face differ in viewing angle remains mostly unexplored. The present study addresses this issue using individual differences and bubbles, a method that pinpoints the facial features effectively used in a visual categorization task. Our results indicate that the use of features located in the center of the face, the lower left portion of the nose area and the center of the mouth, are significantly associated with individual efficiency to generalize a face's identity across different viewpoints. However, as faces become more familiar, the reliance on this area decreases, while the diagnosticity of the eye region increases. This suggests that a certain distinction can be made between the visual mechanisms subtending viewpoint invariance and face recognition in the case of unfamiliar face identification. Our results further support the idea that the eye area may only come into play when the face stimulus is particularly familiar to the observer.

Factors affecting the identification of individual mountain bongo antelope

The recognition of individuals forms the basis of many endangered species monitoring protocols. This process typically relies on manual recognition techniques. This study aimed to calculate a measure of the error rates inherent within the manual technique and also sought to identify visual traits that aid identification, using the critically endangered mountain bongo, Tragelaphus eurycerus isaaci, as a model system. Identification accuracy was assessed with a matching task that required same/different decisions to side-by-side pairings of individual bongos. Error rates were lowest when only the flanks of bongos were shown, suggesting that the inclusion of other visual traits confounded accuracy. Accuracy was also higher for photographs of captive animals than camera-trap images, and in observers experienced in working with mountain bongos, than those unfamiliar with the sub-species. These results suggest that the removal of non-essential morphological traits from photographs of bongos, the use of high-quality images, and relevant expertise all help increase identification accuracy. Finally, given the rise in automated identification and the use of citizen science, something our results would suggest is applicable within the context of the mountain bongo, this study provides a framework for assessing their accuracy in individual as well as species identification.

Face matching in a long task: enforced rest and desk-switching cannot maintain identification accuracy

In face matching, observers have to decide whether two photographs depict the same person or different people. This task is not only remarkably difficult but accuracy declines further during prolonged testing. The current study investigated whether this decline in long tasks can be eliminated with regular rest-breaks (Experiment 1) or room-switching (Experiment 2). Both experiments replicated the accuracy decline for long face-matching tasks and showed that this could not be eliminated with rest or room-switching. These findings suggest that person identification in applied settings, such as passport control, might be particularly error-prone due to the long and repetitive nature of the task. The experiments also show that it is difficult to counteract these problems.