Neural mechanisms of face perception, their emergence over development, and their breakdown

The impact of emotion on temporal prediction ability in different timing contexts

Our ability to predict temporal events (TP) is dynamically modulated by contextual factors (i.e., different predictive contexts) and closely intertwined with emotional states, shaping our adaptive responses within the environment. While studies have extensively probed how emotions distort time perception, their impact on predictive ability remains unexplored. Here, we investigated emotions' impact on temporal prediction. Participants (N = 23) completed a standard implicit TP task and its emotional version (TP-E), using positive (i.e., joy), negative (i.e., fear), and neutral faces as visual stimuli. Reaction times (RTs) to the target were recorded in two predictive contexts: rhythmic (i.e., interstimulus intervals (ISIs) were constant, 900 ms) and single-interval condition (i.e., target's timing estimation was based on the prior exposure of the train of stimuli) and random (no-time context). We found a specific decrease in RTs, in the single-interval context, when fearful stimuli were used, compared to neutral stimuli. This suggests that negative emotion influences temporal prediction, aligning with emotional adjustments in processing threatening situations, including modulation of physiological arousal, cognitive appraisal, and time estimation. Indeed, such modulation of RTs, specifically in the single-interval condition, may be attributed to improved memory and attention, essential cognitive abilities for single-based predictions, enhanced by the exposure to fearful stimuli.

Gyral crowns contribute to the cortical infrastructure of human face processing

Neuroanatomical features across spatial scales contribute to functional specialization and individual differences in behavior across species. Among species with gyrencephalic brains, gyral crown height, which measures a key aspect of the morphology of cortical folding, may represent an anatomical characteristic that importantly shapes neural function. Nevertheless, little is known about the relationship between functional selectivity and gyral crowns-especially in clinical populations. Here, we investigated this relationship and found that the size and gyral crown height of the middle, but not posterior, face-selective region on the fusiform gyrus (FG) was smaller in individuals with developmental prosopagnosia (DPs; N = 22, 68% female, aged 25-62) compared to neurotypical controls (NTs; N = 25, 60% females, aged 21-55), and this difference was related to face perception. Additional analyses replicated the relationship between gyral crowns and face selectivity in 1,053 NTs (55% females, aged 22-36). These results inform theoretical models of face processing while also providing a novel neuroanatomical feature contributing to the cortical infrastructure supporting face processing.

Exploring the links among brain iron accumulation, cognitive performance, and dietary intake in older adults: A longitudinal MRI study

This study evaluated longitudinal brain iron accumulation in older adults, its association with cognition, and the role of specific nutrients in mitigating iron accumulation. MRI-based, quantitative susceptibility mapping estimates of brain iron concentration were acquired from seventy-two healthy older adults (47 women, ages 60-86) at a baseline timepoint (TP1) and a follow-up timepoint (TP2) 2.5-3.0 years later. Dietary intake was evaluated at baseline using a validated questionnaire. Cognitive performance was assessed at TP2 using the uniform data set (Version 3) neuropsychological tests of episodic memory (MEM) and executive function (EF). Voxel-wise, linear mixed-effects models, adjusted for longitudinal gray matter volume alterations, age, and several non-dietary lifestyle factors revealed brain iron accumulation in multiple subcortical and cortical brain regions, which was negatively associated with both MEM and EF performance at T2. However, consumption of specific dietary nutrients at TP1 was associated with reduced brain iron accumulation. Our study provides a map of brain regions showing iron accumulation in older adults over a short 2.5-year follow-up and indicates that certain dietary nutrients may slow brain iron accumulation.

Hemispheric organization of the brain and its prevailing impact on the neuropsychology of aging

Age differences in brain hemispheric asymmetry have figured prominently in the neuropsychology of aging. Here, a broad overview of these empirical and theoretical approaches is provided that dates back to the 1970s and continues to the present day. Methodological advances often brought new evidence to bear on older ideas and promoted the development of new ones. The deficit-focused hypothesis of accelerated right-hemisphere aging is reviewed first, followed by subsequent accounts pertaining to compensation, reserve, and their potential hemispheric underpinnings. Structural and functional neuroimaging reveal important and consistent age-related patterns, including indications of reduced brain asymmetry in older relative to younger adults. While not mutually exclusive, different neuropsychologic theories of aging offer divergent interpretations of such patterns, including age-related reductions in neural specificity (dedifferentiation) and age-related compensatory bilateral recruitment [e.g., Hemispheric Asymmetry Reduction in Older Adults (HAROLD); Compensation-Related Utilization of Neural Circuits Hypothesis (CRUNCH)]. Further, recent neurobehavioral evidence suggests that the right hemisphere plays a unique role in resisting the neurocognitive effects of aging via brain reserve. Future advances in human cognitive neuroscience, including neurostimulation methods for targeted interventions, along with analytic techniques informed by machine learning promise new insights into the neuropsychology of aging and the role of hemispheric processes in resilience and decline.

Representational Dissimilarity of Faces and Places during a Working Memory Task is Associated with Subsequent Recognition Memory during Development

Nearly 50 years of research has focused on faces as a special visual category, especially during development. Yet it remains unclear how spatial patterns of neural similarity of faces and places relate to how information processing supports subsequent recognition of items from these categories. The current study uses representational similarity analysis and functional imaging data from 9- and 10-year-old youth during an emotional n-back task from the Adolescent Brain and Cognitive Development Study 3.0 data release to relate spatial patterns of neural similarity during working memory to subsequent out-of-scanner performance on a recognition memory task. Specifically, we examine how similarities in representations within face categories (neutral, happy, and fearful faces) and representations between visual categories (faces and places) relate to subsequent recognition memory of these visual categories. Although working memory performance was higher for faces than places, subsequent recognition memory was greater for places than faces. Representational similarity analysis revealed category-specific patterns in face-and place-sensitive brain regions (fusiform gyrus, parahippocampal gyrus) compared with a nonsensitive visual region (pericalcarine cortex). Similarity within face categories and dissimilarity between face and place categories in the parahippocampus was related to better recognition of places from the n-back task. Conversely, in the fusiform, similarity within face categories and their relative dissimilarity from places was associated with better recognition of new faces, but not old faces. These findings highlight how the representational distinctiveness of visual categories influence what information is subsequently prioritized in recognition memory during development.

The anterior fusiform gyrus: The ghost in the cortical face machine

Face-selective regions in the human ventral occipito-temporal cortex (VOTC) have been defined for decades mainly with functional magnetic resonance imaging. This face-selective VOTC network is traditionally divided in a posterior 'core' system thought to subtend face perception, and regions of the anterior temporal lobe as a semantic memory component of an extended general system. In between these two putative systems lies the anterior fusiform gyrus and surrounding sulci, affected by magnetic susceptibility artifacts. Here we suggest that this methodological gap overlaps with and contributes to a conceptual gap between (visual) perception and semantic memory for faces. Filling this gap with intracerebral recordings and direct electrical stimulation reveals robust face-selectivity in the anterior fusiform gyrus and a crucial role of this region, especially in the right hemisphere, in identity recognition for both familiar and unfamiliar faces. Based on these observations, we propose an integrated theoretical framework for human face (identity) recognition according to which face-selective regions in the anterior fusiform gyrus join the dots between posterior and anterior cortical face memories.

Decoding semantic representations in mind and brain

A key goal for cognitive neuroscience is to understand the neurocognitive systems that support semantic memory. Recent multivariate analyses of neuroimaging data have contributed greatly to this effort, but the rapid development of these novel approaches has made it difficult to track the diversity of findings and to understand how and why they sometimes lead to contradictory conclusions. We address this challenge by reviewing cognitive theories of semantic representation and their neural instantiation. We then consider contemporary approaches to neural decoding and assess which types of representation each can possibly detect. The analysis suggests why the results are heterogeneous and identifies crucial links between cognitive theory, data collection, and analysis that can help to better connect neuroimaging to mechanistic theories of semantic cognition.

Brain activity during facial processing in autism spectrum disorder: an activation likelihood estimation (ALE) meta-analysis of neuroimaging studies

BACKGROUND

Though aberrant face processing is a hallmark of autistic spectrum disorder (ASD), findings on accompanying brain activity are divergent. Therefore, we conducted an activation likelihood estimation (ALE) meta-analysis of studies examining brain activity during face processing.

METHODS

We searched PubMed and PsycINFO using combinations of terms as 'fMRI', 'Autism Spectrum Disorder', 'Face Perception'. Eligible studies reported on DSM-diagnosed ASD individuals, compared to controls (HC), using face stimuli presented in fMRI and reporting whole-brain analysis coordinates. We compared two approaches: 'convergence of differences' (primary analysis) using study-level coordinates from ASD vs. HC contrasts, and 'differences in convergence' (secondary) pooling coordinates within each group separately, and contrasting the resultant ALE maps.

RESULTS

Thirty-five studies (655 ASD and 668 HC) were included. Primary analysis identified a cluster in amygdala/parahippocampus where HC showed greater convergence of activation. Secondary analysis yielded no significant results.

CONCLUSIONS

Results suggest that ASD dysfunction in face processing relies on structures involved in emotional processing rather than perception. We also demonstrate that the two ALE methodologies lead to divergent results.

Similarity and stability of face network across populations and throughout adolescence and adulthood

The ability to extract cues from faces is fundamental for social animals, including humans. An individual's profile of functional connectivity across a face network can be shaped by common organizing principles, stable individual traits, and time-varying mental states. In the present study, we used data obtained with functional magnetic resonance imaging in two cohorts, IMAGEN (N = 534) and ALSPAC (N = 465), to investigate - both at group and individual levels - the consistency of the regional profile of functional connectivity across populations (IMAGEN, ALSPAC) and time (Visits 1 to 3 in IMAGEN; age 14 to 22 years). At the group level, we found a robust canonical profile of connectivity both across populations and time. At the individual level, connectivity profiles deviated from the canonical profile, and the magnitude of this deviation related to the presence of psychopathology. These findings suggest that the brain processes faces in a highly stereotypical manner, and that the deviations from this normative pattern may be related to the risk of mental illness.

Modeling temporal dynamics of face processing in youth and adults

A hierarchical model of temporal dynamics was examined in adults (n = 34) and youth (n = 46) across the stages of face processing during the perception of static and dynamic faces. Three ERP components (P100, N170, N250) and spectral power in the mu range were extracted, corresponding to cognitive stages of face processing: low-level vision processing, structural encoding, higher-order processing, and action understanding. Youth and adults exhibited similar yet distinct patterns of hierarchical temporal dynamics such that earlier cognitive stages predicted later stages, directly and indirectly. However, latent factors indicated unique profiles related to behavioral performance for adults and youth and age as a continuous factor. The application of path analysis to electrophysiological data can yield novel insights into the cortical dynamics of social information processing.

Psychophysical profiles in super-recognizers

Facial identity matching ability varies widely, ranging from prosopagnosic individuals (who exhibit profound impairments in face cognition/processing) to so-called super-recognizers (SRs), possessing exceptional capacities. Yet, despite the often consequential nature of face matching decisions—such as identity verification in security critical settings—ability assessments tendentially rely on simple performance metrics on a handful of heterogeneously related subprocesses, or in some cases only a single measured subprocess. Unfortunately, methodologies of this ilk leave contributions of stimulus information to observed variations in ability largely un(der)specified. Moreover, they are inadequate for addressing the qualitative or quantitative nature of differences between SRs’ abilities and those of the general population. Here, therefore, we sought to investigate individual differences—among SRs identified using a novel conservative diagnostic framework, and neurotypical controls—by systematically varying retinal availability, bandwidth, and orientation of faces’ spatial frequency content in two face matching experiments. Psychophysical evaluations of these parameters’ contributions to ability reveal that SRs more consistently exploit the same spatial frequency information, rather than suggesting qualitatively different profiles between control observers and SRs. These findings stress the importance of optimizing procedures for SR identification, for example by including measures quantifying the consistency of individuals’ behavior.

Facemasks and face recognition: Potential impact on synaptic plasticity

Visual recognition of facial expression modulates our social interactions. Compelling experimental evidence indicates that face conveys plenty of information that are fundamental for humans to interact. These are encoded at neural level in specific cortical and subcortical brain regions through activity- and experience-dependent synaptic plasticity processes. The current pandemic, due to the spread of SARS-CoV-2 infection, is causing relevant social and psychological detrimental effects. The institutional recommendations on physical distancing, namely social distancing and wearing of facemasks are effective in reducing the rate of viral spread. However, by impacting social interaction, facemasks might impair the neural responses to recognition of facial cues that are overall critical to our behaviors. In this survey, we briefly review the current knowledge on the neurobiological substrate of facial recognition and discuss how the lack of salient stimuli might impact the ability to retain and consolidate learning and memory phenomena underlying face recognition. Such an "abnormal" visual experience raises the intriguing possibility of a "reset" mechanism, a renewed ability of adult brain to undergo synaptic plasticity adaptations.

Brain structure correlates of expected social threat and reward

Prospection (mentally simulating future events) generates emotionally-charged mental images that guide social decision-making. Positive and negative social expectancies-imagining new social interactions to be rewarding versus threatening-are core components of social approach and avoidance motivation, respectively. Interindividual differences in such positive and negative future-related cognitions may be underpinned by distinct neuroanatomical substrates. Here, we asked 100 healthy adults to vividly imagine themselves in a novel self-relevant event that was ambiguous with regards to possible social acceptance or rejection. During this task we measured participants' expectancies for social reward (anticipated feelings of social connection) or threat (anticipated feelings of rejection). On a separate day they underwent structural MRI; voxel-based morphometry was used to explore the relation between social reward and threat expectancies and regional grey matter volumes (rGMV). Increased rGMV in key default-network regions involved in prospection, socio-emotional cognition, and subjective valuation, including ventromedial prefrontal cortex, correlated with both higher social reward and lower social threat expectancies. In contrast, social threat expectancies uniquely correlated with rGMV of regions involved in social attention (posterior superior temporal sulcus, pSTS) and interoception (somatosensory cortex). These findings provide novel insight into the neurobiology of future-oriented cognitive-affective processes critical to adaptive social functioning.

A Naturalistic Dynamic Monkey Head Avatar Elicits Species-Typical Reactions and Overcomes the Uncanny Valley

Research on social perception in monkeys may benefit from standardized, controllable, and ethologically valid renditions of conspecifics offered by monkey avatars. However, previous work has cautioned that monkeys, like humans, show an adverse reaction toward realistic synthetic stimuli, known as the "uncanny valley" effect. We developed an improved naturalistic rhesus monkey face avatar capable of producing facial expressions (fear grin, lip smack and threat), animated by motion capture data of real monkeys. For validation, we additionally created decreasingly naturalistic avatar variants. Eight rhesus macaques were tested on the various videos and avoided looking at less naturalistic avatar variants, but not at the most naturalistic or the most unnaturalistic avatar, indicating an uncanny valley effect for the less naturalistic avatar versions. The avoidance was deepened by motion and accompanied by physiological arousal. Only the most naturalistic avatar evoked facial expressions comparable to those toward the real monkey videos. Hence, our findings demonstrate that the uncanny valley reaction in monkeys can be overcome by a highly naturalistic avatar.

Attentional modulation differentially affects ventral and dorsal face areas in both normal participants and developmental prosopagnosics

Face-selective cortical areas that can be divided into a ventral stream and a dorsal stream. Previous findings indicate selective attention to particular aspects of faces have different effects on the two streams. To better understand the organization of the face network and whether deficits in attentional modulation contribute to developmental prosopagnosia (DP), we assessed the effect of selective attention to different face aspects across eight face-selective areas. Our results from normal participants found that ROIs in the ventral pathway (OFA, FFA) responded strongly when attention was directed to identity and expression, and ROIs in the dorsal pathway (pSTS-FA, IFG-FA) responded the most when attention was directed to facial expression. Response profiles generated by attention to different face aspects were comparable in DPs and normals. Our results demonstrate attentional modulation affects the ventral and dorsal steam face areas differently and indicate deficits in attentional modulation do not contribute to DP.

Inhibiting saccades to a social stimulus: a developmental study

Faces are an important source of social signal throughout the lifespan. In adults, they have a prioritized access to the orienting system. Here we investigate when this effect emerges during development. We tested 139 children, early adolescents, adolescents and adults in a mixed pro- and anti-saccades task with faces, cars or noise patterns as visual targets. We observed an improvement in performance until about 15 years of age, replicating studies that used only meaningless stimuli as targets. Also, as previously reported, we observed that adults made more direction errors to faces than abstract patterns and cars. The children showed this effect too with regards to noise patterns but it was not specific since performance for cars and faces did not differ. The adolescents, in contrast, made more errors for faces than for cars but as many errors for noise patterns and faces. In all groups latencies for pro-saccades were faster towards faces. We discuss these findings with regards to the development of executive control in childhood and adolescence and the influence of social stimuli at different ages.

The hidden identity of faces: a case of lifelong prosopagnosia

BACKGROUND

Not being able to recognize a person's face is a highly debilitating condition from which people with developmental prosopagnosia (DP) suffer their entire life. Here we describe the case of J, a 30 year old woman who reports being unable to recognize her parents, her husband, or herself in the mirror.

CASE PRESENTATION

We set out to assess the severity of J's prosopagnosia using tests with unfamiliar as well as familiar faces and investigated whether impaired configural processing explains her deficit. To assess the specificity of the impairment, we tested J's performance when evaluating emotions, intentions, and the attractiveness and likability of faces. Detailed testing revealed typical brain activity patterns for faces and normal object recognition skills, and no evidence of any brain injury. However, compared to a group of matched controls, J showed severe deficits in learning new faces, and in recognizing familiar faces when only inner features were available. Her recognition of uncropped faces with blurred features was within the normal range, indicating preserved configural processing when peripheral features are available. J was also unimpaired when evaluating intentions and emotions in faces. In line with healthy controls, J rated more average faces as more attractive. However, she was the only one to rate them as less likable, indicating a preference for more distinctive and easier to recognize faces.

CONCLUSIONS

Taken together, the results illustrate both the severity and the specificity of DP in a single case. While DP is a heterogeneous disorder, an inability to integrate the inner features of the face into a whole might be the best explanation for the difficulties many individuals with prosopagnosia experience.

Neurobiological Aspects of Face Recognition: The Role of Oxytocin

Face recognition is an important index in the formation of social cognition and neurodevelopment in humans. Changes in face perception and memory are connected with altered sociability, which is a symptom of numerous brain conditions including autism spectrum disorder (ASD). Various brain regions and neuropeptides are implicated in face processing. The neuropeptide oxytocin (OT) plays an important role in various social behaviors, including face and emotion recognition. Nasal OT administration is a promising new therapy that can address social cognition deficits in individuals with ASD. New instrumental neurotechnologies enable the assessment of brain region activation during specific social tasks and therapies, and can characterize the involvement of genes and peptides in impaired neurodevelopment. The present review sought to discuss some of the mechanisms of the face distinguishing process, the ability of OT to modulate social cognition, as well as new perspectives and technologies for research and rehabilitation of face recognition.

Developmental prosopagnosics have widespread selectivity reductions across category-selective visual cortex

Developmental prosopagnosia (DP) is a neurodevelopmental disorder characterized by severe deficits with facial identity recognition. It is unclear which cortical areas contribute to face processing deficits in DP, and no previous studies have investigated whether other category-selective areas function normally in DP. To address these issues, we scanned 22 DPs and 27 controls using a dynamic localizer consisting of video clips of faces, scenes, bodies, objects, and scrambled objects. We then analyzed category selectivity, a measure of the tuning of a cortical area to a particular visual category. DPs exhibited reduced face selectivity in all 12 face areas, and the reductions were significant in three posterior and two anterior areas. DPs and controls showed similar responses to faces in other category-selective areas, which suggests the DPs' behavioral deficits with faces result from problems restricted to the face network. DPs also had pronounced scene-selectivity reductions in four of six scene-selective areas and marginal body-selectivity reductions in two of four body-selective areas. Our results demonstrate that DPs have widespread deficits throughout the face network, and they are inconsistent with a leading account of DP which proposes that posterior face-selective areas are normal in DP. The selectivity reductions in other category-selective areas indicate many DPs have deficits spread across high-level visual cortex.

Interocularly merged face percepts eliminate binocular rivalry

Faces are important visual objects for humans and other social animals. A complex network of specialized brain areas is involved in the recognition and interpretation of faces. This network needs to strike a balance between being sensitive enough to distinguish between different faces with similar features, and being tolerant of low-level visual changes so that a given face is stably perceived as a particular individual. Such stability may require feedback from higher brain regions down to the level where details are represented. Here, we describe a phenomenon in which interocular competition between face features is stabilized and eliminated when observers attend high-level face characteristics. Two different face images presented to the individual eyes do not cause the perceptual fluctuations that are typically observed in binocular rivalry. Instead, they merge into a stable percept of an intermediate face that combines features from both eyes’ images. The stability of the intermediate face percept depends on the observer attending holistic face properties such as identity or gender. It disappears when observers explicitly attend facial features, suggesting a crucial role of top-down stabilizing feedback from high-level areas that represent holistic faces back to lower processing levels where detailed face features compete for conscious representation.