Selective dissociation between core and extended regions of the face processing network in congenital prosopagnosia

Disentangling developmental prosopagnosia: A scoping review of terms, tools and topics

The goal of this preregistered scoping review is to create an overview of the research on developmental prosopagnosia (DP). Through analysis of all empirical studies of DP in adults, we investigate 1) how DP is conceptualized and defined, 2) how individuals are classified with DP and 3) which aspects of DP are investigated in the literature. We reviewed 224 peer-reviewed studies of DP. Our analysis of the literature reveals that while DP is predominantly defined as a lifelong face recognition impairment in the absence of acquired brain injury and intellectual/cognitive problems, there is far from consensus on the specifics of the definition with some studies emphasizing e.g., deficits in face perception, discrimination and/or matching as core characteristics of DP. These differences in DP definitions is further reflected in the vast heterogeneity in classification procedures. Only about half of the included studies explicitly state how they classify individuals with DP, and these studies adopt 40 different assessment tools. The two most frequently studied aspects of DP are the role of holistic processing and the specificity of face processing, and alongside a substantial body of neuroimaging studies of DP, this paints a picture of a research field whose scientific interests and aims are rooted in cognitive neuropsychology and neuroscience. We argue that these roots - alongside the heterogeneity in DP definition and classification - may have limited the scope and interest of DP research unnecessarily, and we point to new avenues of research for the field.

The neuropsychological evaluation of face identity recognition

Facial identity recognition (FIR) is arguably the ultimate form of recognition for the adult human brain. Even if the term prosopagnosia is reserved for exceptionally rare brain-damaged cases with a category-specific abrupt loss of FIR at adulthood, subjective and objective impairments or difficulties of FIR are common in the neuropsychological population. Here we provide a critical overview of the evaluation of FIR both for clinicians and researchers in neuropsychology. FIR impairments occur following many causes that should be identified objectively by both general and specific, behavioral and neural examinations. We refute the commonly used dissociation between perceptual and memory deficits/tests for FIR, since even a task involving the discrimination of unfamiliar face images presented side-by-side relies on cortical memories of faces in the right-lateralized ventral occipito-temporal cortex. Another frequently encountered confusion is between specific deficits of the FIR function and a more general impairment of semantic memory (of people), the latter being most often encountered following anterior temporal lobe damage. Many computerized tests aimed at evaluating FIR have appeared over the last two decades, as reviewed here. However, despite undeniable strengths, they often suffer from ecological limitations, difficulties of instruction, as well as a lack of consideration for processing speed and qualitative information. Taking into account these issues, a recently developed behavioral test with natural images manipulating face familiarity, stimulus inversion, and correct response times as a key variable appears promising. The measurement of electroencephalographic (EEG) activity in the frequency domain from fast periodic visual stimulation also appears as a particularly promising tool to complete and enhance the neuropsychological assessment of FIR.

Neural computations in prosopagnosia

We report an investigation of the neural processes involved in the processing of faces and objects of brain-lesioned patient PS, a well-documented case of pure acquired prosopagnosia. We gathered a substantial dataset of high-density electrophysiological recordings from both PS and neurotypicals. Using representational similarity analysis, we produced time-resolved brain representations in a format that facilitates direct comparisons across time points, different individuals, and computational models. To understand how the lesions in PS's ventral stream affect the temporal evolution of her brain representations, we computed the temporal generalization of her brain representations. We uncovered that PS's early brain representations exhibit an unusual similarity to later representations, implying an excessive generalization of early visual patterns. To reveal the underlying computational deficits, we correlated PS' brain representations with those of deep neural networks (DNN). We found that the computations underlying PS' brain activity bore a closer resemblance to early layers of a visual DNN than those of controls. However, the brain representations in neurotypicals became more akin to those of the later layers of the model compared to PS. We confirmed PS's deficits in high-level brain representations by demonstrating that her brain representations exhibited less similarity with those of a DNN of semantics.

Can face recognition be selectively preserved in some cases of amnesia? A cautionary tale

Evidence suggests that some patients with isolated hippocampal damage appear to present with selective preservation of unfamiliar face recognition relative to other kinds of visual test stimuli (e.g., words). Bird and Burgess (2008) formulated a review and secondary analysis of a group of 10 cases all tested on a clinical assessment of word and face recognition memory (RMT, Warrington, 1984), which confirmed the key memory dissociation at the group level. The current work provides an updated secondary analysis of such cases with a larger published sample (N = 52). In addition to group-level analyses, we also re-evaluate evidence using a single case statistical approach (Crawford & Garthwaite, 2005), enabling us to determine how many would make criteria for a 'classical dissociation' (Crawford, Garthwaite, & Gray, 2003). Overall, group-level analyses indicated the key pattern of significant differences confined to words was limited to small control sample comparisons. When using the large control sample provided by Bird and Burgess (2008), hippocampal cases as a group were significantly poorer for both classes of items. Furthermore, our single-case approach indicated few had a performance pattern of a relative difference across face > word categories that would meet statistical significance; namely within individual differences across categories that would warrant a significant 'classical dissociation'. Moreover, these analyses also found several cases with a 'classical dissociation' in the reverse direction: namely preserved recognition of words. Such analyses serve to demonstrate the need for a more conservative statistical approach to be undertaken when reporting selective 'preservation' of a category in recognition memory. Whilst material specificity has important implications for understanding the role of the hippocampus in memory, our results highlight the need for statistical methods to be unquestionably rigorous before any claims are made. Lastly, we highlight other methodological issues critical to group analyses and make suggestions for future work.

What is developmental about developmental prosopagnosia?

Developmental prosopagnosia (DP) is characterised by difficulties recognising face identities and is associated with diverse co-occurring object recognition difficulties. The high co-occurrence rate and heterogeneity of associated difficulties in DP is an intrinsic feature of developmental conditions, where co-occurrence of difficulties is the rule, rather than the exception. However, despite its name, cognitive and neural theories of DP rarely consider the developmental context in which these difficulties occur. This leaves a large gap in our understanding of how DP emerges in light of the developmental trajectory of face recognition. Here, we argue that progress in the field requires re-considering the developmental origins of differences in face recognition abilities, rather than studying the end-state alone. In practice, considering development in DP necessitates a re-evaluation of current approaches in recruitment, design, and analyses.

Functional connectivity of the human face network exhibits right hemispheric lateralization from infancy to adulthood

Adults typically exhibit right hemispheric dominance in the processing of faces. In this cross-sectional study, we investigated age-dependent changes in face processing lateralization from infancy to adulthood (1-48 years old; N = 194). We co-registered anatomical and resting state functional Magnetic Resonance Imaging (fMRI) scans of toddlers, children, adolescents, and adults into a common space and examined functional connectivity across the face, as well as place, and object-selective regions identified in adults. As expected, functional connectivity between core face-selective regions was stronger in the right compared to the left hemisphere in adults. Most importantly, the same lateralization was evident in all other age groups (infants, children, adolescents) and appeared only in face-selective regions, and not in place or object-selective regions. These findings suggest that the physiological development of face-selective brain areas may differ from that of object and place-selective areas. Specifically, the functional connectivity of the core-face selective regions exhibits rightward lateralization from infancy, years before these areas develop mature face-selective responses.

The Neural Correlates of Developmental Prosopagnosia: Twenty-Five Years on

Faces play a crucial role in social interactions. Developmental prosopagnosia (DP) refers to the lifelong difficulty in recognizing faces despite the absence of obvious signs of brain lesions. In recent decades, the neural substrate of this condition has been extensively investigated. While early neuroimaging studies did not reveal significant functional and structural abnormalities in the brains of individuals with developmental prosopagnosia (DPs), recent evidence identifies abnormalities at multiple levels within DPs' face-processing networks. The current work aims to provide an overview of the convergent and contrasting findings by examining twenty-five years of neuroimaging literature on the anatomo-functional correlates of DP. We included 55 original papers, including 63 studies that compared the brain structure (MRI) and activity (fMRI, EEG, MEG) of healthy control participants and DPs. Despite variations in methods, procedures, outcomes, sample selection, and study design, this scoping review suggests that morphological, functional, and electrophysiological features characterize DPs' brains, primarily within the ventral visual stream. Particularly, the functional and anatomical connectivity between the Fusiform Face Area and the other face-sensitive regions seems strongly impaired. The cognitive and clinical implications as well as the limitations of these findings are discussed in light of the available knowledge and challenges in the context of DP.

Fine-scale dynamics of functional connectivity in the face-processing network during movie watching

Mapping the human face-processing network is typically done during rest or using isolated, static face images, overlooking widespread cortical interactions obtained in response to naturalistic face dynamics and context. To determine how inter-subject functional correlation (ISFC) relates to face recognition scores, we measure cortical connectivity patterns in response to a dynamic movie in typical adults (N = 517). We find a positive correlation with recognition scores in edges connecting the occipital visual and anterior temporal regions and a negative correlation in edges connecting the attentional dorsal, frontal default, and occipital visual regions. We measure the inter-subject stimulus-evoked response at a single TR resolution and demonstrate that co-fluctuations in face-selective edges are related to activity in core face-selective regions and that the ISFC patterns peak during boundaries between movie segments rather than during the presence of faces. Our approach demonstrates how face processing is linked to fine-scale dynamics in attentional, memory, and perceptual neural circuitry.

What is the prevalence of developmental prosopagnosia? An empirical assessment of different diagnostic cutoffs

The prevalence of developmental prosopagnosia (DP), lifelong face recognition deficits, is widely reported to be 2-2.5%. However, DP has been diagnosed in different ways across studies, resulting in differing prevalence rates. In the current investigation, we estimated the range of DP prevalence by administering well-validated objective and subjective face recognition measures to an unselected web-based sample of 3116 18-55 year-olds and applying DP diagnostic cutoffs from the last 14 years. We found estimated prevalence rates ranged from .64-5.42% when using a z-score approach and .13-2.95% when using a percentile approach, with the most commonly used cutoffs by researchers having a prevalence rate of .93% (z-score, .45% when using percentiles). We next used multiple cluster analyses to examine whether there was a natural grouping of poorer face recognizers but failed to find consistent grouping beyond those with generally above versus below average face recognition. Lastly, we investigated whether DP studies with more relaxed diagnostic cutoffs were associated with better performance on the Cambridge Face Perception Test. In a sample of 43 studies, there was a weak nonsignificant association between greater diagnostic strictness and better DP face perception accuracy (Kendall's tau-b correlation, τb =.18 z-score; τb = .11 percentiles). Together, these results suggest that researchers have used more conservative DP diagnostic cutoffs than the widely reported 2-2.5% prevalence. We discuss the strengths and weaknesses of using more inclusive cutoffs, such as identifying mild and major forms of DP based on DSM-5.

"Looking at nothing": An implicit ocular motor index of face recognition in developmental prosopagnosia

Subjects often look towards to previous location of a stimulus related to a task even when that stimulus is no longer visible. In this study we asked whether this effect would be preserved or reduced in subjects with developmental prosopagnosia. Participants learned faces presented in video-clips and then saw a brief montage of four faces, which was replaced by a screen with empty boxes, at which time they indicated whether the learned face had been present in the montage. Control subjects were more likely to look at the blank location where the learned face had appeared, on both hit and miss trials, though the effect was larger on hit trials. Prosopagnosic subjects showed a reduced effect, though still better on hit than on miss trials. We conclude that explicit accuracy and our implicit looking at nothing effect are parallel effects reflecting the strength of the neural activity underlying face recognition.

Multivariate functional neuroimaging analyses reveal that strength-dependent face expectations are represented in higher-level face-identity areas

Perception is an active inference in which prior expectations are combined with sensory input. It is still unclear how the strength of prior expectations is represented in the human brain. The strength, or precision, of a prior could be represented with its content, potentially in higher-level sensory areas. We used multivariate analyses of functional resonance imaging data to test whether expectation strength is represented together with the expected face in high-level face-sensitive regions. Participants were trained to associate images of scenes with subsequently presented images of different faces. Each scene predicted three faces, each with either low, intermediate, or high probability. We found that anticipation enhances the similarity of response patterns in the face-sensitive anterior temporal lobe to response patterns specifically associated with the image of the expected face. In contrast, during face presentation, activity increased for unexpected faces in a typical prediction error network, containing areas such as the caudate and the insula. Our findings show that strength-dependent face expectations are represented in higher-level face-identity areas, supporting hierarchical theories of predictive processing according to which higher-level sensory regions represent weighted priors.

Common neural substrates of diverse neurodevelopmental disorders

Neurodevelopmental disorders are categorized and studied according to their manifestations as distinct syndromes. For instance, congenital prosopagnosia and dyslexia have largely non-overlapping research literatures and clinical pathways for diagnosis and intervention. On the other hand, the high incidence of neurodevelopmental comorbidities or co-existing extreme strengths and weaknesses suggest that transdiagnostic commonalities may be greater than currently appreciated. The core-periphery model holds that brain regions within the stable core perceptual and motor regions are more densely connected to one another compared to regions in the flexible periphery comprising multimodal association regions. This model provides a framework for the interpretation of neural data in normal development and clinical disorders. Considering network-level commonalities reported in studies of neurodevelopmental disorders, variability in multimodal association cortex connectivity may reflect a shared origin of seemingly distinct neurodevelopmental disorders. This framework helps to explain both comorbidities in neurodevelopmental disorders and profiles of strengths and weaknesses attributable to competitive processing between cognitive systems within an individual.

Face shape processing via visual-to-auditory sensory substitution activates regions within the face processing networks in the absence of visual experience

Previous evidence suggests that visual experience is crucial for the emergence and tuning of the typical neural system for face recognition. To challenge this conclusion, we trained congenitally blind adults to recognize faces via visual-to-auditory sensory-substitution (SDD). Our results showed a preference for trained faces over other SSD-conveyed visual categories in the fusiform gyrus and in other known face-responsive-regions of the deprived ventral visual stream. We also observed a parametric modulation in the same cortical regions, for face orientation (upright vs. inverted) and face novelty (trained vs. untrained). Our results strengthen the conclusion that there is a predisposition for sensory-independent and computation-specific processing in specific cortical regions that can be retained in life-long sensory deprivation, independently of previous perceptual experience. They also highlight that if the right training is provided, such cortical preference maintains its tuning to what were considered visual-specific face features.

Multiple-stage impairments of unfamiliar face learning in developmental prosopagnosia: Evidence from fMRI repetition suppression and multi-voxel pattern stability

Individuals with developmental prosopagnosia (DP) are characterized by severe face recognition deficits, yet it remains unknown how they are hindered in the process of unfamiliar face learning. Here we tracked the changes of neural activation during unfamiliar face repetition in DP with fMRI to reveal their neural deficits in learning unfamiliar faces. At the perceptual level, we found that the bilateral fusiform face area (FFA) in individuals with DP showed attenuated repetition suppression for faces, suggesting an inefficient perceptual analysis for learned faces. At the mnemonic level, individuals with DP showed decreased multi-voxel pattern stability for repeated faces in bilateral medial temporal lobe (MTL), suggesting an unstable mnemonic representation for learned faces. In addition, resting-state functional connectivity between the FFA and MTL was also disrupted in individuals with DP. Finally, the MTL's unstable mnemonic representation was associated with the impaired face recognition performance in DP. In sum, our study provides evidence that individuals with DP showed multi-stage neural deficits in unfamiliar face learning and sheds new light on how unfamiliar faces are learned in normal population.

The role of the ventrolateral anterior temporal lobes in social cognition

A key challenge for neurobiological models of social cognition is to elucidate whether brain regions are specialised for that domain. In recent years, discussion surrounding the role of anterior temporal regions epitomises such debates; some argue the anterior temporal lobe (ATL) is part of a domain‐specific network for social processing, while others claim it comprises a domain‐general hub for semantic representation. In the present study, we used ATL‐optimised fMRI to map the contribution of different ATL structures to a variety of paradigms frequently used to probe a crucial social ability, namely ‘theory of mind’ (ToM). Using multiple tasks enables a clearer attribution of activation to ToM as opposed to idiosyncratic features of stimuli. Further, we directly explored whether these same structures are also activated by a non‐social task probing semantic representations. We revealed that common to all of the tasks was activation of a key ventrolateral ATL region that is often invisible to standard fMRI. This constitutes novel evidence in support of the view that the ventrolateral ATL contributes to social cognition via a domain‐general role in semantic processing and against claims of a specialised social function.

Emotional faces interfere with saccadic inhibition and attention re-orientation: An fMRI study

Modulation of reflex responses is crucial to adapt our behavior and cognition, and this is especially difficult when biological relevant stimuli are present such as emotional faces. The aim of this study was to identify the effect of peripherally presented happy and angry facial expressions in reflexive saccades and saccadic inhibition/re-orientation of attention. Behavior through eye-tracking technique and fMRI event-related BOLD signals activations were evaluated in adult males during the performance of an antisaccade task. fMRI signals obtained during task performance were compared to a baseline. Results showed that antisaccades had a lower percentage of correct responses and higher latency onsets than prosaccades. At the activation brain level, differences between both emotions and the baseline were found during stimuli presentation. Prosaccades for happy and angry faces recruited larger clusters with higher Z values mainly in occipito-parietal and temporal regions related to visual basic and integration processing, as well as regions of the oculomotor network. Meanwhile, when compared to the baseline, antisaccades recruited similar areas but a lower number of clusters with lower Z values as expected for peripheral processing of faces. At antisaccades, happy faces recruited parieto-occipital, temporal and cerebellar regions, while the angry faces added activation of orbital and ventrolateral prefrontal cortex related to emotional regulation. These results suggest that emotional facial expressions are being processed outside of the focus of attention. Particularly, angry expressions recruit a wider brain network in order to inhibit automatic behavior and re-orientate voluntary attention efficiently that may be due to its biological relevance.

Twenty years of investigation with the case of prosopagnosia PS to understand human face identity recognition. Part II: Neural basis

Patient PS sustained her dramatic brain injury in 1992, the same year as the first report of a neuroimaging study of human face recognition. The present paper complements the review on the functional nature of PS's prosopagnosia (part I), illustrating how her case study directly, i.e., through neuroimaging investigations of her brain structure and activity, but also indirectly, through neural studies performed on other clinical cases and neurotypical individuals, inspired and constrained neural models of human face recognition. In the dominant right hemisphere for face recognition in humans, PS's main lesion concerns (inputs to) the inferior occipital gyrus (IOG), in a region where face-selective activity is typically found in normal individuals ('Occipital Face Area', OFA). Her case study initially supported the criticality of this region for face identity recognition (FIR) and provided the impetus for transcranial magnetic stimulation (TMS), intracerebral electrical stimulation, and cortical surgery studies that have generally supported this view. Despite PS's right IOG lesion, typical face-selectivity is found anteriorly in the middle portion of the fusiform gyrus, a hominoid structure (termed the right 'Fusiform Face Area', FFA) that is widely considered to be the most important region for human face recognition. This finding led to the original proposal of direct anatomico-functional connections from early visual cortices to the FFA, bypassing the IOG/OFA (lulu), a hypothesis supported by further neuroimaging studies of PS, other neurological cases and neuro-typical individuals with original visual stimulation paradigms, data recordings and analyses. The proposal of a lack of sensitivity to face identity in PS's right FFA due to defective reentrant inputs from the IOG/FFA has also been supported by other cases, functional connectivity and cortical surgery studies. Overall, neural studies of, and based on, the case of prosopagnosia PS strongly question the hierarchical organization of the human neural face recognition system, supporting a more flexible and dynamic view of this key social brain function.

New evidence of impaired expression recognition in developmental prosopagnosia

Developmental prosopagnosia (DP) is a neurodevelopmental condition characterized by lifelong face recognition difficulties. To date, it remains unclear whether or not individuals with DP experience impaired recognition of facial expressions. It has been proposed that DPs may have sufficient perceptual ability to correctly interpret facial expressions when tasks are relatively easy (e.g., the stimuli are unambiguous and viewing conditions are optimal), but exhibit subtle impairments when tested under more challenging conditions. In the present study, we sought to take advantage of the COVID-19 pandemic to test this view. It is well-established that the surgical-type masks worn during the pandemic hinder the recognition and interpretation of facial emotion in typical participants. Relative to typical participants, we hypothesized that DPs may be disproportionately impaired when asked to interpret the facial emotion of people wearing face masks. We compared the ability of 34 DPs and 60 age-matched typical controls to recognize facial emotions i) when the whole face is visible, and ii) when the lower portion of the face is covered with a surgical mask. When expression stimuli were viewed without a mask, the DPs and typical controls exhibited similar levels of performance. However, when expression stimuli were shown with a mask, the DPs showed signs of subtle expression recognition deficits. The DPs were particularly prone to mislabeling masked expressions of happiness as emotion neutral. These results add to a growing body of evidence that under some conditions, DPs do exhibit subtle deficits of expression recognition.

Intracerebral electrical stimulation of the right anterior fusiform gyrus impairs human face identity recognition

Brain regions located between the right fusiform face area (FFA) in the middle fusiform gyrus and the temporal pole may play a critical role in human face identity recognition but their investigation is limited by a large signal drop-out in functional magnetic resonance imaging (fMRI). Here we report an original case who is suddenly unable to recognize the identity of faces when electrically stimulated on a focal location inside this intermediate region of the right anterior fusiform gyrus. The reliable transient identity recognition deficit occurs without any change of percept, even during nonverbal face tasks (i.e., pointing out the famous face picture among three options; matching pictures of unfamiliar or familiar faces for their identities), and without difficulty at recognizing visual objects or famous written names. The effective contact is associated with the largest frequency-tagged electrophysiological signals of face-selectivity and of familiar and unfamiliar face identity recognition. This extensive multimodal investigation points to the right anterior fusiform gyrus as a critical hub of the human cortical face network, between posterior ventral occipito-temporal face-selective regions directly connected to low-level visual cortex, the medial temporal lobe involved in generic memory encoding, and ventral anterior temporal lobe regions holding semantic associations to people's identity.

Face processing in the temporal lobe

Face perception is a socially important but complex process with many stages and many facets. There is substantial evidence from many sources that it involves a large extent of the temporal lobe, from the ventral occipitotemporal cortex and superior temporal sulci to anterior temporal regions. While early human neuroimaging work suggested a core face network consisting of the occipital face area, fusiform face area, and posterior superior temporal sulcus, studies in both humans and monkeys show a system of face patches stretching from posterior to anterior in both the superior temporal sulcus and inferotemporal cortex. Sophisticated techniques such as fMRI adaptation have shown that these face-activated regions show responses that have many of the attributes of human face processing. Lesions of some of these regions in humans lead to variants of prosopagnosia, the inability to recognize the identity of a face. Lesion, imaging, and electrophysiologic data all suggest that there is a segregation between identity and expression processing, though some suggest this may be better characterized as a distinction between static and dynamic facial information.

Modular community structure of the face network supports face recognition

Face recognition is dependent on computations conducted in specialized brain regions and the communication among them, giving rise to the face-processing network. We examined whether modularity of this network may underlie the vast individual differences found in human face recognition abilities. Modular networks, characterized by strong within and weaker between-network connectivity, were previously suggested to promote efficacy and reduce interference among cognitive systems and also correlated with better cognitive abilities. The study was conducted in a large sample (n = 409) with diffusion-weighted imaging, resting-state fMRI, and a behavioral face recognition measure. We defined a network of face-selective regions and derived a novel measure of communication along with structural and functional connectivity among them. The modularity of this network was positively correlated with recognition abilities even when controlled for age. Furthermore, the results were specific to the face network when compared with the place network or to spatially permuted null networks. The relation to behavior was also preserved at the individual-edge level such that a larger correlation to behavior was found within hemispheres and particularly within the right hemisphere. This study provides the first evidence of modularity-behavior relationships in the domain of face processing and more generally in visual perception.

Distinct neural-behavioral correspondence within face processing and attention networks for the composite face effect

The composite face effect (CFE) is recognized as a hallmark for holistic face processing, but our knowledge remains sparse about its cognitive and neural loci. Using functional magnetic resonance imaging with independent localizer and complete composite face task, we here investigated its neural-behavioral correspondence within face processing and attention networks. Complementing classical comparisons, we adopted a dimensional reduction approach to explore the core cognitive constructs of the behavioral CFE measurement. Our univariate analyses found an alignment effect in regions associated with both the extended face processing network and attention networks. Further representational similarity analyses based on the Euclidian distances among all experimental conditions were used to identify cortical regions with reliable neural-behavioral correspondences. Multidimensional scaling and hierarchical clustering analyses for neural-behavioral correspondence data revealed two principal components underlying the behavioral CFE effect, which fit best to the neural responses in the bilateral insula and medial frontal gyrus. These findings highlight the distinct neurocognitive contributions of both face processing and attentional networks to the behavioral CFE outcome, which bridge the gaps between face recognition and attentional control models.

Face Processing in Developmental Prosopagnosia: Altered Neural Representations in the Fusiform Face Area

Rationale: Face expertise is a pivotal social skill. Developmental prosopagnosia (DP), i.e., the inability to recognize faces without a history of brain damage, affects about 2% of the general population, and is a renowned model system of the face-processing network. Within this network, the right Fusiform Face Area (FFA), is particularly involved in face identity processing and may therefore be a key element in DP. Neural representations within the FFA have been examined with Representational Similarity Analysis (RSA), a data-analytical framework in which multi-unit measures of brain activity are assessed with correlation analysis. Objectives: Our study intended to scrutinize modifications of FFA-activation during face encoding and maintenance based on RSA. Methods: Thirteen participants with DP (23-70 years) and 12 healthy control subjects (19-62 years) participated in a functional MRI study, including morphological MRI, a functional FFA-localizer and a modified Sternberg paradigm probing face memory encoding and maintenance. Memory maintenance of one, two, or four faces represented low, medium, and high memory load. We examined conventional activation differences in response to working memory load and applied RSA to compute individual correlation-matrices on the voxel level. Group correlation-matrices were compared via Donsker's random walk analysis. Results: On the functional level, increased memory load entailed both a higher absolute FFA-activation level and a higher degree of correlation between activated voxels. Both aspects were deficient in DP. Interestingly, control participants showed a homogeneous degree of correlation for successful trials during the experiment. In DP-participants, correlation levels between FFA-voxels were significantly lower and were less sustained during the experiment. In behavioral terms, DP-participants performed poorer and had longer reaction times in relation to DP-severity. Furthermore, correlation levels were negatively correlated with reaction times for the most demanding high load condition. Conclusion: We suggest that participants with DP fail to generate robust and maintained neural representations in the FFA during face encoding and maintenance, in line with poorer task performance and prolonged reaction times. In DP, alterations of neural coding in the FFA might therefore explain curtailing in working memory and contribute to impaired long-term memory and mental imagery.

Separate and Shared Neural Basis of Face Memory and Face Perception in Developmental Prosopagnosia

Developmental prosopagnosia (DP), also known as face blindness, is a cognitive disorder with a severe deficit in recognizing faces. However, the heterogeneous nature of DP leads to a longstanding debate on which stages the deficit occurs, face perception (e.g., matching two consecutively presented faces) or face memory (e.g., matching a face to memorized faces). Here, we used the individual difference approach with functional magnetic resonance imaging to explore the neural substrates of DPs' face perception and face memory that may illuminate DPs' heterogeneity. Specifically, we measured the behavioral performance of face perception and face memory in a large sample of individuals suffering DP (N = 64) and then associated the behavioral performance with their face-selective neural responses in the core face network (CFN) and the extended face network (EFN), respectively. Behaviorally, we found that DP individuals were impaired in both face perception and face memory; however, there was only a weak correlation between the performances of two tasks. Consistent with this observation, the neural correlate of DPs' performance in face memory task was localized in the bilateral fusiform face area, whereas DPs' performance in face perception task was correlated with the face selectivity in the right posterior superior temporal sulcus, suggesting that the neural substrates in the CFN for face memory and face perception were separate in DP. In contrast, shared neural substrates of deficits in face perception and face memory tasks were identified in the EFN, including the right precuneus and the right orbitofrontal cortex. In summary, our study provides one of the first empirical evidence that the separate and shared neural substrates of face perception and face memory were identified in the CFN and EFN, respectively, which may help illuminating DP's heterogeneous nature.

Spatial Integration in Normal Face Processing and Its Breakdown in Congenital Prosopagnosia

Congenital prosopagnosia (CP), a life-long impairment in face processing that occurs in the absence of any apparent brain damage, provides a unique model in which to explore the psychological and neural bases of normal face processing. The goal of this review is to offer a theoretical and conceptual framework that may account for the underlying cognitive and neural deficits in CP. This framework may also provide a novel perspective in which to reconcile some conflicting results that permits the expansion of the research in this field in new directions. The crux of this framework lies in linking the known behavioral and neural underpinnings of face processing and their impairments in CP to a model incorporating grid cell-like activity in the entorhinal cortex. Moreover, it stresses the involvement of active, spatial scanning of the environment with eye movements and implicates their critical role in face encoding and recognition. To begin with, we describe the main behavioral and neural characteristics of CP, and then lay down the building blocks of our proposed model, referring to the existing literature supporting this new framework. We then propose testable predictions and conclude with open questions for future research stemming from this model. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Impaired face recognition is associated with abnormal gray matter volume in the posterior cingulate cortex in congenital amusia

Congenital amusia is as a neurodevelopment disorder primarily defined by impairment in pitch discrimination and pitch memory. Interestingly, it has been reported that individuals with congenital amusia also exhibit deficits in face recognition (prosopagnosia). One explanation of such comorbidity is that the neural substrates of pitch recognition and face recognition may be similar. To test this hypothesis, face recognition ability was assessed using the Cambridge Face Memory Test (CFMT) and gray matter volume was determined through voxel-based morphometry (VBM) among participants with and without congenital amusia. As expected, participants with amusia performed worse on the CFMT test and showed reduced gray matter volume (GMV) in the middle temporal gyrus (MTG), the superior temporal gyrus (STG), and the posterior cingulate cortex (PCC) in the right hemisphere, when compared with matched controls. Furthermore, correlation analyses demonstrated that the CFMT score was positively related to MTG, STG, and PCC GMV in all participants, while separate analyses of each group found a positive correlation of CFMT score and PCC GMV in amusics. These findings suggest that face recognition is associated with a widely distributed microstructural network in the human brain and the PCC plays an important role in both pitch recognition and face recognition in amusics. In addition, neurodevelopmental disorders such as congenital amusia and prosopagnosia may share a common neural substrate.

Finding Distributed Needles in Neural Haystacks

The human cortex encodes information in complex networks that can be anatomically dispersed and variable in their microstructure across individuals. Using simulations with neural network models, we show that contemporary statistical methods for functional brain imaging-including univariate contrast, searchlight multivariate pattern classification, and whole-brain decoding with L1 or L2 regularization-each have critical and complementary blind spots under these conditions. We then introduce the sparse-overlapping-sets (SOS) LASSO-a whole-brain multivariate approach that exploits structured sparsity to find network-distributed information-and show in simulation that it captures the advantages of other approaches while avoiding their limitations. When applied to fMRI data to find neural responses that discriminate visually presented faces from other visual stimuli, each method yields a different result, but existing approaches all support the canonical view that face perception engages localized areas in posterior occipital and temporal regions. In contrast, SOS LASSO uncovers a network spanning all four lobes of the brain. The result cannot reflect spurious selection of out-of-system areas because decoding accuracy remains exceedingly high even when canonical face and place systems are removed from the dataset. When used to discriminate visual scenes from other stimuli, the same approach reveals a localized signal consistent with other methods-illustrating that SOS LASSO can detect both widely distributed and localized representational structure. Thus, structured sparsity can provide an unbiased method for testing claims of functional localization. For faces and possibly other domains, such decoding may reveal representations more widely distributed than previously suspected.SIGNIFICANCE STATEMENT Brain systems represent information as patterns of activation over neural populations connected in networks that can be widely distributed anatomically, variable across individuals, and intermingled with other networks. We show that four widespread statistical approaches to functional brain imaging have critical blind spots in this scenario and use simulations with neural network models to illustrate why. We then introduce a new approach designed specifically to find radically distributed representations in neural networks. In simulation and in fMRI data collected in the well studied domain of face perception, the new approach discovers extensive signal missed by the other methods-suggesting that prior functional imaging work may have significantly underestimated the degree to which neurocognitive representations are distributed and variable across individuals.

Nature and nurture shape structural connectivity in the face processing brain network

Face processing is a key ability facilitating social cognition. Only a few studies explored how nature and nurture shape face processing ontogeny at the behavioral and neural level. Also, very little is known about the contributions of nature and nurture to the establishment of white matter fibers supporting this specific human ability. The main purpose of this study was to assess genetic and environmental influences on white matter bundles connecting atlas-defined and functionally-defined face-responsive areas in the brain. Diffusion weighted images from 408 twins (monozygotic = 264, dizygotic = 144) were obtained from the WU-Minn Human Connectome Project. Fractional anisotropy - a widely used measure of fiber quality - of seven white matter tracts in the face network and ten global white matter tracts was analyzed by means of Structural Equation Modeling for twin data. Results revealed small and moderate genetic effects on face network fiber quality in addition to their shared variance with global brain white matter integrity. Furthermore, a theoretically expected common latent factor accounted for limited genetic and larger environmental variance in multiple face network fibers. The findings suggest that both genetic and environmental factors explain individual differences in fiber quality within the face network, as compared with much larger genetic effects on global brain white matter quality. In addition to heritability, individual-specific environmental influences on the face processing brain network are large, a finding that suggests to connect nature and nurture views on this remarkably specific human ability.

Prosopagnosia and disorders of face processing

Face recognition is a form of expert visual processing. Acquired prosopagnosia is the loss of familiarity for facial identity and has several functional variants, namely apperceptive, amnestic, and associative forms. Acquired forms are usually caused by either occipitotemporal or anterior temporal lesions, right or bilateral in most cases. In addition, there is a developmental form, whose functional and structural origins are still being elucidated. Despite their difficulties with recognizing faces, some of these subjects still show signs of covert recognition, which may have a number of explanations. Other aspects of face perception can be spared in prosopagnosic subjects. Patients with other types of face processing difficulties have been described, including impaired expression processing, impaired lip-reading, false familiarity for faces, and a people-specific amnesia. Recent rehabilitative studies have shown some modest ability to improve face perception in prosopagnosic subjects through perceptual training protocols.

Neural processing of facial identity and expression in adults with and without autism: A multi-method approach

The ability to recognize faces and facial expressions is a common human talent. It has, however, been suggested to be impaired in individuals with autism spectrum disorder (ASD). The goal of this study was to compare the processing of facial identity and emotion between individuals with ASD and neurotypicals (NTs). Behavioural and functional magnetic resonance imaging (fMRI) data from 46 young adults (aged 17-23 years, N_ASD = 22, N_NT = 24) was analysed. During fMRI data acquisition, participants discriminated between short clips of a face transitioning from a neutral to an emotional expression. Stimuli included four identities and six emotions. We performed behavioural, univariate, multi-voxel, adaptation and functional connectivity analyses to investigate potential group differences. The ASD-group did not differ from the NT-group on behavioural identity and expression processing tasks. At the neural level, we found no differences in average neural activation, neural activation patterns and neural adaptation to faces in face-related brain regions. In terms of functional connectivity, we found that amygdala seems to be more strongly connected to inferior occipital cortex and V1 in individuals with ASD. Overall, the findings indicate that neural representations of facial identity and expression have a similar quality in individuals with and without ASD, but some regions containing these representations are connected differently in the extended face processing network.

Normal recognition of famous voices in developmental prosopagnosia

Developmental prosopagnosia (DP) is a condition characterised by lifelong face recognition difficulties. Recent neuroimaging findings suggest that DP may be associated with aberrant structure and function in multimodal regions of cortex implicated in the processing of both facial and vocal identity. These findings suggest that both facial and vocal recognition may be impaired in DP. To test this possibility, we compared the performance of 22 DPs and a group of typical controls, on closely matched tasks that assessed famous face and famous voice recognition ability. As expected, the DPs showed severe impairment on the face recognition task, relative to typical controls. In contrast, however, the DPs and controls identified a similar number of voices. Despite evidence of interactions between facial and vocal processing, these findings suggest some degree of dissociation between the two processing pathways, whereby one can be impaired while the other develops typically. A possible explanation for this dissociation in DP could be that the deficit originates in the early perceptual encoding of face structure, rather than at later, post-perceptual stages of face identity processing, which may be more likely to involve interactions with other modalities.

The role of the MTG in negative emotional processing in young adults with autistic-like traits: A fMRI task study

BACKGROUND

Few previous studies explored negative emotion processing in autistic-like traits people using task-based fMRI. In this study, we applied task fMRI to determine the relationship between negative emotion processing and social skill within autistic-like traits people. aimed to find which brain areas specificity play a key role in emotional processing.

METHODS

106 of Chinese individuals measured with AQ. Then applied emotion regulation task to explore the difference in brain activation and functional connectivity in individuals with autistic traits.

RESULTS

The results showed increased activation in the right middle temporal gyrus (MTG). The mediation analysis showed the right MTG mediates the relationship between autistic-like traits and negative emotion. Generalized psychophysiological interaction (gPPI) analysis also suggested that the right MTG shows significant functional connectivity with the left parahippocampal gyrus (PHG) and left precuneus cortex.

LIMITATIONS

Our sample are university students, there may have a bias in the sample compared to sub-average and have no differences between the gender, we will broaden the sample size and take the gender into account. We use two conditions as our focused theme, we want to use a more specific task to explore negative emotion in autistic-like traits people.

CONCLUSIONS

The results showed that the right MTG was an important brain region in individuals with autistic-like traits, and our study provides a wider discussion about autism brain activation and functional connectivity patterns and the use the MTG as a hallmark in individuals with autistic-like traits.

Neural Substrates of Working Memory Updating

Working memory (WM) needs to protect current content from interference and simultaneously be amenable to rapid updating with newly relevant information. An influential model suggests these opposing requirements are met via a BG-thalamus gating mechanism that allows for selective updating of PFC WM representations. A large neuroimaging literature supports the general involvement of PFC, BG, and thalamus, as well as posterior parietal cortex, in WM. However, the specific functional contributions of these regions to key subprocesses of WM updating, namely, gate opening, content substitution, and gate closing, are still unknown, as common WM tasks conflate these processes. We therefore combined fMRI with the reference-back task, specifically designed to tease apart these subprocesses. Participants compared externally presented face stimuli to a reference face held in WM, while alternating between updating and maintaining this reference, resulting in opening versus closing the gate to WM. Gate opening and substitution processes were associated with strong BG, thalamic, and frontoparietal activation, but intriguingly, the same activity profile was observed for sensory cortex supporting task stimulus processing (i.e., the fusiform face area). In contrast, gate closing was not reliably associated with any of these regions. These findings provide new support for the involvement of the BG in gate opening, as suggested by the gating model, but qualify the model's assumptions by demonstrating that gate closing does not seem to depend on the BG and that gate opening also involves task-relevant sensory cortex.

Characterizing developmental prosopagnosia beyond face perception: Impaired recollection but intact familiarity recognition

Converging lines of research suggests that many developmental prosopagnosics (DPs) have impairments beyond face perception, but currently no framework exists to characterize these impaired mechanisms. One potential extra-perceptual deficit is that DPs encode/retrieve faces in a distinct manner from controls that does not sufficiently support individuation. To test this possibility, 30 DPs and 30 matched controls performed an old/new face recognition task while providing confidence ratings, to which a model-based ROC analysis was applied. DPs had significantly reduced recollection compared to controls, driven by fewer 'high-confidence target' responses, but intact familiarity. Recollection and face perception ability uniquely predicted objective and subjective prosopagnosia symptoms, together explaining 51% and 56% of the variance, respectively. These results suggest that a specific deficit in face recollection in DP may represent a core aspect of the difficulty in confidently identifying an individual by their face.

Evidence for normal novel object recognition abilities in developmental prosopagnosia

The issue of the face specificity of recognition deficits in developmental prosopagnosia (DP) is fundamental to the organization of high-level visual memory and has been increasingly debated in recent years. Previous DP investigations have found some evidence of object recognition impairments, but have almost exclusively used familiar objects (e.g. cars), where performance may depend on acquired object-specific experience and related visual expertise. An object recognition test not influenced by experience could provide a better, less contaminated measure of DPs' object recognition abilities. To investigate this, in the current study we tested 30 DPs and 30 matched controls on a novel object memory test (NOMT Ziggerins) and the Cambridge Face Memory Test (CFMT). DPs with severe impairment on the CFMT showed no differences in accuracy or reaction times compared with controls on the NOMT. We found similar results when comparing DPs with a larger sample of 274 web-based controls. Additional individual analyses demonstrated that the rate of object recognition impairment in DPs did not differ from the rate of impairment in either control group. Together, these results demonstrate unimpaired object recognition in DPs for a class of novel objects that serves as a powerful index for broader novel object recognition capacity.

A Flexible Neural Representation of Faces in the Human Brain

An important question in human face perception research is to understand whether the neural representation of faces is dynamically modulated by context. In particular, although there is a plethora of neuroimaging literature that has probed the neural representation of faces, few studies have investigated what low-level structural and textural facial features parametrically drive neural responses to faces and whether the representation of these features is modulated by the task. To answer these questions, we employed 2 task instructions when participants viewed the same faces. We first identified brain regions that parametrically encoded high-level social traits such as perceived facial trustworthiness and dominance, and we showed that these brain regions were modulated by task instructions. We then employed a data-driven computational face model with parametrically generated faces and identified brain regions that encoded low-level variation in the faces (shape and skin texture) that drove neural responses. We further analyzed the evolution of the neural feature vectors along the visual processing stream and visualized and explained these feature vectors. Together, our results showed a flexible neural representation of faces for both low-level features and high-level social traits in the human brain.

Rapid forgetting of faces in congenital prosopagnosia

Congenital prosopagnosia (CP) is a life-long impairment in face recognition that occurs in the absence of any known brain damage. It is still unclear whether this disorder is related to a visual deficit, or to an impairment in encoding, maintaining or retrieving a face from memory. We tested CPs and matched neurotypical controls using a delayed estimation task in which a target face was shown either upright or inverted. Participants were asked to select the target face out of a cyclic space of morphed faces that could either resemble the target face, or not. The inclusion of upright and inverted faces enabled to examine the extent of the face inversion effect, a well-known face specific effect often associated with holistic processing. To enable disentangling visual from mnemonic processing, reports were required either following 1 and 6 sec retention interval, or simultaneously while the target face was still visible. Controls showed slower forgetting of upright compared to inverted faces. In contrast, CPs exhibited rapid forgetting of upright faces that was comparable to their performance and to performance of controls on inverted faces. Such forgetting was evident in random errors in which the selected faces did not resemble the face in memory, implying a time related decrease in the probability to access the correct face in memory. Importantly, CPs exhibited no inversion effect across all retention intervals, including the simultaneous one, suggesting that their abnormal rapid forgetting could be explained by an impairment in holistic visual processing of upright faces.

A unified neurocognitive model of semantics language social behaviour and face recognition in semantic dementia

The anterior temporal lobes (ATL) have become a key brain region of interest in cognitive neuroscience founded upon neuropsychological investigations of semantic dementia (SD). The purposes of this investigation are to generate a single unified model that captures the known cognitive-behavioural variations in SD and map these to the patients' distribution of frontotemporal atrophy. Here we show that the degree of generalised semantic impairment is related to the patients' total, bilateral ATL atrophy. Verbal production ability is related to total ATL atrophy as well as to the balance of left > right ATL atrophy. Apathy is found to relate positively to the degree of orbitofrontal atrophy. Disinhibition is related to right ATL and orbitofrontal atrophy, and face recognition to right ATL volumes. Rather than positing mutually-exclusive sub-categories, the data-driven model repositions semantics, language, social behaviour and face recognition into a continuous frontotemporal neurocognitive space.

Looking beyond the face area: lesion network mapping of prosopagnosia

Damage to the right fusiform face area can disrupt the ability to recognize faces, a classic example of how damage to a specialized brain region can disrupt a specialized brain function. However, similar symptoms can arise from damage to other brain regions, and face recognition is now thought to depend on a distributed brain network. The extent of this network and which regions are critical for facial recognition remains unclear. Here, we derive this network empirically based on lesion locations causing clinically significant impairments in facial recognition. Cases of acquired prosopagnosia were identified through a systematic literature search and lesion locations were mapped to a common brain atlas. The network of brain regions connected to each lesion location was identified using resting state functional connectivity from healthy participants (n = 1000), a technique termed lesion network mapping. Lesion networks were overlapped to identify connections common to lesions causing prosopagnosia. Reproducibility was assessed using split-half replication. Specificity was assessed through comparison with non-specific control lesions (n = 135) and with control lesions associated with symptoms other than prosopagnosia (n = 155). Finally, we tested whether our facial recognition network derived from clinically evident cases of prosopagnosia could predict subclinical facial agnosia in an independent lesion cohort (n = 31). Our systematic literature search identified 44 lesions causing prosopagnosia, only 29 of which intersected the right fusiform face area. However, all 44 lesion locations fell within a single brain network defined by connectivity to the right fusiform face area. Less consistent connectivity was found to other face-selective regions. Surprisingly, all 44 lesion locations were also functionally connected, through negative correlation, with regions in the left frontal cortex. This connectivity pattern was highly reproducible and specific to lesions causing prosopagnosia. Positive connectivity to the right fusiform face area and negative connectivity to left frontal regions were independent predictors of prosopagnosia and predicted subclinical facial agnosia in an independent lesion cohort. We conclude that lesions causing prosopagnosia localize to a single functionally connected brain network defined by connectivity to the right fusiform face area and to left frontal regions. Implications of these findings for models of facial recognition deficits are discussed.

Multi-Item Discriminability Pattern to Faces in Developmental Prosopagnosia Reveals Distinct Mechanisms of Face Processing

Previous studies have shown that individuals with developmental prosopagnosia (DP) show specific deficits in face processing. However, the mechanism underlying the deficits remains largely unknown. One hypothesis suggests that DP shares the same mechanism as normal population, though their faces processing is disproportionally impaired. An alternative hypothesis emphasizes a qualitatively different mechanism of DP processing faces. To test these hypotheses, we instructed DP and normal individuals to perceive faces and objects. Instead of calculating accuracy averaging across stimulus items, we used the discrimination accuracy for each item to construct a multi-item discriminability pattern. We found DP's discriminability pattern was less similar to that of normal individuals when perceiving faces than perceiving objects, suggesting that DP has qualitatively different mechanism in representing faces. A functional magnetic resonance imaging study was conducted to reveal the neural basis and found that multi-voxel activation patterns for faces in the right fusiform face area and occipital face area of DP were deviated away from the mean activation pattern of normal individuals. Further, the face representation was more heterogeneous in DP, suggesting that deficits of DP may come from multiple sources. In short, our study provides the first direct evidence that DP processes faces qualitatively different from normal population.

Hemispheric Organization for Visual Object Recognition: A Theoretical Account and Empirical Evidence

Despite the similarity in structure, the hemispheres of the human brain have somewhat different functions. A traditional view of hemispheric organization asserts that there are independent and largely lateralized domain-specific regions in ventral occipitotemporal (VOTC), specialized for the recognition of distinct classes of objects. Here, we offer an alternative account of the organization of the hemispheres, with a specific focus on face and word recognition. This alternative account relies on three computational principles: distributed representations and knowledge, cooperation and competition between representations, and topography and proximity. The crux is that visual recognition results from a network of regions with graded functional specialization that is distributed across both hemispheres. Specifically, the claim is that face recognition, which is acquired relatively early in life, is processed by VOTC regions in both hemispheres. Once literacy is acquired, word recognition, which is co-lateralized with language areas, primarily engages the left VOTC and, consequently, face recognition is primarily, albeit not exclusively, mediated by the right VOTC. We review psychological and neural evidence from a range of studies conducted with normal and brain-damaged adults and children and consider findings which challenge this account. Last, we offer suggestions for future investigations whose findings may further refine this account.

Left hemisphere abnormalities in developmental prosopagnosia when looking at faces but not words

Developmental prosopagnosia is a disorder characterized by profound and lifelong difficulties with face recognition in the absence of sensory or intellectual deficits or known brain injury. While there has been a surge in research on developmental prosopagnosia over the last decade and a half, the cognitive mechanisms behind the disorder and its neural underpinnings remain elusive. Most recently it has been proposed that developmental prosopagnosia may be a manifestation of widespread disturbance in neural migration which affects both face responsive brain regions as well as other category-sensitive visual areas. We present a combined behavioural and functional MRI study of face, object and word processing in a group of developmental prosopagnosics (N = 15). We show that developmental prosopagnosia is associated with reduced activation of core ventral face areas during perception of faces. The reductions were bilateral but tended to be more pronounced in the left hemisphere. As the first study to address category selectivity for word processing in developmental prosopagnosia, we do not, however, find evidence for reduced activation of the visual word form area during perception of orthographic material. We also find no evidence for reduced activation of the lateral occipital complex during perception of objects. These imaging findings correspond well with the behavioural performance of the developmental prosopagnosics, who show severe impairment for faces but normal reading and recognition of line drawings. Our findings suggest that a general deficit in neural migration across ventral occipito-temporal cortex is not a viable explanation for developmental prosopagnosia. The finding of left hemisphere involvement in our group of developmental prosopagnosics was at first surprising. However, a closer look at existing studies shows similar, but hitherto undiscussed, findings. These left hemisphere abnormalities seen in developmental prosopagnosia contrasts with lesion and imaging studies suggesting primarily right hemisphere involvement in acquired prosopagnosia, and this may reflect that the left hemisphere is important for the development of a normal face recognition network.

Minimal Recognizable Configurations Elicit Category-selective Responses in Higher Order Visual Cortex

Visual object recognition is performed effortlessly by humans notwithstanding the fact that it requires a series of complex computations, which are, as yet, not well understood. Here, we tested a novel account of the representations used for visual recognition and their neural correlates using fMRI. The rationale is based on previous research showing that a set of representations, termed "minimal recognizable configurations" (MIRCs), which are computationally derived and have unique psychophysical characteristics, serve as the building blocks of object recognition. We contrasted the BOLD responses elicited by MIRC images, derived from different categories (faces, objects, and places), sub-MIRCs, which are visually similar to MIRCs, but, instead, result in poor recognition and scrambled, unrecognizable images. Stimuli were presented in blocks, and participants indicated yes/no recognition for each image. We confirmed that MIRCs elicited higher recognition performance compared to sub-MIRCs for all three categories. Whereas fMRI activation in early visual cortex for both MIRCs and sub-MIRCs of each category did not differ from that elicited by scrambled images, high-level visual regions exhibited overall greater activation for MIRCs compared to sub-MIRCs or scrambled images. Moreover, MIRCs and sub-MIRCs from each category elicited enhanced activation in corresponding category-selective regions including fusiform face area and occipital face area (faces), lateral occipital cortex (objects), and parahippocampal place area and transverse occipital sulcus (places). These findings reveal the psychological and neural relevance of MIRCs and enable us to make progress in developing a more complete account of object recognition.

Multifaceted Integration: Memory for Faces Is Subserved by Widespread Connections between Visual, Memory, Auditory, and Social Networks

Our ability to recognize others by their facial features is at the core of human social interaction, yet this ability varies widely within the general population, ranging from developmental prosopagnosia to "super-recognizers". Previous work has focused mainly on the contribution of neural activity within the well described face network to this variance. However, given the nature of face memory in everyday life, and the social context in which it takes place, we were interested in exploring how the collaboration between different networks outside the face network in humans (measured through resting state connectivity) affects face memory performance. Fifty participants (men and women) were scanned with fMRI. Our data revealed that although the nodes of the face-processing network were tightly coupled at rest, the strength of these connections did not predict face memory performance. Instead, face recognition memory was dependent on multiple connections between these face patches and regions of the medial temporal lobe memory system (including the hippocampus), and the social processing system. Moreover, this network was selective for memory for faces, and did not predict memory for other visual objects (cars). These findings suggest that in the general population, variability in face memory is dependent on how well the face processing system interacts with other processing networks, with interaction among the face patches themselves accounting for little of the variance in memory ability.SIGNIFICANCE STATEMENT Our ability to recognize and remember faces is one of the pillars of human social interaction. Face recognition however is a very complex skill, requiring specialized neural resources in visual cortex, as well as memory, identity, and social processing, all of which are inherent in our real-world experience of faces. Yet in the general population, people vary greatly in their face memory abilities. Here we show that in the neural domain this variability is underpinned by the integration of visual, memory and social circuits, with the strength of the connections between these circuits directly linked to face recognition ability.

Concrete versus abstract forms of social concept: an fMRI comparison of knowledge about people versus social terms

The anterior temporal lobes (ATLs) play a key role in conceptual knowledge representation. The hub-and-spoke theory suggests that the contribution of the ATLs to semantic representation is (a) transmodal, i.e. integrating information from multiple sensorimotor and verbal modalities, and (b) pan-categorical, representing concepts from all categories. Another literature, however, suggests that this region's responses are modality- and category-selective; prominent examples include category selectivity for socially relevant concepts and face recognition. The predictions of each approach have never been directly compared. We used data from three studies to compare category-selective responses within the ATLs. Study 1 compared ATL responses to famous people versus another conceptual category (landmarks) from visual versus auditory inputs. Study 2 compared ATL responses to famous people from pictorial and written word inputs. Study 3 compared ATL responses to a different kind of socially relevant stimuli, namely abstract non-person-related words, in order to ascertain whether ATL subregions are engaged for social concepts more generally or only for person-related knowledge. Across all three studies a dominant bilateral ventral ATL cluster responded to all categories in all modalities. Anterior to this ‘pan-category’ transmodal region, a second cluster responded more weakly overall yet selectively for people, but did so equally for spoken names and faces (Study 1). A third region in the anterior superior temporal gyrus responded selectively to abstract socially relevant words (Study 3), but did not respond to concrete socially relevant words (i.e. written names; Study 2). These findings can be accommodated by the graded hub-and-spoke model of concept representation. On this view, the ventral ATL is the centre point of a bilateral ATL hub, which contributes to conceptual representation through transmodal distillation of information arising from multiple modality-specific association cortices. Partial specialization occurs across the graded ATL hub as a consequence of gradedly differential connectivity across the region.

This article is part of the theme issue ‘Varieties of abstract concepts: development, use and representation in the brain’.

Object recognition in acquired and developmental prosopagnosia

Whether face and object recognition are dissociated in prosopagnosia continues to be debated: a recent review highlighted deficiencies in prior studies regarding the evidence for such a dissociation. Our goal was to study cohorts with acquired and developmental prosopagnosia with a complementary battery of tests of object recognition that address prior limitations, as well as evaluating for residual effects of object expertise. We studied 15 subjects with acquired and 12 subjects with developmental prosopagnosia on three tests: the Old/New Tests, the Cambridge Bicycle Memory Test, and the Expertise-adjusted Test of Car Recognition. Most subjects with developmental prosopagnosia were normal on the Old/New Tests: for acquired prosopagnosia, subjects with occipitotemporal lesions often showed impairments while those with anterior temporal lesions did not. Ten subjects showed a putative classical dissociation between the Cambridge Face and Bicycle Memory Tests, seven of whom had normal reaction times. Both developmental and acquired groups showed reduced car recognition on the expertise-adjusted test, though residual effects of expertise were still evident. Two subjects with developmental prosopagnosia met criteria for normal object recognition across all tests. We conclude that strong evidence for intact object recognition can be found in a few subjects but the majority show deficits, particularly those with the acquired form. Both acquired and developmental forms show residual but reduced object expertise effects.

Evaluating the organizational structure and specificity of network topology within the face processing system

There is increasing appreciation that network-level interactions among regions produce components of face processing previously ascribed to individual regions. Our goals were to use an exhaustive data-driven approach to derive and quantify the topology of directed functional connections within a priori defined nodes of the face processing network and evaluate whether the topology is category-specific. Young adults were scanned with fMRI as they viewed movies of faces, objects, and scenes. We employed GIMME to model effective connectivity among core and extended face processing regions, which allowed us to evaluate all possible directional connections, under each viewing condition (face, object, place). During face processing, we observed directional connections from the right posterior superior temporal sulcus to both the right occipital face area and right fusiform face area (FFA), which does not reflect the topology reported in prior studies. We observed connectivity between core and extended regions during face processing, but this limited to a feed-forward connection from the FFA to the amygdala. Finally, the topology of connections was unique to face processing. These findings suggest that the pattern of directed functional connections within the face processing network, particularly in the right core regions, may not be as hierarchical and feed-forward as described previously. Our findings support the notion that topologies of network connections are specialized, emergent, and dynamically responsive to task demands.

Over time, the right results will emerge

Scientific research involves going beyond the well-trodden and well-tested ideas and theories that form the core of scientific knowledge. During the time scientists are working things out, some results will be right, and others will be wrong. Over time, the right results will emerge. Lisa Randall (Frank B. Baird, Jr. Professor of Science, Physics Department, Harvard University) We are grateful to all the commentators for the important and thoughtful comments raised in response to the Geskin and Behrmann (G & B) literature survey. The issues raised in the introduction to this Special Issue and in these commentaries not only address and challenge aspects of the G & B literature review, but contribute perspectives and extensions that go well beyond the scope of the review. As is evident from G & B and from the 13 commentaries, many aspects of congenital prosopagnosia (CP) remain controversial. Adopting the language of the quote above, the intention of the G & B survey, along with the commentaries and this response, is to establish a collaborative process from which the right results (and right theory) will emerge in time. We are grateful to the editor of this Special Issue, Dr. Brad Mahon, for his support and for facilitating this collaborative exchange in Cognitive Neuropsychology.