fMRI activity in the medial temporal lobe during famous face processing

Overlapping neural correlates underpin theory of mind and semantic cognition: Evidence from a meta-analysis of 344 functional neuroimaging studies

Key unanswered questions for cognitive neuroscience include whether social cognition is underpinned by specialised brain regions and to what extent it simultaneously depends on more domain-general systems. Until we glean a better understanding of the full set of contributions made by various systems, theories of social cognition will remain fundamentally limited. In the present study, we evaluate a recent proposal that semantic cognition plays a crucial role in supporting social cognition. While previous brain-based investigations have focused on dissociating these two systems, our primary aim was to assess the degree to which the neural correlates are overlapping, particularly within two key regions, the anterior temporal lobe (ATL) and the temporoparietal junction (TPJ). We focus on activation associated with theory of mind (ToM) and adopt a meta-analytic activation likelihood approach to synthesise a large set of functional neuroimaging studies and compare their results with studies of semantic cognition. As a key consideration, we sought to account for methodological differences across the two sets of studies, including the fact that ToM studies tend to use nonverbal stimuli while the semantics literature is dominated by language-based tasks. Overall, we observed consistent overlap between the two sets of brain regions, especially in the ATL and TPJ. This supports the claim that tasks involving ToM draw upon more general semantic retrieval processes. We also identified activation specific to ToM in the right TPJ, bilateral anterior mPFC, and right precuneus. This is consistent with the view that, nested amongst more domain-general systems, there is specialised circuitry that is tuned to social processes.

Combining electrodermal activity analysis and dynamic causal modeling to investigate the visual-odor multimodal integration during face perception

Objective. This study presents a novel methodological approach for incorporating information related to the peripheral sympathetic response into the investigation of neural dynamics. Particularly, we explore how hedonic contextual olfactory stimuli influence the processing of neutral faces in terms of sympathetic response, event-related potentials and effective connectivity analysis. The objective is to investigate how the emotional valence of odors influences the cortical connectivity underlying face processing and the role of face-induced sympathetic arousal in this visual-olfactory multimodal integration.Approach. To this aim, we combine electrodermal activity (EDA) analysis and dynamic causal modeling to examine changes in cortico-cortical interactions.Results. The results reveal that stimuli arising sympathetic EDA responses are associated with a more negative N170 amplitude, which may be a marker of heightened arousal in response to faces. Hedonic odors, on the other hand, lead to a more negative N1 component and a reduced the vertex positive potential when they are unpleasant or pleasant. Concerning connectivity, unpleasant odors strengthen the forward connection from the inferior temporal gyrus (ITG) to the middle temporal gyrus, which is involved in processing changeable facial features. Conversely, the occurrence of sympathetic responses after a stimulus is correlated with an inhibition of this same connection and an enhancement of the backward connection from ITG to the fusiform face gyrus.Significance. These findings suggest that unpleasant odors may enhance the interpretation of emotional expressions and mental states, while faces capable of eliciting sympathetic arousal prioritize identity processing.

Neural tracking of social hierarchies in adolescents' real-world social networks

In the current study, we combined sociometric nominations and neuroimaging techniques to examine adolescents' neural tracking of peers from their real-world social network that varied in social preferences and popularity. Adolescent participants from an entire school district (N = 873) completed peer sociometric nominations of their grade at school, and a subset of participants (N = 117, Mage = 13.59 years) completed a neuroimaging task in which they viewed peer faces from their social networks. We revealed two neural processes by which adolescents track social preference: (1) the fusiform face area, an important region for early visual perception and social categorization, simultaneously represented both peers high in social preference and low in social preference; (2) the dorsolateral prefrontal cortex (DLPFC), which was differentially engaged in tracking peers high and low in social preference. No regions specifically tracked peers high in popularity and only the inferior parietal lobe, temporoparietal junction, midcingulate cortex and insula were involved in tracking unpopular peers. This is the first study to examine the neural circuits that support adolescents' perception of peer-based social networks. These findings identify the neural processes that allow youths to spontaneously keep track of peers' social value within their social network.

Top-down modulation and cortical-AMG/HPC interaction in familiar face processing

Humans can accurately recognize familiar faces in only a few hundred milliseconds, but the underlying neural mechanism remains unclear. Here, we recorded intracranial electrophysiological signals from ventral temporal cortex (VTC), superior/middle temporal cortex (STC/MTC), medial parietal cortex (MPC), and amygdala/hippocampus (AMG/HPC) in 20 epilepsy patients while they viewed faces of famous people and strangers as well as common objects. In posterior VTC and MPC, familiarity-sensitive responses emerged significantly later than initial face-selective responses, suggesting that familiarity enhances face representations after they are first being extracted. Moreover, viewing famous faces increased the coupling between cortical areas and AMG/HPC in multiple frequency bands. These findings advance our understanding of the neural basis of familiar face perception by identifying the top-down modulation in local face-selective response and interactions between cortical face areas and AMG/HPC.

Multiple-stage impairments of unfamiliar face learning in developmental prosopagnosia: Evidence from fMRI repetition suppression and multi-voxel pattern stability

Individuals with developmental prosopagnosia (DP) are characterized by severe face recognition deficits, yet it remains unknown how they are hindered in the process of unfamiliar face learning. Here we tracked the changes of neural activation during unfamiliar face repetition in DP with fMRI to reveal their neural deficits in learning unfamiliar faces. At the perceptual level, we found that the bilateral fusiform face area (FFA) in individuals with DP showed attenuated repetition suppression for faces, suggesting an inefficient perceptual analysis for learned faces. At the mnemonic level, individuals with DP showed decreased multi-voxel pattern stability for repeated faces in bilateral medial temporal lobe (MTL), suggesting an unstable mnemonic representation for learned faces. In addition, resting-state functional connectivity between the FFA and MTL was also disrupted in individuals with DP. Finally, the MTL's unstable mnemonic representation was associated with the impaired face recognition performance in DP. In sum, our study provides evidence that individuals with DP showed multi-stage neural deficits in unfamiliar face learning and sheds new light on how unfamiliar faces are learned in normal population.

Face learning via brief real-world social interactions includes changes in face-selective brain areas and hippocampus

Making new acquaintances requires learning to recognise previously unfamiliar faces. In the current study, we investigated this process by staging real-world social interactions between actors and the participants. Participants completed a face-matching behavioural task in which they matched photographs of the actors (whom they had yet to meet), or faces similar to the actors (henceforth called foils). Participants were then scanned using functional magnetic resonance imaging (fMRI) while viewing photographs of actors and foils. Immediately after exiting the scanner, participants met the actors for the first time and interacted with them for 10 min. On subsequent days, participants completed a second behavioural experiment and then a second fMRI scan. Prior to each session, actors again interacted with the participants for 10 min. Behavioural results showed that social interactions improved performance accuracy when matching actor photographs, but not foil photographs. The fMRI analysis revealed a difference in the neural response to actor photographs and foil photographs across all regions of interest (ROIs) only after social interactions had occurred. Our results demonstrate that short social interactions were sufficient to learn and discriminate previously unfamiliar individuals. Moreover, these learning effects were present in brain areas involved in face processing and memory.

Activation of Person Knowledge in Medial Prefrontal Cortex during the Encoding of New Lifelike Events

Our knowledge about people can help us predict how they will behave in particular situations and interpret their actions. In this study, we investigated the cognitive and neural effects of person knowledge on the encoding and retrieval of novel life-like events. Healthy human participants learnt about two characters over a week by watching 6 episodes of one of two situation comedies, which were both centered on a young couple. In the scanner, they watched and then silently recalled 20 new scenes from both shows that were all set in unfamiliar locations: 10 from their trained show and 10 from the untrained show. After scanning, participants' recognition memory was better for scenes from the trained show. The functional magnetic resonance imaging (fMRI) patterns of brain activity when watching the videos were reinstated during recall, but this effect was not modulated by training. However, person knowledge boosted the similarity in fMRI patterns of activity in the medial prefrontal cortex (MPFC) when watching the new events involving familiar characters. Our findings identify a role for the MPFC in the representation of schematic person knowledge during the encoding of novel, lifelike events.

Getting to Know Someone: Familiarity, Person Recognition, and Identification in the Human Brain

In our everyday life, we continuously get to know people, dominantly through their faces. Several neuroscientific experiments showed that familiarization changes the behavioral processing and underlying neural representation of faces of others. Here, we propose a model of the process of how we actually get to know someone. First, the purely visual familiarization of unfamiliar faces occurs. Second, the accumulation of associated, nonsensory information refines person representation, and finally, one reaches a stage where the effortless identification of very well-known persons occurs. We offer here an overview of neuroimaging studies, first evaluating how and in what ways the processing of unfamiliar and familiar faces differs and, second, by analyzing the fMRI adaptation and multivariate pattern analysis results we estimate where identity-specific representation is found in the brain. The available neuroimaging data suggest that different aspects of the information emerge gradually as one gets more and more familiar with a person within the same network. We propose a novel model of familiarity and identity processing, where the differential activation of long-term memory and emotion processing areas is essential for correct identification.

Predicting Interpersonal Outcomes From Information Processing Tasks Using Personally Relevant and Generic Stimuli: A Methodology Study

Despite evidence of differential processing of personally relevant stimuli (PR), most studies investigating attentional biases in processing emotional content use generic stimuli. We sought to examine differences in the processing of PR, relative to generic, stimuli across information processing tasks and to validate their use in predicting concurrent interpersonal functioning. Fifty participants (25 female) viewed generic and PR (i.e., their intimate partner’s face) emotional stimuli during tasks assessing selective attention (using a modified version of the Spatial Cueing Task) and inhibition (using the Negative Affective Priming task) of emotional content. Ratings of relationship quality were also collected. Evidence of increased selective attention during controlled and greater avoidance during automatic stages of processing emerged when viewing PR, relative to generic, emotional faces. We also found greater inhibition of PR sad faces. Finally, male, but not female, participants who displayed greater difficulty disengaging from the sad face of their partner reported more conflict in their relationships. Taken together, findings from information processing studies using generic emotional stimuli may not be representative of how we process PR stimuli in naturalistic settings.

Typical visual unfamiliar face individuation in left and right mesial temporal epilepsy

Patients with chronic mesial temporal lobe epilepsy have difficulties at identifying familiar faces as well as at explicit old/new face recognition tasks. However, the extent to which these difficulties can be attributed to visual individuation of faces, independently of general explicit learning and semantic memory processes, is unknown. We tested 42 mesial temporal lobe epilepsy patients divided into two groups according to the side of epilepsy (left and right) and 42 matched controls on an extensive series of individuation tasks of unfamiliar faces and control visual stimuli, as well as on face detection, famous face recognition and naming, and face and non-face learning. Overall, both patient groups had difficulties at identifying and naming famous faces, and at explicitly learning face and non-face images. However, there was no group difference in accuracy between patients and controls at the two most widely used neuropsychological tests assessing visual individuation of unfamiliar faces (Benton Facial Recognition Test and Cambridge Face Memory Test). While patients with right mesial temporal lobe epilepsy were slowed down at all tasks, this effect was not specific to faces or even high-level stimuli. Importantly, both groups showed the same profile of response as typical participants across various stimulus manipulations, showing no evidence of qualitative processing impairments. Overall, these results point to largely preserved visual face individuation processes in patients with mesial temporal lobe epilepsy, with semantic and episodic memory difficulties being consistent with the localization of the neural structures involved in their epilepsy (anterior temporal cortex and hippocampus). These observations have implications for the prediction of neuropsychological outcomes in the case of surgery and support the validity of intracranial electroencephalographic recordings performed in this population to understand neural mechanisms of human face individuation, notably through intracranial electrophysiological recordings and stimulations.

Effects of Prior-Knowledge on Brain Activation and Connectivity During Associative Memory Encoding

Forming new associations is a fundamental process of building our knowledge system. At the brain level, how prior-knowledge influences acquisition of novel associations has not been thoroughly investigated. Based on recent cognitive neuroscience literature on multiple-component memory processing, we hypothesize that prior-knowledge triggers additional evaluative, semantic, or episodic-binding processes, mainly supported by the ventromedial prefrontal cortex (vmPFC), anterior temporal pole (aTPL), and hippocampus (HPC), to facilitate new memory encoding. To test this hypothesis, we scanned 20 human participants with functional magnetic resonance imaging (fMRI) while they associated novel houses with famous or nonfamous faces. Behaviorally, we found beneficial effects of prior-knowledge on associative memory. At the brain level, we found that the vmPFC and HPC, as well as the parahippocampal place area (PPA) and fusiform face area, showed stronger activation when famous faces were involved. The vmPFC, aTPL, HPC, and PPA also exhibited stronger activation when famous faces elicited stronger emotions and memories, and when associations were later recollected. Connectivity analyses also suggested that HPC connectivity with the vmPFC plays a more important role in the famous than nonfamous condition. Taken together, our results suggest that prior-knowledge facilitates new associative encoding by recruiting additional perceptual, evaluative, or associative binding processes.

An image-invariant neural response to familiar faces in the human medial temporal lobe

The ability to recognise familiar faces with ease across different viewing conditions contrasts with the inherent difficulty in the perception of unfamiliar faces across similar image manipulations. Models of face processing suggest that this difference is based on the neural representation for familiar faces being more invariant to changes in the image, than it is for unfamiliar faces. Here, we used an fMR-adaptation paradigm to investigate neural correlates of image-invariant face recognition in face-selective regions of the human brain. Participants viewed faces presented in a blocked design. Each block contained different images of the same identity or different images from different identities. Faces in each block were either familiar or unfamiliar to the participants. First, we defined face-selective regions by comparing the response to faces with the response to scenes and scrambled faces. Next, we asked whether any of these face-selective regions showed image-invariant adaptation to the identity of a face. The core face-selective regions showed image-invariant adaptation to familiar and unfamiliar faces. However, there was no difference in the adaptation to familiar compared to unfamiliar faces. In contrast, image-invariant adaptation for familiar faces, but not for unfamiliar faces, was found in face-selective regions of the medial temporal lobe (MTL). Taken together, our results suggest that the marked differences in the perception of familiar and unfamiliar faces may depend critically on neural processes in the medial temporal lobe.

Relearning knowledge for people in a case of right variant frontotemporal dementia

Right variant frontotemporal dementia (Rvt-FTD) is a rare variant of FTD that usually presents with a progressive difficulty in recognizing familiar people. We aimed to determine whether rehabilitation of semantic knowledge for people improves recognition by both verbal and visual channels in a patient with Rvt-FTD. Knowledge for 21 famous people was assessed in a patient with Rvt-FTD before and after completing a semantic rehabilitation program. After rehabilitation recognition increased by 95% when presented with the famous people's names and related semantic facts, but only by 28% when presented with their faces. Recognition of people by verbal and visual channels improves differently after semantic knowledge rehabilitation.

The Roles of Left Versus Right Anterior Temporal Lobes in Conceptual Knowledge: An ALE Meta-analysis of 97 Functional Neuroimaging Studies

The roles of the right and left anterior temporal lobes (ATLs) in conceptual knowledge are a source of debate between 4 conflicting accounts. Possible ATL specializations include: (1) Processing of verbal versus non-verbal inputs; (2) the involvement of word retrieval; and (3) the social content of the stimuli. Conversely, the "hub-and-spoke" account holds that both ATLs form a bilateral functionally unified system. Using activation likelihood estimation (ALE) to compare the probability of left and right ATL activation, we analyzed 97 functional neuroimaging studies of conceptual knowledge, organized according to the predictions of the three specialized hypotheses. The primary result was that ATL activation was predominately bilateral and highly overlapping for all stimulus types. Secondary to this bilateral representation, there were subtle gradations both between and within the ATLs. Activations were more likely to be left lateralized when the input was a written word or when word retrieval was required. These data are best accommodated by a graded version of the hub-and-spoke account, whereby representation of conceptual knowledge is supported through bilateral yet graded connectivity between the ATLs and various modality-specific sensory, motor, and limbic cortices.

Neural microgenesis of personally familiar face recognition

Despite a wealth of information provided by neuroimaging research, the neural basis of familiar face recognition in humans remains largely unknown. Here, we isolated the discriminative neural responses to unfamiliar and familiar faces by slowly increasing visual information (i.e., high-spatial frequencies) to progressively reveal faces of unfamiliar or personally familiar individuals. Activation in ventral occipitotemporal face-preferential regions increased with visual information, independently of long-term face familiarity. In contrast, medial temporal lobe structures (perirhinal cortex, amygdala, hippocampus) and anterior inferior temporal cortex responded abruptly when sufficient information for familiar face recognition was accumulated. These observations suggest that following detailed analysis of individual faces in core posterior areas of the face-processing network, familiar face recognition emerges categorically in medial temporal and anterior regions of the extended cortical face network.

Spatiotemporal changes in neural response patterns to faces varying in visual familiarity

Increasing experience with a previously unfamiliar face improves human ability to recognize it in challenging and novel viewing conditions. Differential neural responses to familiar versus unfamiliar faces in multiple regions of the ventral-temporal and parietal cortex have been reported in previous work, but with limited attention to how behavioral and neural measures change with increasing familiarity. We examined changes in the spatial and temporal characteristics of neural response patterns elicited by faces that vary in their degree of visual familiarity. First, we developed a behavioral paradigm to familiarize participants to low-, medium-, and high-levels of familiarity with faces. Recognition of novel, naturalistic images of the learned individuals improved with increasing familiarity with faces. Next, a new set of participants learned faces using the behavioral paradigm, outside the fMRI scanner, and subsequently viewed blocks of whole-body images of the learned and novel people, inside the scanner. We found that the face-selective FFA and OFA, and a combination of the ventral-temporal areas (e.g., fusiform gyrus) and parietal areas (e.g., precuneus) contained patterns useful for classifying highly familiar versus unfamiliar faces. Classification along the temporal-sequence of the face blocks revealed an early separation of neural patterns elicited in response to highly familiar versus unfamiliar faces in the FFA and OFA, but not in other regions of interest. This indicates the potential for a rapid assessment of the "known versus unknown" status of faces in core face-selective regions of the brain. The present study provides a first look at the perceptual and neural correlates underlying experience gains with faces as they become familiar.

Single-trial EEG-informed fMRI reveals spatial dependency of BOLD signal on early and late IC-ERP amplitudes during face recognition

Simultaneous EEG-fMRI has opened up new avenues for improving the spatio-temporal resolution of functional brain studies. However, this method usually suffers from poor EEG quality, especially for evoked potentials (ERPs), due to specific artifacts. As such, the use of EEG-informed fMRI analysis in the context of cognitive studies has particularly focused on optimizing narrow ERP time windows of interest, which ignores the rich diverse temporal information of the EEG signal. Here, we propose to use simultaneous EEG-fMRI to investigate the neural cascade occurring during face recognition in 14 healthy volunteers by using the successive ERP peaks recorded during the cognitive part of this process. N170, N400 and P600 peaks, commonly associated with face recognition, were successfully and reproducibly identified for each trial and each subject by using a group independent component analysis (ICA). For the first time we use this group ICA to extract several independent components (IC) corresponding to the sequence of activation and used single-trial peaks as modulation parameters in a general linear model (GLM) of fMRI data. We obtained an occipital-temporal-frontal stream of BOLD signal modulation, in accordance with the three successive IC-ERPs providing an unprecedented spatio-temporal characterization of the whole cognitive process as defined by BOLD signal modulation. By using this approach, the pattern of EEG-informed BOLD modulation provided improved characterization of the network involved than the fMRI-only analysis or the source reconstruction of the three ERPs; the latter techniques showing only two regions in common localized in the occipital lobe.

Vision dominates at the preresponse level and audition dominates at the response level in cross-modal interaction: behavioral and neural evidence

There are ongoing debates on the direction of sensory dominance in cross-modal interaction. In the present study, we demonstrate that the specific direction of sensory dominance depends on the level of processing: vision dominates at earlier stages, whereas audition dominates at later stages of cognitive processing. Moreover, these dominances are subserved by different neural networks. In three experiments, human participants were asked to attend to either visual or auditory modality while ignoring simultaneous stimulus inputs from the other modality. By manipulating three levels of congruency between the simultaneous visual and auditory inputs, congruent (C), incongruent at preresponse level (PRIC), and incongruent at response level (RIC), we differentiated the cross-modal conflict explicitly into preresponse (PRIC > C) and response (RIC > PRIC) levels. Behavioral data in the three experiments consistently suggested that visual distractors caused more interference to auditory processing than vice versa (i.e., the typical visual dominance) at the preresponse level, but auditory distractors caused more interference to visual processing than vice versa (i.e., the typical auditory dominance) at the response level regardless of experimental tasks, types of stimuli, or differential processing speeds in different modalities. Dissociable neural networks were revealed, with the default mode network being involved in the visual dominance at the preresponse level and the prefrontal executive areas being involved in the auditory dominance at the response level. The default mode network may be attracted selectively by irrelevant visual, rather than auditory, information via enhanced neural coupling with the ventral visual stream, resulting in visual dominance at the preresponse level.

Neural correlates of covert face processing: fMRI evidence from a prosopagnosic patient

Brains can perceive or recognize a face even though we are subjectively unaware of the existence of that face. However, the exact neural correlates of such covert face processing remain unknown. Here, we compared the fMRI activities between a prosopagnosic patient and normal controls when they saw famous and unfamiliar faces. When compared with objects, the patient showed greater activation to famous faces in the fusiform face area (FFA) though he could not overtly recognize those faces. In contrast, the controls showed greater activation to both famous and unfamiliar faces in the FFA. Compared with unfamiliar faces, famous faces activated the controls', but not the patient's lateral prefrontal cortex (LPFC) known to be involved in familiar face recognition. In contrast, the patient showed greater activation in the bilateral medial frontal gyrus (MeFG). Functional connectivity analyses revealed that the patient's right middle fusiform gyrus (FG) showed enhanced connectivity to the MeFG, whereas the controls' middle FG showed enhanced connectivity to the LPFC. These findings suggest that the FFA may be involved in both covert and overt face recognition. The patient's impairment in overt face recognition may be due to the absence of the coupling between the right FG and the LPFC.

Anterior temporal face patches: a meta-analysis and empirical study

Evidence suggests the anterior temporal lobe (ATL) plays an important role in person identification and memory. In humans, neuroimaging studies of person memory report consistent activations in the ATL to famous and personally familiar faces and studies of patients report resection or damage of the ATL causes an associative prosopagnosia in which face perception is intact but face memory is compromised. In addition, high-resolution fMRI studies of non-human primates and electrophysiological studies of humans also suggest regions of the ventral ATL are sensitive to novel faces. The current study extends previous findings by investigating whether similar subregions in the dorsal, ventral, lateral, or polar aspects of the ATL are sensitive to personally familiar, famous, and novel faces. We present the results of two studies of person memory: a meta-analysis of existing fMRI studies and an empirical fMRI study using optimized imaging parameters. Both studies showed left-lateralized ATL activations to familiar individuals while novel faces activated the right ATL. Activations to famous faces were quite ventral, similar to what has been reported in previous high-resolution fMRI studies of non-human primates. These findings suggest that face memory-sensitive patches in the human ATL are in the ventral/polar ATL.

Social cognition and the anterior temporal lobes: a review and theoretical framework

Memory for people and their relationships, along with memory for social language and social behaviors, constitutes a specific type of semantic memory termed social knowledge. This review focuses on how and where social knowledge is represented in the brain. We propose that portions of the anterior temporal lobe (ATL) play a critical role in representing and retrieving social knowledge. This includes memory about people, their names and biographies and more abstract forms of social memory such as memory for traits and social concepts. This hypothesis is based on the convergence of several lines of research including anatomical findings, lesion evidence from both humans and non-human primates and neuroimaging evidence. Moreover, the ATL is closely interconnected with cortical nuclei of the amygdala and orbitofrontal cortex via the uncinate fasciculus. We propose that this pattern of connectivity underlies the function of the ATL in encoding and storing emotionally tagged knowledge that is used to guide orbitofrontal-based decision processes.

Functional magnetic resonance imaging of semantic memory as a presymptomatic biomarker of Alzheimer's disease risk

Extensive research efforts have been directed toward strategies for predicting risk of developing Alzheimer's disease (AD) prior to the appearance of observable symptoms. Existing approaches for early detection of AD vary in terms of their efficacy, invasiveness, and ease of implementation. Several non-invasive magnetic resonance imaging strategies have been developed for predicting decline in cognitively healthy older adults. This review will survey a number of studies, beginning with the development of a famous name discrimination task used to identify neural regions that participate in semantic memory retrieval and to test predictions of several key theories of the role of the hippocampus in memory. This task has revealed medial temporal and neocortical contributions to recent and remote memory retrieval, and it has been used to demonstrate compensatory neural recruitment in older adults, apolipoprotein E ε4 carriers, and amnestic mild cognitive impairment patients. Recently, we have also found that the famous name discrimination task provides predictive value for forecasting episodic memory decline among asymptomatic older adults. Other studies investigating the predictive value of semantic memory tasks will also be presented. We suggest several advantages associated with the use of semantic processing tasks, particularly those based on person identification, in comparison to episodic memory tasks to study AD risk. Future directions for research and potential clinical uses of semantic memory paradigms are also discussed. This article is part of a Special Issue entitled: Imaging Brain Aging and Neurodegenerative disease.

Associative memory deficits in mild cognitive impairment: the role of hippocampal formation

Neuropathological events featuring early stages of Alzheimer's disease (AD) appear in the entorhinal cortex (EC), subiculum (SB) and cornu ammonis 1 (CA1) of hippocampus, which may account for associative memory deficits in non-demented people with mild cognitive impairment (MCI). To test this hypothesis in vivo, we investigated whether volume changes in these regions are related to failures in associative memory in MCI as compared to cognitively normal (CN) elderly subjects. Volume changes in EC and hippocampal subfields were determined by using deformation-based morphometry techniques applied to probabilistic cytoarchitectonic maps derived from post mortem human brains. CN subjects were distinguished from MCI patients by firstly identifying local volume differences in EC and hippocampus, and then evaluating the way in which these anatomical changes correlated with performance in a non-intentional face-location association task. MCI patients not only performed worse than CN elders in building new associations, but they were further unable to benefit from semantic encoding to improve episodic binding. According to our initial hypothesis, local volume reductions in both EC and hippocampal CA accounted for group differences in associative memory whereas atrophy in CA, but not in EC, accounted for semantic encoding of associations. Two main conclusions can be drawn from the present study: i) access to semantic information during encoding does not reduce the episodic deficit in MCI; and ii) EC and hippocampal CA, two regions early affected by AD neuropathology, are responsible, at least partially, for associative memory deficits observed in MCI patients.

Accessing Semantic Person Knowledge: Temporal Dynamics of Nonstrategic Categorical and Associative Priming

Recent theories of semantic memory suggest a subdivision into several separate domains of knowledge. The present study examined the structure of semantic person knowledge by analyzing both behavioral and ERP correlates of associative priming (via co-occurrence and/or shared semantic information) versus purely categorical priming (via shared occupational information). Participants performed familiarity decisions for target faces, which were preceded by sandwich-masked prime names at either short (33 msec) or long (1033 msec) SOAs. Although masking effectively prevented explicit prime recognition, faster RTs were generally observed for both associative and categorical priming (relative to an unrelated prime-target condition). At the short SOA, both associatively and categorically primed targets similarly elicited more positive going ERPs compared with unrelated targets in the N400 time range (N400 priming effect), suggesting a common initial mechanism mediating both forms of priming. By contrast, at the long SOA, a typical N400 priming effect was observed for associative priming only, whereas the corresponding effect for categorical priming was small and restricted to a left parietal site. This hitherto unreported interaction of relatedness, and SOA in the N400 suggests an initial fast spreading of activation to a wide range of related targets, which subsequently focuses to more closely related people at longer SOAs. This ability of ERPs to trace the neural dynamics of activation for different forms of prime/target relatedness can be exploited for testing different models of semantic priming.

Brain responses differ to faces of mothers and fathers

We encounter many faces each day but relatively few are personally familiar. Once faces are familiar, they evoke semantic and social information known about the person. Neuroimaging studies demonstrate differential brain activity to familiar and non-familiar faces; however, brain responses related to personally familiar faces have been more rarely studied. We examined brain activity with fMRI in adults in response to faces of their mothers and fathers compared to faces of celebrities and strangers. Overall, faces of mothers elicited more activity in core and extended brain regions associated with face processing, compared to fathers, celebrity or stranger faces. Fathers' faces elicited activity in the caudate, a deep brain structure associated with feelings of love. These new findings of differential brain responses elicited by faces of mothers and fathers are consistent with psychological research on attachment, evident even during adulthood.

The influence of perceptual and knowledge-based familiarity on the neural substrates of face perception

This study examined the neural substrates of facial familiarity and person-knowledge. Based on current neural models of face perception, it was hypothesized that distinct extended networks of brain regions differentiate the perception of (a) novel faces, (b) novel faces associated with person-knowledge, (c) perceptually familiar faces and (d) familiar faces for which person-knowledge was learned. To test this hypothesis, we conducted an event-related functional magnetic resonance imaging experiment during which participants viewed faces experimentally manipulated to represent these different levels of familiarity. Results confirmed that distinct networks of brain regions, particularly the medial prefrontal cortex, underlie the perception of faces for which person-knowledge is available.

Beyond the memory mechanism: person-selective and nonselective processes in recognition of personally familiar faces

Special processes recruited during the recognition of personally familiar people have been assumed to reflect the rich episodic and semantic information that selectively represents each person. However, the processes may also include person nonselective ones, which may require interpretation in terms beyond the memory mechanism. To examine this possibility, we assessed decrease in differential activation during the second presentation of an identical face (repetition suppression) as an index of person selectivity. During fMRI, pictures of personally familiar, famous, and unfamiliar faces were presented to healthy subjects who performed a familiarity judgment. Each face was presented once in the first half of the experiment and again in the second half. The right inferior temporal and left inferior frontal gyri were activated during the recognition of both types of familiar faces initially, and this activation was suppressed with repetition. Among preferentially activated regions for personally familiar over famous faces, robust suppression in differential activation was exhibited in the bilateral medial and anterior temporal structures, left amygdala, and right posterior STS, all of which are known to process episodic and semantic information. On the other hand, suppression was minimal in the posterior cingulate, medial prefrontal, right inferior frontal, and intraparietal regions, some of which were implicated in social cognition and cognitive control. Thus, the recognition of personally familiar people is characterized not only by person-selective representation but also by nonselective processes requiring a research framework beyond the memory mechanism, such as a social adaptive response.

Human medial temporal lobe neurons respond preferentially to personally relevant images

People with whom one is personally acquainted tend to elicit richer and more vivid memories than people with whom one does not have a personal connection. Recent findings from neurons in the human medial temporal lobe (MTL) have shown that individual cells respond selectively and invariantly to representations of famous people [Quian Quiroga R, Reddy L, Kreiman G, Koch C, Fried I (2005) Nature 435(7045):1102-1107]. Observing these cells, we wondered whether photographs of personally relevant individuals, such as family members, might be more likely to generate such responses. To address this issue, we recorded the activity of 2,330 neurons in the human MTL while patients viewed photographs of varying personal relevance: previously unknown faces and landscapes, familiar but not necessarily personally relevant faces and landscapes, and finally, photographs of the patients themselves, their families, and the experimenters. Our findings indicate that personally relevant photographs are indeed more likely to elicit selective responses in MTL neurons than photographs of individuals with whom the patients have had no personal contact. These findings further suggest that relevant stimuli are encoded by a larger proportion of neurons than less relevant stimuli, given that familiar or personally relevant items are linked to a larger variety of experiences and memories of these experiences.

Neural bases of autobiographical support for episodic recollection of faces

Incidental retrieval of autobiographical knowledge can provide rich contextual support for episodic recollection of a recent event. We examined the neural bases of these two processes by performing fMRI scanning during a recognition memory test for faces that were unfamiliar, famous, or personally known. The presence of pre-experimental knowledge of a face was incidental to the task, but nonetheless resulted in improved performance. Two distinct networks of activation were associated with correct recollection of a face's prior presentation (recollection hits vs. correct rejections) on one hand, and with pre-experimental knowledge about it (famous or personally known vs. unfamiliar faces) on the other. The former included mid/posterior cingulate cortex, precuneus, and ventral striatum. The latter included bilateral hippocampus, retrosplenial, and ventromedial prefrontal cortices. Anterior and medial thalamic activations showed an interaction between both effects, driven by increased activation for recollection of unfamiliar faces. When recollecting the presentation of a famous or personally known face, hippocampal activation increased with participants' ratings of how well they felt they knew the person shown. Ventromedial prefrontal cortex showed significantly greater activation for personally known than famous faces. Our results indicate a dissociation between the involvement of retrosplenial vs. mid/posterior cingulate and precuneus in memory tasks. They also indicate that, during recognition memory experiments, the hippocampus supports incidental retrieval of pre-experimental knowledge about the stimuli presented. This type of knowledge likely underlies the additional recollection found for prior presentation of well known stimuli compared with novel ones and may link hippocampal activation at encoding to subsequent memory performance more generally.

Neural correlates of personally familiar faces: parents, partner and own faces

Investigations of the neural correlates of face recognition have typically used old/new paradigms where subjects learn to recognize new faces or identify famous faces. Familiar faces, however, include one's own face, partner's and parents' faces. Using event-related fMRI, we examined the neural correlates of these personally familiar faces. Ten participants were presented with photographs of own, partner, parents, famous and unfamiliar faces and responded to a distinct target. Whole brain, two regions of interest (fusiform gyrus and cingulate gyrus), and multiple linear regression analyses were conducted. Compared with baseline, all familiar faces activated the fusiform gyrus; own faces also activated occipital regions and the precuneus; partner faces activated similar areas, but in addition, the parahippocampal gyrus, middle superior temporal gyri and middle frontal gyrus. Compared with unfamiliar faces, only personally familiar faces activated the cingulate gyrus and the extent of activation varied with face category. Partner faces also activated the insula, amygdala and thalamus. Regions of interest analyses and laterality indices showed anatomical distinctions of processing the personally familiar faces within the fusiform and cingulate gyri. Famous faces were right lateralized whereas personally familiar faces, particularly partner and own faces, elicited bilateral activations. Regression analyses show experiential predictors modulated with neural activity related to own and partner faces. Thus, personally familiar faces activated the core visual areas and extended frontal regions, related to semantic and person knowledge and the extent and areas of activation varied with face type.

Integrating visual and tactile information in the perirhinal cortex

By virtue of its widespread afferent projections, perirhinal cortex is thought to bind polymodal information into abstract object-level representations. Consistent with this proposal, deficits in cross-modal integration have been reported after perirhinal lesions in nonhuman primates. It is therefore surprising that imaging studies of humans have not observed perirhinal activation during visual–tactile object matching. Critically, however, these studies did not differentiate between congruent and incongruent trials. This is important because successful integration can only occur when polymodal information indicates a single object (congruent) rather than different objects (incongruent). We scanned neurologically intact individuals using functional magnetic resonance imaging (fMRI) while they matched shapes. We found higher perirhinal activation bilaterally for cross-modal (visual–tactile) than unimodal (visual–visual or tactile–tactile) matching, but only when visual and tactile attributes were congruent. Our results demonstrate that the human perirhinal cortex is involved in cross-modal, visual–tactile, integration and, thus, indicate a functional homology between human and monkey perirhinal cortices.

Differential contributions of the anterior temporal and medial temporal lobe to the retrieval of memory for person identity information

Although previous studies have suggested the importance of the bilateral anterior temporal (ATL) and medial temporal lobes (MTL) in the retrieval of person identity information, there is little evidence concerning how these regions differentially contribute to the process. Here we investigated this question using functional magnetic resonance imaging (fMRI). Before scanning, subjects learned associations among faces (F), names (N), and job titles (as a form of person-related semantics, S). During retrieval with fMRI, subjects were presented with previously learned and new S stimuli, and judged whether the stimuli were old or new. Successful retrieval (H) trials were divided into three conditions: retrieval of S and associated F and N (HSFN); retrieval of S and associated F (HSF); and retrieval of S only (HS). The left ATL was significantly activated in HSFN, compared to HSF or HS, whereas the right ATL and MTL were significantly activated in HSFN and HSF relative to HS. In addition, activity in bilateral ATL was significantly correlated with reaction time for HSFN, whereas we found no significant correlation between activity in the right MTL and reaction time in any condition. The present findings suggest that the left ATL may mediate associations between names and person-related semantic information, whereas the right ATL mediates the association between faces and person-related semantic information in memory for person identity information. In addition, activation of the right MTL region implies that this area may contribute to a more general relational processing of associative components, including memory for person identity information.

The anatomic correlate of prosopagnosia in semantic dementia

OBJECTIVE

To determine the anatomic correlate of prosopagnosia in subjects with semantic dementia.

METHODS

We identified all subjects who had been evaluated by an experienced behavioral neurologist, met criteria for semantic dementia, and had completed a volumetric head MRI scan. In all subjects, historical records were reviewed and subjects in which the presence (n = 15) or absence (n = 12) of prosopagnosia was specifically ascertained by the neurologist were identified. Voxel-based morphometry was used to assess patterns of gray matter atrophy in subjects with and without prosopagnosia compared to a group of age and gender-matched normal controls, and compared to each other.

RESULTS

Compared to controls, both groups showed prominent temporal lobe volume loss. Those with prosopagnosia showed bilateral loss but with greater involvement of the right temporal lobe, while those without prosopagnosia showed predominantly left anterior temporal lobe loss. On direct comparison, subjects with prosopagnosia showed greater loss predominantly in the right amygdala, hippocampus, fusiform gyrus, and anterior temporal pole than those without prosopagnosia. No regions were involved to a greater degree in those without prosopagnosia, compared to those with prosopagnosia.

CONCLUSIONS

Prosopagnosia appears to be associated with volume loss of the right temporal lobe, particularly medial temporal lobe, fusiform gyrus, and anterior temporal pole, although in semantic dementia it is occurring in the context of bilateral temporal lobe volume loss.

Functional imaging of semantic memory predicts postoperative episodic memory functions in chronic temporal lobe epilepsy

Medial temporal (MTL) structures have crucial functions in episodic (EM), but also in semantic memory (SM) processing. Preoperative functional magnetic resonance imaging (fMRI) activity within the MTL is increasingly used to predict post-surgical memory capacities. Based on the hypothesis that EM and SM memory functions are both hosted by the MTL the present study wanted to explore the relationship between SM related activations in the MTL as assessed before and the capacity of EM functions after surgery. Patients with chronic unilateral left (n=14) and right (n=12) temporal lobe epilepsy (TLE) performed a standard word list learning test pre- and postoperatively, and a fMRI procedure before the operation using a semantic decision task. SM processing caused significant bilateral MTL activations in both patient groups. While right TLE patients showed asymmetry of fMRI activation with more activation in the left MTL, left TLE patients had almost equal activation in both MTL regions. Contrasting left TLE versus right TLE patients revealed greater activity within the right MTL, whereas no significant difference was observed for the reverse contrast. Greater effect size in the MTL region ipsilateral to the seizure focus was significantly and positively correlated with preoperative EM abilities. Greater effect size in the contralateral MTL was correlated with better postoperative verbal EM, especially in left TLE patients. These results suggest that functional imaging of SM tasks may be useful to predict postoperative verbal memory in TLE. They also advocate a common neuroanatomical basis for SM and EM processes in the MTL.

Category-specific naming and recognition deficits in temporal lobe epilepsy surgical patients

OBJECTIVE

Based upon Damasio's "convergence zone" model of semantic memory, we predicted that epilepsy surgical patients with anterior temporal lobe (TL) seizure onset would exhibit a pattern of category-specific naming and recognition deficits not observed in patients with seizures arising elsewhere.

METHODS

We assessed epilepsy patients with unilateral seizure onset of anterior TL or other origin (n=22), pre- or post-operatively, using a set of category-specific items and a conventional measure of visual naming (Boston Naming Test: BNT).

RESULTS

Category-specific naming deficits were exhibited by patients with dominant anterior TL seizure onset/resection for famous faces and animals, while category-specific recognition deficits for these same categories were exhibited by patients with nondominant anterior TL onset/resection. Patients with other seizure onset did not exhibit category-specific deficits. Naming and recognition deficits were frequently not detected by the BNT, which samples only a limited range of stimuli.

INTERPRETATION

Consistent with the "convergence zone" framework, results suggest that the nondominant anterior TL plays a major role in binding sensory information into conceptual percepts for certain stimuli, while dominant TL regions function to provide a link to verbal labels for these percepts. Although observed category-specific deficits were striking, they were often missed by the BNT, suggesting that they are more prevalent than recognized in both pre- and post-surgical epilepsy patients. Systematic investigation of these deficits could lead to more refined models of semantic memory, aid in the localization of seizures, and contribute to modifications in surgical technique and patient selection in epilepsy surgery to improve neurocognitive outcome.

Face familiarity feelings, the right temporal lobe and the possible underlying neural mechanisms

A comprehensive review was made of the relationships between right hemisphere and face familiarity feelings, taking separately into account: (a) studies of patients with unilateral lesions of the anterior or the posterior parts of the right and left temporal lobes, who showed a familiar people recognition disorder, (b) studies of right and left brain-damaged patients, presenting an increased familiarity for unknown persons or abnormal familiarity feelings for well known people, (c) results of studies conducted in normal subjects to evaluate the lateralization of face familiarity feelings. In this last section, we separately reviewed: results obtained by means of separate presentation of familiar and unfamiliar faces to the right and left visual fields; lateralization of event-related potentials evoked by familiar vs unfamiliar faces; results of activation studies presenting familiar and unfamiliar faces. Taken together, results of this review have shown that face familiarity feelings are specifically generated by the right hemisphere. Clinical and neurophysiological data suggest that familiarity feelings: (1) are probably due to a lateralized subcortical route, allowing a first, unconscious, global recognition of familiar faces and (2) facilitate the subsequent distinction of known faces (unconsciously detected) from unfamiliar faces. Results of the review have also shown that the right frontal areas play an important role in the production or monitoring of inappropriate familiarity decisions.

Blood oxygenation level-dependent visualization of synaptic relay stations of sensory pathways along the neuroaxis in response to graded sensory stimulation of a limb

Blood oxygenation level-dependent (BOLD) functional magnetic resonance imaging (fMRI) was used to test at which levels of the neuroaxis signals are elicited when different modalities of sensory information from the limbs ascend to cortex cerebri. We applied graded electric stimuli to the rat hindlimbs and used echo-planar imaging to monitor activity changes in the lumbar spinal cord and medulla oblongata, where primary afferents of painful and nonpainful sensation synapse, respectively. BOLD signals were detected in ipsilateral lumbar spinal cord gray matter using sufficiently strong stimuli. Using stimuli well below the threshold needed for signals to be elicited in the spinal cord, we found BOLD responses in dorsal medulla oblongata. The distribution of these signals is compatible with the neuroanatomy of the respective synaptic relay stations of the corresponding sensory pathways. Hence, the sensory pathways conducting painful and nonpainful information were successfully distinguished. The fMRI signals in the spinal cord were markedly decreased by morphine, and these effects were counteracted by naloxone. We conclude that fMRI can be used as a reliable and valid method to monitor neuronal activity in the rat spinal cord and medulla oblongata in response to sensory stimuli. Previously, we also documented BOLD signals from thalamus and cortex. Thus, BOLD responses can be elicited at all principal synaptic relay stations along the neuroaxis from lumbar spinal cord to sensory cortex. Rat spinal cord fMRI should become a useful tool in experimental spinal cord injury and pain research.

Gender differences in hemispheric asymmetry for face processing

BACKGROUND

Current cognitive neuroscience models predict a right-hemispheric dominance for face processing in humans. However, neuroimaging and electromagnetic data in the literature provide conflicting evidence of a right-sided brain asymmetry for decoding the structural properties of faces. The purpose of this study was to investigate whether this inconsistency might be due to gender differences in hemispheric asymmetry.

RESULTS

In this study, event-related brain potentials (ERPs) were recorded in 40 healthy, strictly right-handed individuals (20 women and 20 men) while they observed infants' faces expressing a variety of emotions. Early face-sensitive P1 and N1 responses to neutral vs. affective expressions were measured over the occipital/temporal cortices, and the responses were analyzed according to viewer gender. Along with a strong right hemispheric dominance for men, the results showed a lack of asymmetry for face processing in the amplitude of the occipito-temporal N1 response in women to both neutral and affective faces.

CONCLUSION

Men showed an asymmetric functioning of visual cortex while decoding faces and expressions, whereas women showed a more bilateral functioning. These results indicate the importance of gender effects in the lateralization of the occipito-temporal response during the processing of face identity, structure, familiarity, or affective content.