Functional magnetic resonance imaging of human visual cortex during face matching: a comparison with positron emission tomography

Human genetics of face recognition: discovery of MCTP2 mutations in humans with face blindness (congenital prosopagnosia)

Face recognition is important for both visual and social cognition. While prosopagnosia or face blindness has been known for seven decades and face-specific neurons for half a century, the molecular genetic mechanism is not clear. Here we report results after 17 years of research with classic genetics and modern genomics. From a large family with 18 congenital prosopagnosia (CP) members with obvious difficulties in face recognition in daily life, we uncovered a fully cosegregating private mutation in the MCTP2 gene which encodes a calcium binding transmembrane protein expressed in the brain. After screening through cohorts of 6589, we found more CPs and their families, allowing detection of more CP associated mutations in MCTP2. Face recognition differences were detected between 14 carriers with the frameshift mutation S80fs in MCTP2 and 19 noncarrying volunteers. Six families including one with 10 members showed the S80fs-CP correlation. Functional magnetic resonance imaging found association of impaired recognition of individual faces by MCTP2 mutant CPs with reduced repetition suppression to repeated facial identities in the right fusiform face area. Our results have revealed genetic predisposition of MCTP2 mutations in CP, 76 years after the initial report of prosopagnosia and 47 years after the report of the first CP. This is the first time a gene required for a higher form of visual social cognition was found in humans.

Reading and listening comprehension in Cantonese-speaking people with right hemisphere versus left hemisphere brain damage

The problem in language comprehension in people with right hemisphere damage (RHD) is more equivocal than people with left hemisphere damage. This study explores the reading and listening comprehension of Cantonese-speaking individuals with RHD, left hemisphere damage, and neurotypical healthy controls using the Cantonese Computerized Revised Token Test (CRTT-Cantonese) adapted from the English CRTT. Eighteen native Cantonese-speaking individuals with RHD, 32 individuals with left hemisphere damage and aphasia (PWA), and 42 healthy controls participated in this study. All the participants completed the Cantonese Aphasia Battery, Hong Kong Oxford Cognitive Screen, the listening comprehension version of CRTT-Cantonese (CRTT-L-Cantonese), and the reading comprehension version of CRTT-Cantonese (CRTT-R-_WF-Cantonese) across different sessions. Linear mixed-effect analysis revealed significant differences among the groups in CRTT-Cantonese tests. However, there were no significant difference between CRTT-L-Cantonese and CRTT-R-_WF-Cantonese within the PWA, RHD and healthy control groups. Tukey post-hoc pairwise comparisons showed that PWA scored significantly lower than RHD and healthy control groups (p < 0.0001) in both CRTT-L-Cantonese and CRTT-R-_WF-Cantonese, and the RHD group scored significantly lower than healthy control group only on the CRTT-R-_WF-Cantonese. The results demonstrate that the CRTT-L-Cantonese and CRTT-R-_WF-Cantonese differentiate language comprehension abilities among PWA, RHD and healthy control groups. Although the current findings did not show any diversion between reading and listening comprehension in RHD group, this group showed poorer performance in reading comprehension when compared to healthy controls. The latter findings may support the view that the right hemisphere contributes to reading comprehension in Chinese.

Anatomical and neurophysiological basis of face recognition

Face recognition is a highly developed and efficient human function that involves multiple neural networks. A main pathway links the occipital cortex, where an occipital face area (OFA) has been identified, to a fusiform face area (FFA) in the fusiform gyrus, which plays a critical role in face recognition. This core pathway deals with invariant aspects of the face. Another pathway, including the superior temporal sulcus, is involved in the perception of more changeable aspects of the face such as gaze orientation, face expression and lip movements. It has been defined by some authors as a "third pathway of visual recognition", i.e. a lateral pathway in addition to the "what" and "where" pathways. It deals with sociocognitive aspects of face perception. Many other accessory functional systems are connected to the core system of visual recognition to act in concert with it: the intraparietal sulcus (for the management of spatial attention), the primary auditory cortex (prelexical perception of speech), the amygdala, the insula and the limbic system (perception of emotions), the anterior temporal pole (access to the identity of the individual, his name, biographical information), etc. Functional brain imaging has made remarkable progress in the understanding of face perception, which in the early years was limited to the description of single cases of brain-damaged patients. This progress has made it possible to better analyse the many face recognition disorders, sometimes subtle, other times confusing, observed in human pathology.

Sexual Dimorphism in Hemispheric Processing of Faces in Humans: A Meta-Analysis of 817 Cases

A well-established neuroimaging literature predicts a right-sided asymmetry in the activation of face-devoted areas such as the fusiform gyrus (FG) and its resulting M/N170 response during face processing. However, the face-related response sometimes appears to be bihemispheric. A few studies have argued that bilaterality depended on the sex composition of the sample. To shed light on this matter, two meta-analyses were conducted starting from a large initial database of 250 ERP (Event-related potentials)/MEG (Magnetoencephalography) peer-reviewed scientific articles. Paper coverage was from 1985 to 2020. Thirty-four articles met the inclusion criteria of a sufficiently large and balanced sample size with strictly right-handed and healthy participants aged 18–35 years and N170 measurements in response to neutral front view faces at left and right occipito/temporal sites. The data of 817 male (n = 414) and female (n = 403) healthy adults were subjected to repeated-measures analyses of variance. The results of statistical analyses from the data of 17 independent studies (from Asia, Europe and America) seem to robustly indicate the presence of a sex difference in the way the two cerebral hemispheres process facial information in humans, with a marked right-sided asymmetry of the bioelectrical activity in males and a bilateral or left-sided activity in females.

Identification of White Matter Networks Engaged in Object (Face) Recognition Showing Differential Responses to Modulated Stimulus Strength

Blood-oxygenation-level-dependent (BOLD) signals in magnetic resonance imaging indirectly reflect neural activity in cortex, but they are also detectable in white matter (WM). BOLD signals in WM exhibit strong correlations with those in gray matter (GM) in a resting state, but their interpretation and relationship to GM activity in a task are unclear. We performed a parametric visual object recognition task designed to modulate the BOLD signal response in GM regions engaged in higher order visual processing, and measured corresponding changes in specific WM tracts. Human faces embedded in different levels of random noise have previously been shown to produce graded changes in BOLD activation in for example, the fusiform gyrus, as well as in electrophysiological (N170) evoked potentials. The magnitudes of BOLD responses in both GM regions and selected WM tracts varied monotonically with the stimulus strength (noise level). In addition, the magnitudes and temporal profiles of signals in GM and WM regions involved in the task coupled strongly across different task parameters. These findings reveal the network of WM tracts engaged in object (face) recognition and confirm that WM BOLD signals may be directly affected by neural activity in GM regions to which they connect.

Looking at my body. Similarities and differences between anorexia nervosa patients and controls in body image visual processing

Background

Body image distortion is a core symptom of eating disorders. Functional magnetic resonance imaging (fMRI) studies on body image processing, described different patterns of neural response, mainly involving the inferior and superior parietal lobules, and the dorsolateral prefrontal cortex (DLPFC), with conflicting results.

Methods

The neural response to the view of their own body pictures (normal size and distorted) was evaluated in 18 female anorexia nervosa (AN) restricting type patients, and in 19 healthy female subjects (HC) using fMRI. Clinical assessment was performed by means of the structured clinical interview for DSM-IV and self-reported questionnaires.

Results

In response to the body image distortion, patients and controls showed an inverse pattern of activation, with the widest extent of activation in the oversize condition in AN, while in the undersize condition in HC. AN and HC showed a similar pattern of neural response to the view of their own body, with an increased activation in the extrastriate body area, superior and inferior parietal lobule and prefrontal areas, although the extent of activation in HC was more limited as compared with AN patients. Increased activity in AN patients, compared with HC, was observed in the DLPFC in response to the oversized body picture and a significant correlation was found in AN patients between DLPFC activation and eating disorder psychopathology.

Conclusions

Our findings suggest the existence of a continuum from normalcy to pathology in neural response to body image, and confirm the clinical relevance of body image distortion in AN, reinforcing the key role of attentive, executive and self-evaluation networks in AN visual processing of own distorted body image.

Universal Mechanisms and the Development of the Face Network: What You See Is What You Get

Our assignment was to review the development of the face-processing network, an assignment that carries the presupposition that a face-specific developmental program exists. We hope to cast some doubt on this assumption and instead argue that the development of face processing is guided by the same ubiquitous rules that guide the development of cortex in general.

Polygenic Risk Score for Schizophrenia and Face-Processing Network in Young Adulthood

Development of schizophrenia relates to both genetic and environmental factors. Functional deficits in many cognitive domains, including the ability to communicate in social interactions and impaired recognition of facial expressions, are common for patients with schizophrenia and might also be present in individuals at risk of developing schizophrenia. Here we explore whether an individual's polygenic risk score (PRS) for schizophrenia is associated with the degree of interregional similarities in blood oxygen level-dependent (BOLD) signal and gray matter volume of the face-processing network and whether the exposure to early adversity moderates this association. A total of 90 individuals (mean age 22 years, both functional and structural data available) were used for discovery analyses, and 211 individuals (mean age 26 years, structural data available) were used for replication of the structural findings. Both samples were drawn from the Northern Finland Birth Cohort 1986. We found that the degree of interregional similarities in BOLD signal and gray matter volume vary as a function of PRS; lowest interregional correlation (both measures) was observed in individuals with high PRS. We also replicated the gray matter volume finding. We did not find evidence for an interaction between early adversity and PRS on the interregional correlation of BOLD signal and gray matter volume. We speculate that the observed group differences in PRS-related correlations in both modalities may result from differences in the concurrent functional engagement of the face-processing regions over time, eg, via differences in exposure to social interaction with other people.

Parallel distributed networks resolved at high resolution reveal close juxtaposition of distinct regions

Examination of large-scale distributed networks within the individual reveals details of cortical network organization that are absent in group-averaged studies. One recent discovery is that a distributed transmodal network, often referred to as the “default network,” comprises two closely interdigitated networks, only one of which is coupled to posterior parahippocampal cortex. Not all studies of individuals have identified the same networks, and questions remain about the degree to which the two networks are separate, particularly within regions hypothesized to be interconnected hubs. In this study we replicate the observation of network separation across analytical (seed-based connectivity and parcellation) and data projection (volume and surface) methods in two individuals each scanned 31 times. Additionally, three individuals were examined with high-resolution (7T; 1.35 mm) functional magnetic resonance imaging to gain further insight into the anatomical details. The two networks were identified with separate regions localized to adjacent portions of the cortical ribbon, sometimes inside the same sulcus. Midline regions previously implicated as hubs revealed near complete spatial separation of the two networks, displaying a complex spatial topography in the posterior cingulate and precuneus. The network coupled to parahippocampal cortex also revealed a separate region directly within the hippocampus, at or near the subiculum. These collective results support that the default network is composed of at least two spatially juxtaposed networks. Fine spatial details and juxtapositions of the two networks can be identified within individuals at high resolution, providing insight into the network organization of association cortex and placing further constraints on interpretation of group-averaged neuroimaging data.

NEW & NOTEWORTHY Recent evidence has emerged that canonical large-scale networks such as the “default network” fractionate into parallel distributed networks when defined within individuals. This research uses high-resolution imaging to show that the networks possess juxtapositions sometimes evident inside the same sulcus and within regions that have been previously hypothesized to be network hubs. Distinct circumscribed regions of one network were also resolved in the hippocampal formation, at or near the parahippocampal cortex and subiculum.

Emotional context restores cortical prediction error responses in schizophrenia

The mismatch negativity (MMN) deficit in schizophrenia is a consistently replicated finding and is considered a potential biomarker. From the cognitive neuroscience perspective, MMN represents a cortical correlate of the prediction error, a fundamental computational operator that may be at the core of various cognitive and clinical deficits observed in schizophrenia. The impact of emotion on cognitive processes in schizophrenia is insufficiently understood, and its impact on basic operators of cortical computation is largely unknown. In the visual domain, the facial expression mismatch negativity (EMMN) offers an opportunity to investigate basic computational operators in purely cognitive and in emotional contexts. In this study, we asked whether emotional context enhances cortical prediction error responses in patients with schizophrenia, as is the case in normal subjects. Therefore, seventeen patients with schizophrenia and eighteen controls completed a visual sequence oddball task, which allows for directly comparing MMN components evoked by deviants with high, intermediate and low emotional engagement. Interestingly, patients with schizophrenia showed pronounced deficits in response to neutral stimuli, but almost normal responses to emotional stimuli. The dissociation between impaired MMN and normal EMMN suggests that emotional context not only enhances, but restores cortical prediction error responses in patients with schizophrenia to near-normal levels. Our results show that emotional processing in schizophrenia is not necessarily defect; more likely, emotional processing heterogeneously impacts on cognition in schizophrenia. In fact, this study suggests that emotional context may even compensate for cognitive deficits in schizophrenia that are, in a different sensory domain, discussed as biomarkers.

Dissociable meta-analytic brain networks contribute to coordinated emotional processing

Meta-analytic techniques for mining the neuroimaging literature continue to exert an impact on our conceptualization of functional brain networks contributing to human emotion and cognition. Traditional theories regarding the neurobiological substrates contributing to affective processing are shifting from regional- towards more network-based heuristic frameworks. To elucidate differential brain network involvement linked to distinct aspects of emotion processing, we applied an emergent meta-analytic clustering approach to the extensive body of affective neuroimaging results archived in the BrainMap database. Specifically, we performed hierarchical clustering on the modeled activation maps from 1,747 experiments in the affective processing domain, resulting in five meta-analytic groupings of experiments demonstrating whole-brain recruitment. Behavioral inference analyses conducted for each of these groupings suggested dissociable networks supporting: (1) visual perception within primary and associative visual cortices, (2) auditory perception within primary auditory cortices, (3) attention to emotionally salient information within insular, anterior cingulate, and subcortical regions, (4) appraisal and prediction of emotional events within medial prefrontal and posterior cingulate cortices, and (5) induction of emotional responses within amygdala and fusiform gyri. These meta-analytic outcomes are consistent with a contemporary psychological model of affective processing in which emotionally salient information from perceived stimuli are integrated with previous experiences to engender a subjective affective response. This study highlights the utility of using emergent meta-analytic methods to inform and extend psychological theories and suggests that emotions are manifest as the eventual consequence of interactions between large-scale brain networks.

Gender Differences in Neural Responses to Perceptually Invisible Fearful Face-An ERP Study

Women tend to respond to emotional stimuli differently from men. This study aimed at investigating whether neural responses to perceptually “invisible” emotional stimuli differ between men and women by exploiting event-related potential (ERP). Forty healthy participants (21 women) were recruited for the main experiment. A control experiment was conducted by excluding nine (7 women) participants from the main experiment and replacing them with additional ten (6 women) participants (total 41 participants) where Beck's Anxiety Inventory (BAI) and Beck's Depression Inventory (BDI) scores were controlled. Using the visual backward masking paradigm, either a fearful or a neutral face stimulus was presented in varied durations (subthreshold, near-threshold, or suprathreshold) followed by a mask. Participants performed a two-alternative forced choice (2-AFC) emotion discrimination task on each face. Behavioral analysis showed that participants were unaware of masked stimuli of which duration was the shortest and, therefore, processed at subthreshold. Nevertheless, women showed significantly larger response in P100 amplitude to subthreshold fearful faces than men. This result remained consistent in the control experiment. Our findings indicate gender-differences in neural response to subthreshold emotional face, which is reflected in the early processing stage.

A method to establish the spatiotemporal evolution of task-related cortical activity from electrocorticographic signals in single trials

BACKGROUND

Progress in neuroscience depends substantially on the ability to establish the detailed spatial and temporal sequence of neuronal population-level activity across large areas of the brain. Because there is substantial inter-trial variability in neuronal activity, traditional techniques that rely on signal averaging obscure where and when neuronal activity occurs. Thus, up to the present, it has been difficult to examine the detailed progression of neuronal activity across large areas of the brain.

NEW METHOD

Here we describe a method for establishing the spatiotemporal evolution of neuronal population-level activity across large brain regions by determining exactly where and when neural activity occurs during a behavioral task in individual trials. We validate the efficacy of the method, examine the effects of its parameterization, and demonstrate its utility by highlighting two sets of results that could not readily be achieved with traditional methods.

RESULTS

Our results reveal the precise spatiotemporal evolution of neuronal population activity that unfolds during a sensorimotor task in individual trials, and establishes the relationship between neuronal oscillations and the onset of this activity.

CONCLUSIONS

The ability to identify the spatiotemporal evolution of neuronal population activity onsets in single trials gives investigators a powerful new tool with which to study large-scale cortical processes.

Long-Term Response to Cholinesterase Inhibitor Treatment Is Related to Functional MRI Response in Alzheimer's Disease

BACKGROUND

Treatment of Alzheimer's disease (AD) with cholinesterase inhibitors (ChEI) enhances cholinergic activity and alleviates clinical symptoms. However, there is variation in the clinical response as well as system level changes revealed by functional MRI (fMRI) studies.

METHODS

We investigated 18 newly diagnosed mild AD patients with fMRI using a face recognition task after a single oral dose of rivastigmine, a single dose of placebo and 1-month treatment with rivastigmine. The clinical follow-up took place at 6 and 12 months.

RESULTS

MMSE score difference between baseline and the follow-ups showed a positive correlation with fMRI activation difference between treatment and placebo in the right prefrontal cortex. A negative correlation was found for the left prefrontal cortex and the left fusiform gyrus. In addition, greater signal intensity in the right versus the left fusiform gyrus predicted a response to ChEI with increasing MMSE scores during the follow-up with 77.8% sensitivity and 77.8% specificity.

CONCLUSIONS

The increased fMRI activation by cholinergic stimulation in brain areas associated with the processing of the visual task reveals still functioning brain networks and a subsequent positive effect of ChEI on cognition. Thus, fMRI may be useful for identifying AD patients most likely to respond to treatment with ChEI.

Neural architecture underlying classification of face perception paradigms

We present a novel strategy for deriving a classification system of functional neuroimaging paradigms that relies on hierarchical clustering of experiments archived in the BrainMap database. The goal of our proof-of-concept application was to examine the underlying neural architecture of the face perception literature from a meta-analytic perspective, as these studies include a wide range of tasks. Task-based results exhibiting similar activation patterns were grouped as similar, while tasks activating different brain networks were classified as functionally distinct. We identified four sub-classes of face tasks: (1) Visuospatial Attention and Visuomotor Coordination to Faces, (2) Perception and Recognition of Faces, (3) Social Processing and Episodic Recall of Faces, and (4) Face Naming and Lexical Retrieval. Interpretation of these sub-classes supports an extension of a well-known model of face perception to include a core system for visual analysis and extended systems for personal information, emotion, and salience processing. Overall, these results demonstrate that a large-scale data mining approach can inform the evolution of theoretical cognitive models by probing the range of behavioral manipulations across experimental tasks.

Emotional context facilitates cortical prediction error responses

In the predictive coding framework, mismatch negativity (MMN) is regarded a correlate of the prediction error that occurs when top-down predictions conflict with bottom-up sensory inputs. Expression-related MMN is a relatively novel construct thought to reflect a prediction error specific to emotional processing, which, however, has not yet been tested directly. Our paradigm includes both neutral and emotional deviants, thereby allowing for investigating whether expression-related MMN is emotion-specific or unspecifically arises from violations of a given sequence. Twenty healthy participants completed a visual sequence oddball task where they were presented with (1) sequence deviants, (2) emotional sequence deviants, and (3) emotional deviants. Mismatch components were assessed at ventral occipitotemporal scalp sites and analyzed regarding their amplitudes, spatiotemporal profiles, and neuronal sources. Expression-related MMN could be clearly separated from its neutral counterpart in all investigated aspects. Specifically, expression-related MMN showed enhanced amplitude, shorter latency, and different neuronal sources. Our results, therefore, provide converging evidence for a quantitative specificity of expression-related MMN and seems to provide an opportunity to study prediction error during preattentive emotional processing. Our neurophysiological evidence ultimately suggests that a basic cognitive operator, the prediction error, is enhanced at the cortical level by processing of emotionally salient stimuli.

Functional mapping of dynamic happy and fearful facial expressions in young adults with familial risk for psychosis - Oulu Brain and Mind Study

BACKGROUND

Social interaction requires mirroring to other people's mental state. Psychotic disorders have been connected to social interaction and emotion recognition impairment. We compared the brain activity between young adults with familial risk for psychosis (FR) and matched controls during visual exposure to emotional facial expression. We also investigated the role of the amygdala, the key region for social interaction and emotion recognition.

METHODS

51 FR and 52 control subjects were drawn from the Northern Finland 1986 Birth Cohort (Oulu Brain and Mind Study). None of the included participants had developed psychosis. The FR group was defined as having a parent with psychotic disorder according to the Finnish Hospital Discharge Register. Participants underwent functional MRI (fMRI) using visual presentation of dynamic happy and fearful facial expressions. FMRI data were processed to produce maps of activation for happy and fearful facial expression, which were then compared between groups. Two spherical regions of interest (ROIs) in the amygdala were set to extract BOLD responses during happy and fearful facial expression. BOLD responses were then compared with subjects' emotion recognition, which was assessed after fMRI. Psychophysiological interaction (PPI) for the left and right amygdala during happy and fearful facial expression was conducted using the amygdala as seed regions.

RESULTS

FR subjects had increased activity in the left premotor cortex and reduced deactivation of medial prefrontal cortex structures during happy facial expression. There were no between-group differences during fearful facial expression. The FR group also showed a statistically significant linear correlation between mean amygdala BOLD response and facial expression recognition. PPI showed that there was a significant negative interaction between the amygdala and the dorsolateral prefrontal cortex (dlPFC) and superior temporal gyrus in FR subjects.

CONCLUSIONS

Increased activations by positive valence in FR were in brain regions crucial to emotion recognition and social interaction. Increased activation of the premotor cortex may serve as a compensatory mechanism as FR subjects may have to exert more effort on processing the stimuli, as has been found earlier in schizophrenia. Failure to deactivate PFC structures may imply error in the default mode network. Abnormal PFC function in FR was also suggested by PPI, as the dlPFC showed decreased functional connectivity with the amygdala in the FR group. This may indicate that in FR subjects the amygdala have to take a greater role in emotion recognition and social functioning. This inference was supported by our discovery of statistically significant correlations between the amygdala BOLD response and emotion recognition in the FR group but not in controls.

Disturbed spatial cognitive processing of body-related stimuli in a case of a lesion to the right fusiform gyrus

The fusiform gyrus (FG) is well known as one of the main neural sites of human face and body processing. We report the case of a young male patient with epilepsy and a circumscribed lesion in the right FG who presented with isolated impairments in spatial cognitive processing of body-related stimuli. However, he did not show any clinical signs of prosopagnosia. In particular, handling/processing of body and face stimuli was impaired, when stimuli were presented in unconventional views and orientations, thus requiring additional spatial cognitive operations. In this case study, we discuss the patient's selective impairment from the view of current empirical and theoretical work on the segregation of functions in the FG.

Different hemispheric roles in recognition of happy expressions

The emotional expression of the face provides an important social signal that allows humans to make inferences about other people's state of mind. However, the underlying brain mechanisms are complex and still not completely understood. Using magnetoencephalography (MEG), we analyzed the spatiotemporal structure of regional electrical brain activity in human adults during a categorization task (faces or hands) and an emotion discrimination task (happy faces or neutral faces). Brain regions that are specifically important for different aspects of processing emotional facial expressions showed interesting hemispheric dominance patterns. The dorsal brain regions showed a right predominance when participants paid attention to facial expressions: The right parietofrontal regions, including the somatosensory, motor/premotor, and inferior frontal cortices showed significantly increased activation in the emotion discrimination task, compared to in the categorization task, in latencies of 350 to 550 ms, while no activation was found in their left hemispheric counterparts. Furthermore, a left predominance of the ventral brain regions was shown for happy faces, compared to neutral faces, in latencies of 350 to 550 ms within the emotion discrimination task. Thus, the present data suggest that the right and left hemispheres play different roles in the recognition of facial expressions depending on cognitive context.

Two faces, two languages: an fMRI study of bilingual picture naming

This fMRI study explores how nonlinguistic cues modulate lexical activation in the bilingual brain. We examined the influence of face race on bilingual language production in a picture-naming paradigm. Chinese-English bilinguals were presented with pictures of objects and images of faces (Asian or Caucasian). Participants named the picture in their first or second language (Chinese or English) in separate blocks. Face race and naming language were either congruent (e.g., naming in Chinese when seeing an Asian face) or incongruent (e.g., naming in English when seeing an Asian face). Our results revealed that face cues facilitate naming when the socio-cultural identity of the face is congruent with the naming language. The congruence effects are reflected as effective integration of lexical and facial cues in key brain regions including IFG, MFG, ACC, and caudate. Implications of the findings in light of theories of language processing and cultural priming are discussed.

Attentional orienting and response inhibition: insights from spatial-temporal neuroimaging

Attentional orienting and response inhibition have largely been studied separately. Each has yielded important findings, but controversy remains concerning whether they share any neurocognitive processes. These conflicting findings may originate from two issues: (1) at the cognitive level, attentional orienting and response inhibition are typically studied in isolation; and (2) at the technological level, a single neuroimaging method is typically used to study these processes. This article reviews recent achievements in both spatial and temporal neuroimaging, emphasizing the relationship between attentional orienting and response inhibition. We suggest that coordinated engagement, both top-down and bottom-up, serves as a common neural mechanism underlying these two cognitive processes. In addition, the right ventrolateral prefrontal cortex may play a major role in their harmonious operation.

A continuous semantic space describes the representation of thousands of object and action categories across the human brain

Humans can see and name thousands of distinct object and action categories, so it is unlikely that each category is represented in a distinct brain area. A more efficient scheme would be to represent categories as locations in a continuous semantic space mapped smoothly across the cortical surface. To search for such a space, we used fMRI to measure human brain activity evoked by natural movies. We then used voxelwise models to examine the cortical representation of 1,705 object and action categories. The first few dimensions of the underlying semantic space were recovered from the fit models by principal components analysis. Projection of the recovered semantic space onto cortical flat maps shows that semantic selectivity is organized into smooth gradients that cover much of visual and nonvisual cortex. Furthermore, both the recovered semantic space and the cortical organization of the space are shared across different individuals.

Age-related changes in the neural correlates of degraded and nondegraded face processing

In order to explore the neural correlates of age-related changes in visual perception of faces, positron emission tomographic scans were obtained on young and old adults while they were engaged in tasks of nondegraded and degraded face matching. Old adults were less accurate than were young adults across all face matching conditions, although the age difference was greatly reduced when degraded performance was adjusted for nondegraded performance. The interaction of age and degree of degradation on performance measures was not significant. Brain activity patterns during nondegraded face matching were similar in the two groups with some differences in parietal and prestriate cortices (greater activity in young adults) and in prefrontal cortex, thalamus, and hippocampus (greater activity in old adults). Increases in activity related to increasing degradation of the faces were seen mainly in prefrontal cortices in both age groups. Despite this similarity in the brain response to face degradation, there were striking differences between groups in the correlations between brain activity and degraded task performance. Different regions of extrastriate cortex were positively correlated with behavioural measures in the two groups (fusiform gyrus in the young adults and posterior occipital regions in old adults). In addition two areas where older adults showed greater activity during nondegraded face matching, thalamus and hippocampus, also showed positive correlations with behaviour during the degraded tasks in this group, but not in the young group. Thus, although the elderly are not more vulnerable to the effects of increasing face degradation, the brain systems involved in carrying out these visual discriminations in young and old adults are not the same. These results are consistent with the idea of functional plasticity in face processing over the life span.

Localised face processing by the human prefrontal cortex: stimulation-evoked hallucinations of faces

Left and right prefrontal, premotor, and anterior temporal sites were stereotaxically implanted in order to direct surgical therapy for epilepsy. Direct electrical stimulation of the right anterior inferior frontal gyrus resulted in face-related hallucinations and illusions. When the patient was viewing a blank background, stimulation induced the experience of a rapid succession of faces. When the patient was viewing a real face, stimulation induced a series of modifications to that face. Effective stimulations induced afterdischarges that remained localised to right ventrolateral prefrontal cortex (VLPFC). Stimulation of other frontal and anterior temporal sites, bilaterally, induced no face-related hallucinations or illusions. This result supports a contribution of right VLPFC to face processing, and is consistent with models wherein it activates representations in working or declarative memories.

Is face recognition not so unique after all?

In monkeys, a number of different neocortical as well as limbic structures have cell populations that respond preferentially to face stimuli. Face selectivity is also differentiated within itself: Cells in the inferior temporal and prefrontal cortex tend to respond to facial identity, others in the upper bank of the superior temporal sulcus to gaze directions, and yet another population in the amygdala to facial expression. The great majority of these cells are sensitive to the entire configuration of a face. Changing the spatial arrangement of the facial features greatly diminishes the neurons' response. It would appear, then, that an entire neural network for faces exists which contains units highly selective to complex configurations and that respond to different aspects of the object "face." Given the vital importance of face recognition in primates, this may not come as a surprise. But are faces the only objects represented in this way? Behavioural work in humans suggests that nonface objects may be processed like faces if subjects are required to discriminate between visually similar exemplars and acquire sufficient expertise in doing so. Recent neuroimaging studies in humans indicate that level of categorisation and expertise interact to produce the specialisation for faces in the middle fusiform gyrus. Here we discuss some new evidence in the monkey suggesting that any arbitrary homogeneous class of artificial objects-which the animal has to individually learn, remember, and recognise again and again from among a large number of distractors sharing a number of common features with the target-can induce configurational selectivity in the response of neurons in the visual system. For all of the animals tested, the neurons from which we recorded were located in the anterior inferotemporal cortex. However, as we have only recorded from the posterior and anterior ventrolateral temporal lobe, other cells with a similar selectivity for the same objects may also exist in areas of the medial temporal lobe or in the limbic structures of the same "expert" monkeys. It seems that the encoding scheme used for faces may also be employed for other classes with similar properties. Thus, regarding their neural encoding, faces are not "special" but rather the "default special" class in the primate recognition system.

Development of orthogonal task designs in fMRI studies of higher cognition: the NIMH experience

This paper chronicles one researcher's journey at the National Institute of Mental Health, exploring ways to understand the neural systems responsible for the cognitive sub-processes of working memory tasks. Both the opportunities and the pitfalls with applying the idea of cognitive subtraction to neuroimaging data were well-known from studies using positron emission tomography. We took advantage of the improved temporal resolution of fMRI with a delayed-recognition task and identified the time-courses of the different stages of the task (encoding, memory delay, and recognition test) as predictor variables in a multiple regression analysis. Because these signals were temporally independent, individual components of tasks could be contrasted with one another, rather than entire tasks, reducing the problem of violations of pure insertion in cognitive subtraction. This approach enabled us to draw more detailed conclusions about the neural systems of higher cognition and the organization of prefrontal cortex than had been possible before fMRI. Further enhancements and innovations over the last 20 years by a multitude of researchers across the field have greatly expanded this knowledge, but this approach called "orthogonal task design" has remained a fundamental component of many of these modern studies.

Medial frontal hyperactivity to sad faces in generalized social anxiety disorder and modulation by oxytocin

Generalized social anxiety disorder (GSAD) is associated with heightened limbic and prefrontal activation to negative social cues conveying threat (e.g. fearful faces), but less is known about brain response to negative non-threatening social stimuli. The neuropeptide oxytocin (Oxt) has been shown to attenuate (and normalize) fear-related brain activation and reactivity to emotionally negative cues. Here, we examined the effects of intranasal Oxt on cortical activation to non-threatening sad faces in patients with GSAD and matched controls (Con). In a double-blind placebo-controlled within-subjects design, the cortical activation to sad and happy (vs. neutral) faces was examined using functional magnetic resonance imaging following acute intranasal administration of 24 IU Oxt and placebo. Relative to the Con group, GSAD patients exhibited heightened activity to sad faces in the medial prefrontal cortex (mPFC/BA 10) extending into anterior cingulate cortex (ACC/BA 32). Oxt significantly reduced this heightened activation in the mPFC/ACC regions to levels similar to that of controls. These findings suggest that GSAD is associated with cortical hyperactivity to non-threatening negative but not positive social cues and that Oxt attenuates this exaggerated cortical activity. The modulation of cortical activity by Oxt highlights a broader mechanistic role of this neuropeptide in modulating socially negative cues in GSAD.

Cytoarchitectonical analysis and probabilistic mapping of two extrastriate areas of the human posterior fusiform gyrus

The human extrastriate visual cortex comprises numerous functionally defined areas, which are not identified in the widely used cytoarchitectonical map of Brodmann. The ventral part of the extrastriate cortex is particularly devoted to the identification of visual objects, faces and word forms. We analyzed the region immediately antero-lateral to hOc4v in serially sectioned (20 μm) and cell body-stained human brains using a quantitative observer-independent cytoarchitectonical approach to further identify the anatomical organization of the extrastriate cortex. Two novel cytoarchitectonical areas, FG1 and FG2, were identified on the posterior fusiform gyrus. The results of ten postmortem brains were then registered to their MRI volumes (acquired before histological processing), 3D reconstructed, and spatially normalized to the Montreal Neurological Institute reference brain. Finally, probabilistic maps were generated for each cytoarchitectonical area by superimposing the areas of the individual brains in the reference space. Comparison with recent functional imaging studies yielded that both areas are located within the object-related visual cortex. FG1 fills the gap between the retinotopically mapped area VO-1 and a posterior fusiform face patch. FG2 is probably the correlate of this face patch.

Probing principles of large-scale object representation: category preference and location encoding

Knowledge about the principles that govern large-scale neural representations of objects is central to a systematic understanding of object recognition. We used functional magnetic resonance imaging (fMRI) and multivariate pattern classification to investigate two such candidate principles: category preference and location encoding. The former designates the preferential activation of distinct cortical regions by a specific category of objects. The latter refers to information about where in the visual field a particular object is located. Participants viewed exemplars of three object categories (faces, bodies, and scenes) that were presented left or right of fixation. The analysis of fMRI activation patterns revealed the following. Category-selective regions retained their preference to the same categories in a manner tolerant to changes in object location. However, category preference was not absolute: category-selective regions also contained location-tolerant information about nonpreferred categories. Furthermore, location information was present throughout high-level ventral visual cortex and was distributed systematically across the cortical surface. We found more location information in lateral-occipital cortex than in ventral-temporal cortex. Our results provide a systematic account of the extent to which the principles of category preference and location encoding determine the representation of objects in the high-level ventral visual cortex.

TDCS guided using fMRI significantly accelerates learning to identify concealed objects

The accurate identification of obscured and concealed objects in complex environments was an important skill required for survival during human evolution, and is required today for many forms of expertise. Here we used transcranial direct current stimulation (tDCS) guided using neuroimaging to increase learning rate in a novel, minimally guided discovery-learning paradigm. Ninety-six subjects identified threat-related objects concealed in naturalistic virtual surroundings used in real-world training. A variety of brain networks were found using functional magnetic resonance imaging (fMRI) data collected at different stages of learning, with two of these networks focused in right inferior frontal and right parietal cortex. Anodal 2.0 mA tDCS performed for 30 min over these regions in a series of single-blind, randomized studies resulted in significant improvements in learning and performance compared with 0.1 mA tDCS. This difference in performance increased to a factor of two after a one-hour delay. A dose-response effect of current strength on learning was also found. Taken together, these brain imaging and stimulation studies suggest that right frontal and parietal cortex are involved in learning to identify concealed objects in naturalistic surroundings. Furthermore, they suggest that the application of anodal tDCS over these regions can greatly increase learning, resulting in one of the largest effects on learning yet reported. The methods developed here may be useful to decrease the time required to attain expertise in a variety of settings.

A short-lived face alert during inhibition of return

In the present study, we explored the role of faces in oculomotor inhibition of return (IOR) using a tightly controlled spatial cuing paradigm. We measured saccadic response latency to targets following peripheral cues that were either faces or objects of lesser sociobiological salience. A recurring influence from cue content was observed across numerous methodological variations. Faces versus other object cues briefly reduced saccade latencies toward subsequently presented targets, independently of attentional allocation and IOR. The results suggest a short-lived priming effect or social facilitation effect from the mere presence of a face. In the present study, we further showed that saccadic responses were unaffected by face versus nonface objects in double-cue presentations. Our findings indicate that peripheral face cues do not influence attentional orienting processes involved in IOR any differently from other objects in a tightly controlled oculomotor IOR paradigm.

Neural representations of faces and limbs neighbor in human high-level visual cortex: evidence for a new organization principle

Neurophysiology and optical imaging studies in monkeys and functional magnetic resonance imaging (fMRI) studies in both monkeys and humans have localized clustered neural responses in inferotemporal cortex selective for images of biologically relevant categories, such as faces and limbs. Using higher resolution (1.5 mm voxels) fMRI scanning methods than past studies (3-5 mm voxels), we recently reported a network of multiple face- and limb-selective regions that neighbor one another in human ventral temporal cortex (Weiner and Grill-Spector, Neuroimage, 52(4):1559-1573, 2010) and lateral occipitotemporal cortex (Weiner and Grill-Spector, Neuroimage, 56(4):2183-2199, 2011). Here, we expand on three basic organization principles of high-level visual cortex revealed by these findings: (1) consistency in the anatomical location of functional regions, (2) preserved spatial relationship among functional regions, and (3) a topographic organization of face- and limb-selective regions in adjacent and alternating clusters. We highlight the implications of this structure in comparing functional brain organization between typical and atypical populations. We conclude with a new model of high-level visual cortex consisting of ventral, lateral, and dorsal components, where multimodal processing related to vision, action, haptics, and language converges in the lateral pathway.

An intracranial event-related potential study on transformational apparent motion. Does its neural processing differ from real motion?

How the brain processes visual stimuli has been extensively studied using scalp surface electrodes and magnetic resonance imaging. Using these and other methods, complex gratings have been shown to activate the ventral visual stream, whereas moving stimuli preferentially activate the dorsal stream. In the current study, a first experiment assessed brain activations evoked by complex gratings using intracranial electroencephalography in 10 epileptic patients implanted with subdural electrodes. These stimuli of intermediate levels of complexity were presented in such a way that transformational apparent motion (TAM) was perceived. Responses from both the ventral and the dorsal pathways were obtained. The response characteristics of visual area 4 and the fusiform cortex were of similar amplitudes, suggesting that both ventral areas are recruited for the processing of complex gratings. On the other hand, TAM-induced responses of dorsal pathway areas were relatively noisier and of lower amplitudes, suggesting that TAM does not activate motion-specific structures to the same extent as does real motion. To test this hypothesis, we examined the activity evoked by TAM in comparison to the one produced by real motion in a patient implanted with the same subdural electrodes. Findings demonstrated that neural response to real motion was much stronger than that evoked by TAM, in both the primary visual cortex (V1) and other motion-sensitive areas within the dorsal pathway. These results support the conclusion that apparent motion, even if perceptually similar to real motion, is not processed in a similar manner.

Unintentional temporal context-based prediction of emotional faces: an electrophysiological study

The ability to extract sequential regularities embedded in the temporal context or temporal structure of sensory events and to predict upcoming events based on the extracted sequential regularities plays a central role in human cognition. In the present study, we demonstrate that, without any intention, upcoming emotional faces can be predicted based on sequential regularities, by showing that prediction error responses as reflected by visual mismatch negativity (MMN), an event-related brain potential (ERP) component, were evoked in response to emotional faces that violated a regular alternation pattern of 2 emotional faces (fearful and happy faces) under a situation where the emotional faces themselves were unrelated to the participant's task. Face-inversion and negative-bias effects in the visual MMN further indicated the involvement of holistic face representations. In addition, through successive source analyses of the visual MMN, it was revealed that the prediction error responses were composed of activations mainly in the face-responsible visual extrastriate areas and the prefrontal areas. The present results provide primary evidence for the existence of the unintentional temporal context-based prediction of biologically relevant visual stimuli as well as empirical support for the major engagement of the visual and prefrontal areas in unintentional temporal context-based prediction in vision.

Individual differences in neural activity during a facial expression vs. identity working memory task

Facial expressions of emotion constitute a critical portion of our non-verbal social interactions. In addition, the identity of the individual displaying this expression is critical to these interactions as they embody the context in which these expressions will be interpreted. To identify any overlapping and/or unique brain circuitry involved in the processing of these two information streams in a laboratory setting, participants performed a working memory (WM) task (i.e., n-back) in which they were instructed to monitor either the expression (EMO) or the identity (ID) of the same set of face stimuli. Consistent with previous work, during both the EMO and ID tasks, we found a significant increase in activity in dorsolateral prefrontal cortex (DLPFC) supporting its generalized role in WM. Further, individuals that showed greater DLPFC activity during both tasks also showed increased amygdala activity during the EMO task and increased lateral fusiform gyrus activity during the ID task. Importantly, the level of activity in these regions significantly correlated with performance on the respective tasks. These findings provide support for two separate neural circuitries, both involving the DLPFC, supporting working memory for the faces and expressions of others.

Face activated neurodynamic cortical networks

Previous neuroimaging studies have shown that complex visual stimuli, such as faces, activate multiple brain regions, yet little is known on the dynamics and complexity of the activated cortical networks during the entire measurable evoked response. In this study, we used simulated and face-evoked empirical MEG data from an oddball study to investigate the feasibility of accurate, efficient, and reliable spatio-temporal tracking of cortical pathways over prolonged time intervals. We applied a data-driven, semiautomated approach to spatio-temporal source localization with no prior assumptions on active cortical regions to explore non-invasively face-processing dynamics and their modulation by task. Simulations demonstrated that the use of multi-start downhill simplex and data-driven selections of time intervals submitted to the Calibrated Start Spatio-Temporal (CSST) algorithm resulted in improved accuracy of the source localization and the estimation of the onset of their activity. Locations and dynamics of the identified sources indicated a distributed cortical network involved in face processing whose complexity was task dependent. This MEG study provided the first non-invasive demonstration, agreeing with intracranial recordings, of an early onset of the activity in the fusiform face gyrus (FFG), and that frontal activation preceded parietal for responses elicited by target faces.

Individuating faces and common objects produces equal responses in putative face-processing areas in the ventral occipitotemporal cortex

Controversy surrounds the proposal that specific human cortical regions in the ventral occipitotemporal cortex, commonly called the fusiform face area (FFA) and occipital face area (OFA), are specialized for face processing. Here, we present findings from an fMRI study of identity discrimination of faces and objects that demonstrates the FFA and OFA are equally responsive to processing stimuli at the level of individuals (i.e., individuation), be they human faces or non-face objects. The FFA and OFA were defined via a passive viewing task as regions that produced greater activation to faces relative to non-face stimuli within the middle fusiform gyrus and inferior occipital gyrus. In the individuation task, participants judged whether sequentially presented images of faces, diverse objects, or wristwatches depicted the identical or a different exemplar. All three stimulus types produced equivalent BOLD activation within the FFA and OFA; that is, there was no face-specific or face-preferential processing. Critically, individuation processing did not eliminate an object superiority effect relative to faces within a region more closely linked to object processing in the lateral occipital complex (LOC), suggesting that individuation processes are reasonably specific to the FFA and OFA. Taken together, these findings challenge the prevailing view that the FFA and OFA are face-specific processing regions, demonstrating instead that they function to individuate - i.e., identify specific individuals - within a category. These findings have significant implications for understanding the function of brain regions widely believed to play an important role in social cognition.

Controlled scanpath variation alters fusiform face activation

We investigated the influence of experimentally guided saccades and fixations on fMRI activation in brain regions specialized for face and object processing. Subjects viewed a static image of a face while a small fixation cross made a discrete jump within the image every 500 ms. Subjects were required to make a saccade and fixate the cross at its new location. Each run consisted of alternating blocks in which the subject was guided to make a series of saccades and fixations that constituted either a Typical or an Atypical face scanpath. Typical scanpaths were defined as a scanpath in which the fixation cross landed on the eyes or the mouth in 90% of all trials. Atypical scanpaths were defined as scanpaths in which the fixation cross landed on the eyes or mouth on 12% of all trials. The average saccade length was identical in both typical and atypical blocks, and both were preceded by a baseline block where the fixation cross made much smaller jumps in the middle of the screen. Within the functionally predefined face area of the ventral occipitotemporal cortex (VOTC), typical scanpaths evoked significantly more activity when compared to atypical scanpaths. A voxel-based analysis revealed a similar pattern in clusters of voxels located within VOTC, frontal eye fields, superior colliculi, intraparietal sulcus, and inferior frontal gyrus. These results demonstrate that fMRI activation is highly sensitive to the pattern of eye movements employed during face processing, and thus illustrates the potential confounding influence of uncontrolled eye movements for neuroimaging studies of face and object perception in normal and clinical populations.

Individual Differences in Face Cognition: Brain–Behavior Relationships

Individual differences in perceiving, learning, and recognizing faces, summarized under the term face cognition, have been shown on the behavioral and brain level, but connections between these levels have rarely been made. We used ERPs in structural equation models to determine the contributions of neurocognitive processes to individual differences in the accuracy and speed of face cognition as established by Wilhelm, Herzmann, Kunina, Danthiir, Schacht, and Sommer [Individual differences in face cognition, in press]. For 85 participants, we measured several ERP components and, in independent tasks and sessions, assessed face cognition abilities and other cognitive abilities, including immediate and delayed memory, mental speed, general cognitive ability, and object cognition. Individual differences in face cognition were unrelated to domain-general visual processes (P100) and to processes involved with memory encoding (Dm component). The ability of face cognition accuracy was moderately related to neurocognitive indicators of structural face encoding (latency of the N170) and of activating representations of both faces and person-related knowledge (latencies and amplitudes of the early and late repetition effects, ERE/N250 and LRE/N400, respectively). The ability of face cognition speed was moderately related to the amplitudes of the ERE and LRE. Thus, a substantial part of individual differences in face cognition is explained by the speed and efficiency of activating memory representations of faces and person-related knowledge. These relationships are not moderated by individual differences in established cognitive abilities.

Coordinate-based activation likelihood estimation meta-analysis of neuroimaging data: a random-effects approach based on empirical estimates of spatial uncertainty

A widely used technique for coordinate-based meta-analyses of neuroimaging data is activation likelihood estimation (ALE). ALE assesses the overlap between foci based on modeling them as probability distributions centered at the respective coordinates. In this Human Brain Project/Neuroinformatics research, the authors present a revised ALE algorithm addressing drawbacks associated with former implementations. The first change pertains to the size of the probability distributions, which had to be specified by the used. To provide a more principled solution, the authors analyzed fMRI data of 21 subjects, each normalized into MNI space using nine different approaches. This analysis provided quantitative estimates of between-subject and between-template variability for 16 functionally defined regions, which were then used to explicitly model the spatial uncertainty associated with each reported coordinate. Secondly, instead of testing for an above-chance clustering between foci, the revised algorithm assesses above-chance clustering between experiments. The spatial relationship between foci in a given experiment is now assumed to be fixed and ALE results are assessed against a null-distribution of random spatial association between experiments. Critically, this modification entails a change from fixed- to random-effects inference in ALE analysis allowing generalization of the results to the entire population of studies analyzed. By comparative analysis of real and simulated data, the authors showed that the revised ALE-algorithm overcomes conceptual problems of former meta-analyses and increases the specificity of the ensuing results without loosing the sensitivity of the original approach. It may thus provide a methodologically improved tool for coordinate-based meta-analyses on functional imaging data.

Developmental continuity and change in responses to social and nonsocial categories in human extrastriate visual cortex

It is well known that adult human extrastriate visual cortex contains areas that respond in a selective fashion to specific categories of visual stimuli. Three regions have been identified with particular regularity: the fusiform face area (FFA), which responds to faces more than to other objects; the parahippocampal place area (PPA), which responds selectively to images of houses, places, and visual scenes; and the extrastriate body area (EBA), which responds specifically to images of bodies and body parts. While the presence of these regions in the mature human brain is well-established, the degree to which children possess these areas and the degree of functional specialization of these areas in children of various ages has thus far remained unclear. This functional magnetic resonance imaging study examined the development of the FFA, EBA, and PPA in healthy, typically developing 7- to 11-year-old children and adults. Our results revealed a right FFA and a bilateral EBA and PPA in the children that were localized in a way consistent with these same regions in adults. In addition, the response profiles of these regions were very similar in adults and children with comparable levels of functional specificity at all of the ages tested. We discuss the implications of this research for understanding abnormal regional specialization for social and nonsocial object categories in individuals with autism spectrum disorders.