Neural structures associated with recognition of facial expressions of basic emotions

Drug addiction and its underlying neurobiological basis: neuroimaging evidence for the involvement of the frontal cortex

OBJECTIVE

Studies of the neurobiological processes underlying drug addiction primarily have focused on limbic subcortical structures. Here the authors evaluated the role of frontal cortical structures in drug addiction.

METHOD

An integrated model of drug addiction that encompasses intoxication, bingeing, withdrawal, and craving is proposed. This model and findings from neuroimaging studies on the behavioral, cognitive, and emotional processes that are at the core of drug addiction were used to analyze the involvement of frontal structures in drug addiction.

RESULTS

The orbitofrontal cortex and the anterior cingulate gyrus, which are regions neuroanatomically connected with limbic structures, are the frontal cortical areas most frequently implicated in drug addiction. They are activated in addicted subjects during intoxication, craving, and bingeing, and they are deactivated during withdrawal. These regions are also involved in higher-order cognitive and motivational functions, such as the ability to track, update, and modulate the salience of a reinforcer as a function of context and expectation and the ability to control and inhibit prepotent responses.

CONCLUSIONS

These results imply that addiction connotes cortically regulated cognitive and emotional processes, which result in the overvaluing of drug reinforcers, the undervaluing of alternative reinforcers, and deficits in inhibitory control for drug responses. These changes in addiction, which the authors call I-RISA (impaired response inhibition and salience attribution), expand the traditional concepts of drug dependence that emphasize limbic-regulated responses to pleasure and reward.

Recognition of emotion from facial, prosodic and written verbal stimuli in Parkinson's disease

Although the basal ganglia are thought to be important in recognizing emotion, there is contradictory evidence as to whether patients with Parkinson's disease (PD) have deficits in recognizing facial expressions. In addition, few studies have examined their ability to recognize emotion from non-visual stimuli, such as voices. We examined the ability of PD patients and age-matched controls to recognize emotion in three different modalities: facial, prosodic, and written verbal stimuli. Compared to controls, PD patients showed deficits in recognizing fear and disgust in facial expressions. These impairments were not seen in their recognition of prosodic or written verbal stimuli. This modality-specific deficit suggests that the neural substrates for recognizing emotion from different modalities are not fully identical.

Habituation of attentional networks during emotion processing

Dysfunctional emotion processing is a key aspect of many neuropsychiatric disorders. This dysfunction may be due to an abnormal magnitude of neural substrate activation during emotion processing or due to an altered time course of the neural substrate response. To better understand the temporal characteristics of the neural substrate activation underlying implicit emotion processing, nine healthy female controls were repeatedly exposed to pictures of affective faces while performing a gender identification task in an fMRI. As the salience of the stimuli decreased with repeated exposure, brain areas implicated in a right hemispheric spatial attention network (including the posterior parietal cortex (BA 40) and the frontal eye fields (BA 6)) habituated while brain areas lateralized to the left hemisphere (including the angular gyrus (BA 39), posterior superior temporal gyrus (BA 39) and insula (BA 13)) sensitized. These results provide strong evidence that the time course of activation is a critical component when assessing the function of neural substrates underlying emotion processing (specifically whether habituation is altered) in neuro-psychiatric patients.

Brain activation during facial emotion processing

Functional neuroimaging studies have helped identify neural systems involved in cognitive processing and more recently have indicated limbic activation to emotional stimuli. Some functional magnetic resonance imaging (fMRI) studies have reported increased amygdala response during exposure to emotional stimuli while others have not shown such activation. The present study was designed to test the hypothesis that activation of the amygdala is related to the relevance of the emotional valence of stimuli. Healthy young participants (7 men, 7 women) were studied in a high-field (4 tesla) scanner using blood oxygenation-level dependent (BOLD) signal changes in a blocked "box car" design. They viewed facial displays of happiness, sadness, anger, fear, and disgust as well as neutral faces obtained from professional actors and actresses of diverse ethnicity and age. Their task alternated between emotion discrimination (indicating whether the emotion was positive or negative) and age discrimination (indicating whether the poser was older or younger than 30). Blocks contained the same proportion of emotional and neutral faces. Limbic response was greater during the emotion than during the age discrimination conditions. The response was most pronounced in the amygdala, but was also present in the hippocampus and circumscribed voxels in other limbic regions. These results support the central role of the amygdala in emotion processing, and indicate its sensitivity to the task relevance of the emotional display.

Functional neuroanatomy of emotion: a meta-analysis of emotion activation studies in PET and fMRI

Neuroimagingstudies with positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) have begun to describe the functional neuroanatomy of emotion. Taken separately, specific studies vary in task dimensions and in type(s) of emotion studied and are limited by statistical power and sensitivity. By examining findings across studies, we sought to determine if common or segregated patterns of activations exist across various emotional tasks. We reviewed 55 PET and fMRI activation studies (yielding 761 individual peaks) which investigated emotion in healthy subjects. Peak activation coordinates were transformed into a standard space and plotted onto canonical 3-D brain renderings. We divided the brain into 20 nonoverlapping regions, and characterized each region by its responsiveness across individual emotions (positive, negative, happiness, fear, anger, sadness, disgust), to different induction methods (visual, auditory, recall/imagery), and in emotional tasks with and without cognitive demand. Our review yielded the following summary observations: (1) The medial prefrontal cortex had a general role in emotional processing; (2) fear specifically engaged the amygdala; (3) sadness was associated with activity in the subcallosal cingulate; (4) emotional induction by visual stimuli activated the occipital cortex and the amygdala; (5) induction by emotional recall/imagery recruited the anterior cingulate and insula; (6) emotional tasks with cognitive demand also involved the anterior cingulate and insula. This review provides a critical comparison of findings across individual studies and suggests that separate brain regions are involved in different aspects of emotion.

Enhanced amygdala responses to emotional versus neutral schematic facial expressions

Human facial emotional expressions are complex. This may confound studies examining brain responses to these stimuli in control and clinical populations. However, several lines of evidence suggest that a few elementary facial features convey the gist of emotional expressions. Using fMRI, we assessed brain responses to line drawings of emotionally valenced (i.e. angry and happy) and neutral faces in healthy human subjects. Significantly increased fMRI signal was found in the amygdala, hippocampus and prefrontal cortex in response to emotional vs neutral schematic faces. Although direct comparisons of schematic and human faces will be needed, these initial results suggest that schematic faces may be useful for studying brain responses to emotional stimuli because of their simplicity relative to human faces.

Neural systems for recognizing emotion

Recognition of emotion draws on a distributed set of structures that include the occipitotemporal neocortex, amygdala, orbitofrontal cortex and right frontoparietal cortices. Recognition of fear may draw especially on the amygdala and the detection of disgust may rely on the insula and basal ganglia. Two important mechanisms for recognition of emotions are the construction of a simulation of the observed emotion in the perceiver, and the modulation of sensory cortices via top-down influences.

Face and emotion processing in frontal variant frontotemporal dementia

Lavenu et al. [Alzheimer Dis. Assoc. Disorder 5 (1999) 96] have shown that patients with frontotemporal dementia (FTD) show impaired recognition of facial expressions. It is not clear, however, whether these deficits arise from an impairment affecting face processing generally, emotion processing generally, or facial expression recognition alone. We address this issue by testing six patients with frontal variant frontotemporal dementia (fvFTD) on a series of face perception tasks (including facial identity and facial expression recognition), and a test of vocal emotion recognition. In general, the fvFTD participants showed impaired recognition of facial expressions in the context of preserved recognition of facial identity. In addition, however, deficits were also observed for the vocal emotion recognition task. These results are consistent with the idea that fvFTD affects the recognition of emotional signals from multiple modalities rather than facial expression processing alone. It is plausible that the emotion recognition impairments observed contribute to the abnormal social behaviour that is characteristic of this condition.

The classification of 'fear' from faces is associated with face recognition skill in women

Two experiments were conducted to explore the relationship between the discrimination of the facial expression of 'fear' in faces and facial recognition. On the basis of the reported role of the amygdala in both processes in patients, we hypothesised that the two skills would be correlated in normal adults. In Experiment 1, a series of tests of facial expression categorisation, of face matching and of familiar and unfamiliar face recognition was conducted on normal young women, for whom psychometric scores were also obtained (n=23). Accuracy of categorisation of fear from faces predicted variance in face recognition accuracy-especially in tasks of unfamiliar face recognition (immediate old-new discrimination). No other correlations between face processing and expression classification were significant. Experiment 2 repeated the expression classification tests and an unfamiliar face recognition test on a new sample of men (n=13) and women (n=16). While there were no sex differences in face recognition, the correlation between 'fear' and face recognition was replicated only for women. These data indicate that the amygdala supports both the specific apprehension of fear in faces and face recognition in adult human females, but that the association may not hold for men. Sex differences in the structure of the amygdala-hippocampal complex suggest a likely cortical substrate for the observed differences. We speculate that social learning, which involves identifying the faces of potentially salient others, and also their attitude to the observer, engages the amygdala more readily in women than in men.

Automatic and intentional brain responses during evaluation of trustworthiness of faces

Successful social interaction partly depends on appraisal of others from their facial appearance. A critical aspect of this appraisal relates to whether we consider others to be trustworthy. We determined the neural basis for such trustworthiness judgments using event-related functional magnetic resonance imaging. Subjects viewed faces and assessed either trustworthiness or age. In a parametric factorial design, trustworthiness ratings were correlated with BOLD signal change to reveal task-independent increased activity in bilateral amygdala and right insula in response to faces judged untrustworthy. Right superior temporal sulcus (STS) showed enhanced signal change during explicit trustworthiness judgments alone. The findings extend a proposed model of social cognition by highlighting a functional dissociation between automatic engagement of amygdala versus intentional engagement of STS in social judgment.

The role of the basal forebrain in episodic memory retrieval: a positron emission tomography study

Human lesion data indicate that the basal forebrain or orbitofrontal cortex, or both, as well as medial temporal and diencephalic structures, is important for normal memory and that its disruption causes the pure amnesic syndrome, in which episodic memory is grossly impaired while other kinds of memory remain preserved. Among these critical areas, functional imaging studies have so far failed to detect activation of the basal forebrain, although activation in the nearby orbitofrontal cortex has been reported during episodic memory retrieval. We employed positron emission tomography to elucidate the neural basis of episodic memory recall utilizing two types of time cues and successfully detected activity in the basal forebrain for the first time. Specifically, recall of previously memorized words from temporal cues was associated with activity in the basal forebrain, right middle frontal gyrus, right superior temporal gyrus, and posterior cingulate gyrus, whereas their recall from person cues was associated with activity in the left insula, right middle frontal gyrus, and posterior cingulate gyrus. Furthermore, percentage increases of regional blood flow in the basal forebrain were correlated with behavioral data of successful recall. Our results provide clear evidence that the human basal forebrain has a specific role in episodic memory recall, especially that from time-contextual information.

A generalised deficit can account for problems in facial emotion recognition in schizophrenia

Neuroimaging research has shown localised brain activation to different facial expressions. This, along with the finding that schizophrenia patients perform poorly in their recognition of negative emotions, has raised the suggestion that patients display an emotion specific impairment. We propose that this asymmetry in performance reflects task difficulty gradations, rather than aberrant processing in neural pathways subserving recognition of specific emotions. A neural network model is presented, which classifies facial expressions on the basis of measurements derived from human faces. After training, the network showed an accuracy pattern closely resembling that of healthy subjects. Lesioning of the network led to an overall decrease in the network's discriminant capacity, with the greatest accuracy decrease to fear, disgust and anger stimuli. This implies that the differential pattern of impairment in schizophrenia patients can be explained without having to postulate impairment of specific processing modules for negative emotion recognition.

Neural interaction of the amygdala with the prefrontal and temporal cortices in the processing of facial expressions as revealed by fMRI

Some involvement of the human amygdala in the processing of facial expressions has been investigated in neuroimaging studies, although the neural mechanisms underlying motivated or emotional behavior in response to facial stimuli are not yet fully understood. We investigated, using functional magnetic resonance imaging (fMRI) and healthy volunteers, how the amygdala interacts with other cortical regions while subjects are judging the sex of faces with negative, positive, or neutral emotion. The data were analyzed by a subtractive method, then, to clarify possible interaction among regions within the brain, several kinds of analysis (i.e., a correlation analysis, a psychophysiological interaction analysis and a structural equation modeling) were performed. Overall, significant activation was observed in the bilateral fusiform gyrus, medial temporal lobe, prefrontal cortex, and the right parietal lobe during the task. The results of subtraction between the conditions showed that the left amygdala, right orbitofrontal cortex, and temporal cortices were predominantly involved in the processing of the negative expressions. The right angular gyrus was involved in the processing of the positive expressions when the negative condition was subtracted from the positive condition. The correlation analysis showed that activity in the left amygdala positively correlated with activity in the left prefrontal cortex under the negative minus neutral subtraction condition. The psychophysiological interaction revealed that the neural responses in the left amygdala and the right prefrontal cortex underwent the condition-specific changes between the negative and positive face conditions. The right amygdaloid activity also had an interactive effect with activity in the right hippocampus and middle temporal gyrus. These results may suggest that the left and right amygdalae play a differential role in effective processing of facial expressions in collaboration with other cortical or subcortical regions, with the left being related with the bilateral prefrontal cortex, and the right with the right temporal lobe.

Neuroimaging and behavior: probing brain behavior relationships in the 21st century

Functional neuroimaging over the past decade has provided a new way to examine brain behavior relationships. Current noninvasive neuroimaging techniques, which can examine structure and function, have begun to clarify the networks involved in cognitive processes and how these are affected in aging and disease. Functional magnetic resonance imaging (fMRI) has demonstrated the interaction between medial temporal and prefrontal regions in episodic memory. The anatomical correlates of various components of spatial attention and working memory have emerged from elegant event-related fMRI designs. Distinct neural networks for different emotions are being mapped out, and the role of the anterior cingulate in depressed mood has been documented. This review highlights key recent studies that have illuminated the neural substrates of these important cognitive and affective processes.

Neural activity associated with episodic memory for emotional context

To address the question of which brain regions subserve retrieval of emotionally-valenced memories, we used event-related fMRI to index neural activity during the incidental retrieval of emotional and non-emotional contextual information. At study, emotionally neutral words were presented in the context of sentences that were either negatively, neutrally or positively valenced. At test, fMRI data were obtained while participants discriminated between studied and unstudied words. Recognition of words presented in emotionally negative relative to emotionally neutral contexts was associated with enhanced activity in right dorsolateral prefrontal cortex, left amygdala and hippocampus, right lingual gyrus and posterior cingulate cortex. Recognition of words from positive relative to neutral contexts was associated with increased activity in bilateral prefrontal and orbitofrontal cortices, and left anterior temporal lobe. These findings suggest that neural activity mediating episodic retrieval of contextual information and its subsequent processing is modulated by emotion in at least two ways. First, there is enhancement of activity in networks supporting episodic retrieval of neutral information. Second, regions known to be activated when emotional information is encountered in the environment are also active when emotional information is retrieved from memory.

An examination of the effects of stimulus type, encoding task, and functional connectivity on the role of right prefrontal cortex in recognition memory

Right anterior prefrontal cortex and other brain areas are active during memory retrieval but the role of prefrontal cortex and how it interacts with these other regions to mediate memory function remain unclear. To explore these issues we used positron emission tomography to examine the effects of stimulus material and encoding task on brain activity during visual recognition, assessing both task-related changes and functional connectivity. Words and pictures of objects were encoded using perceptual and semantic strategies, resulting in better memory for semantically encoded items. There was no significant effect of prior encoding strategy on brain activity during recognition. Right anterior prefrontal cortex was equally active during recognition of both types of stimuli irrespective of initial encoding strategy. Regions whose activity was positively correlated with activity in right anterior prefrontal cortex included widespread areas of prefrontal and inferior temporal cortices bilaterally. Activity in this entire network of regions was negatively correlated with recognition accuracy of semantically encoded items. These results suggest that initial encoding task has little impact on the set of brain regions that is active during subsequent recognition. Right anterior prefrontal cortex appears to be involved in retrieval mode, reflected in its equivalent activity across conditions differing in both stimulus type and encoding task, and also in retrieval effort, shown by the negative correlation between its functional connectivity and individual differences in recognition accuracy.

Aversive learning in patients with unilateral lesions of the amygdala and hippocampus

The present study applied a visual half field paradigm with emotional facial expressions in patients with selective unilateral amygdalo-hippocampectomy (AHE) to elucidate the contributions of the left and right medial temporal lobe and amygdala to emotional learning. Electrodermal indicators of aversive learning were studied in 14 left AHE and 12 right AHE patients, as well as 13 controls matched in sex and age. In a differential conditioning paradigm with negative (CS+) and positive (CS-) facial expressions, CS+ were associated with an aversive vocalization (US, 95 dB, 3 s). During extinction, stimuli were presented laterally and preattentively using backward masking. Appropriate CS durations yielding preattentive presentation were individually determined prior to conditioning. In contrast to controls, both left and right AHE patients failed to show an autonomic conditioning effect following left visual field presentations of masked negative CS+ during extinction. AHE patients also showed no clear differential acquisition. Moreover, right AHE patients poorly recognised that negative valence was an affiliating dimension of the CS-US compound.

The psychobiology of obsessive-compulsive disorder: how important is the role of disgust?

Psychobiologic models of obsessive-compulsive disorder (OCD) have focused on cortico-striatal-thalamic-cortical (CTSC) circuits, noting normal function in cognitive and motoric procedural strategies. Such models have relied on the classification of OCD as an anxiety disorder, seldom exploring other relevant emotions. Based on the hypothesis that a central emotion in OCD is disgust, the authors review the literature on its psychobiology and its relevance to current models of OCD. There are important parallels between the psychobiology of OCD and that of disgust. Obsessive- compulsive disorder may be conceptualized in terms of a false contamination alarm in which disgust plays a crucial organizing or embodying role, not only at a basic brain level, but also in terms of the psychosocial aspects of the disorder. Just as psychobiologic models of panic disorder and post- traumatic stress disorder have been strengthened by the inclusion of preclinical work on amygdala-mediated fear conditioning, so findings on disgust and its mediating CSTC circuits may generate useful hypotheses for OCD research.

Working memory of identification of emotional vocal expressions: an fMRI study

The distribution of brain activation during working memory processing of emotional vocal expressions was studied using functional magnetic resonance imaging (fMRI) in eight female subjects performing n-back tasks with three load levels (0-back, 1-back, and 2-back tasks). The stimuli in the n-back tasks were the Finnish female name [Saara] uttered in an astonished, angry, frightened, commanding, and scornful mode, and the subjects were instructed to memorize the emotional connotation of the stimuli. Subregions in the prefrontal, parietal, and visual association areas were load-dependently activated during the performance of the n-back tasks. The most consistently activated areas in the prefrontal region were detected in the inferior frontal gyrus corresponding to Brodmann's areas (BAs) 44 and 45 and in the middle and superior frontal gyri (BAs 6/8). Activation was also found in the inferior parietal lobe and intraparietal sulcus (BAs 40/7) and visual association areas including the lingual and fusiform gyri. The results suggest that a distributed neuronal network in occipital, parietal, and frontal areas is involved in working memory processing of emotional content of aurally presented information.

Nuclear magnetic resonance spectroscopy and imaging in animal research

Nuclear magnetic resonance (NMR) spectroscopy and imaging can be used to investigate, noninvasively, a wide range of biological processes in systems as diverse as protein solutions, single cells, isolated perfused organs, and tissues in vivo. It is also possible to combine different NMR techniques enabling metabolic, anatomical, and physiological information to be obtained in the same experiment. This review provides a simple overview of the basic principles of NMR and outlines both the advantages and disadvantages of NMR spectroscopy and imaging. A few examples of potential applications of NMR spectroscopy and imaging are presented, which demonstrate the range of questions that can be asked using these techniques. The potential impact of using NMR techniques in a biomedical research program on the total number of animals required for specific investigations, as well as the number of animals used in research, are discussed. The article concludes with a personal perspective on the impact of continuing improvements in NMR technology for future applications in animal research.

Neuropsychology of fear and loathing

For over 60 years, ideas about emotion in neuroscience and psychology have been dominated by a debate on whether emotion can be encompassed within a single, unifying model. In neuroscience, this approach is epitomized by the limbic system theory and, in psychology, by dimensional models of emotion. Comparative research has gradually eroded the limbic model, and some scientists have proposed that certain individual emotions are represented separately in the brain. Evidence from humans consistent with this approach has recently been obtained by studies indicating that signals of fear and disgust are processed by distinct neural substrates. We review this research and its implications for theories of emotion.

EEG-correlates of facial affect recognition and categorisation of blurred faces in schizophrenic patients and healthy volunteers

The ability to recognise emotional expressions of faces and the ability to categorise blurred and non-blurred faces and complex objects was tested in 16 schizophrenic in-patients and 16 healthy volunteers. EEGs were recorded during performance of the tasks and event-related potentials were compared between groups. Patients performed worse than healthy volunteers in recognition of facial affect but not in categorisation of blurred faces. Furthermore, within a 180-250ms latency range patients showed reduced amplitudes during affect recognition compared with controls but not during categorisation of blurred faces. Amplitudes recorded at frontal electrode sites were associated with performance in facial affect recognition. These results provide a first clue to the neurophysiological basis of the widely reported facial affect recognition deficit in schizophrenic patients.

Neural substrates of facial emotion processing using fMRI

We identified human brain regions involved in the perception of sad, frightened, happy, angry, and neutral facial expressions using functional magnetic resonance imaging (fMRI). Twenty-one healthy right-handed adult volunteers (11 men, 10 women; aged 18-45; mean age 21.6 years) participated in four separate runs, one for each of the four emotions. Participants viewed blocks of emotionally expressive faces alternating with blocks of neutral faces and scrambled images. In comparison with scrambled images, neutral faces activated the fusiform gyri, the right lateral occipital gyrus, the right superior temporal sulcus, the inferior frontal gyri, and the amygdala/entorhinal cortex. In comparisons of emotional and neutral faces, we found that (1) emotional faces elicit increased activation in a subset of cortical regions involved in neutral face processing and in areas not activated by neutral faces; (2) differences in activation as a function of emotion category were most evident in the frontal lobes; (3) men showed a differential neural response depending upon the emotion expressed but women did not.

A functional MRI study of human amygdala responses to facial expressions of fear versus anger

Functional magnetic resonance imaging (fMRI) of the human brain was used to compare changes in amygdala activity associated with viewing facial expressions of fear and anger. Pictures of human faces bearing expressions of fear or anger, as well as faces with neutral expressions, were presented to 8 healthy participants. The blood oxygen-level dependent (BOLD) fMRI signal within the dorsal amygdala was significantly greater to Fear versus Anger, in a direct contrast. Significant BOLD signal changes in the ventral amygdala were observed in contrasts of Fear versus Neutral expressions and, in a more spatially circumscribed region, to Anger versus Neutral expressions. Thus, activity in the amygdala is greater to fearful facial expressions when contrasted with either neutral or angry faces. Furthermore, directly contrasting fear with angry faces highlighted involvement of the dorsal amygdaloid region.

Brain function in a patient with torture related post-traumatic stress disorder before and after fluoxetine treatment: a positron emission tomography provocation study

We report positron emission tomographic measurements of regional cerebral blood flow (rCBF) in a male patient with war and torture related post-traumatic stress disorder (PTSD) during symptom provocation. The subject was exposed to war related sounds before and after treatment with a selective serotonin reuptake inhibitor (SSRI; Fluoxetine; Fontex((R))). Therapy reduced PTSD symptoms, provoked anxiety and heart rate. Before treatment trauma reminders resulted in decreased rCBF in the insula, prefrontal, and inferior frontal cortices. Increased activity was evident in the cerebellum, precuneus and supplementary motor cortex. This was normalized after SSRI administration. Prefrontal and cingulate rCBF correlated with heart rate. Hence, the anxiolytic effect of SSRI for PTSD could be mediated by prefrontal and paralimbic cortices. Data suggest that SSRI treatment normalize provocation induced rCBF alterations in areas involved in memory, emotion, attention and motor-control.

The amygdala: vigilance and emotion

Here we provide a review of the animal and human literature concerning the role of the amygdala in fear conditioning, considering its potential influence over autonomic and hormonal changes, motor behavior and attentional processes. A stimulus that predicts an aversive outcome will change neural transmission in the amygdala to produce the somatic, autonomic and endocrine signs of fear, as well as increased attention to that stimulus. It is now clear that the amygdala is also involved in learning about positively valenced stimuli as well as spatial and motor learning and this review strives to integrate this additional information. A review of available studies examining the human amygdala covers both lesion and electrical stimulation studies as well as the most recent functional neuroimaging studies. Where appropriate, we attempt to integrate basic information on normal amygdala function with our current understanding of psychiatric disorders, including pathological anxiety.

Impaired recognition and experience of disgust following brain injury

Huntington's disease can particularly affect people's recognition of disgust from facial expressions, and functional neuroimaging research has demonstrated that facial expressions of disgust consistently engage different brain areas (insula and putamen) than other facial expressions. However, it is not known whether these particular brain areas process only facial signals of disgust or disgust signals from multiple modalities. Here we describe evidence, from a patient with insula and putamen damage, for a neural system for recognizing social signals of disgust from multiple modalities.

The distributed human neural system for face perception

Face perception, perhaps the most highly developed visual skill in humans, is mediated by a distributed neural system in humans that is comprised of multiple, bilateral regions. We propose a model for the organization of this system that emphasizes a distinction between the representation of invariant and changeable aspects of faces. The representation of invariant aspects of faces underlies the recognition of individuals, whereas the representation of changeable aspects of faces, such as eye gaze, expression, and lip movement, underlies the perception of information that facilitates social communication. The model is also hierarchical insofar as it is divided into a core system and an extended system. The core system is comprised of occipitotemporal regions in extrastriate visual cortex that mediate the visual analysis of faces. In the core system, the representation of invariant aspects is mediated more by the face-responsive region in the fusiform gyrus, whereas the representation of changeable aspects is mediated more by the face-responsive region in the superior temporal sulcus. The extended system is comprised of regions from neural systems for other cognitive functions that can be recruited to act in concert with the regions in the core system to extract meaning from faces.

Electrophysiological correlates of emotional and structural face processing in humans

In order to study brain potentials related to decoding of facial expressions of emotions and those, related to basic perception of faces 16 right-handed subjects performed tasks on facial emotion recognition and perception of blurred faces and objects. Electroencephalograph (EEG) recordings during performance of the tasks revealed similar event-related potentials during the presentation of faces at 120 and 170 ms after stimulus onset in both of the tasks but significant differences in amplitudes between 180 and 300 ms. Whereas faces in the emotion recognition task produced high amplitudes in that latency range, potentials in response to faces in the blurred object condition were virtually absent. These data point to the assumption that decoding of facial expressions starts early in the brain and might be processed separately from basic stages of face perception.

Imaging Cognition II: An Empirical Review of 275 PET and fMRI Studies

Positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) have been extensively used to explore the functional neuroanatomy of cognitive functions. Here we review 275 PET and fMRI studies of attention (sustained, selective, Stroop, orientation, divided), perception (object, face, space/motion, smell), imagery (object, space/ motion), language (written/spoken word recognition, spoken/ no spoken response), working memory (verbal/numeric, object, spatial, problem solving), semantic memory retrieval (categorization, generation), episodic memory encoding (verbal, object, spatial), episodic memory retrieval (verbal, nonverbal, success, effort, mode, context), priming (perceptual, conceptual), and procedural memory (conditioning, motor, and nonmotor skill learning). To identify consistent activation patterns associated with these cognitive operations, data from 412 contrasts were summarized at the level of cortical Brodmann's areas, insula, thalamus, medial-temporal lobe (including hippocampus), basal ganglia, and cerebellum. For perception and imagery, activation patterns included primary and secondary regions in the dorsal and ventral pathways. For attention and working memory, activations were usually found in prefrontal and parietal regions. For language and semantic memory retrieval, typical regions included left prefrontal and temporal regions. For episodic memory encoding, consistently activated regions included left prefrontal and medial-temporal regions. For episodic memory retrieval, activation patterns included prefrontal, medial-temporal, and posterior midline regions. For priming, deactivations in prefrontal (conceptual) or extrastriate (perceptual) regions were consistently seen. For procedural memory, activations were found in motor as well as in non-motor brain areas. Analysis of regional activations across cognitive domains suggested that several brain regions, including the cerebellum, are engaged by a variety of cognitive challenges. These observations are discussed in relation to functional specialization as well as functional integration.

Imaging cognition II: An empirical review of 275 PET and fMRI studies

Positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) have been extensively used to explore the functional neuroanatomy of cognitive functions. Here we review 275 PET and fMRI studies of attention (sustained, selective, Stroop, orientation, divided), perception (object, face, space/motion, smell), imagery (object, space/motion), language (written/spoken word recognition, spoken/no spoken response), working memory (verbal/numeric, object, spatial, problem solving), semantic memory retrieval (categorization, generation), episodic memory encoding (verbal, object, spatial), episodic memory retrieval (verbal, nonverbal, success, effort, mode, context), priming (perceptual, conceptual), and procedural memory (conditioning, motor, and nonmotor skill learning). To identify consistent activation patterns associated with these cognitive operations, data from 412 contrasts were summarized at the level of cortical Brodmann's areas, insula, thalamus, medial-temporal lobe (including hippocampus), basal ganglia, and cerebellum. For perception and imagery, activation patterns included primary and secondary regions in the dorsal and ventral pathways. For attention and working memory, activations were usually found in prefrontal and parietal regions. For language and semantic memory retrieval, typical regions included left prefrontal and temporal regions. For episodic memory encoding, consistently activated regions included left prefrontal and medial temporal regions. For episodic memory retrieval, activation patterns included prefrontal, medial temporal, and posterior midline regions. For priming, deactivations in prefrontal (conceptual) or extrastriate (perceptual) regions were consistently seen. For procedural memory, activations were found in motor as well as in non-motor brain areas. Analysis of regional activations across cognitive domains suggested that several brain regions, including the cerebellum, are engaged by a variety of cognitive challenges. These observations are discussed in relation to functional specialization as well as functional integration.

A differential neural response to threatening and non-threatening negative facial expressions in paranoid and non-paranoid schizophrenics

Several studies have demonstrated impaired facial expression recognition in schizophrenia. Few have examined the neural basis for this; none have compared the neural correlates of facial expression perception in different schizophrenic patient subgroups. We compared neural responses to facial expressions in 10 right-handed schizophrenic patients (five paranoid and five non-paranoid) and five normal volunteers using functional Magnetic Resonance Imaging (fMRI). In three 5-min experiments, subjects viewed alternating 30-s blocks of black-and-white facial expressions of either fear, anger or disgust contrasted with expressions of mild happiness. After scanning, subjects categorised each expression. All patients were less accurate in identifying expressions, and showed less activation to these stimuli than normals. Non-paranoids performed poorly in the identification task and failed to activate neural regions that are normally linked with perception of these stimuli. They categorised disgust as either anger or fear more frequently than paranoids, and demonstrated in response to disgust expressions activation in the amygdala, a region associated with perception of fearful faces. Paranoids were more accurate in recognising expressions, and demonstrated greater activation than non-paranoids to most stimuli. We provide the first evidence for a distinction between two schizophrenic patient subgroups on the basis of recognition of and neural response to different negative facial expressions.

Regional brain activity during transient self-induced anxiety and anger in healthy adults

BACKGROUND

Several studies have demonstrated that transient self-induced sadness activates anterior paralimbic structures. To further examine the specificity of these findings and the neural substrates involved in anger and anxiety, we studied the neural correlates of the induction of anxiety and anger in healthy adults.

METHODS

We used H2(15)O and positron emission tomography (PET) to measure regional cerebral blood flow (rCBF) in 16 healthy adults during the induction of transient anxiety, anger, and neutral emotions. Subjects achieved differential emotions by recalling prior life events while viewing affect-appropriate faces.

RESULTS

Both the anxiety and anger conditions were associated with increased normalized rCBF in left inferior frontal and left temporal pole regions and decreased rCBF in right posterior temporal/parietal and right superior frontal cortex, compared to the neutral induction. Additionally, compared to neutral induction, anxiety was associated with increased rCBF in the left anterior cingulate and cuneus and decreased rCBF in right medial frontal cortex, while the anger induction was uniquely associated with increased rCBF in right temporal pole and thalamus.

CONCLUSIONS

Self-generated transient states of anxiety and anger are associated with both overlapping and distinct regional brain activity patterns and provide a template for further dissection of specific components of normal and pathologic emotions.