Frontolimbic responses to emotional face memory: the neural correlates of first impressions

Exploring Hospital Physical Environment Influencing Users First Impressions of the Healthcare Organizations: A Conceptual Framework Based on Literature Review

PURPOSE

The aim of the study was to examine literature on first impressions and how physical design factors influence users' first impressions.

BACKGROUND

Engineering a first impression through physical design has been successfully used in the context of US federal buildings and retail. A patient's first impression is important as it affects their downstream behaviors and experiences. However, little is known about it in the context of healthcare design.

METHOD

This study is part of a broader literature review that searched for studies on the first impression phenomenon, which were examined in a cross-disciplinary literature review, along with trade/professional journals/magazines. Three databases were in-depth searched-Scopus, Web of Science, and HaPI along with Google Scholar search and hand searching. A total of 187 satisfied articles and three books were reviewed through three phases to obtain an understanding of the first impressions and the factors affecting it.

RESULTS

After the in-depth review of the theories behind the first impression, the authors proposed a conceptual framework explaining the concept of the first impression and engineering it through physical design. The findings from published articles suggest five conceptual steps between early information pickup and early impression formation: (1) exposure time, (2) information pickup, (3) cognition, (4) emotion, and (5) judgment.

CONCLUSIONS

The findings show a causal association between one's initial information pickup during the first 5 min of exposure to a target and the formation of a first impression. It suggests a crucial role of physical design of the environment, including in healthcare facilities.

Medial prefrontal and occipito-temporal activity at encoding determines enhanced recognition of threatening faces after 1.5 years

Studies demonstrated that faces with threatening emotional expressions are better remembered than non-threatening faces. However, whether this memory advantage persists over years and which neural systems underlie such an effect remains unknown. Here, we employed an individual difference approach to examine whether the neural activity during incidental encoding was associated with differential recognition of faces with emotional expressions (angry, fearful, happy, sad and neutral) after a retention interval of > 1.5 years (N = 89). Behaviorally, we found a better recognition for threatening (angry, fearful) versus non-threatening (happy and neutral) faces after a delay of > 1.5 years, which was driven by forgetting of non-threatening faces compared with immediate recognition after encoding. Multivariate principal component analysis (PCA) on the behavioral responses further confirmed the discriminative recognition performance between threatening and non-threatening faces. A voxel-wise whole-brain analysis on the concomitantly acquired functional magnetic resonance imaging (fMRI) data during incidental encoding revealed that neural activity in bilateral inferior occipital gyrus (IOG) and ventromedial prefrontal/orbitofrontal cortex (vmPFC/OFC) was associated with the individual differences in the discriminative emotional face recognition performance measured by an innovative behavioral pattern similarity analysis (BPSA). The left fusiform face area (FFA) was additionally determined using a regionally focused analysis. Overall, the present study provides evidence that threatening facial expressions lead to persistent face recognition over periods of > 1.5 years, and that differential encoding-related activity in the medial prefrontal cortex and occipito-temporal cortex may underlie this effect.

Altered functional brain dynamics in chromosome 22q11.2 deletion syndrome during facial affect processing

Chromosome 22q11.2 deletion syndrome (22q11.2DS) is a multisystem disorder associated with multiple congenital anomalies, variable medical features, and neurodevelopmental differences resulting in diverse psychiatric phenotypes, including marked deficits in facial memory and social cognition. Neuroimaging in individuals with 22q11.2DS has revealed differences relative to matched controls in BOLD fMRI activation during facial affect processing tasks. However, time-varying interactions between brain areas during facial affect processing have not yet been studied with BOLD fMRI in 22q11.2DS. We applied constrained principal component analysis to identify temporally overlapping brain activation patterns from BOLD fMRI data acquired during an emotion identification task from 58 individuals with 22q11.2DS and 58 age-, race-, and sex-matched healthy controls. Delayed frontal-motor feedback signals were diminished in individuals with 22q11.2DS, as were delayed emotional memory signals engaging amygdala, hippocampus, and entorhinal cortex. Early task-related engagement of motor and visual cortices and salience-related insular activation were relatively preserved in 22q11.2DS. Insular activation was associated with task performance within the 22q11.2DS sample. Differences in cortical surface area, but not cortical thickness, showed spatial alignment with an activation pattern associated with face processing. These findings suggest that relative to matched controls, primary visual processing and insular function are relatively intact in individuals with 22q11.22DS, while motor feedback, face processing, and emotional memory processes are more affected. Such insights may help inform potential interventional targets and enhance the specificity of neuroimaging indices of cognitive dysfunction in 22q11.2DS.

Effects of Positioning Errors Onto the Ratio and Angle Measurements in Photographs of Patients With Unilateral Cleft Lip and Palate

BACKGROUND

Nasolabial esthetics is 1 of the most important issues in the evaluation of treatment outcomes in patients with unilateral cleft lip and palate (CLP). Frontal and basal view photographs are commonly used to evaluate nasolabial esthetics in patients with unilateral CLP. High-quality photography plays an important role in evaluating the treatment outcomes and poor quality photographs can result in errors, whereas evaluating the treatment results. Facial proportions and angles are important in the esthetic perception of the face. Hence, this study aimed to determine the effects of positioning errors on the ratio and angle measurements in photographs of patients with unilateral CLP.

METHODS

In the clinical and computer environment, a mechanism was set up to take photos at standard and at different angles. A real-size unilateral CLP silicone doll was constructed for the photographs to be taken in the clinical setting. A test-retest was performed to determine the reliability of the measured values.

RESULTS

The correlation coefficients for the first measurement and remeasurement values were statistically significant; positive and strong correlations were obtained.

CONCLUSIONS

Based on the data obtained from our study, the angle and ratio measurements obtained from the two-dimensional photographs provided reliable results.

Brain responsivity to emotional faces differs in men and women with and without a history of alcohol use disorder

Inclusion of women in research on Alcohol Use Disorder (AUD) has shown that gender differences contribute to unique profiles of cognitive, emotional, and neuropsychological dysfunction. We employed functional magnetic resonance imaging (fMRI) of abstinent individuals with a history of AUD (21 women [AUDw], 21 men [AUDm]) and demographically similar non-AUD control (NC) participants without AUD (21 women [NCw], 21 men [NCm]) to explore how gender and AUD interact to influence brain responses during emotional processing and memory. Participants completed a delayed match-to-sample emotional face memory fMRI task, and brain activation contrasts between a fixation stimulus and pictures of emotional face elicited a similar overall pattern of activation for all four groups. Significant Group by Gender interactions revealed two activation clusters. A cluster in an anterior portion of the middle and superior temporal gyrus, elicited lower activation to the fixation stimulus than to faces for the AUDw as compared to the NCw; that abnormality was more pronounced than the one observed for men. Another cluster in the medial portion of the superior frontal cortex elicited higher activation to the faces by AUDm than NCm, a difference that was more evident than the one observed for women. Together, these findings have added new evidence of AUD-related gender differences in neural responses to facial expressions of emotion.

Recognition of Contextually Threat-Related Scenes is Enhanced by Preceding Emotionally Incongruent Facial Expression

Previous studies on intentional and incidental face memory have investigated the effects of emotional facial expression on facial recognition itself. However, it is still uncertain whether facial expression influences later recognition of other emotional stimuli, such as emotional scenes. To address this issue, participants during the encoding phase were presented with emotional scenes together with facial expressions. The emotion of the scenes was either congruent or incongruent with that of the facial expression. In order to increase the attention towards faces/facial expressions, the task was related to faces rather than scenes, for example, the participants were asked either to memorize the facial identities (intentional face learning, Experiment 1) or to identify the gender of the faces (incidental face learning, Experiment 2). Subsequently, the participants were asked to perform an unexpected old/new recognition task regarding the scene pictures. In general, the results showed that recognition of threat-related scenes was enhanced by a preceding emotionally incongruent facial expression irrespective of intentional or incidental face learning. The findings indicate that facial expression influences recognition of contextual threat-related scenes.

Shared facial emotion processing functional network findings in medication-naïve major depressive disorder and healthy individuals: detection by sICA

BACKGROUND

The fundamental mechanism underlying emotional processing in major depressive disorder (MDD) remains unclear. To better understand the neural correlates of emotional processing in MDD, we investigated the role of multiple functional networks (FNs) during emotional stimuli processing.

METHODS

Thirty-two medication-naïve subjects with MDD and 36 healthy controls (HCs) underwent an emotional faces fMRI task that included neutral, happy and fearful expressions. Spatial independent component analysis (sICA) and general linear model (GLM) were conducted to examine the main effect of task condition and group, and two-way interactions of group and task conditions.

RESULTS

In sICA analysis, MDD patients and HCs together showed significant differences in task-related modulations in five FNs across task conditions. One FN mainly involving the ventral medial prefrontal cortex showed lower activation during fearful relative to happy condition. Two FNs mainly involving the bilateral inferior frontal gyrus and temporal cortex, showed opposing modulation relative to the ventral medial prefrontal cortex FN, i.e., greater activation during fearful relative to happy condition. Two remaining FNs involving the fronto-parietal and occipital cortices, showed reduced activation during both fearful and happy conditions relative to the neutral condition. However, MDD and HCs did not show significant differences in expression-related modulations in any FNs in this sample.

CONCLUSIONS

SICA revealed differing functional activation patterns than typical GLM-based analyses. The sICA findings demonstrated unique FNs involved in processing happy and fearful facial expressions. Potential differences between MDD and HCs in expression-related FN modulation should be investigated further.

Brain responses to facial attractiveness induced by facial proportions: evidence from an fMRI study

Brain responses to facial attractiveness induced by facial proportions are investigated by using functional magnetic resonance imaging (fMRI), in 41 young adults (22 males and 19 females). The subjects underwent fMRI while they were presented with computer-generated, yet realistic face images, which had varying facial proportions, but the same neutral facial expression, baldhead and skin tone, as stimuli. Statistical parametric mapping with parametric modulation was used to explore the brain regions with the response modulated by facial attractiveness ratings (ARs). The results showed significant linear effects of the ARs in the caudate nucleus and the orbitofrontal cortex for all of the subjects, and a non-linear response profile in the right amygdala for only the male subjects. Furthermore, canonical correlation analysis was used to learn the most relevant facial ratios that were best correlated with facial attractiveness. A regression model on the fMRI-derived facial ratio components demonstrated a strong linear relationship between the visually assessed mean ARs and the predictive ARs. Overall, this study provided, for the first time, direct neurophysiologic evidence of the effects of facial ratios on facial attractiveness and suggested that there are notable gender differences in perceiving facial attractiveness as induced by facial proportions.

Anticipation of Negative Pictures Enhances the P2 and P3 in Their Later Recognition

Anticipation of emotional pictures has been found to be relevant to the encoding of the pictures as well as their later recognition performance. However, it is as yet unknown whether anticipation modulates neural activity in the later recognition of emotional pictures. To address this issue, participants in the present study were asked to view emotional (negative or neutral) pictures. The picture was preceded by a cue which indicated the emotional content of the picture in half of the trials (the anticipated condition) and without any cues in the other half (the unanticipated condition). Subsequently, participants had to perform an unexpected old/new recognition task in which old and novel pictures were presented without any preceding cues. Electroencephalography data was recorded during the recognition phase. Event-related potential results showed that for negative pictures, P2 and P3 amplitudes were larger in the anticipated as compared to the unanticipated condition; whereas this anticipation effect was not shown for neutral pictures. The present findings suggest that anticipation of negative pictures may enhance neural activity in their later recognition.

Fearful contextual expression impairs the encoding and recognition of target faces: an ERP study

Previous event-related potential (ERP) studies have shown that the N170 to faces is modulated by the emotion of the face and its context. However, it is unclear how the encoding of emotional target faces as reflected in the N170 is modulated by the preceding contextual facial expression when temporal onset and identity of target faces are unpredictable. In addition, no study as yet has investigated whether contextual facial expression modulates later recognition of target faces. To address these issues, participants in the present study were asked to identify target faces (fearful or neutral) that were presented after a sequence of fearful or neutral contextual faces. The number of sequential contextual faces was random and contextual and target faces were of different identities so that temporal onset and identity of target faces were unpredictable. Electroencephalography (EEG) data was recorded during the encoding phase. Subsequently, participants had to perform an unexpected old/new recognition task in which target face identities were presented in either the encoded or the non-encoded expression. ERP data showed a reduced N170 to target faces in fearful as compared to neutral context regardless of target facial expression. In the later recognition phase, recognition rates were reduced for target faces in the encoded expression when they had been encountered in fearful as compared to neutral context. The present findings suggest that fearful compared to neutral contextual faces reduce the allocation of attentional resources towards target faces, which results in limited encoding and recognition of target faces.

Functional neuroimaging abnormalities in youth with psychosis spectrum symptoms

IMPORTANCE

The continuum view of the psychosis spectrum (PS) implies that, in population-based samples, PS symptoms should be associated with neural abnormalities similar to those found in help-seeking clinical risk individuals and in schizophrenia. To our knowledge, functional neuroimaging has not previously been applied in large population-based PS samples and can help us understand the neural architecture of psychosis more broadly and identify brain phenotypes beyond symptoms that are associated with the extended psychosis phenotype.

OBJECTIVE

To examine the categorical and dimensional relationships of PS symptoms to prefrontal hypoactivation during working memory and to amygdala hyperactivation during threat emotion processing.

DESIGN, SETTING, AND PARTICIPANTS

The Philadelphia Neurodevelopmental Cohort is a genotyped, prospectively accrued, population-based sample of almost 10,000 youths who received a structured psychiatric evaluation and a computerized neurocognitive battery. The study was conducted at an academic and children's hospital health care network, between November 1, 2009 to November 30, 2011. A subsample of 1445 youths underwent neuroimaging, including functional magnetic resonance imaging tasks examined herein. Participants were youth aged 11 to 22 years old identified through structured interview as having PS features (PS group) (n = 260) and typically developing (TD) comparison youth without significant psychopathology (TD group) (n = 220).

MAIN OUTCOMES AND MEASURES

Two functional magnetic resonance imaging paradigms were used: a fractal n-back working memory task probing executive system function and an emotion identification task probing amygdala responses to threatening faces.

RESULTS

In the n-back task, working memory evoked lower activation in the PS group than the TD group throughout the executive control circuitry, including dorsolateral prefrontal cortex (cluster-corrected P < .05). Within the PS group, dorsolateral prefrontal cortex activation correlated with cognitive deficits (r = .32, P < .001), but no correlation was found with positive symptom severity. During emotion identification, PS demonstrated elevated responses to threatening facial expressions in amygdala, as well as left fusiform cortex and right middle frontal gyrus (cluster-corrected P < .05). The response in the amygdala correlated with positive symptom severity (r = .16, P = .01) but not with cognitive deficits.

CONCLUSIONS AND RELEVANCE

The pattern of functional abnormalities observed in the PS group is similar to that previously found in schizophrenia and help-seeking risk samples. Specific circuit dysfunction during cognitive and emotion-processing tasks is present early in the development of psychopathology and herein could not be attributed to chronic illness or medication confounds. Hypoactivation in executive circuitry and limbic hyperactivation to threat could reflect partly independent risk factors for PS symptoms, with the former relating to cognitive deficits that increase the risk for developing psychotic symptoms and the latter contributing directly to positive psychotic symptoms.

Brain functional changes in facial expression recognition in patients with major depressive disorder before and after antidepressant treatment: A functional magnetic resonance imaging study

Functional magnetic resonance imaging was used during emotion recognition to identify changes in functional brain activation in 21 first-episode, treatment-naive major depressive disorder patients before and after antidepressant treatment. Following escitalopram oxalate treatment, patients exhibited decreased activation in bilateral precentral gyrus, bilateral middle frontal gyrus, left middle temporal gyrus, bilateral postcentral gyrus, left cingulate and right parahippocampal gyrus, and increased activation in right superior frontal gyrus, bilateral superior parietal lobule and left occipital gyrus during sad facial expression recognition. After antidepressant treatment, patients also exhibited decreased activation in the bilateral middle frontal gyrus, bilateral cingulate and right parahippocampal gyrus, and increased activation in the right inferior frontal gyrus, left fusiform gyrus and right precuneus during happy facial expression recognition. Our experimental findings indicate that the limbic-cortical network might be a key target region for antidepressant treatment in major depressive disorder.

Impact of puberty on the evolution of cerebral perfusion during adolescence

Puberty is the defining biological process of adolescent development, yet its effects on fundamental properties of brain physiology such as cerebral blood flow (CBF) have never been investigated. Capitalizing on a sample of 922 youths ages 8-22 y imaged using arterial spin labeled MRI as part of the Philadelphia Neurodevelopmental Cohort, we studied normative developmental differences in cerebral perfusion in males and females, as well as specific associations between puberty and CBF. Males and females had conspicuously divergent nonlinear trajectories in CBF evolution with development as modeled by penalized splines. Seventeen brain regions, including hubs of the executive and default mode networks, showed a robust nonlinear age-by-sex interaction that surpassed Bonferroni correction. Notably, within these regions the decline in CBF was similar between males and females in early puberty and only diverged in midpuberty, with CBF actually increasing in females. Taken together, these results delineate sex-specific growth curves for CBF during youth and for the first time to our knowledge link such differential patterns of development to the effects of puberty.

Striatal intrinsic reinforcement signals during recognition memory: relationship to response bias and dysregulation in schizophrenia

Ventral striatum (VS) is a critical brain region for reinforcement learning and motivation, and VS hypofunction is implicated in psychiatric disorders including schizophrenia. Providing rewards or performance feedback has been shown to activate VS. Intrinsically motivated subjects performing challenging cognitive tasks are likely to engage reinforcement circuitry even in the absence of external feedback or incentives. However, such intrinsic reinforcement responses have received little attention, have not been examined in relation to behavioral performance, and have not been evaluated for impairment in neuropsychiatric disorders such as schizophrenia. Here we used fMRI to examine a challenging “old” vs. “new” visual recognition task in healthy subjects and patients with schizophrenia. Targets were unique fractal stimuli previously presented as salient distractors in a visual oddball task, producing incidental memory encoding. Based on the prediction error theory of reinforcement learning, we hypothesized that correct target recognition would activate VS in controls, and that this activation would be greater in subjects with lower expectation of responding correctly as indexed by a more conservative response bias. We also predicted these effects would be reduced in patients with schizophrenia. Consistent with these predictions, controls activated VS and other reinforcement processing regions during correct recognition, with greater VS activation in those with a more conservative response bias. Patients did not show either effect, with significant group differences suggesting hyporesponsivity in patients to internally generated feedback. These findings highlight the importance of accounting for intrinsic motivation and reward when studying cognitive tasks, and add to growing evidence of reward circuit dysfunction in schizophrenia that may impact cognition and function.

Opposing amygdala and ventral striatum connectivity during emotion identification

Lesion and electrophysiological studies in animals provide evidence of opposing functions for subcortical nuclei such as the amygdala and ventral striatum, but the implications of these findings for emotion identification in humans remain poorly described. Here we report a high-resolution fMRI study in a sample of 39 healthy subjects who performed a well-characterized emotion identification task. As expected, the amygdala responded to THREAT (angry or fearful) faces more than NON-THREAT (sad or happy) faces. A functional connectivity analysis of the time series from an anatomically defined amygdala seed revealed a strong anticorrelation between the amygdala and the ventral striatum/ventral pallidum, consistent with an opposing role for these regions in during emotion identification. A second functional connectivity analysis (psychophysiological interaction) investigating relative connectivity on THREAT vs. NON-THREAT trials demonstrated that the amygdala had increased connectivity with the orbitofrontal cortex during THREAT trials, whereas the ventral striatum demonstrated increased connectivity with the posterior hippocampus on NON-THREAT trials. These results indicate that activity in the amygdala and ventral striatum may be inversely related, and that both regions may provide opposing affective bias signals during emotion identification.

Affective cognition and its disruption in mood disorders

In this review, we consider affective cognition, responses to emotional stimuli occurring in the context of cognitive evaluation. In particular, we discuss emotion categorization, biasing of memory and attention, as well as social/moral emotion. We discuss limited neuropsychological evidence suggesting that affective cognition depends critically on the amygdala, ventromedial frontal cortex, and the connections between them. We then consider neuroimaging studies of affective cognition in healthy volunteers, which have led to the development of more sophisticated neural models of these processes. Disturbances of affective cognition are a core and specific feature of mood disorders, and we discuss the evidence supporting this claim, both from behavioral and neuroimaging perspectives. Serotonin is considered to be a key neurotransmitter involved in depression, and there is a considerable body of research exploring whether serotonin may mediate disturbances of affective cognition. The final section presents an overview of this literature and considers implications for understanding the pathophysiology of mood disorder as well as developing and evaluating new treatment strategies.

Association of enhanced limbic response to threat with decreased cortical facial recognition memory response in schizophrenia

OBJECTIVE

Recognition memory of faces is impaired in patients with schizophrenia, as is the neural processing of threat-related signals, but how these deficits interact to produce symptoms is unclear. The authors used an affective face recognition paradigm to examine possible interactions between cognitive and affective neural systems in schizophrenia.

METHOD

Blood-oxygen-level-dependent response was examined by means of functional magnetic resonance imaging (3 Tesla) in healthy comparison subjects (N=21) and in patients with schizophrenia (N=12) or schizoaffective disorder, depressed type (N=4), during a two-choice recognition task that used images of human faces. Each target face, previously displayed with a threatening or nonthreatening affect, was displayed with neutral affect. Responses to successful recognition and responses to the effect of previously threatening versus nonthreatening affect were evaluated, and correlations with symptom severity (total Brief Psychiatric Rating Scale score) were examined. Functional connectivity analyses examined the relationship between activation in the amygdala and cortical regions involved in recognition memory.

RESULTS

Patients performed the task more slowly than healthy comparison subjects. Comparison subjects recruited the expected cortical regions to a greater degree than patients, and patients with more severe symptoms demonstrated proportionally less recruitment. Increased symptoms were also correlated with augmented amygdala and orbitofrontal cortex response to threatening faces. Comparison subjects exhibited a negative correlation between activity in the amygdala and cortical regions involved in cognition, while patients showed weakening of this relationship.

CONCLUSION

Increased symptoms were related to an enhanced threat response in limbic regions and a diminished recognition memory response in cortical regions, supporting a link between these two brain systems that are often examined in isolation. This finding suggests that abnormal processing of threat-related signals in the environment may exacerbate cognitive impairment in schizophrenia.

Neural correlates of psychotic symptoms in dementia with Lewy bodies

The aim of this study was to investigate the association between psychotic symptoms in dementia with Lewy bodies and brain perfusion on single photon emission tomography. Based on factor analysis in 145 patients, psychotic symptoms were classified into five symptom domains (factor 1 to 4-related symptoms and delusions). The relationship between each symptom domain and brain perfusion was assessed in 100 patients with dementia with Lewy bodies, while accounting for the effects of age, sex, dementia severity, parkinsonism and dysphoria. Factor 1 symptoms (Capgras syndrome, phantom boarder, reduplication of person and place and misidentification of person) represented misidentifications, and were significantly related to hypoperfusion in the left hippocampus, insula, ventral striatum and bilateral inferior frontal gyri. Factor 3 symptoms (visual hallucination of person and feeling of presence) represented hallucinations of person and were related to hypoperfusion in the left ventral occipital gyrus and bilateral parietal areas. Delusions of theft and persecution were associated with relative hyperperfusion in the right rostral medial frontal cortex, left medial superior frontal gyrus and bilateral dorsolateral frontal cortices. This study revealed that different psychotic symptoms in dementia with Lewy bodies were associated with distinguishable cerebral networks. Visual hallucinations were related to dysfunction of the parietal and occipital association cortices, misidentifications were related to dysfunction of the limbic-paralimbic structures and delusions were related to dysfunction of the frontal cortices. Our findings provide important insights into the pathophysiological mechanisms underlying psychotic symptoms in dementia with Lewy bodies.