Facial emotion recognition from moving and static point-light images in schizophrenia

Ties between reading faces, bodies, eyes, and autistic traits

While reading covered with masks faces during the COVID-19 pandemic, for efficient social interaction, we need to combine information from different sources such as the eyes (without faces hidden by masks) and bodies. This may be challenging for individuals with neuropsychiatric conditions, in particular, autism spectrum disorders. Here we examined whether reading of dynamic faces, bodies, and eyes are tied in a gender-specific way, and how these capabilities are related to autistic traits expression. Females and males accomplished a task with point-light faces along with a task with point-light body locomotion portraying different emotional expressions. They had to infer emotional content of displays. In addition, participants were administered the Reading the Mind in the Eyes Test, modified and Autism Spectrum Quotient questionnaire. The findings show that only in females, inferring emotions from dynamic bodies and faces are firmly linked, whereas in males, reading in the eyes is knotted with face reading. Strikingly, in neurotypical males only, accuracy of face, body, and eyes reading was negatively tied with autistic traits. The outcome points to gender-specific modes in social cognition: females rely upon merely dynamic cues while reading faces and bodies, whereas males most likely trust configural information. The findings are of value for examination of face and body language reading in neuropsychiatric conditions, in particular, autism, most of which are gender/sex-specific. This work suggests that if male individuals with autistic traits experience difficulties in reading covered with masks faces, these deficits may be unlikely compensated by reading (even dynamic) bodies and faces. By contrast, in females, reading covered faces as well as reading language of dynamic bodies and faces are not compulsorily connected to autistic traits preventing them from paying high costs for maladaptive social interaction.

Poor emotional responsiveness in clinical hypertension: Reduced accuracy in the labelling and matching of emotional faces amongst individuals with hypertension and prehypertension

Psychological factors are known to play an important part in the origin of many medical conditions including hypertension. Recent studies have reported elevated blood pressure (even in the normal range of variation) to be associated with a reduced responsiveness to emotions or 'emotional dampening'. Our aim was to assess emotional dampening in individuals with more extreme blood pressure levels including prehypertensives (N = 58) and hypertensives (N = 60) by comparing their emotion recognition ability with normotensives (N = 57). Participants completed novel facial emotion matching and facial emotion labelling tasks following blood pressure measurement and their accuracy of emotion recognition and average response times were compared. The normotensives demonstrated a significantly higher accuracy of emotion recognition than the prehypertensives and the hypertensives in labelling of facial emotions. This difference generalised to the task where two facial halves (upper & lower) had to be matched on the basis of emotions. In neither the labelling nor matching emotion conditions did the groups differ in their speed of emotion processing. Findings of the present study extend reports of 'emotional dampening' to hypertensives as well as to those at-risk for developing hypertension (i.e. prehypertensives) and have important implications for understanding the psychological component of such medical conditions as hypertension.

Biological motion processing in schizophrenia - Systematic review and meta-analysis

CONTEXT

Patients with schizophrenia show impairments in processing of biological motion. This is especially important since deficits in domains of social cognition has been associated with functional outcome and everyday functioning in this population.

OBJECTIVES

We conducted a systematic review and meta-analysis of studies which have used point-light displays to present whole-body motion to patients with schizophrenia and healthy controls, to evaluate the magnitude of differences between these groups in biological motion processing.

METHOD

Firstly, relevant publications were identified by a systematic search of Google Scholar and PubMed databases. Secondly, we excluded non-relevant studies for the meta-analysis according to our exclusion criteria. Effect sizes were expressed as standardized mean difference (SMD).

RESULTS

15 papers reporting results of 14 different experiments with 571 patients and 482 controls were included in the meta-analysis. The results for the general biological motion perception analysis revealed that patients with schizophrenia (compared with healthy controls) present reduced biological motion processing capacity with the effect size (SMD) of 0.66 (95% CI, -0.79 to -0.54; p<0.001). The results for the specific biological motion-based tasks were also statistically significant with SMD of 0.72 for Basic Biological Motion task (95% CI: -0.94 to -0.51; p<0.001) and SMD of 0.61 for Emotion in Biological Motion task, (95% CI: -0.79 to -0.43; p<0.001) respectively.

CONCLUSION

The findings from our meta-analysis highlight abnormalities in general and specific domains of biological motion perception in schizophrenia patients as compared with healthy controls.

Reading Emotions from Body Movement: A Generalized Impairment in Schizophrenia

Body language reading is a social cognitive process with importance for successful maneuvering of social situations. In this study, we investigated body language reading as assessed with human point-light displays in participants with a diagnosis of schizophrenia (n = 84) compared to healthy control participants (n = 84), aiming to answer three questions: (1) whether persons with a diagnosis of schizophrenia have poorer body language reading abilities than healthy persons; (2) whether some emotions are easier to read from body language than others, and if this is the same for individuals with schizophrenia and healthy individuals, and (3) whether there are sex differences in body language reading in participants with schizophrenia and healthy participants. A fourth research aim concerned associations of body language reading with symptoms and functioning in participants with schizophrenia. Scores on the body language reading measure was first standardized using a separate sample of healthy control participants (n = 101). Further results showed that persons with schizophrenia had impaired body language reading ability compared to healthy persons. A significant effect of emotion indicated that some emotions (happiness, neutral) were easier to recognize and this was so for both individuals with schizophrenia and healthy individuals. There were no sex differences for either diagnostic group. Body language reading ability was not associated with symptoms or functioning. In conclusion; schizophrenia was characterized by a global impairment in body language reading that was present for all emotions and across sex.

Neural responses to dynamic multimodal stimuli and pathology-specific impairments of social cognition in schizophrenia and depression

BACKGROUND

Individuals with schizophrenia and people with depression both show abnormal behavioural and neural responses when perceiving and responding to emotional stimuli, but pathology-specific differences and commonalities remain mostly unclear.

AIMS

To directly compare empathic responses to dynamic multimodal emotional stimuli in a group with schizophrenia and a group with depression, and to investigate their neural correlates using functional magnetic resonance imaging (fMRI).

METHOD

The schizophrenia group (n = 20), the depression group (n = 24) and a control group (n = 24) were presented with portrait-shot video clips expressing emotion through three possible communication channels: facial expression, prosody and content. Participants rated their own and the actor's emotional state as an index of empathy.

RESULTS

Although no group differences were found in empathy ratings, characteristic differences emerged in the fMRI activation patterns. The schizophrenia group demonstrated aberrant activation patterns during the neutral speech content condition in regions implicated in multimodal integration and formation of semantic constructs. Those in the depression group were most affected during conditions with trimodal emotional and trimodal neutral stimuli, in key regions of the mentalising network.

CONCLUSIONS

Our findings reveal characteristic differences in patients with schizophrenia compared with those with depression in their cortical responses to dynamic affective stimuli. These differences indicate that impairments in responding to emotional stimuli may be caused by pathology-specific problems in social cognition.

Borderline personality disorder is associated with lower confidence in perception of emotional body movements

Much recent research has shown that personality disorders are associated with an altered emotion perception. Whereas most of this research was conducted with stimuli such as faces, the present study examined possible differences in the perception of emotions expressed via body language and body movements. 30 patients with borderline personality disorder (BPD) and 30 non-patients observed video scenes of emotional human interactions conveyed by point–light displays, rated the depicted valence, and judged their confidence in this rating. Patients with BPD showed no altered emotion perception (i.e., no biased perception in either a negative or a positive direction). They did not perceive and evaluate depicted emotions as being more extreme than healthy controls. However, patients with BPD showed less confidence in their perception of depicted emotions, especially when these were difficult to identify. The findings extend insights on altered emotion perception in persons with BPD to include the field of body movements.

Brain mapping biomarkers of socio-emotional processing in schizophrenia

The Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS) initiative has formed with the expressed intent of identifying constructs and paradigms that would identify biomarkers of psychosis. The manipulation of these biomarkers would serve as targets for treatment interventions. The second phase of CNTRICS consisted of critical discussions evaluating brain mapping (functional neuroimaging and brain electrical activity) paradigms as biomarkers to measure specific constructs. Among the constructs identified in, CNTRICS I was socio-emotional processing, specifically focused on affect recognition. Here, we provide a critical appraisal of the ability of candidate socio-emotional tasks to identify putative biomarkers and recommendations for future directions in this rapidly moving research domain.

Recognition of Emotion in Moving and Static Composite Faces

This paper investigates whether the greater accuracy of emotion identification for dynamic versus static expressions, as noted in previous research, can be explained through heightened levels of either component or configural processing. Using a paradigm by Young, Hellawell, and Hay (1987 ), we tested recognition performance of aligned and misaligned composite faces with six basic emotions (happiness, fear, disgust, surprise, anger, sadness). Stimuli were created using 3D computer graphics and were shown as static peak expressions (static condition) and 7 s video sequences (dynamic condition). The results revealed that, overall, moving stimuli were better recognized than static faces, although no interaction between motion and other factors was found. For happiness, sadness, and surprise, misaligned composites were better recognized than aligned composites, suggesting that aligned composites fuse to form a single expression, while the two halves of misaligned composites are perceived as two separate emotions. For anger, disgust, and fear, this was not the case. These results indicate that emotions are perceived on the basis of both configural and component-based information, with specific activation patterns for separate emotions, and that motion has a quality of its own and does not increase configural or component-based recognition separately.

Facial emotion perception in schizophrenia: a meta-analytic review

OBJECTIVES

A considerable body of literature has reported on emotion perception deficits and the relevance to clinical symptoms and social functioning in schizophrenia. Studies published between 1970-2007 were examined regarding emotion perception abilities between patient and control groups and potential methodological, demographic, and clinical moderators. DATA SOURCES AND REVIEW: Eighty-six studies were identified through a computerized literature search of the MEDLINE, PsychINFO, and PubMed databases. A quality of reporting of meta-analysis standard was followed in the extraction of relevant studies and data. Data on emotion perception, methodology, demographic and clinical characteristics, and antipsychotic medication status were compiled and analyzed using Comprehensive Meta-analysis Version 2.0 (Borenstein M, Hedges L, Higgins J and Rothstein H. Comprehensive Meta-analysis. 2. Englewood, NJ: Biostat; 2005).

RESULTS

The meta-analysis revealed a large deficit in emotion perception in schizophrenia, irrespective of task type, and several factors that moderated the observed impairment. Illness-related factors included current hospitalization and--in part--clinical symptoms and antipsychotic treatment. Demographic factors included patient age and gender in controls but not race.

CONCLUSION

Emotion perception impairment in schizophrenia represents a robust finding in schizophrenia that appears to be moderated by certain clinical and demographic factors. Future directions for research on emotion perception are discussed.

Facial emotion perception in schizophrenia: a meta-analytic review

OBJECTIVES

A considerable body of literature has reported on emotion perception deficits and the relevance to clinical symptoms and social functioning in schizophrenia. Studies published between 1970-2007 were examined regarding emotion perception abilities between patient and control groups and potential methodological, demographic, and clinical moderators. DATA SOURCES AND REVIEW: Eighty-six studies were identified through a computerized literature search of the MEDLINE, PsychINFO, and PubMed databases. A quality of reporting of meta-analysis standard was followed in the extraction of relevant studies and data. Data on emotion perception, methodology, demographic and clinical characteristics, and antipsychotic medication status were compiled and analyzed using Comprehensive Meta-analysis Version 2.0 (Borenstein M, Hedges L, Higgins J and Rothstein H. Comprehensive Meta-analysis. 2. Englewood, NJ: Biostat; 2005).

RESULTS

The meta-analysis revealed a large deficit in emotion perception in schizophrenia, irrespective of task type, and several factors that moderated the observed impairment. Illness-related factors included current hospitalization and--in part--clinical symptoms and antipsychotic treatment. Demographic factors included patient age and gender in controls but not race.

CONCLUSION

Emotion perception impairment in schizophrenia represents a robust finding in schizophrenia that appears to be moderated by certain clinical and demographic factors. Future directions for research on emotion perception are discussed.

CNTRICS final task selection: social cognitive and affective neuroscience-based measures

This article describes the results and recommendations of the third Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia meeting related to measuring treatment effects on social and affective processing. At the first meeting, it was recommended that measurement development focuses on the construct of emotion identification and responding. Five Tasks were nominated as candidate measures for this construct via the premeeting web-based survey. Two of the 5 tasks were recommended for immediate translation, the Penn Emotion Recognition Task and the Facial Affect Recognition and the Effects of Situational Context, which provides a measure of emotion identification and responding as well as a related, higher level construct, context-based modulation of emotional responding. This article summarizes the criteria-based, consensus building analysis of each nominated task that led to these 2 paradigms being recommended as priority tasks for development as measures of treatment effects on negative symptoms in schizophrenia.

Dysfunction in configural face processing in patients with schizophrenia

BACKGROUND

Face recognition has important implications for patients with schizophrenia, who exhibit poor interpersonal and social skills. Previous reports have suggested that patients with schizophrenia have deficits in their ability to recognize faces, and because face recognition relies heavily on information about the configuration of faces, we hypothesized that patients with schizophrenia would have specific problems in processing configural information.

METHODS

We measured the performance of 20 patients with schizophrenia and 20 normal subjects in a face-discrimination task, using upright and inverted pairs of face photographs that differed in featural or configural information.

RESULTS

The patients with schizophrenia showed disproportionately poorer performance in discriminating configural compared with featural face sets.

CONCLUSION

The result suggests that the face-recognition deficit in schizophrenic patients is due to specific impairments in configural processing of faces.