Emotional processing during speech communication and positive symptoms in schizophrenia

Impaired emotion perception in schizophrenia shows sex differences with channel- and category-specific effects: A pilot study

Individuals with schizophrenia reportedly demonstrate deficits in emotion perception. Relevant studies on the effects of decoder's sex, communication channels and emotion categories have produced mixed findings and seldom explored the interactions among these three key factors. The present pilot study examined how male and female individuals with schizophrenia and healthy controls perceived emotional (e.g., angry, happy, and sad) and neutral expressions from verbal semantic and nonverbal prosodic and facial channels. Twenty-eight (11 females) individuals with schizophrenia and 30 healthy controls (13 females) were asked to recognize emotional facial expressions, emotional prosody, and emotional semantics. Both accuracy and response time showed subpar performance for all communication channels and emotional categories in the schizophrenia group. More severe emotion perception deficits were found with the nonverbal (not the verbal) materials. There was also a reduced level of impairment with anger perception, especially in the female individuals with schizophrenia while biased perception towards emotional semantics was more pronounced in male individuals with schizophrenia. These findings, although preliminary, indicate the channel- and category-specific nature of emotion perception with potential sex differences among people with schizophrenia, which has important theoretical and practical implications.

Comparison of Subjective Facial Emotion Recognition and "Facial Emotion Recognition Based on Multi-Task Cascaded Convolutional Network Face Detection" between Patients with Schizophrenia and Healthy Participants

Patients with schizophrenia may exhibit a flat affect and poor facial expressions. This study aimed to compare subjective facial emotion recognition (FER) and FER based on multi-task cascaded convolutional network (MTCNN) face detection in 31 patients with schizophrenia (patient group) and 40 healthy participants (healthy participant group). A Pepper Robot was used to converse with the 71 aforementioned participants; these conversations were recorded on video. Subjective FER (assigned by medical experts based on video recordings) and FER based on MTCNN face detection was used to understand facial expressions during conversations. This study confirmed the discriminant accuracy of the FER based on MTCNN face detection. The analysis of the smiles of healthy participants revealed that the kappa coefficients of subjective FER (by six examiners) and FER based on MTCNN face detection concurred (κ = 0.63). The perfect agreement rate between the subjective FER (by three medical experts) and FER based on MTCNN face detection in the patient, and healthy participant groups were analyzed using Fisher's exact probability test where no significant difference was observed (p = 0.72). The validity and reliability were assessed by comparing the subjective FER and FER based on MTCNN face detection. The reliability coefficient of FER based on MTCNN face detection was low for both the patient and healthy participant groups.

Investigation of Methods to Create Future Multimodal Emotional Data for Robot Interactions in Patients with Schizophrenia: A Case Study

Rapid progress in humanoid robot investigations offers possibilities for improving the competencies of people with social disorders, although this improvement of humanoid robots remains unexplored for schizophrenic people. Methods for creating future multimodal emotional data for robot interactions were studied in this case study of a 40-year-old male patient with disorganized schizophrenia without comorbidities. The qualitative data included heart rate variability (HRV), video-audio recordings, and field notes. HRV, Haar cascade classifier (HCC), and Empath API© were evaluated during conversations between the patient and robot. Two expert nurses and one psychiatrist evaluated facial expressions. The research hypothesis questioned whether HRV, HCC, and Empath API© are useful for creating future multimodal emotional data about robot–patient interactions. The HRV analysis showed persistent sympathetic dominance, matching the human–robot conversational situation. The result of HCC was in agreement with that of human observation, in the case of rough consensus. In the case of observed results disagreed upon by experts, the HCC result was also different. However, emotional assessments by experts using Empath API© were also found to be inconsistent. We believe that with further investigation, a clearer identification of methods for multimodal emotional data for robot interactions can be achieved for patients with schizophrenia.

Multisensory Integration of Emotion in Schizophrenic Patients

Multisensory integration (MSI) of emotion has been increasingly recognized as an essential element of schizophrenic patients' impairments, leading to the breakdown of their interpersonal functioning. The present review provides an updated synopsis of schizophrenics' MSI abilities in emotion processing by examining relevant behavioral and neurological research. Existing behavioral studies have adopted well-established experimental paradigms to investigate how participants understand multisensory emotion stimuli, and interpret their reciprocal interactions. Yet it remains controversial with regard to congruence-induced facilitation effects, modality dominance effects, and generalized vs specific impairment hypotheses. Such inconsistencies are likely due to differences and variations in experimental manipulations, participants' clinical symptomatology, and cognitive abilities. Recent electrophysiological and neuroimaging research has revealed aberrant indices in event-related potential (ERP) and brain activation patterns, further suggesting impaired temporal processing and dysfunctional brain regions, connectivity and circuities at different stages of MSI in emotion processing. The limitations of existing studies and implications for future MSI work are discussed in light of research designs and techniques, study samples and stimuli, and clinical applications.

Altered attentional processing of happy prosody in schizophrenia

BACKGROUND

Abnormalities in emotional prosody processing have been consistently reported in schizophrenia. Emotionally salient changes in vocal expressions attract attention in social interactions. However, it remains to be clarified how attention and emotion interact during voice processing in schizophrenia. The current study addressed this question by examining the P3b event-related potential (ERP) component.

METHOD

The P3b was elicited with a modified oddball task, in which frequent (p = .84) neutral stimuli were intermixed with infrequent (p = .16) task-relevant emotional (happy or angry) targets. Prosodic speech was presented in two conditions - with intelligible (semantic content condition - SCC) or unintelligible semantic content (prosody-only condition - POC). Fifteen chronic schizophrenia patients and 15 healthy controls were instructed to silently count the target vocal sounds.

RESULTS

Compared to controls, P3b amplitude was specifically reduced for happy prosodic stimuli in schizophrenia, irrespective of semantic status. Groups did not differ in the processing of neutral standards or angry targets.

DISCUSSION

The selectively reduced P3b for happy prosody in schizophrenia suggests top-down attentional resources were less strongly engaged by positive relative to negative prosody, reflecting alterations in the evaluation of the emotional salience of the voice. These results highlight the role played by higher-order processes in emotional prosody dysfunction in schizophrenia.

Improving emotion recognition in schizophrenia with "VOICES": An on-line prosodic self-training

Introduction

Emotion recognition (ER) deficits have been extensively demonstrated in schizophrenia. These deficiencies are not only restricted to facial emotion recognition but also include emotional prosody (tone of the voice) recognition deficits. They have been significantly associated with symptom severity and poor social functioning. The aim of this study was to test the efficacy, in real clinical conditions, of an online self-training prosodic game included in the Social Cognition rehabilitation program e-Motional Training.

Method

A randomized, single-blind multicenter clinical trial was conducted with 50 outpatients with schizophrenia or schizoaffective disorder. The control group was treated with Treatment-as-usual (TAU), based on drug therapy, case management and individual and group psychotherapy (not focused on Social Cognition). The intervention group was treated with TAU plus the employment of Voices, an online self-training program devised for prosodic rehabilitation.

Statistical analysis

Linear regression was used to evaluate the effectiveness of the intervention in emotion recognition measured with the Reading the Mind in the Voice–Spanish Version (RMV-SV).

Results

There were statistically significant differences between the intervention and control group measured with RMV-SV (β = 3,6[IC 95%], p<0.001), with a response variable in RMV post R² = 0,617.

Discussion

Voices, a prosodic rehabilitation game included in e-Motional Training, seems to be a promising tool for improving emotional voice recognition deficits in schizophrenia, filling the need for such interventions.

Emotional Prosody Processing in Schizophrenic Patients: A Selective Review and Meta-Analysis

Emotional prosody (EP) has been increasingly recognized as an important area of schizophrenic patients’ dysfunctions in their language use and social communication. The present review aims to provide an updated synopsis on emotional prosody processing (EPP) in schizophrenic disorders, with a specific focus on performance characteristics, the influential factors and underlying neural mechanisms. A literature search up to 2018 was conducted with online databases, and final selections were limited to empirical studies which investigated the prosodic processing of at least one of the six basic emotions in patients with a clear diagnosis of schizophrenia without co-morbid diseases. A narrative synthesis was performed, covering the range of research topics, task paradigms, stimulus presentation, study populations and statistical power with a quantitative meta-analytic approach in Comprehensive Meta-Analysis Version 2.0. Study outcomes indicated that schizophrenic patients’ EPP deficits were consistently observed across studies (d = −0.92, 95% CI = −1.06 < δ < −0.78), with identification tasks (d = −0.95, 95% CI = −1.11 < δ < −0.80) being more difficult to process than discrimination tasks (d = −0.74, 95% CI = −1.03 < δ < −0.44) and emotional stimuli being more difficult than neutral stimuli. Patients’ performance was influenced by both participant- and experiment-related factors. Their social cognitive deficits in EP could be further explained by right-lateralized impairments and abnormalities in primary auditory cortex, medial prefrontal cortex and auditory-insula connectivity. The data pointed to impaired pre-attentive and attentive processes, both of which played important roles in the abnormal EPP in the schizophrenic population. The current selective review and meta-analysis support the clinical advocacy of including EP in early diagnosis and rehabilitation in the general framework of social cognition and neurocognition deficits in schizophrenic disorders. Future cross-sectional and longitudinal studies are further suggested to investigate schizophrenic patients’ perception and production of EP in different languages and cultures, modality forms and neuro-cognitive domains.

Perception of emotion-related conflict in human communications: what are the effects of schizophrenia?

Our ability to make sense of emotional cues is of paramount importance for understanding state of mind and communicative intent. However, emotional cues often conflict with each other; this presents a significant challenge for people with schizophrenia. We conducted a theoretical review to determine the extent and types of impaired processing of emotion-related conflict in schizophrenia; we evaluated the relationship with medication and symptoms, and considered possible mediatory mechanisms. The literature established that people with schizophrenia demonstrated impaired function: (i) when passively exposed to emotion cues whilst performing an unrelated task, (ii) when selectively attending to one source of emotion cues whilst trying to ignore interference from another source, and (iii) when trying to resolve conflicting emotion cues and judge meta-communicative intent. These deficits showed associations with both negative and positive symptoms. There was limited evidence for antipsychotic medications attenuating impaired emotion perception when there are conflicting cues, with further direct research needed. Impaired attentional control and context processing may underlie some of the observed impairments. Neuroanatomical correlates are likely to involve interhemispheric transfer via the corpus callosum, limbic regions such as the amygdala, and possibly dorsolateral prefrontal and anterior cingulate cortex through their role in conflict processing.