Introduction to the Special Issue on Nonconscious Mimicry: History, Applications, and Theoretical and Methodological Innovations

Movement Synchrony and Facial Synchrony as Diagnostic Features of Depression: A Pilot Study

ABSTRACT

The pilot study investigated with a matched-subjects design whether nonverbal synchrony is a diagnostic feature for depression and whether it mediates between depression and postsession ratings of the interviewer behavior. The sample includes n = 15 patients with major depression and n = 15 healthy controls (aged 20-30 years, 40% female). We conducted structured diagnostic interviews for somatic complaints to standardize the recording setting, issue, and course of conversation. Body movements and facial expressions were coded automatically frame by frame using computer vision methods. Ratings of the interviewers' professional behavior and positive affect were assessed using questionnaires. Patients with depression showed less movement synchrony and less synchronous positive facial expressions. Only synchronous positive expressions mediated between depression and less perceived positive affect. We conclude that the applied methodology is well suited to examine nonverbal processes under naturalistic but widely standardized conditions and that depression affects the nonverbal communication in medical conversations.

Perceiving emotions in visual stimuli: social verbal context facilitates emotion detection of words but not of faces

Building on the notion that processing of emotional stimuli is sensitive to context, in two experimental tasks we explored whether the detection of emotion in emotional words (task 1) and facial expressions (task 2) is facilitated by social verbal context. Three different levels of contextual supporting information were compared, namely (1) no information, (2) the verbal expression of an emotionally matched word pronounced with a neutral intonation, and (3) the verbal expression of an emotionally matched word pronounced with emotionally matched intonation. We found that increasing levels of supporting contextual information enhanced emotion detection for words, but not for facial expressions. We also measured activity of the corrugator and zygomaticus muscle to assess facial simulation, as processing of emotional stimuli can be facilitated by facial simulation. While facial simulation emerged for facial expressions, the level of contextual supporting information did not qualify this effect. All in all, our findings suggest that adding emotional-relevant voice elements positively influence emotion detection.