Associations between movement synchrony and outcome in patients with social anxiety disorder: Evidence for treatment specific effects

Interpersonal neural synchrony and mental disorders: unlocking potential pathways for clinical interventions

Introduction

Interpersonal synchronization involves the alignment of behavioral, affective, physiological, and brain states during social interactions. It facilitates empathy, emotion regulation, and prosocial commitment. Mental disorders characterized by social interaction dysfunction, such as Autism Spectrum Disorder (ASD), Reactive Attachment Disorder (RAD), and Social Anxiety Disorder (SAD), often exhibit atypical synchronization with others across multiple levels. With the introduction of the "second-person" neuroscience perspective, our understanding of interpersonal neural synchronization (INS) has improved, however, so far, it has hardly impacted the development of novel therapeutic interventions.

Methods

To evaluate the potential of INS-based treatments for mental disorders, we performed two systematic literature searches identifying studies that directly target INS through neurofeedback (12 publications; 9 independent studies) or brain stimulation techniques (7 studies), following PRISMA guidelines. In addition, we narratively review indirect INS manipulations through behavioral, biofeedback, or hormonal interventions. We discuss the potential of such treatments for ASD, RAD, and SAD and using a systematic database search assess the acceptability of neurofeedback (4 studies) and neurostimulation (4 studies) in patients with social dysfunction.

Results

Although behavioral approaches, such as engaging in eye contact or cooperative actions, have been shown to be associated with increased INS, little is known about potential long-term consequences of such interventions. Few proof-of-concept studies have utilized brain stimulation techniques, like transcranial direct current stimulation or INS-based neurofeedback, showing feasibility and preliminary evidence that such interventions can boost behavioral synchrony and social connectedness. Yet, optimal brain stimulation protocols and neurofeedback parameters are still undefined. For ASD, RAD, or SAD, so far no randomized controlled trial has proven the efficacy of direct INS-based intervention techniques, although in general brain stimulation and neurofeedback methods seem to be well accepted in these patient groups.

Discussion

Significant work remains to translate INS-based manipulations into effective treatments for social interaction disorders. Future research should focus on mechanistic insights into INS, technological advancements, and rigorous design standards. Furthermore, it will be key to compare interventions directly targeting INS to those targeting other modalities of synchrony as well as to define optimal target dyads and target synchrony states in clinical interventions.

Catching a (sine) wave: Temporal dynamics of nonverbal synchrony in social anxiety disorder

Individuals with social anxiety disorder (SAD) experience a range of interpersonal problems and studies have found that nonverbal synchrony (the coordination between interaction partners' movements) may be impaired in dyads in which one individual has SAD (Asher et al., 2020). In the present study, we examined the temporal dynamics of nonverbal synchrony during "getting aquatinted" conversations of individuals with and without SAD. Specifically, participants (n = 146) formed either SAD dyads (dyads in which one individual had SAD and the other did not; n = 37 dyads), or control dyads (dyads in which both individuals did not have SAD; n = 36 dyads). Dyads were randomized to either small talk or closeness-generating (i.e., intimate) conversations. We found that during conversations, nonverbal synchrony followed a repeating pattern of increases and decreases that was best modeled by a sinusoidal wave (explained variance = 63.74 %). We found significant Diagnosis × Social Context interactions in the temporal dynamics of nonverbal synchrony (i.e., in the parameters of sine waves). Specifically, we found that for SAD dyads (but not control dyads), the average sine wave amplitude which indicates increases and decreases in nonverbal synchrony was greater during small talk conversations compared to closeness-generating conversations. In addition, we found that among control dyads (but not SAD dyads), the average vertical offset of sine waves (i.e., the average level of nonverbal synchrony) during closeness-generating conversations was greater compared to small talk conversations. The findings are interpreted within the context of the social anxiety literature as capturing two distinct social-anxiety related processes, and suggest that when examined temporally (rather than averaged), nonverbal synchrony may be an important implicit biomarker of SAD.

Individual-Specific Animated Profiles of Mental Health

How important is the timing of the pretreatment evaluation? If we consider mental health to be a relatively fixed condition, the specific timing (e.g., day, hour) of the evaluation is immaterial and often determined on the basis of technical considerations. Indeed, the fundamental assumption underlying the vast majority of psychotherapy research and practice is that mental health is a state that can be captured in a one-dimensional snapshot. If this fundamental assumption, underlying 80 years of empirical research and practice, is incorrect, it may help explain why for decades psychotherapy failed to rise above the 50% efficacy rate in the treatment of mental-health disorders, especially depression, a heterogeneous disorder and the leading cause of disability worldwide. Based on recent studies suggesting within-individual dynamics, this article proposes that mental health and its underlying therapeutic mechanisms have underlying intrinsic dynamics that manifest across dimensions. Computational psychotherapy is needed to develop individual-specific pretreatment animated profiles of mental health. Such individual-specific animated profiles are expected to improve the ability to select the optimal treatment for each patient, devise adequate treatment plans, and adjust them on the basis of ongoing evaluations of mental-health dynamics, creating a new understanding of therapeutic change as a transition toward a more adaptive animated profile.

Inhibiting responses under the watch of a recently synchronized peer increases self-monitoring: evidence from functional near-infrared spectroscopy

Developing motor synchrony with a peer (through interventions such as the mirror game) can yield collaborative, cognitive and social benefits. However, it is also well established that observation by an audience can improve cognition. The combined and relative advantages offered by motor synchronization and audience effects are not yet understood. It is important to address this gap to determine the extent to which synchronizing activities might interact with the positive effects of an audience. In this preregistered study, we investigate the extent to which response inhibition may be improved when observed by a peer after motor synchronization with this peer. We compare behavioural and cortical (functional near-infrared spectroscopy; fNIRS) measures of inhibition between synchronized and non-synchronized dyads and find that the presence of a synchronized peer-audience introduces a speed-accuracy trade-off, consisting of slower reaction times and improved accuracy. This co-occurs with cortical activation in bilateral inferior frontal and middle prefrontal cortices, which are implicated in monitoring and maintenance of social alignment. Our findings have implications for carers and support people, who may benefit from synchronizing activities for rehabilitating inhibition and social skills in clinical settings.

The role of interpersonal coordination dynamics in alliance rupture and repair processes in psychotherapy-A systematic review

Introduction

The purpose of this systematic review is to expand our knowledge of the underlying mechanisms of the alliance in psychotherapy. This is done by examining the association between alliance rupture and repair processes and interpersonal coordination dynamics.

Method

A systematic review based on PRISMA guidelines was conducted, aimed at papers investigating the association between alliance rupture and repair episodes and different behavioral modalities (i.e., physiology, movement) in the psychotherapeutic interaction. Seventeen studies were included for full text-analysis.

Results

The results indicate that rupture and repair episodes were associated with interpersonal coordination dynamics. Different modalities (movement, heart rate, and vocalization) were found to serve as markers for alliance rupture and repair events. Facial expressions, physiological arousal, vocalization, and behavior were found to play important roles in the therapeutic interaction in relation to mutual emotion regulation, empathic response, safety, trust, and meaning-making.

Discussion

Limitations of this review are discussed, including the great methodological variation and selection bias observed in the reviewed studies. Recommendations for future research in this area are presented. Overall, interpersonal coordination dynamics was found to have the potential to help identify and manage alliance ruptures and foster repairs in the therapeutic interaction, which has high potential for future clinical work and training.

Nonverbal synchrony in diagnostic interviews of individuals with social anxiety disorder

The present study examined nonverbal synchrony (i.e., synchrony between individuals' movement) during diagnostic interviews of individuals with and without social anxiety disorder (SAD). Specifically, 42 individuals with SAD and 42 individuals without SAD underwent a structured clinical interview, and videos of clinical interviews were analysed using Motion Energy Analysis (an objective machine-based video analysis) to quantify each individuals' movement as well as dyadic synchrony. Results indicated that interviews of individuals with SAD had significantly lower levels of nonverbal synchrony compared to interviews of individuals without SAD. In addition, interviews of individuals with SAD had lower levels of pacing compared to interviews of individuals without SAD (pacing refers to synchrony in which the interviewer initiates movement to which the participant responds). Analyses with social anxiety represented as a continuum of severity (vs. a diagnostic dichotomy) resulted in similar findings. Thus, individuals with SAD synchronized with interviewers' movement to a lesser extent compared to individuals without SAD, and social anxiety was associated with diminished synchrony. Implications for psychopathology and diagnosis of SAD are discussed.

Client-counselor behavioral and inter-brain synchronization among dismissing and secure clients and its association with alliance quality and outcome

Objective This study aimed to explore whether behavioral synchrony (BS) and inter-brain synchrony (IBS) could serve as potential biomarkers for alliance quality or outcomes among clients with different adult attachment styles. Method: We assessed the clients' self-report working alliance and clinical outcomes as well as simultaneously measured BS using motion energy analysis (MEA) and IBS with functional near-infrared spectroscopy (fNIRS) among 37 secure (N = 21) or dismissing (N = 16) clients with their counselors during the first psychological counseling meeting. Results: Dismissing dyads manifested significantly higher late-stage counselor-led and client-led IBS (p = .018) than secure dyads. Adult attachment style served as the moderators in the correlation of both whole-stage client-led BS with bond dimension of alliance (p = .015) as well as in the correlation of both whole-stage no-lag IBS with CORE-10 score changes (p = .022). Moreover, increases in the whole-stage client-led BS were significantly associated with decreases in early-stage, late-stage and whole-stage no-lag IBS (all ps ≤ 0.01). Conclusion: These findings revealed the potentially impeding role of interpersonal synchrony in alliance quality for dismissing clients, at least during the first psychological counseling meetings. They also might partially validate the relationship between different modalities of interpersonal synchrony.

Facilitating dyadic synchrony in psychotherapy sessions: Systematic review and meta-analysis

Objective: This paper highlights the facilitation of dyadic synchrony as a core psychotherapist skill that occurs at the non-verbal level and underlies many other therapeutic methods. We define dyadic synchrony, differentiate it from similar constructs, and provide an excerpt illustrating dyadic synchrony in a psychotherapy session. Method: We then present a systematic review of 17 studies that have examined the associations between dyadic synchrony and psychotherapy outcomes. We also conduct a meta-analysis of 8 studies that examined whether there is more synchrony between clients and therapists than would be expected by chance. Results: Weighted box score analysis revealed that the overall association of synchrony and proximal as well as distal outcomes was neutral to mildly positive. The results of the meta-analysis indicated that real client-therapist dyad pairs exhibited synchronized behavioral patterns to a much greater extent than a sample of randomly paired people who did not actually speak. Conclusion: Our discussion revolves around how synchrony can be facilitated in a beneficial way, as well as situations in which it may not be beneficial. We conclude with training implications and therapeutic practices.

Long-term psychodynamic psychotherapy in a face-to-face versus videoconferencing setting: A single case study

OBJECTIVE

Due to the coronavirus pandemic and crisis, psychotherapists around the world were forced to switch to video- or tele-based treatments overnight. To date, only a few studies on the effectiveness of video-based psychodynamic psychotherapy via the Internet exist. Therefore, the goal of the present study was to examine symptom improvement, therapeutic relationship, nonverbal synchrony processes, and intersession processes within a systematic single case design and compare face-to-face to video-based approaches in long-term psychodynamic-oriented psychotherapy.

METHODS

We examined 85 sessions of a client with major depression whose psychodynamic psychotherapy changed from a face-to-face setting to a video-based setting. Video recordings were analyzed using motion energy analysis, and nonverbal synchrony was computed using a surrogate synchrony approach. Time series analyses were performed to analyze changes in symptom severity, therapeutic relationship, and intersession processes.

RESULTS

The results showed that symptom severity improved descriptively, but not significantly, across the entire course of psychotherapy. There were significant differences, however, in the therapeutic relationship, intersession experiences, and synchronous behavior between the face-to-face and video-based settings.

CONCLUSION

The results indicate that the presented methodology is well situated to investigate the question whether psychodynamic psychotherapy in video-based setting works in the sameway as in a face-to-face setting.

multiSyncPy: A Python package for assessing multivariate coordination dynamics

In order to support the burgeoning field of research into intra- and interpersonal synchrony, we present an open-source software package: multiSyncPy. Multivariate synchrony goes beyond the bivariate case and can be useful for quantifying how groups, teams, and families coordinate their behaviors, or estimating the degree to which multiple modalities from an individual become synchronized. Our package includes state-of-the-art multivariate methods including symbolic entropy, multidimensional recurrence quantification analysis, coherence (with an additional sum-normalized modification), the cluster-phase 'Rho' metric, and a statistical test based on the Kuramoto order parameter. We also include functions for two surrogation techniques to compare the observed coordination dynamics with chance levels and a windowing function to examine time-varying coordination for most of the measures. Taken together, our collation and presentation of these methods make the study of interpersonal synchronization and coordination dynamics applicable to larger, more complex and often more ecologically valid study designs. In this work, we summarize the relevant theoretical background and present illustrative practical examples, lessons learned, as well as guidance for the usage of our package - using synthetic as well as empirical data. Furthermore, we provide a discussion of our work and software and outline interesting further directions and perspectives. multiSyncPy is freely available under the LGPL license at: https://github.com/cslab-hub/multiSyncPy , and also available at the Python package index.

Cross-Correlation- and Entropy-Based Measures of Movement Synchrony: Non-Convergence of Measures Leads to Different Associations with Depressive Symptoms

BACKGROUND

Several algorithms have been proposed to quantify synchronization. However, little is known about their convergent and predictive validity.

METHODS

The sample included 30 persons who completed a manualized interview focusing on psychosomatic symptoms. The intensity of body motions was measured using motion-energy analysis. We computed several measures of movement synchrony based on the time series of the interviewer and participant: mutual information, windowed cross-recurrence analysis, cross-correlation, rMEA, SUSY, SUCO, WCLC-PP and WCLR-PP. Depressive symptoms were assessed with the Patient Health Questionnaire (PHQ9).

RESULTS

According to the explorative factor analyses, all the variants of cross-correlation and all the measures of SUSY, SUCO and rMEA-WCC led to similar synchrony measures and could be assigned to the same factor. All the mutual-information measures, rMEA-WCLC, WCLC-PP-F, WCLC-PP-R2, WCLR-PP-F, and WinCRQA-DET loaded on the second factor. Depressive symptoms correlated negatively with WCLC-PP-F and WCLR-PP-F and positively with rMEA-WCC, SUCO-ES-CO, and MI-Z.

CONCLUSION

More standardization efforts are needed because different synchrony measures have little convergent validity, which can lead to contradictory conclusions concerning associations between depressive symptoms and movement synchrony using the same dataset.

Dyadic nonverbal synchrony during pre and post music therapy interventions and its relationship to self-reported therapy readiness

Nonverbal interpersonal synchronization has been established as an important factor in therapeutic relationships, and the differentiation of who leads the interaction appears to provide further important information. We investigated nonverbal synchrony - quantified as the coordination of body movement between patient and therapist. This was observed in music therapy dyads, while engaged in verbal interaction before and after a music intervention in the session. We further examined associations with patients' self-reported therapy readiness at the beginning of the session. Eleven neurological in-patients participated in this study. Our results showed an increase in both nonverbal synchrony and patient leading after the music intervention. A significant negative correlation was found between self-reported therapy readiness and nonverbal synchrony after the music intervention. These findings point to the empathic ability of the music therapist to sense patients' therapy readiness. Higher patient leading in nonverbal synchrony after the music intervention may thus indicate that the music intervention may have allowed dyadic entrainment to take place, potentially increasing self-regulation and thus empowering patients.

Inter-brain plasticity as a biological mechanism of change in psychotherapy: A review and integrative model

Recent models of psychopathology and psychotherapy highlight the importance of interpersonal factors. The current review offers a biological perspective on these interpersonal processes by examining inter-brain synchrony—the coupling of brain activity between people interacting with one another. High inter-brain synchrony is associated with better relationships in therapy and in daily life, while deficits in the ability to achieve inter-brain synchrony are associated with a variety of psychological and developmental disorders. The review suggests that therapy improves patients’ ability to achieve such synchrony through inter-brain plasticity—a process by which recurring exposure to high inter-brain synchrony leads to lasting change in a person’s overall ability to synchronize. Therapeutic sessions provide repeated situations with high inter-brain synchrony. This can lead to a long-term increase in the ability to synchronize, first with the therapist, then generalized to other interpersonal relationships, ultimately leading to symptom reduction. The proposed inter-brain plasticity model offers a novel biological framework for understanding relational change in psychotherapy and its links to various forms of psychopathology and provides testable hypotheses for future research. Understanding this mechanism may help improve existing psychotherapy methods and develop new ones.

Nonverbal synchrony in subjects with hearing impairment and their significant others

Introduction

Hearing loss has a great impact on the people affected, their close partner and the interaction between both, as oral communication is restricted. Nonverbal communication, which expresses emotions and includes implicit information on interpersonal relationship, has rarely been studied in people with hearing impairment (PHI). In psychological settings, non-verbal synchrony of body movements in dyads is a reliable method to study interpersonal relationship.

Material and methods

A 10-min social interaction was videorecorded in 39 PHI (29 spouses and 10 parent-child dyads) and their significant others (SOs). Nonverbal synchrony, which means the nonverbal behaviors of two interacting persons (referring to both general synchrony and the role of leading) and verbal interaction (percentage of speech, frequency of repetitions, and queries) were analyzed by computer algorithms and observer ratings. Hearing-related quality of life, coping mechanisms, general psychopathology, quality of relationship, and burden of hearing loss experienced by SOs were assessed using questionnaires.

Results

In the 39 dyads, true nonverbal synchrony differed from pseudosynchrony [t_(43.4) = 2.41; p = 0.02] with a medium effect size (d = 0.42). Gender of PHI had a significant effect on general synchrony (p = 0.025) and on leading by SOs (p = 0.017). Age gap correlated with synchronic movements (p = 0.047). Very short duration of hearing impairment was associated with lower nonverbal synchrony in the role of leading by SOs (p = 0.031). Feeling of closeness by PHI correlated negatively with the role of leading by SOs (p > 0.001) and feeling of closeness by SOs was positively associated with leading by PHI (p = 0.015). No correlation was detected between nonverbal synchrony and other questionnaires. Burden experienced by the SOs was higher in SOs who reported less closeness (p = 0.014).

Discussion

A longer hearing impairment leads to more nonverbal leading by SOs compared to PHI with very short duration of hearing loss, possibly because of the long-lasting imbalance in communication. If PHI felt more closeness, SOs led less and vice versa. Burden experienced by SOs negatively correlated with closeness reported by SOs. Use of nonverbal signals and communication might help to improve benefits of auditory rehabilitation for PHI and decrease burden experienced by SOs.

Experiences of mimicry in eating disorders

BACKGROUND

People unknowingly mimic the behaviors of others, a process that results in feelings of affiliation. However, some individuals with eating disorders describe feeling "triggered" when mimicked. This study explores the effects of implicit non-verbal mimicry on individuals with a history of an eating disorder (ED-His) compared to healthy controls (HCs).

METHOD

Women (N = 118, n_ED-His = 31; M_age = 21 years) participated in a laboratory task with a confederate trained to either discreetly mimic (Mimicry condition) or not mimic (No-Mimicry condition) the mannerisms of the participant. Participants rated the likability of the confederate and the smoothness of the interaction.

RESULTS

Participants in the No-Mimicry condition rated the confederate as significantly more likable than in the Mimicry condition, and ED-His rated the confederate as more likable than HCs. ED-His in the Mimicry condition rated the interaction as less smooth than HCs, whereas this pattern was not found in the No-Mimicry condition. Among ED-His, longer disorder duration (≥ 3.87 years) was associated with less liking of a confederate who mimicked and more liking of a confederate who did not mimic.

CONCLUSIONS

We discuss the implications of these findings for interpersonal therapeutic processes and group treatment settings for eating disorders. Our study on subtle, nonverbal mimicry revealed differences in social behavior for women with a history of an eating disorder compared to healthy women. For participants with an eating disorder history, a longer duration of illness was associated with a worse pattern of affiliation, reflected in lower liking of a mimicker. Further research on how diverging processes of affiliation may function to perpetuate the chronicity of eating disorders and implications for treatment is needed.

Associations Between Sympathetic Nervous System Synchrony, Movement Synchrony, and Speech in Couple Therapy

Background

Research on interpersonal synchrony has mostly focused on a single modality, and hence little is known about the connections between different types of social attunement. In this study, the relationship between sympathetic nervous system synchrony, movement synchrony, and the amount of speech were studied in couple therapy.

Methods

Data comprised 12 couple therapy cases (24 clients and 10 therapists working in pairs as co-therapists). Synchrony in electrodermal activity, head and body movement, and the amount of speech and simultaneous speech during the sessions were analyzed in 12 sessions at the start of couple therapy (all 72 dyads) and eight sessions at the end of therapy (48 dyads). Synchrony was calculated from cross-correlations using time lags and compared to segment-shuffled pseudo synchrony. The associations between the synchrony modalities and speech were analyzed using complex modeling (Mplus).

Findings

Couple therapy participants' synchrony mostly occurred in-phase (positive synchrony). Anti-phase (negative) synchrony was more common in movement than in sympathetic nervous system activity. Synchrony in sympathetic nervous system activity only correlated with movement synchrony between the client-therapist dyads (r = 0.66 body synchrony, r = 0.59 head synchrony). Movement synchrony and the amount of speech correlated negatively between spouses (r = -0.62 body synchrony, r = -0.47 head synchrony) and co-therapists (r = -0.39 body synchrony, r = -0.28 head synchrony), meaning that the more time the dyad members talked during the session, the less bodily synchrony they exhibited.

Conclusion

The different roles and relationships in couple therapy were associated with the extent to which synchrony modalities were linked with each other. In the relationship between clients and therapists, synchrony in arousal levels and movement "walked hand in hand", whereas in the other relationships (spouse or colleague) they were not linked. Generally, more talk time by the therapy participants was associated with anti-phase movement synchrony. If, as suggested, emotions prepare us for motor action, an important finding of this study is that sympathetic nervous system activity can also synchronize with that of others independently of motor action.

Movement-based patient-therapist attunement in psychological therapy and its association with early change

Objective

Attunement is a novel measure of nonverbal synchrony reflecting the duration of the present moment shared by two interaction partners. This study examined its association with early change in outpatient psychotherapy.

Methods

Automated video analysis based on motion energy analysis (MEA) and cross-correlation of the movement time-series of patient and therapist was conducted to calculate movement synchrony for N = 161 outpatients. Movement-based attunement was defined as the range of connected time lags with significant synchrony. Latent change classes in the HSCL-11 were identified with growth mixture modeling (GMM) and predicted by pre-treatment covariates and attunement using multilevel multinomial regression.

Results

GMM identified four latent classes: high impairment, no change (Class 1); high impairment, early response (Class 2); moderate impairment (Class 3); and low impairment (Class 4). Class 2 showed the strongest attunement, the largest early response, and the best outcome. Stronger attunement was associated with a higher likelihood of membership in Class 2 (b = 0.313, p = .007), Class 3 (b = 0.251, p = .033), and Class 4 (b = 0.275, p = .043) compared to Class 1. For highly impaired patients, the probability of no early change (Class 1) decreased and the probability of early response (Class 2) increased as a function of attunement.

Conclusions

Among patients with high impairment, stronger patient-therapist attunement was associated with early response, which predicted a better treatment outcome. Video-based assessment of attunement might provide new information for therapists not available from self-report questionnaires and support therapists in their clinical decision-making.

Validation and application of the Non-Verbal Behavior Analyzer: An automated tool to assess non-verbal emotional expressions in psychotherapy

BACKGROUND

Emotions play a key role in psychotherapy. However, a problem with examining emotional states via self-report questionnaires is that the assessment usually takes place after the actual emotion has been experienced which might lead to biases and continuous human ratings are time and cost intensive. Using the AI-based software package Non-Verbal Behavior Analyzer (NOVA), video-based emotion recognition of arousal and valence can be applied in naturalistic psychotherapeutic settings. In this study, four emotion recognition models (ERM) each based on specific feature sets (facial: OpenFace, OpenFace-Aureg; body: OpenPose-Activation, OpenPose-Energy) were developed and compared in their ability to predict arousal and valence scores correlated to PANAS emotion scores and processes of change (interpersonal experience, coping experience, affective experience) as well as symptoms (depression and anxiety in HSCL-11).

MATERIALS AND METHODS

A total of 183 patient therapy videos were divided into a training sample (55 patients), a test sample (50 patients), and a holdout sample (78 patients). The best ERM was selected for further analyses. Then, ERM based arousal and valence scores were correlated with patient and therapist estimates of emotions and processes of change. Furthermore, using regression models arousal and valence were examined as predictors of symptom severity in depression and anxiety.

RESULTS

The ERM based on OpenFace produced the best agreement to the human coder rating. Arousal and valence correlated significantly with therapists' ratings of sadness, shame, anxiety, and relaxation, but not with the patient ratings of their own emotions. Furthermore, a significant negative correlation indicates that negative valence was associated with higher affective experience. Negative valence was found to significantly predict higher anxiety but not depression scores.

CONCLUSION

This study shows that emotion recognition with NOVA can be used to generate ERMs associated with patient emotions, affective experiences and symptoms. Nevertheless, limitations were obvious. It seems necessary to improve the ERMs using larger databases of sessions and the validity of ERMs needs to be further investigated in different samples and different applications. Furthermore, future research should take ERMs to identify emotional synchrony between patient and therapists into account.

Challenges and added value of measuring embodied variables in psychotherapy

Research on embodied aspects of clinical encounters is growing, but discussion on the premises of including embodied variables in empirical research is scarce. Studies have repeatedly demonstrated that embodied aspects of psychotherapy interaction are vital in developing a therapeutic alliance, and these should be considered to better understand the change process in psychotherapy. However, the field is still debating which methods should be used and which features of the embodied aspects are relevant in the clinical context. The field lacks methodological consistency as well as a theoretical model. In the Relational Mind research project, we have studied the embodied aspects of interaction in the context of couple therapy for almost a decade and have gained experience with the positive and negative aspects of studying embodied variables in quantitative and qualitative studies. We have set out to develop the methodology (or procedures) for studying embodied variables in a multiperson setting, concentrating on interpersonal synchrony of sympathetic nervous system responses and movements, and we have strived to create methods for integrating information from different embodied modalities. In this narrative review, we share our experiences of the challenges and added value of studying embodied aspects in psychotherapy. The research field urgently needs an ongoing discussion of what researchers should take into consideration when studying the embodied aspects of interaction. We urge researchers to collaborate between research groups to jointly decide on the basic parameters of studies on the different embodied modalities of the research so that the individual researcher can become more aware of the impact the methodological choices have on their studies, results, and interpretations. We also see the use of embodied variables as having added value in the clinical work of psychotherapists, since it not only deepens our understanding about what is helpful in psychotherapy but will enable fine-tuning therapy processes to better suit clients who are verbally less fluent.

Nonverbal Synchrony in Couple Therapy Linked to Clients' Well-Being and the Therapeutic Alliance

Nonverbal synchrony between individuals has a robust relation to the positive aspects of relationships. In psychotherapy, where talking is the cure, nonverbal synchrony has been related to a positive outcome of therapy and to a stronger therapeutic alliance between therapist and client in dyadic settings. Only a few studies have focused on nonverbal synchrony in multi-actor therapy conversations. Here, we studied the synchrony of head and body movements in couple therapy, with four participants present (spouses and two therapists). We analyzed more than 2000min of couple therapy videos from 11 couple therapy cases using Motion Energy Analysis and a Surrogate Synchrony (SUSY), a procedure used earlier in dyadic psychotherapy settings. SUSY was calculated for all six dyads per session, leading to synchrony computations for 66 different dyads. Significant synchrony occurred in all 29 analyzed sessions and between the majority of dyads. Complex models were used to determine the relations between nonverbal synchrony and the clients’ well-being and all participants’ evaluations of the therapeutic alliance. The clients’ well-being was related to body synchronies in the sessions. Differences were found between the clients’ and therapists’ alliance evaluations: the clients’ alliance evaluations were related to synchrony between both dyads of opposite gender, whereas the therapists’ alliance evaluations were related to synchrony between dyads of the same gender, but opposite to themselves. With four participants present, our study introduces a new aspect of nonverbal synchrony, since as a dyad synchronizes, the other two participants are observing it. Nonverbal synchrony seems to be as important in couple therapy as in individual psychotherapy, but the presence of multiple participants makes the patterns more complex.

Language and Movement Synchronization in Dyadic Psychotherapeutic Interaction - A Qualitative Review and a Proposal for a Classification

In individual psychotherapy verbal communication and movement synchronization are closely interrelated. The microanalysis of timing, rhythm and gestalt of movement has established dynamic movement coordination as a systemic property of the dyadic interaction. Movement synchronization supports and enhances the unfolding of linguistic meaning. In order to substantiate the importance of the concept of synchrony for adult psychotherapy we review evidence from developmental psychology and discuss approaches to measure synchrony with particular reference to the naturalistic setting of dyadic psychotherapy. As the concept of synchrony is still ambiguous, and the respective interactional phenomena are ephemeral and fluid, in the current paper we suggest a set of five criteria for the description of synchronization in general terms and eight additional criteria which specifically enable the description of phenomena of movement synchronization. The five general dimensions are: (1) context, (2) modality, (3) resources, (4) entrainment, and (5) time-lag. The eight categories for the description of movement synchrony are: (1) spatial direction, (2) amplitude, (3) sinuosity, (4) duration, (5) event structure, (6) phase, (7) frequency, and (8) content. To understand the process of participatory sense-making and the emergence of meaning in psychotherapy, synchrony research has to cope with the multimodality of the embodied interaction. This requires an integrated perspective of movement and language. A system for the classification of synchrony phenomena may contribute to the linking of variations and patterns of movement with language and linguistic utterances.

Beyond Dyadic Coupling: The Method of Multivariate Surrogate Synchrony (mv-SUSY)

Measuring interpersonal synchrony is a promising approach to assess the complexity of social interaction, which however has been mostly limited to dyads. In this study, we introduce multivariate Surrogate Synchrony (mv-SUSY) to extend the current set of computational methods. Methods: mv-SUSY was applied to eight datasets consisting of 10 time series each, all with n = 9600 observations. Datasets 1 to 5 consist of simulated time series with the following characteristics: white noise (dataset 1), non-stationarity with linear time trends (dataset 2), autocorrelation (dataset 3), oscillation (dataset 4), and multivariate correlation (dataset 5). Datasets 6 to 8 comprise empirical multivariate movement data of two individuals (datasets 6 and 7) and between members of a group discussion (dataset 8.) Results: As hypothesized, findings of mv-SUSY revealed absence of synchrony in datasets 1 to 4 and presence of synchrony in dataset 5. In the empirical datasets, mv-SUSY indicated significant movement synchrony. These results were predominantly replicated by two well-established dyadic synchrony approaches, Surrogate Synchrony (SUSY) and Surrogate Concordance (SUCO). Conclusions: The study applied and evaluated a novel synchrony approach, mv-SUSY. We demonstrated the feasibility and validity of estimating multivariate nonverbal synchrony within and between individuals by mv-SUSY.

Shedding light on the effects of supportive techniques on nonverbal synchrony and their moderators in psychotherapy for depression

Objective: Accumulating research demonstrates the importance of utilizing supportive techniques in psychotherapy; however, little is known about therapeutic processes that are set in motion following the use of supportive techniques. The present study examined the effects of supportive techniques on nonverbal synchrony, both at the sample level and at the individual differences level.Method: The sample consisted of 86 patients from a randomized controlled trial for treatment of depression. Supportive techniques were rated by patients and therapists after every session, and nonverbal synchrony was quantified by motion energy analysis (MEA) for each session. The ability of supportive techniques to predict subsequent nonverbal synchrony was examined using polynomial regression and response surface analysis.Results: The findings suggest that, at the sample level, greater use of supportive techniques was a significant predictor of subsequent higher levels of nonverbal synchrony. At the individual differences level, this effect was significant for patients with low levels of depression severity and personality disorders, yet not significant for patients with high levels.Conclusion: The present study demonstrates that greater use of supportive techniques in treatment may facilitate a process that manifests as higher levels of synchrony, especially for patients with lower levels of personality disorders and depression.

Movement Synchrony in the Psychotherapy of Adolescents With Borderline Personality Pathology - A Dyadic Trait Marker for Resilience?

Movement synchrony describes the coordination of body movements. In psychotherapy, higher movement synchrony between therapist and patient has been associated with higher levels of empathy, therapeutic alliance, better therapy outcome, and fewer drop-outs. The current study investigated movement synchrony during the psychotherapeutic treatment of female adolescents with borderline personality disorder. It was hypothesized that there are higher levels of movement synchrony in the analyzed therapy sessions compared to pseudo-interactions. Further, we tested whether higher levels of movement synchrony correlate with stronger patients' symptom reduction and whether higher movement synchrony predicts higher post-session ratings. A total of 356 sessions from 16 completed psychotherapies of adolescent patients with BPD were analyzed. Movement synchrony was assessed with motion energy analysis and an index of synchrony was calculated by lagged cross-correlation analysis. As hypothesized, the findings support higher levels of movement synchrony in therapy sessions compared to pseudo-interactions (Cohen's d = 0.85). Additionally, a correlation of movement synchrony with better therapy outcome was found (standardized beta = -0.43 indicating stronger personality functioning impairment reduction). The post-session ratings were negatively associated with higher levels of movement synchrony (standardized beta = -0.1). The relevance of movement synchrony and potential implications for clinical practice are discussed.

Change Process in Coaching: Interplay of Nonverbal Synchrony, Working Alliance, Self-Regulation, and Goal Attainment

Background: Psychological literature emphasizes that self-regulation is important as goal intentions, goal setting, or implementation intention does not automatically result in effective results in coaching. The question which coaching strategies to apply to strengthening clients' self-regulatory capacities as prerequisites of effective change outcomes remains a black box in coaching.

Method: This quantitative study explored clients' self-regulatory mechanisms by addressing how nonverbal synchrony influences clients' cognitive and emotional self-regulation across sessions. One hundred eighty-four coach–client pairs and their evolving change process were observed over 8 months. Video-recorded sessions were assessed with motion energy analysis to automatically capture coach and client nonverbal behavior and quantify nonverbal synchrony at the level of the dyad.

Results: Synchrony was differentially associated with clients' post-session questionnaires on result-oriented problem-reflection and self-reflection, affect balance, and working alliance. Network analyses suggested that the association between synchrony and other process variables did not correspond to the previously found positive association between synchrony and positive aspects of alliance or outcome. Instead, this association depended on the level of perceived outcome.

Discussion: Coaching success may be predicted by process variables assessed after each session: goal reflection, alliance, and mood all predict successful coaching. The assessment of nonverbal synchrony suggests a state-dependent effect of embodied processes on a coaching outcome that warrants further inspection.

Hand movements that change during psychotherapy and their relation to therapeutic outcome: An analysis of individual and simultaneous movements

Hands are, compared to other body parts, the body parts that display the most gestural movements during an interaction and their movement is sensitive to reveal anxiety states. However, psychotherapy research focuses on movement synchrony of different body parts to be an indicator of improved symptoms. The present study investigates symptoms in social anxiety disorder and considers both, individual and simultaneous hand movements. 56 video recordings of 28 patient-therapist dyads with patients with social anxiety at the beginning and in the end of psychotherapy were analyzed. Two independent blind certified raters analyzed the hand movement behavior using the NEUROGES^® analysis system for nonverbal behavior concerning individual movement units and the simultaneous overlaps between the patients' and therapists' movement units. Simultaneous overlap change negatively correlated with symptoms (LSAS week eight-measurement, r = -.52; and week 15-measurement, r = -.52; BDI pre-measurement, r = -.54). The patients' right hand movement at the end of the psychotherapy correlated significantly with therapeutic alliance (HAQ post-measurement; r = .55). Hand movement behavior analysis should be considered in psychotherapy research in combination with movement synchrony as a measurement parameter related to therapeutic process and outcome. Enriching previous findings, this study indicates that simultaneous movement change is related to symptoms and therefore a process-sensitive parameter in psychotherapy.

Observational and Accelerometer Analysis of Head Movement Patterns in Psychotherapeutic Dialogue

Psychotherapists, who use their communicative skills to assist people, review their dialogue practices and improve their skills from their experiences. However, technology has not been fully exploited for this purpose. In this study, we analyze the use of head movements during actual psychotherapeutic dialogues between two participants-therapist and client-using video recordings and head-mounted accelerometers. Accelerometers have been utilized in the mental health domain but not for analyzing mental health related communications. We examined the relationship between the state of the interaction and temporally varying head nod and movement patterns in psychological counseling sessions. Head nods were manually annotated and the head movements were measured using accelerometers. Head nod counts were analyzed based on annotations taken from video data. We conducted cross-correlation analysis of the head movements of the two participants using the accelerometer data. The results of two case studies suggest that upward and downward head nod count patterns may reflect stage transitions in counseling dialogues and that peaks of head movement synchrony may be related to emphasis in the interaction.

Movement and Emotional Facial Expressions during the Adult Attachment Interview: Interaction Effects of Attachment and Anxiety Disorder

INTRODUCTION

Adult attachment is commonly associated with emotion regulation. Less is known about the nonverbal embodiment of adult attachment.

OBJECTIVE

We hypothesized that dismissing attachment is related to less movement and fewer facial expressions of emotions, whereas preoccupied attachment is associated with more negative emotional facial expressions. Moreover, the interaction of attachment and the presence of an anxiety disorder (AD) was explored.

METHODS

The sample included 95 individuals, 21 with AD without comorbidity, 21 with AD and comorbid major depression (AD-CD), and 53 healthy controls. We analyzed nonverbal behavior during a part of the Adult Attachment Interview (AAI) asking about the family and parental figures. The movements of the interviewees were captured via Motion Energy Analysis. Facial expressions were coded according to the Facial Action Coding System using the OpenFace software. We compared individuals with secure, dismissing, and preoccupied states of mind (assessed with the AAI) with regard to the frequency and complexity of movements and the frequency of the facial expressions such as happy, sad, and contemptuous.

RESULTS

As expected, dismissingly attached individuals moved less often and with lower complexity than securely attached. For emotional facial expressions, a main effect of the disorder group and interaction effects of attachment by disorder were found. In the AD-CD group, dismissingly attached patients showed comparatively fewer happy facial expressions than securely attached individuals.

CONCLUSIONS

Reduced movement specifically seems to be related to dismissing attachment when interviewees talk about significant parental figures. Facial expressions of emotions related to attachment occurred when maladaptive emotion regulation strategies were intensified by a psychological disorder.

Movement Synchrony and Facial Synchrony as Diagnostic Features of Depression: A Pilot Study

ABSTRACT

The pilot study investigated with a matched-subjects design whether nonverbal synchrony is a diagnostic feature for depression and whether it mediates between depression and postsession ratings of the interviewer behavior. The sample includes n = 15 patients with major depression and n = 15 healthy controls (aged 20-30 years, 40% female). We conducted structured diagnostic interviews for somatic complaints to standardize the recording setting, issue, and course of conversation. Body movements and facial expressions were coded automatically frame by frame using computer vision methods. Ratings of the interviewers' professional behavior and positive affect were assessed using questionnaires. Patients with depression showed less movement synchrony and less synchronous positive facial expressions. Only synchronous positive expressions mediated between depression and less perceived positive affect. We conclude that the applied methodology is well suited to examine nonverbal processes under naturalistic but widely standardized conditions and that depression affects the nonverbal communication in medical conversations.

Therapeuteneffekte bei der ambulanten Behandlung sozialer Ängste

Hintergrund

Die Studie untersuchte Therapeuteneffekte bei der Psychotherapie der sozialen Angststörung unter Verwendung von 3 methodischen Ansätzen: 1. Varianzen zufälliger Effekte, 2. Effekte soziodemografischer Variablen und 3. eine Disaggregation von therapeutischer Beziehung und nonverbaler Synchronisation in einen „Between“- und einen „Within“-Anteil der Therapeutenvarianz sowie deren Vorhersage des Outcome.

Material und Methoden

Die Patienten wurden mit manualisierter supportiver-expressiver Therapie (n = 54), manualisierter kognitiver Verhaltenstherapie (n = 102) oder naturalistischer kognitiver Verhaltenstherapie (n = 111) behandelt (insgesamt n = 267). Es wurden Patientenbeurteilungen interpersonaler Probleme (Inventar zur Erfassung interpersonaler Probleme, IIP-32), von Depressionssymptomen (Beck-Depressions-Inventar, BDI) und der therapeutischen Beziehung (Helping Alliance Questionnaire, HAQ) erfasst. Die nonverbale Synchronisation wurde mithilfe der Motion Energy Analysis und zeitreihenanalytischer Verfahren quantifiziert. Die Zusammenhangsanalysen erfolgten mit Mehrebenenmodellen.

Ergebnisse

Alter und Geschlecht des Therapeuten waren nicht prädiktiv für die zum Therapieende gemessenen IIP-32- und BDI-Werte. Therapeuteneffekte in Form zufälliger Effekte (Intra-Klassen-Korrelation [ICC] = 23,4 % bzw. 30,1 %) erklärten ein Vielfaches mehr an Outcome-Varianz als das Therapieverfahren (ICC = 6 % bzw. ICC = 1,6 %). Bei der nonverbalen Synchronisation waren Between-therapist- und Within-therapist-Anteil mit der Reduktion des IIP-32 assoziiert. Der Between-therapist-Anteil des HAQ sagte eine Reduktion des BDI vorher.

Schlussfolgerung

Bei der Behandlung sozialer Ängste sind Therapeuteneffekte bedeutsamer als das Therapieverfahren. Desgleichen waren die Therapeutenanteile bei den prozessrelevanten Variablen therapeutische Beziehung und nonverbale Synchronisation bedeutsamer als die patienten- bzw. dyadenspezifischen Anteile.

What's in a Moment: What Can Be Learned About Pair Bonding From Studying Moment-To-Moment Behavioral Synchrony Between Partners?

Our understanding of the behavioral and physiological mechanisms of monogamy largely comes from studies of behavioral interactions unique to pair-bonded individuals. By focusing on these highly marked behaviors, a remarkable conservation in the mechanisms underlying pair bonding has been revealed; however, we continue to know very little about the range of behavioral and neurobiological mechanisms that could explain the great diversity of pair-bonding phenotypes that exists both within and across species. In order to capture the dynamic nature of bonds over time and across contexts, we need specific, operationally-defined behavioral variables relevant across such a diversity of scenarios. Additionally, we need to be able to situate these behavioral variables within broader frameworks that allow us to interpret and compare patterns seen across species. Here I review what is known about behavioral synchrony with respect to pair bonding and discuss using synchrony as such a variable as well as a framework to expand on our understanding of pair bonding across timescales, contexts and species. First, I discuss the importance of behavioral synchrony and parental coordination for reproductive success in monogamous biparental bird species. Second, I highlight research documenting the critical importance of interpersonal coordination for human social relationships. Finally, I present recent work that experimentally bridges these lines of research by quantifying moment-to-moment behavioral synchrony during brief social interactions in zebra finch dyads. All together, these distinct perspectives support the notion that synchrony (1) is a shared premise for sociality across species, (2) is deeply shaped by social experiences, and (3) exists across timescales, behaviors, and levels of physiology. Conceptualizing pair bonding through the framework of behavioral synchrony is likely to facilitate a deeper understanding of the nuances of how social experiences and interactions impact the brain and behavior.

Two-Person Approaches to Studying Social Interaction in Psychiatry: Uses and Clinical Relevance

Social interaction is ubiquitous in human society. The two-person approach-a new, powerful tool to study information exchange and social behaviors-aims to characterize the behavioral dynamics and neural mechanisms of real-time social interactions. In this review, we discuss the benefits of two-person approaches compared to those for conventional, single-person approaches. We describe measures and paradigms that model social interaction in three dimensions (3-D), including eye-to-eye, body-to-body, and brain-to-brain relationships. We then discuss how these two-person measures and paradigms are used in psychiatric conditions (e.g., autism, mood disorders, schizophrenia, borderline personality disorder, and psychotherapy). Furthermore, the advantages of a two-person approach (e.g., dual brain stimulation, multi-person neurofeedback) in clinical interventions are described. Finally, we discuss the methodological and translational challenges surrounding the application of two-person approaches in psychiatry, as well as prospects for future two-/multi-person studies. We conclude that two-person approaches serve as useful additions to the range of behavioral and neuroscientific methods available to assess social interaction in psychiatric settings, for both diagnostic techniques and complementary interventions.

Exploring the evolution of nonverbal synchrony in psychotherapy: The idiographic perspective provides a different picture

Objectives: A methodological obstacle for the assessment of psychotherapy process concerns the compatibility between nomothetic versus idiographic approaches. Using quantitative methodology at an idiographic level, we seek to narrow this gap for the special case of nonverbal synchrony in psychotherapy dyads.Methods: Using quantitative idiographic process analysis (QUIPA), we combined the assessments of nonverbal synchrony-the coordination of patient's and therapist's body-movement-quantified with motion energy analysis (MEA), patient- and therapist session-reports, and patient's self-reports of symptomatology into multivariate time-series of psychotherapy process across the course of N = 12 dyadic psychotherapies with a total of N = 150 sessions. Adopting both mixed models as well as vector auto regressive models (VAR) to time-series, we aimed to extend previous results assessed in a randomized sample by exploring the evolution of nonverbal synchrony in psychotherapy dyads across time.Results: Aggregated idiographic data revealed that nonverbal synchrony was different from findings based on a previously reported nomothetic account: Associations with session-level outcome were weaker and did not replicate cross-sectional analyses.Conclusions: The application of idiographic assessments may help broadening our conception of synchrony in psychotherapy and also reminds us that ergodicity is not necessarily the usual case, but one of many possibilities.