Measurement properties of the Brazilian version of the Working Alliance Inventory (patient and therapist short-forms) and Session Rating Scale for low back pain

The Working Alliance Inventory's Measurement Properties: A Systematic Review

Measurement properties of the Working Alliance Inventory (WAI) and its various translations and adaptations for specific target groups have been investigated for over 30 years. No systematic review analyzing studies on measurement properties of the WAI has been conducted to date. COnsensus-based Standards for the selection of health Measurements INstruments (COSMIN) were developed for conducting high-quality systematic reviews on measurement properties in a transparent and standardized way. Aim of this study was to systematically review studies on measurement properties of the WAI, and its adapted versions, within psychotherapy, and other healthcare contexts using COSMIN criteria. PsycINFO, Medline, and EMBASE were searched (1989–2021). In all phases of the review procedure, study selection, data extraction, risk of bias assessment, rating of the quality of measurement properties, and rating of the quality of evidence for measurement properties, disagreement between reviewers was resolved by discussion. Results on validity, internal structure, reliability, construct validity, and responsiveness were analyzed. In total 66 studies were included. In most studies, evidence for measurement properties was according to COSMIN criteria, insufficient, lacking, or conflicting. Content validity was rated insufficient because neither patients nor healthcare professionals were involved in the development and validation process. Hence evidence for content validity of the WAI is unknown. Conflicting evidence was found for structural validity. Evidence for internal consistency could not be established. Limited evidence was found for inter-rater reliability and convergent validity. Conflicting evidence was also found for test-retest reliability and divergent validity. COSMIN criteria exposed persistent problems in validation studies of the WAI. These findings may indicate that measurement properties of the WAI are not up to current standards, or that COSMIN criteria may be less appropriate for assessing measurement properties of the WAI, or it could indicate both. The results of this systematic review suggest that WAI outcomes should be interpreted with caution and further research is needed regarding the content validity and hypotheses development. For the future, the theoretical framework underlying the measurement of the working alliance needs to be studied in psychotherapy and other health contexts, and tested in methodologically sound studies.

An exploration of clinical variables that enhance therapeutic alliance in patients seeking care for musculoskeletal pain: A mixed methods approach

INTRODUCTION/OBJECTIVES

Therapeutic alliance (TA) is an integral part of building a patient and clinician relationship. TA begins at the initial encounter; however, the specific TA behavioural practices that are most impactful and linked to pain reduction and improved function remain unclear. The primary objective of this study was to explore physical therapist behaviours and interactions during the initial physical therapy evaluation and how they related to the patient's perception of TA. A secondary objective was to explore the relationship between TA, pain intensity, and function.

METHODS

A mixed methods study was conducted. Pain intensity, TA and self-reported function were assessed at three time points. Spearman's Rho (ρ) was used to quantify if there was an association between increased TA and function and reduced pain intensity, while a checklist of TA themes and behavioural practices was used for the qualitative analysis.

RESULTS

There was a statistically significant negative correlation between patient-perceived TA and pain intensity immediately after the initial evaluation (ρ = -0.39 [p = 0.048]). Behavioural practices associated with higher TA included information gathering, pausing to listen, using humour and transitions, and use of clarifying questions. Behavioural practices associated with patient-perceived lower TA interactions were lack of touch, the absence of pain neuroscience education, and not restating what the patient said during the interview.

CONCLUSION

This study highlights a relationship between TA and reduction of pain intensity after the initial evaluation and identifies key behavioural practices that could positively and negatively impact TA during the clinical encounter.

Measuring therapeutic relationship in physiotherapy: conceptual foundations

The "therapeutic relationship" in physiotherapy refers to the beneficial or healing relationship between the patient and physiotherapist. Interest in researching therapeutic relationships in physiotherapy is growing and there is a need for a measure of therapeutic relationship with a strong conceptual foundation. Body of paper:We begin with a general discussion of the state of therapeutic relationship measurement in physiotherapy research - notably, how current research is based on measures borrowed and adapted from psychotherapy. Then, we introduce Miciak's physiotherapy therapeutic relationship framework, discuss why it offers a solid foundation for measurement development, and describe the key concepts in the framework. We then discuss various approaches to measuring therapeutic relationship, illustrating how Miciak's framework could be used to inform their development. We end by discussing current challenges in measuring therapeutic relationship and how these could be addressed.

Systematic Review of Therapeutic Alliance Measurement Instruments in Physiotherapy

Purpose: Interest in measuring the therapeutic alliance has grown in recent years in both the clinical field and the literature. Several instruments can be used to measure the therapeutic alliance in physiotherapy, and choosing the most appropriate one is challenging. The purpose of this systematic review was to (1) identify the instruments that have been used to evaluate the therapeutic alliance in physiotherapy and (2) appraise the methodological quality of studies of the psychometric properties of these instruments. Method: The researchers carried out a systematic search in MEDLINE, SciELO, PsycINFO, Theseus, Cochrane Library, and Open Grey. Only articles published in English and Spanish were included. The articles were evaluated by two independent reviewers in accordance with the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) and Preferred Reporting items for Systematic Review and Meta-Analysis standards, using the four-point COSMIN checklist. Results: Four studies were included in this review, and four instruments evaluated the therapeutic alliance in physiotherapy. The methodological quality of the studies was fair for most of the psychometric characteristics analyzed. Conclusions: The Working Alliance Inventory is the best instrument to measure therapeutic alliance and the measure that had the greatest number of psychometric properties evaluated against the COSMIN standard. More studies of high methodological quality are required to evaluate the psychometric properties of the instruments used to assess the therapeutic alliance in physiotherapy.

Patient- and Physical Therapist-Level Predictors of Patient-Reported Therapeutic Alliance: An Observational, Exploratory Study of Cohorts With Knee and Low Back Pain

OBJECTIVE

To identify patient- and physical therapist-level predictors for therapeutic alliance at the end of an episode of physical therapy for knee or low back pain (LBP).

DESIGN

Secondary analysis of observational cohort.

SETTING

Outpatient physical therapy clinics.

PARTICIPANTS

Patients receiving physical therapy for knee (n=189) or LBP (n=252) and physical therapists (n=19). Candidate predictor variables included demographics, patient clinical characteristics, and physical therapist attitudes and beliefs (Pain Attitudes and Beliefs Scale for Physical Therapists) and confidence in providing patient-centered care (Self-Efficacy in Patient-Centeredness Questionnaire).

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Patient-reported therapeutic alliance was measured using the 12-item Work Alliance Inventory-Short Revised (WAI-SR).

RESULTS

Final linear mixed models indicated different patient- and physical therapist-level factor contributions in predicting final WAI-SR scores across cohorts with knee and LBP. Female sex was a consistent patient-level predictor for both knee (estimated β=1.57, P<.05) and LBP (β=1.42, P<.05), with age (β=-0.07, P<.01) and baseline function (β=0.06, P<.01) contributing to cohorts with knee and LBP, respectively. Physical therapist-level predictors included female sex (β=6.04, P<.05), Pain Attitudes and Beliefs Scale for Physiotherapists behavioral (β=0.65, P<.01), and Self-Efficacy in Patient-Centeredness Questionnaire (SEPCQ) Exploring Patient Perspective (β=-0.75, P<.01) subscale scores for LBP, with SEPCQ Sharing Information and Power subscale scores (β=0.56, P<.05) contributing to both cohorts with knee (β=0.56, P<.05) and LBP (β=0.74, P<.01). Random effects for patients nested within physical therapists were observed for both cohorts.

CONCLUSIONS

These findings provide preliminary evidence for inconsistent relationships among patient- and physical therapist-level factors and therapeutic alliance across cohorts with knee and LBP.

The Relationship of the Therapeutic Alliance to Patient Characteristics and Functional Outcome During an Episode of Physical Therapy Care for Patients With Low Back Pain: An Observational Study

OBJECTIVE

Research supports the relevance of the therapeutic alliance (TA) between patients and physical therapists on outcomes, but the impact of TA during routine physical therapist practice has not been quantified. The primary objective of this study was to examine the relationship between TA assessed during a physical therapy episode of care for patients with low back pain and functional outcome at the conclusion of care. The secondary objective was to examine psychometric properties of the Working Alliance Inventory-Short Revised (WAI-SR) form, a patient-reported TA measure.

METHODS

This study was a retrospective analysis of prospectively collected data from 676 patients (mean [SD] age = 55.6 [16.1] y; 55.9% female) receiving physical therapy for low back pain in 45 outpatient clinics from 1 health system in the United States. Participating clinics routinely collect patient-reported data at initial, interim, and final visits. The lumbar computer-adapted test (LCAT) was used to evaluate functional outcome. The TA was assessed from the patient's perspective at interim assessments using the WAI-SR, bivariate correlations were examined, and regression models were examined if interim WAI-SR scores explained outcome variance beyond a previously validated multivariate prediction model. Internal consistency and ceiling effects for the WAI-SR were examined.

RESULTS

Interim WAI-SR scores were not correlated with patient characteristics or initial LCAT, but they were correlated with final LCAT and LCAT change from initial to final assessment. WAI-SR total score (adjusted R2 = 0.36), and Task (adjusted R2 = 0.38) and Goal subscales (adjusted R2 = 0.35) explained additional variance in outcome beyond the base model (adjusted R2 = 0.33). Internal consistency was higher for WAI-SR total score (α = .88) than for subscales (α = .76-.82). Substantial ceiling effects were observed for all WAI-SR scores (27.2%-63.6%).

CONCLUSION

Findings support the importance of TA in physical therapist practice. Measurement challenges were identified, most notably ceiling effects.

IMPACT

This study supports the impact of the patient-physical therapist alliance on functional outcome. Results extend similar findings from controlled studies into a typical physical therapist practice setting. Better understanding of the role of contextual factors including the therapeutic alliance might be key to improving the magnitude of treatment effect for discrete physical therapist interventions and enhancing clinical outcomes of physical therapy episodes of care.

Development and validation of the therapeutic alliance in physiotherapy questionnaire for patients with chronic musculoskeletal pain

OBJECTIVE

The purpose of this study is to present the development and analysis of the factorial structure and psychometric properties of a new self-administered questionnaire (Therapeutic Alliance in Physiotherapy Questionnaire-Patients [CAF-P]) designed to measure therapeutic alliance in physiotherapy.

METHODS

The sample included 204 patients with chronic pain attending nine primary care centres. The CAF-P was developed and validated using standard methodology, which included developing items, cognitive debriefing and psychometric validation.

RESULTS

CAF-P has excellent internal consistency, with Cronbach's α of 0.91 and an intraclass correlation coefficient (ICC) of 0.87. We propose a structure of two factors that explain 55.80 % of the variance. The convergent validity showed a moderate positive correlation with the probability of recommending treatment and with the level of satisfaction.

CONCLUSIONS

The CAF-P appears to be a valid and reliable instrument for measuring the therapeutic alliance perceived by patients in physiotherapy.

PRACTICE IMPLICATIONS

The results of the present study leads to further research to identify the differences in the therapeutic alliance construct between different settings or professions.

Reducing ceiling effects in the Working Alliance Inventory-Rehabilitation Dutch Version

Purpose: To reduce ceiling effects on domain scores (Task, Goal, and Bond) of the Working Alliance Inventory (WAI)-Rehabilitation Dutch Version by changing response scales and using Visual Analogue Scales (VASs).Methods: Clients, who had at least three treatment sessions prior, randomly received one of the three versions of the WAI-Rehabilitation Dutch Version, using items with a balanced Likert scale, Positive-Packed Likert scale or VAS. Primary outcome was percentage of ceiling effects in total- and domain scores, secondary outcomes were construct validity and internal consistency of the three versions.Results: One hundred and seventy-six clients randomly received a set of questionnaires (one of the three versions of the WAI-Rehabilitation Dutch Version, Session Rating Scale (SRS) and Helping Alliance Questionnaire (HAQ)-II); 152 participants (mean age 51.5 ± 16.3, 106 women) returned the questionnaires. No ceiling effects were present in the total scores of all versions. Significantly fewer ceiling effects were found in the VAS-Version (Goal: 8.0%, Bond: 7.7%) compared to the original (Goal: 18.0%, Bond: 29.8%) and Positive-Packed Version (Goal: 27.1%, Bond: 29.8%). Spearman's correlations between VAS-Version, SRS and HAQ-II ranged 0.747-0.845.Conclusions: Visual Analogue Scales effectively reduced ceiling effects on domain scores of the WAI-Rehabilitation Dutch Version, while maintaining validity.Implications for RehabilitationVisual Analogue Scales effectively reduced ceiling effects on domain scores of the Working Alliance Inventory-Rehabilitation Dutch Version, while maintaining construct validity.The Working Alliance Inventory version with Visual Analogue Scales can be used in rehabilitation.

The role of the therapeutic alliance on pain relief in musculoskeletal rehabilitation: A systematic review

The aim of this systematic review was to investigate the role of therapeutic alliance in pain relief in patients with musculoskeletal disorders treated by physiotherapy. Manual and database searches (Medline, Embase, ISI Web of Knowledge, CINAHL, PEDro, Lilacs, Cochrane Library, and PsycINFO) were performed with no restrictions of language and publication date. We included prospective studies with samples of patients undergoing physiotherapy for musculoskeletal conditions, with one measure of therapeutic alliance and the outcome pain. Methodological quality was assessed by the Methodological Index for Nonrandomized Studies and the Cochrane tool for risk of bias. Six articles from four studies were included out of the 936 manuscripts identified. All studies used samples composed of patients with chronic low back pain. Two studies applied therapeutic alliance incentive measures during treatment and reported significant improvement in pain. The remaining studies, without alliance incentives, showed divergence regarding the relationship between the therapeutic alliance and pain. Methodological quality analysis determined low risk of bias of the studies. A lack of studies on the therapeutic alliance regarding musculoskeletal physiotherapy was verified. Existing studies fail to provide evidence of a strong relationship between the therapeutic alliance and pain relief.

Development and validation of the Working Alliance Inventory Dutch version for use in rehabilitation setting

Background: In rehabilitation, therapeutic alliance is associated with improvements in clinical outcomes. The Working Alliance Inventory (WAI) measures therapeutic alliance and is frequently used in rehabilitation research; however, it has not been validated for rehabilitation. Objectives: To determine content validity, internal consistency and construct validity of the Working Alliance Inventory Rehabilitation Dutch Version (WAI-ReD). Methods: In phase 1, content and face validity of the WAI-ReD was judged by professionals (n = 15) and in phase 2 by patients (n = 22). In phase 3, 14 hypotheses were tested in patients (n = 138) regarding: content validity (i.e., missing items, floor, and ceiling effects); internal consistency; and construct validity (i.e., factor structural testing correlations of WAI-ReD scores with Session Rating Scale (SRS), the Helping Alliance Questionnaire II (HAQ-II), and Visual Analog Scale of Pain (VAS_pain)). Results: After phase 1 and phase 2, the WAI-ReD was formulated and tested. Content validity; missing items were negligible. Ceiling effects were present in all domains. Internal consistency; Cronbach's α ranged between 0.804 and 0.927. Construct validity; correlations between WAI-ReD, SRS, HAQ-II, and VAS_pain fell within the hypothesized ranges. Conclusion: Eleven of the 14 hypotheses were not rejected confirming good clinimetric properties of the WAI-ReD. The WAI-ReD can be used in rehabilitation to measure therapeutic alliance.

Characteristics of therapeutic alliance in musculoskeletal physiotherapy and occupational therapy practice: a scoping review of the literature

Background

Most conventional treatment for musculoskeletal conditions continue to show moderate effects, prompting calls for ways to increase effectiveness, including drawing from strategies used across other health conditions. Therapeutic alliance refers to the relational processes at play in treatment which can act in combination or independently of specific interventions. Current evidence guiding the use of therapeutic alliance in health care arises largely from psychotherapy and medicine literature. The objective of this review was to map out the available literature on therapeutic alliance conceptual frameworks, themes, measures and determinants in musculoskeletal rehabilitation across physiotherapy and occupational therapy disciplines.

Methods

A scoping review of the literature published in English since inception to July 2015 was conducted using Medline, EMBASE, PsychINFO, PEDro, SportDISCUS, AMED, OTSeeker, AMED and the grey literature. A key search term strategy was employed using “physiotherapy”, “occupational therapy”, “therapeutic alliance”, and “musculoskeletal” to identify relevant studies. All searches were performed between December 2014 and July 2015 with an updated search on January 2017. Two investigators screened article title, abstract and full text review for articles meeting the inclusion criteria and extracted therapeutic alliance data and details of each study.

Results

One hundred and thirty articles met the inclusion criteria including quantitative (33%), qualitative (39%), mixed methods (7%) and reviews and discussions (23%) and most data came from the USA (23%). Randomized trials and systematic reviews were 4.6 and 2.3% respectively. Low back pain condition (22%) and primary care (30.7%) were the most reported condition and setting respectively. One theory, 9 frameworks, 26 models, 8 themes and 42 subthemes of therapeutic alliance were identified. Twenty-six measures were identified; the Working Alliance Inventory (WAI) was the most utilized measure (13%). Most of the therapeutic alliance themes extracted were from patient perspectives. The relationship between adherence and therapeutic alliance was examined by 26 articles of which 57% showed some correlation between therapeutic alliance and adherence. Age moderated the relationship between therapeutic alliance and adherence with younger individuals and an autonomy support environment reporting improved adherence. Prioritized goals, autonomy support and motivation were facilitators of therapeutic alliance.

Conclusion

Therapeutic Alliance has been studied in a limited extent in the rehabilitation literature with conflicting frameworks and findings. Potential benefits described for enhancing therapeutic alliance might include better exercise adherence. Several knowledge gaps have been identified with a potential for generating future research priorities for therapeutic alliance in musculoskeletal rehabilitation.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-017-2311-3) contains supplementary material, which is available to authorized users.