Adverse events in psychotherapy randomized controlled trials: A systematic review

Objective: Although evidence for benefits of psychotherapy is substantial, less is known about potential harm. Therefore, we systematically summarized randomized controlled trials (RCTs) to compile evidence-based data on the frequency and characteristics of adverse events (AEs) of psychotherapy. Method: This systematic review of result publications is based on a review of harm consideration in psychotherapy study protocols. Results: On the basis of 115 study protocols, 85 RCTs with 126 psychotherapy and 61 control conditions were eligible for inclusion. The sample consisted of 14,420 participants with the most common mental disorders. Harmful events, e.g., AEs, number of individuals with symptom deterioration, were explicitly reported in 60% of the studies. Conceptualization, recording, and reporting of AEs were heterogeneous. For most reported AEs, the association to study treatment remained unclear. Conclusions: Because the AE recording approaches of the individual studies differed substantially, results could only be compared to a limited extent. Consistent with other findings, this review demonstrates that AEs can be expected to affect more than one in ten participants. Serious AEs occurred more than in one in 21 participants in psychotherapy RCTs. To allow a balanced risk/benefit evaluation of psychotherapy, systematic harm monitoring and reporting should become standard in psychotherapy RCTs.

Effects and experiences of idiographic patient-reported outcome measures for feedback in psychotherapy: A systematic review and secondary analysis of the empirical literature

Objective: There is a growing interest in idiographic patient-reported outcome measures (I-PROMs) for routine outcome monitoring (ROM) and clinical feedback (CF) in psychotherapy, but to our knowledge, no systematic reviews of the empirical literature. Method: We conducted a systematic literature search for empirical papers investigating effects and experiences of I-PROMs for ROM/CF and found a total of 13 papers. There was only one experimental controlled effectiveness study. Results: We formulated a narrative summary of the data set as a whole. We conducted a secondary analysis of nine papers containing qualitative data on stakeholder experiences with I-PROMs and found three superordinate themes and eight subthemes, summarized as "I-PROMs can facilitate self-reflection for patients, assist in identifying and tracking therapeutic topics, and make patients more committed to therapy by giving them a greater sense of responsibility and empowerment. Formulating goals and problems can be difficult, and lack of progress can be demotivating. Time in therapy is precious and must be spent wisely. Effective use of I-PROMs is facilitated by flexibility and therapists' use of clinical skills." Conclusion: We discuss the limitations of the study and provide recommendations for future research and clinical practice.

Therapists' experiences of negative effects in intensive short-term dynamic psychotherapy: A qualitative interview study

OBJECTIVE

Negative effects of psychotherapy are a broad term that encompasses events such as non-response, deterioration, and novel symptoms. The aim of the present study was to explore experiences with negative effects among clinicians working within an intensive short-term dynamic psychotherapy (ISTDP) framework.

METHOD

Eight ISTDP clinicians consented to participate and were interviewed using semi-structured video interviews. Data were transcribed and analyzed using a reflexive thematic analysis framework.

RESULTS

The thematic analysis resulted in five themes. Overall, the clinicians found it difficult to define negative effects, but that negative effects, regardless of cause, could be used therapeutically. Inaccurate assessment was seen as the main cause of negative effects. Other themes concerned the connection between dropout and negative effects, patient feedback, and the ISTDP community's relationship to negative effects.

CONCLUSIONS

The results are largely in line with qualitative studies of CBT clinicians' views of negative effects although clinicians in the present study emphasized more strongly the therapeutic potential of these events. The research field could be further improved by using mixed-method designs while including both patients and therapists.

Using Measurement-Based Care as a Precision Medicine Strategy for Substance Use Disorders

PURPOSE OF REVIEW

Precision medicine prioritizes characterization of individual patient parameters to optimize care and this review evaluates measurement-based care (MBC) as a strategy for doing so in the treatment of substance use disorders (SUD). Measurement-based care refers to the systematic use of validated assessments to inform diagnosis and treatment planning, with varying frequency of assessments. Despite the seemingly obvious grounds for the use of MBC in treating SUD, systematic implementation to date has been limited. Thus, the goal of this review is to evaluate efforts to date and to stimulate greater consideration of MBC models in addictions programs.

RECENT FINDINGS

Data from two published randomized controlled trials and findings from pragmatic clinical research highlight the potential utility of MBC in the SUD treatment settings. Despite these findings, the existing literature indicates the high need for larger-scale clinical trials and quality improvement programs. Potential barriers to the implementation of MBC for SUD are outlined at the patient, provider, organization, and system levels, as well as the challenges associated with the use of MBC programs for clinical research. Critical thinking considerations and risk mitigation strategies are offered toward advancing MBC for SUD beyond the current nascent state. Collectively, the existing data confirm that MBC is a suitable and promising strategy for applying a precision medicine approach in SUD treatment, warranting further implementation efforts and scientific inquiry.

Measurement-based care in an adolescent partial hospitalization program: Exploring treatment progress and predictors using the top problems assessment

This study used measurement-based care (MBC) to examine patient improvement and trajectories of change during treatment in an adolescent partial hospitalization program (PHP). The current study also explored whether youth trajectories in PHP varied based on demographic variables, symptom severity at intake, or presence of an anxiety or depressive disorder diagnosis. Participants included 124 youth (aged 13-18) with primarily anxiety and depression diagnoses who received care in a PHP. The Top Problems Assessment (TPA), an idiographic measure of patients' chief complaints, was administered weekly alongside depression and anxiety symptom questionnaires to incorporate the consumer perspective. Results demonstrated that youth significantly benefitted from PHP treatment across all measures. The rate of TPA improvement slowed down over time whereas the rates of decline for the anxiety and depression questionnaires did not change statistically. Anxiety disorder status and more severe baseline anxiety symptoms were also independently associated with slower rates of improvement on TPA, but not on the symptom measures. Overall, these results suggest youth improved from treatment in this PHP, and that changes in youth-reported top problems may be more prominent at the beginning of treatment. Moreover, providers may want to consider treatment modifications, or perhaps monitor progress more closely, for youth who present with higher anxiety severity at PHP admission. This study demonstrates how incorporating MBC practices and personalized assessment in a PHP can enable exploration of who benefits most, under what conditions, and when.

A systematic review on the effect of routine outcome monitoring and feedback on client outcomes in alcohol and other drug treatment

ISSUES

Routine outcome monitoring (ROM) involves regularly measuring clients' outcomes during treatment, which can then be fed back to clinicians and/or clients. In the mental health field, ROM and feedback have been shown to improve client outcomes; however, no systematic reviews have examined whether improvement is also seen in alcohol and other drug (AOD) treatment outcomes. This review examines whether feedback to clients and/or clinicians of ROM data in AOD treatment improves future client outcomes.

APPROACH

This systematic review of papers identified in Medline, PsycInfo and Scopus examines the effect on client outcomes of feeding back ROM data to clinicians and/or clients in AOD treatment settings. Key client outcomes included substance use, treatment attendance and wellbeing measures.

KEY FINDINGS

Ten studies were included-five randomised controlled trials and five pre-post within-subjects designs. Six studies were deemed good- or fair-quality. Of these six, three provided feedback to clinicians only, one to clients only, and two to both clients and clinicians. Only one of the six found feedback was associated with significant reductions in substance use and only among off-track clients. Four of the six found feedback improved other outcomes, including treatment retention, global functioning, therapeutic alliance and mood symptoms.

CONCLUSIONS

There may be some positive effects for clients of providing feedback to clients and/or clinicians; however, the small number of randomised trials and the heterogeneity of methods, outcome measures and findings, mean that firm conclusions cannot be drawn about the efficacy of feedback until larger randomised studies are conducted.

Using a Quality Improvement Approach to Implement Measurement-Based Care (MBC) in Outpatient General Psychiatry

BACKGROUND

Measurement-based care (MBC) is the clinical practice of using patient-reported symptom measurement to inform treatment decisions. MBC has been shown to improve patient outcomes and quality of care in outpatient psychiatry. Despite these benefits, MBC is not routinely used in most psychiatric outpatient settings. This quality improvement (QI) project aimed to achieve 75% completion of symptom scales using an online MBC platform in a general psychiatry clinic in Toronto, Canada, by June 2022.

METHODS

The QI team used the Model for Improvement methodology. The main outcome measure was completion of symptom scales using an online MBC platform. Process measures included counts of invitations to join the MBC platform, counts of online MBC account creation, and counts of symptom scale assignment by clinicians. Balancing measures included administrative task completion and physician workload assessment. Stakeholder interviews explored barriers and facilitators to MBC utilization.

RESULTS

Completion of symptom scales increased from 7/65 (10.8%) preintervention to 40/70 (57.1%) during the 26-week intervention. Clinician reminders and coaching clinicians about how to incorporate MBC into the care process facilitated uptake of MBC. Stakeholders identified several barriers to implementation, particularly physician attitudes toward MBC and perceived administrative burden.

CONCLUSION

Completion of symptom scales increased over the course of this QI initiative. Successful implementation of MBC in general psychiatry outpatient settings requires the availability of a broad range of measurement scales given the diversity of mental health diagnoses. Implementation must also consider health equity, including access to technology and availability of symptom scales in multiple languages.

Italian validation of the Clinical Outcomes in Routine Evaluation 10 (CORE-10): a short measure for routine outcome monitoring in clinical practice

The customization of the intervention using patient feedback is an evidence-based practice aimed at the continuous evaluation, during the course of treatment, of the patient's change at a clinical level. There are few easy-to-use tools for common assessment of psychological distress, designed to be used for screening and during treatment to monitor progress. The CORE-10 is definitely one of them. Thus, the aim of the present study was to examine the psychometric properties of the Italian version of the Clinical Outcomes in Routine Evaluation - 10 (CORE-10). A sample of 548 participants (females, N = 463, 84,5%; mean age 23.29 ± 7.21 years) was recruited in the study and filled out a battery of measures. The internal validity of the CORE-10 was investigated through a confirmatory factor analysis (CFA) which evidenced a good fit to the data, suggesting a unidimensional factorial structure of the measure. Further, the scale had a good internal reliability and was significantly associated with other measures of distress, interpersonal problems, wellbeing, and insecure attachment. Finally, it showed excellent diagnostic accuracy, as well as intrinsic and post-test diagnostics. Given its validity and reliability, the CORE-10 may be adopted by Italian-speaking psychotherapists and researchers to evaluate the outcomes of mental health interventions as well as to track the session-to-session changes over time in psychological distress among patients.

Which therapist perceptions best predict client outcomes? A naturalistic examination

Examining associations between therapists' perceptions of therapy sessions and client-reported outcomes in naturalistic settings (real-life therapy settings) can provide valuable guidance for the assessment, treatment, and monitoring of clients. This study included data of 1334 sessions from 127 clients (86 individual and 41 couple cases) and 15 therapists, collected at a therapy training center. Clients reported their personal functioning and individual symptoms before each session. Therapists rated clients' participation, receptivity, session progress, goal progress, and therapeutic alliance at the end of each therapy session. Multilevel Structural Equation Modeling analyses revealed that therapist-rated client participation and goal progress predicted better personal functioning, beyond clients' previous personal functioning scores. In contrast, none of therapist-rated session variables predicted clients' individual symptoms, beyond previous symptom scores. Power analyses suggested sufficient statistical power to detect small effect sizes. Findings of the current study have clinical implications for treatment planning and progress monitoring.

Systematic Review and Meta-Analysis of Stepped Care Psychological Prevention and Treatment Approaches for Posttraumatic Stress Disorder

Stepped care approaches have been developed to increase treatment accessibility for individuals with posttraumatic stress disorder (PTSD). However, despite guidelines recommending stepped care, it is currently unclear how the approach compares to other treatments for PTSD in terms of symptom reduction, cost, and client-rated acceptability. We conducted a systematic review and meta-analysis of randomized controlled and open trials evaluating stepped care prevention (i.e., targeting those with recent trauma exposure at risk of developing PTSD) and treatment approaches for adults and adolescents/children with PTSD. Eight prevention and four treatment studies were included. There was considerable variation in the sample types, stepped approaches, and control conditions. Most studies found no significant differences between stepped care (both prevention and treatment) and control (active and usual care) in terms of PTSD severity, loss of PTSD diagnosis, depression severity, and quality of life at the final follow-up. There was some evidence to suggest that stepped care was more cost-effective, and as acceptable or more acceptable compared to controls. Interpretations were tempered by high statistical heterogeneity, risk of bias, and lack of recommended evidence-based treatments. Stepped care can make PTSD treatment more accessible; however, more high-quality research is needed comparing stepped care to active controls.

Attitudes of psychotherapists towards their own performance and the role of the social comparison group: The self-assessment bias in psychodynamic, humanistic, systemic, and behavioral therapists

Studies report that psychotherapists overestimate their own performance (self-assessment bias). This study aimed to examine if the self-assessment bias in psychotherapists differs between therapeutic orientations and/or between social comparison groups. Psychotherapists gave subjective estimations of their professional performance (0–100 scale from poorest to best performance) compared to two social comparison groups (“all psychotherapists” vs. “psychotherapists with the same therapeutic approach”). They further rated the proportion of their patients recovering, improving, not changing, or deteriorating. In total, N = 229 Austrian psychotherapists (n = 39 psychodynamic, n = 121 humanistic, n = 48 systemic, n = 21 behavioral) participated in the online survey. Psychotherapists rated their own performance on average at M = 79.11 relative to “all psychotherapists” vs. at M = 77.76 relative to “psychotherapists with the same therapeutic approach” (p < 0.05). This was not significantly different between therapeutic orientations. A significant interaction between social comparison group and therapeutic orientation (p < 0.05) revealed a drop of self-assessement bias in social comparison group “same approach” vs. “all psychotherapists” in psychodynamic and humanistic therapists (p < 0.05). Psychotherapists overestimated the proportion of patients recovering (M = 44.76%), improving (M = 43.73%) and underestimated the proportion of patients not changing (M = 9.86%) and deteriorating (M = 1.64%), with no differences between orientations. The self-assessment bias did not differ between therapeutic orientations, but the social comparison group appears to be an important variable. A major drawback is that results have not been connected to patient-reported outcome or objectively rated performance parameters.

Strengthening Community End-of-Life Care through Implementing Measurement-Based Palliative Care

The increasing demand for palliative care in New Zealand presents a potential threat to the quality of service delivery. One strategy to overcome this is through the implementation of valid and reliable patient-reported outcome measures. This mixed-methods study aimed to (1) implement measurement-based palliative care (MBPC) in a community palliative care service in Auckland, New Zealand; (2) evaluate the clinical utility of MBPC perceived by clinicians; (3) describe patient characteristics as measured by the Integrated Palliative Care Outcome Scale (IPOS), the Australasian Modified Karnofsky Performance Scale (AKPS), and Phase of Illness (POI); and (4) evaluate the internal consistency of the IPOS. Participants were over 18 years of age from a community outpatient palliative care service. In a phased approach to implementation, healthcare staff were educated on each instrument used for patient assessment. Uptake and internal consistency were evaluated through descriptive statistics. An interpretive descriptive methodology was used to explore the clinical utility of MBPC through semi-structured interviews with seven clinical staff members. Individual patient assessments (n = 1507) were undertaken predominantly on admission, with decreasing frequency as patients advanced through to the terminal phase of their care. Mean total IPOS scores were 17.97 (SD = 10.39, α = 0.78). The POI showed that 65% of patients were in the stable phase, 20% were in the unstable phase, 9% were in the deteriorating phase, and 2% were in the terminal phase. Clinicians reported that MBPC facilitated holistic and comprehensive assessments, as well as the development of a common interdisciplinary language. Clinicians expressed discomfort using the psychosocial and spiritual items. Measurement-based palliative care was only partially implemented but it was valued by staff and perceived to increase the quality of service delivery. Future research should determine the optimal timing of assessments, cultural responsivity for Māori and Pacific patients, and the role of MBPC in decision support for clinicians.

Optimization of measurement-based care (OMBC) for depression based on all-round and continuous assessment: rationale and protocol for a multicenter randomized control clinical trial

BACKGROUND

Despite the recent findings presenting the benefits of measurement-based care (MBC) compared to treatment as usual (TAU), MBC is still not the standard of care used in clinical settings. The aim of the present study was to achieve the optimization of MBC (OMBC) for major depressive disorder (MDD) by establishing a comprehensive MBC framework based on all-round, continuous assessment for depression.

METHODS

The target recruitment size is 900 patients, and the study is conducted at 8 centers in China. The patients are randomly assigned to the MBC and TAU groups at a 2:1 ratio. The subjects are scheduled to remain for 12 weeks in the acute phase and for 12 months in the maintenance phase. The primary outcomes are the complete remission rate and the proportion of patients with a 16-item Quick Inventory of Depressive Symptomatology-Self-Report (QIDS-SR 16) total score ≤ 5 of the MBC and TAU groups at the acute phase, and the recurrence rate/time between the two groups is measured at the maintenance phase. Secondary outcomes included the changes in the parameters QIDS-SR 16, Patient Health Questionnaire-9 (PHQ-9), and 17-item Hamilton Rating Scale for Depression (HAMD-17) from baseline and the response rate between the two groups at the acute phase as well as the comparison of recurrence rate between the two groups at the end of the study.

TRIAL REGISTRATION

Chinese Clinical Trial Registry, ChiCTR-OOC-17012566 . The registration was performed retrospectively on 4 September 2017.

Adapted remote cognitive behavioural therapy for comfort eating with a woman with intellectual disabilities: Case report

BACKGROUND

Diagnostic overshadowing can prevent the treatment of comfort eating in people with intellectual disabilities, and the published literature contains few therapeutic examples. This case study reports a relatively novel, promising, and accessible, remote cognitive behavioural intervention.

CASE PRESENTATION

This case study documents a therapeutic intervention for comfort eating with a client, Sarah, in a National Health Service adult Community Learning Disabilities Service. Sarah is a white, British woman in her late thirties, with a diagnosis of Down syndrome who experienced significant problems with comfort eating and subsequent weight management. Despite dieting and exercising, Sarah was clinically obese and experienced weight related pain and psychological distress. Systemic intervention between Sarah, her mother, and the therapist formulated Sarah's eating difficulties using a cognitive behavioural framework. This hypothesised how comfort-eating met her emotional needs and maintained her health difficulties. Remote cognitive behavioural therapy interventions included collaborative behavioural experiments, coping strategies, and homework tasks.

CONCLUSIONS

The Maslow Assessment of Needs Scale-Learning Disabilities, Glasgow Depression Scale for people with a Learning Disability, Glasgow Anxiety Scale for people with an Intellectual Disability, qualitative feedback from family, as well as frequency data showed significant improvement. Additionally, the case considers the evidence base, assessment, formulation and intervention, before reflecting on its various strengths and limitations. It reflects on the intersectionality of sexuality and intellectual disabilities, and the desire for romantic attachment, which was additionally complicated by the context of coronavirus and social isolation. The environmental influences on comfort eating regarding this case, and in general, the experiences of people with intellectual disabilities are also considered. The potential clinical impact of this case study includes exemplifying an effective comfort eating therapeutic intervention in an often overlooked client group.

Goal setting and monitoring with alcohol and other drug use disorders: Principles and practices

INTRODUCTION

This work builds on a small body of literature that explores core processes in psychotherapy, behavior change, and evidence-based alcohol or other drug (AOD) therapies. Here, this paper discusses two separate but dependent processes. The research team defines goal setting and goal monitoring as collaborative processes where clinicians and clients identify and formulate therapeutic goals; actionable objectives; and revisit, measure, and renegotiate these plans via a standardized procedure over time.

METHOD

Study methods included a literature review and qualitative content analysis to derive a set of principles and practices of goal setting and monitoring. The research team used source documents (i.e., literature reviews, therapy manuals, and government-issued practice guidelines) and videos (i.e., therapy demonstration videos), and we performed analyses in NVIVO.

RESULTS

The study identified ten principles and 32 practices. The principles suggest that goal setting and monitoring can be characterized as a collaborative, explicit, and standardized approach to engaging in goal-directed therapeutic work. The term goal-directed therapeutic work connotes a shift toward a more accountable frame for care than has been previously emphasized in the literature. The identified practices were organized into five sub-themes related to goal setting (10 practices), goal monitoring (10 practices), as well as practices specific to mechanisms of goal pursuit and behavior change. These practices involved ways to attend to client self-determination (4 practices), motivation (4 practices), and self-efficacy (4 practices).

CONCLUSIONS

Goal setting and monitoring are a collaborative means of mapping and tracking a course of mutually accountable treatment. The current work is a novel resource for trainees, clinicians, and clinical supervisors interested in care based on evidence-based principles and practices of AOD and other behavior change therapies.

Measurement-Based Care in the Adolescent Partial Hospital Setting: Implementation, Challenges, & Future Directions

In this paper, we describe the process of implementing measurement-based care (MBC) in the adolescent partial hospital program setting. First, we outline the rationale for incorporating MBC in this treatment setting. Second, we describe the partial hospital setting in which implementation took place, including the patient population, treatment providers, and structure of programming. Next, we outline the initial implementation of standardized assessments into our programming, including key initial considerations and challenges during implementation. We describe the importance of considering the primary symptom presentations of the patient population when selecting assessment tools, the importance of leveraging existing electronic health record tools to efficiently track and record data collection, and the ability to integrate assessments into clinical workflows. Fourth, we present data describing compliance with implementation, patient outcomes, and providers' attitudes towards and knowledge of MBC following implementation. We found after the initial implementation period, compliance was high. We also found providers had an overall positive perception of the use of MBC, reporting they perceived it to be helpful to both their clinical practice and patient outcomes. Finally, we discuss future directions for best utilizing standardized assessments in intensive treatment settings.

Clients’ Hope for Counseling as a Predictor of Outcome in Psychotherapy

Researchers have demonstrated links between general hope and symptoms of distress. Findings like these are important given the conceptual role of hope in psychotherapy theories like Frank and Frank’s contextual model. Existing literature, however, has involved researchers employing general hope measures despite hope being variable across domains rather than a general trait. The purpose of this study was to explore the relationships between hope for counseling and clients’ outcomes as well as the working alliance. Self-report data were collected from 103 clients in a doctoral training clinic. Evidence (from multilevel modeling) demonstrated that increases in working alliance predict increases in hope for counseling over the course of treatment and that increases in hope for counseling significantly predict decreases in distress over the course of counseling when working alliance and session number are controlled. We discuss implications for clinical practice and positively-oriented work in counseling psychology.

Provider perceived barriers and facilitators to integrating routine outcome monitoring into practice in an urban community psychiatry clinic: A mixed-methods quality improvement project

BACKGROUND AND AIMS

Although mental health clinics are under increasing pressure to demonstrate value and routine outcome monitoring (ROM) has become a mandated component of care, providers have been slow to adopt ROM into practice, with some estimating that less than 20% of mental health clinicians use it consistently in the United States. This article explores perceived barriers and facilitators to integrating ROM into practice among clinicians and administrators in a large urban US community psychiatry clinic.

METHOD

One hundred and thirty-eight clinical and administrative staff were administered an anonymous web-based survey to elicit attitudes towards ROM. Responses were summarized descriptively and qualitatively synthesized into a conceptual model using inductive thematic analysis.

RESULTS

Common barriers to integration included insufficient time to collect and/or use measures, not knowing what measures to use, measures being difficult to access, and insufficient training. Facilitators included increased access/ease of use, training and support, measure relevance/validity, and accountability.

CONCLUSIONS

In order for psychiatry clinics to successfully implement ROM into practice, they must diagnose organization-side barriers and translate this knowledge into actionable quality improvement initiatives ranging from the infrastructural to the cultural.

Middle and High School Student Perspectives on Digitally-Delivered Mental Health Assessments and Measurement Feedback Systems

Implementation of measurement-based care (MBC) by child-serving community mental health providers, particularly school-based providers, is low. To inform user-centered design of measurement feedback systems (MFSs) and MBC implementation more broadly, semi-structured interviews were conducted with 61 middle and high school students. Interviews explored student preferences for and perceived helpfulness of different assessment methods and use of MFS in counseling. Results indicate that student preference for digitally-administered assessment is equivocal, with preferences being influenced by student perceptions of the ease of use, impersonalization, and confidentiality. Students with exposure to the MFS found it helpful when used by their provider to share assessment feedback.

Using progress feedback to improve outcomes and reduce drop-out, treatment duration, and deterioration: A multilevel meta-analysis

Progress feedback is an intervention aimed at enhancing patient outcomes in routine clinical practice. This study reports a comprehensive multilevel meta-analysis on the effectiveness of progress feedback in psychological treatments in curative care. The short- and long-term effects of feedback on symptom reduction were investigated using 58 (randomized and non-randomized) studies, analyzing 110 effect sizes in a total of 21,699 patients. Effects of feedback on dropout rate, percentage of deteriorated cases, and treatment duration were also examined. Moderation analyses were conducted for study and feedback characteristics. A small significant effect of progress feedback on symptom reduction (d = 0.15, 95% CI: [0.10, 0.20]) was found, compared to control groups. This was also true for not-on-track cases (d = 0.17, 95% CI: [0.11, 0.22]). In addition, feedback had a small favorable effect on dropout rates (OR = 1.19, 95% CI: [1.03, 1.38]). The moderation analyses identified several potentially interesting variables for further research, including feedback instrument, outcome instrument, type of feedback, feedback frequency, treatment intensity, and country in which the study was conducted. Future studies should report on these variables more consistently so that we can obtain a better understanding of when and why feedback improves outcomes.

ANZAED eating disorder treatment principles and general clinical practice and training standards

INTRODUCTION

Eating disorders are complex to manage, and there is limited guidance around the depth and breadth of knowledge, skills and experience required by treatment providers. The Australia & New Zealand Academy for Eating Disorders (ANZAED) convened an expert group of eating disorder researchers and clinicians to define the clinical practice and training standards recommended for mental health professionals and dietitians providing treatment for individuals with an eating disorder. General principles and clinical practice standards were first developed, after which separate mental health professional and dietitian standards were drafted and collated by the appropriate members of the expert group. The subsequent review process included four stages of consultation and document revision: (1) expert reviewers; (2) a face-to-face consultation workshop attended by approximately 100 health professionals working within the sector; (3) an extensive open access online consultation process; and (4) consultation with key professional and consumer/carer stakeholder organisations.

RECOMMENDATIONS

The resulting paper outlines and describes the following eight eating disorder treatment principles: (1) early intervention is essential; (2) co-ordination of services is fundamental to all service models; (3) services must be evidence-based; (4) involvement of significant others in service provision is highly desirable; (5) a personalised treatment approach is required for all patients; (6) education and/or psychoeducation is included in all interventions; (7) multidisciplinary care is required and (8) a skilled workforce is necessary. Seven general clinical practice standards are also discussed, including: (1) diagnosis and assessment; (2) the multidisciplinary care team; (3) a positive therapeutic alliance; (4) knowledge of evidence-based treatment; (5) knowledge of levels of care; (6) relapse prevention; and (7) professional responsibility.

CONCLUSIONS

These principles and standards provide guidance to professional training programs and service providers on the development of knowledge required as a foundation on which to build competent practice in the eating disorder field. Implementing these standards aims to bring treatment closer to best practice, and consequently improve treatment outcomes, reduce financial cost to patients and services and improve patient quality of life.

Defining Success in Measurement-Based Care for Depression: A Comparison of Common Metrics

OBJECTIVE

The National Committee for Quality Assurance recommends response and remission as indicators of successful depression treatment for the Healthcare Effectiveness and Data Information Set. Effect size and severity-adjusted effect size (SAES) offer alternative metrics. This study compared measures and examined the relationship between baseline symptom severity and treatment success.

METHODS

Electronic records from two large integrated health systems (Kaiser Permanente Colorado and Washington) were used to identify 5,554 new psychotherapy episodes with a baseline Patient Health Questionnaire (PHQ-9) score of ≥10 and a PHQ-9 follow-up score from 14-180 days after treatment initiation. Treatment success was defined for four measures: response (≥50% reduction in PHQ-9 score), remission (PHQ-9 score <5), effect size ≥0.8, and SAES ≥0.8. Descriptive analyses examined agreement of measures. Logistic regression estimated the association between baseline severity and success on each measure. Sensitivity analyses evaluated the impact of various outcome definitions and loss to follow-up.

RESULTS

Effect size ≥0.8 was most frequently attained (72% across sites), followed by SAES ≥0.8 (66%), response (46%), and remission (22%). Response was the only measure not associated with baseline PHQ-9 score. Effect size ≥0.8 favored episodes with a higher baseline PHQ-9 score (odds ratio [OR]=2.3, p<0.001, for 10-point difference in baseline PHQ-9 score), whereas SAES ≥0.8 (OR=0.61, p<0.001) and remission (OR=0.43, p<0.001) favored episodes with lower baseline scores.

CONCLUSIONS

Response is preferable for comparing treatment outcomes, because it does not favor more or less baseline symptom severity, indicates clinically meaningful improvement, and is transparent and easy to calculate.

Progress monitoring and feedback delivered in routine psychiatric care: Beneficial but not reaching those thought to need it most

Objective: The study evaluated the use and effectiveness of a progress monitoring system routinely operational in a private mental health care setting. Method: In a nonrandomized trial in which 778 consecutively admitted patients underwent a 2-week cognitive behavioral therapy intervention, the effectiveness of therapists choosing to use progress monitoring feedback to frame therapist-patient discussions about individuals' progress was evaluated. Results: Patients engaged in discussions involving progress monitoring feedback during the intervention achieved a more consistent recovery rate. Furthermore, individuals that were not-on-track to achieve a positive outcome experienced a boost to recovery immediately after receiving feedback. However, evidence suggested that therapists were not using progress monitoring to primarily focus additional resources on not-on-track patients. Conclusion: Progress monitoring feedback benefited patient recovery. However, guidelines could improve the system by directing therapists to use feedback primarily with patients not on course for a positive therapeutic outcome.

Development and Initial Validation of the Therapist Hope for Clients Scale

Hope is a critical component of therapeutic change. However, hope does not singularly emanate from clients. Therapists’ hope for their clients represents a specific therapeutic factor that may impact clinical outcomes. Currently no measure exists to assess the uniqueness of therapist’s hope in therapy with specific clients. Our purpose in this study was to develop and initially validate the Therapist Hope for Clients Scale (THCS). Participants ( N = 380) completed the THCS, plus four additional measures to assess therapists’ use of clients’ strengths, self-efficacy in helping skills, working alliance with individual clients, and a general measure of hope. We subjected the THCS to parallel analysis, factor analyses, reliability testing, and validity testing. These steps led to the development of a 10-item measure. THCS scores were positively related to therapists’ use of clients’ strengths, helping skills, self-efficacy, and working alliance. Implications of the THCS are discussed.

Effectiveness of an Integrated Care Pathway for Adolescents with Depression: A Pilot Clinical Trial Protocol

OBJECTIVE

Our group aims to improve treatment response for adolescents with depression through the use of an Integrated Care Pathway (ICP) we developed using: (1) recommendations from a high quality Clinical Practice Guideline (CPG); and, (2) a measurement-based care framework.

METHOD

Pre-specified criteria will identify eligible adolescents in two outpatient hospital study sites. Study group allocation, to the ICP versus treatment as usual (TAU), is based on site of presentation. The primary clinical outcome is reduction of depression symptoms, assessed using the Childhood Depression Rating Scale - Revised (CDRS-R). Measures will be taken at baseline and every four weeks until 20 weeks of treatment has been offered.

RESULTS

Our overall hypothesis is that the ICP will be associated with greater improvement in depressive symptoms compared to TAU. Feasibility targets for this pilot trial include the following: recruitment of 30 participants per site over a 21-month period, 95% baseline assessment completion rates, 90% clinician adherence to the ICP in the intervention arm and 80% completion of the scheduled CDRS-R measures over the 20-week interval. Focus-group feedback from youth and parents will also produce qualitative information.

CONCLUSIONS

If feasibility targets are met, and preliminary results regarding clinical outcomes are promising, then a multi-center cluster RCT would be pursued.

Measurement-Based Care in the Veteran's Health Administration: A Critique and Recommendations for Future Use in Mental Health Practice

Measurement-based care (MBC), a mechanism through which feedback is given to providers and patients, is increasingly being used in mental health care and has a number of benefits. These include providing information about treatment progress, encouraging a discussion around these topics, providing a method for shared decision-making and personalized treatment, and improving treatment outcomes. Although there are many benefits to using MBC, it is still not being used regularly. Barriers include time to administer measures and uncertainty regarding which measures to administer. This paper will briefly describe MBC and its use in mental health care and then will focus on the use and implementation of MBC within the Veteran's Health Administration (VHA). The VHA is a large healthcare system in which there have been ongoing efforts to implement MBC. Suggestions for successful implementation will be discussed.

Predicting Dropout from Inpatient Substance Use Disorder Treatment: A Prospective Validation Study of the OQ-Analyst

Background and Aims:

There is an urgent need for tools allowing therapists to identify patients at risk of dropout. The OQ-Analyst, an increasingly popular computer-based system, is used to track patient progress and predict dropout. However, we have been unable to find empirical documentation regarding the ability of OQ-Analyst to predict dropout. The aim of the present study was to perform the first direct test of the ability of the OQ-Analyst to predict dropout.

Design:

Patients were consecutively enlisted in a naturalistic, prospective, longitudinal clinical trial. As interventions based on feedback from the OQ-Analyst could alter the outcome and potentially render the prediction wrong, feedback was withheld from patients and therapists.

Setting:

The study was carried out during 2011–2013 in an inpatient substance use disorder clinic in Oslo, Norway.

Participants:

Patients aged 18 to 28 years who met criteria for a principal diagnosis of mental or behavioural disorder due to psychoactive substance use (ICD 10; F10.2–F19.2).

Measurements:

Red signal (predictions of high risk) from the Norwegian version of the OQ-Analyst were compared with dropouts identified using patient medical records as the standard for predictive accuracy.

Findings:

A total of 40 patients completed 647 OQ assessments resulting in 46 red signals. There were 27 observed dropouts, only one of which followed after a red signal. Patients indicated by the OQ-Analyst as being at high risk of dropping out were no more likely to do so than those indicated as being at low risk. Random intercept logistic regression predicting dropout from a red signal was statistically nonsignificant. Bayes factor supports no association.

Conclusions:

The study does not support the predictive ability of the OQ-Analyst for the present patient population. In the absence of empirical evidence of predictive ability, it may be better not to assume such ability.

Implementing Measurement-Based Care in Behavioral Health: A Review

IMPORTANCE

Measurement-based care (MBC) is the systematic evaluation of patient symptoms before or during an encounter to inform behavioral health treatment. Despite MBC's demonstrated ability to enhance usual care by expediting improvements and rapidly detecting patients whose health would otherwise deteriorate, it is underused, with typically less than 20% of behavioral health practitioners integrating it into their practice. This narrative review addresses definitional issues, offers a concrete and evaluable operationalization of MBC fidelity, and summarizes the evidence base and utility of MBC. It also synthesizes the extant literature's characterization of barriers to and strategies for supporting MBC implementation, sustainment, and scale-up.

OBSERVATIONS

Barriers to implementing MBC occur at multiple levels: patient (eg, concerns about confidentiality breach), practitioner (eg, beliefs that measures are no better than clinical judgment), organization (eg, no resources for training), and system (eg, competing requirements). Implementation science-the study of methods to integrate evidence-based practices such as MBC into routine care-offers strategies to address barriers. These strategies include using measurement feedback systems, leveraging local champions, forming learning collaboratives, training leadership, improving expert consultation with clinical staff, and generating incentives.

CONCLUSIONS AND RELEVANCE

This narrative review, informed by implementation science, offers a 10-point research agenda to improve the integration of MBC into clinical practice: (1) harmonize terminology and specify MBC's core components; (2) develop criterion standard methods for monitoring fidelity and reporting quality of implementation; (3) develop algorithms for MBC to guide psychotherapy; (4) test putative mechanisms of change, particularly for psychotherapy; (5) develop brief and psychometrically strong measures for use in combination; (6) assess the critical timing of administration needed to optimize patient outcomes; (7) streamline measurement feedback systems to include only key ingredients and enhance electronic health record interoperability; (8) identify discrete strategies to support implementation; (9) make evidence-based policy decisions; and (10) align reimbursement structures.

Association of Therapeutic Alliance with Outcomes Over Two Years in Youth and Family Service

This study examines therapeutic alliance (TA) over 2 years and the association with clinical outcomes for children and youth in a home and school-based behavioral health service characterized by innovative TA practices. Caregiver report of TA and functioning were collected monthly and discussed to inform service planning. Trajectory analysis was conducted to discern distinct patterns of TA ratings over time with linear mixed models to examine factors associated with the resulting TA patterns. We identified 1714 Medicaid-eligible youth and families. The majority of families (84%) reported high and steady ratings of TA, 5% reported lower but improving TA ratings, and 11% reported declining TA ratings over time. Average TA rating was associated with family and child functioning, yet all TA groups experienced improved functioning over time. Measurement of TA over time may help clinicians target and improve care for children and families.

Negative effects in psychotherapy: commentary and recommendations for future research and clinical practice

BACKGROUND

Psychotherapy can alleviate mental distress and improve quality of life, but little is known about its potential negative effects and how to determine their frequency.

AIMS

To present a commentary on the current understanding and future research directions of negative effects in psychotherapy.

METHOD

An anonymous survey was distributed to a select group of researchers, using an analytical framework known as strengths, weaknesses, opportunities and threats.

RESULTS

The researchers perceive an increased awareness of negative effects in psychotherapy in recent years, but also discuss some of the unresolved issues in relation to their definition, assessment and reporting. Qualitative methods and naturalistic designs are regarded as important to pursue, although a number of obstacles to using such methods are identified.

CONCLUSION

Negative effects of psychotherapy are multifaceted, warranting careful considerations in order for them to be monitored and reported in research settings and routine care.

DECLARATION OF INTEREST

None.

Towards an evidence-based unified psychodynamic protocol for emotional disorders

BACKGROUND

In psychotherapy research unified, transdiagnostic and modular treatments have emerged. This is true for both cognitive-behavioral therapy and psychodynamic therapy. Recently, two unified psychodynamic protocols were presented, one for anxiety disorders, another for depressive disorders. Integrating the treatment principles for these two highly prevalent disorder groups into one protocol for "emotional disorders" may be useful for both clinical practice and training in psychotherapy.

METHODS

After updating the evidence for psychodynamic therapy in anxiety and depressive disorders in terms of randomized controlled trials (RCTs) by a systematic search, the treatment elements applied in those RCTs providing evidence for the efficacy of psychodynamic therapy in depressive or anxiety disorders were reviewed and compared.

RESULTS

Twenty-seven RCTs for anxiety or depressive disorders were identified. A review revealed a high overlap between the principles used for the psychodynamic treatment of anxiety and depressive disorders, reflecting the transdiagnostic nature of psychodynamic therapy. The overlap suggested to integrate the identified treatment principles into one unified psychodynamic protocol for "emotional disorders" (UPP-EMO). As a result, seven treatment principles or modules were distilled which can be flexibly applied depending on the patient´s symptoms and needs. In addition, a separate module addresses diagnostic assessment. Across modules, a focus on resources has been included.

LIMITATIONS

Despite being based on RCTs, UPP-EMO has not yet been examined in an RCT - which is planned as a next step.

CONCLUSIONS

As psychodynamic therapy is transdiagnostic in origin focusing on core underlying processes of mental disorders, acceptability of UPP-EMO among psychodynamic psychotherapists is likely to be high.

A conceptual model for generating and validating in-session clinical judgments

OBJECTIVE

Little attention has been paid to the nuanced and complex decisions made in the clinical session context and how these decisions influence therapy effectiveness. Despite decades of research on the dual-processing systems, it remains unclear when and how intuitive and analytical reasoning influence the direction of the clinical session.

METHOD

This paper puts forth a testable conceptual model, guided by an interdisciplinary integration of the literature, that posits that the clinical session context moderates the use of intuitive versus analytical reasoning.

RESULTS

A synthesis of studies examining professional best practices in clinical decision-making, empirical evidence from clinical judgment research, and the application of decision science theories indicate that intuitive and analytical reasoning may have profoundly different impacts on clinical practice and outcomes.

CONCLUSIONS

The proposed model is discussed with respect to its implications for clinical practice and future research.

Working with interpretations in cognitive behavioural therapy for obsessive compulsive disorder

Cognitive behavioural therapy (CBT) is a highly effective treatment for obsessive compulsive disorder (OCD). Identifying, challenging and monitoring interpretations of intrusions is considered a key element of CBT for OCD but preliminary research suggests that treatment does not always include identification and modification of misinterpretations. The present investigation explored ‘OCD-expert’ and ‘non-OCD-expert’ clinicians’ views on key elements of CBT for OCD to determine whether identifying and modifying key interpretations were considered important in therapy and whether clinicians who do not have specific expertise in OCD found working with interpretations difficult. Study 1 used a qualitative approach to investigate OCD-expert and non-OCD-expert clinician's views on key elements of CBT for OCD. Study 2 used a questionnaire to investigate what non-OCD-expert clinicians viewed as important and difficult aspects of CBT for OCD. Study 1 results showed that OCD-expert and non-OCD-expert clinicians reported working with interpretations was a key element of CBT for OCD. However, OCD-expert clinicians linked interpretations more closely to a formulation and intervention plan and reported using more techniques and questionnaires when working with interpretations compared with non-OCD-expert clinicians. Study 2 results showed that non-OCD-expert clinicians rated interpretations as both important and difficult to work with but no more important or difficult than other key elements of CBT for OCD. OCD-expert and non-OCD-expert clinicians identify working with interpretations as a key element of CBT for OCD. Non-OCD-expert clinicians may benefit from additional training on formulation tools that help identify, monitor and challenge interpretations of intrusions.

Harm in Hypnosis: Three Understandings From Psychoanalysis That Can Help

Over 50 years of empirical data demonstrate unequivocally that psychotherapy can cause harm as well as good. Two therapist factors increasing harm risk are inadequate assessment of patients' vulnerabilities and certain attitudes/affects. Adding hypnosis as a technique within psychotherapy heightens risk for harm because: (a) trance can unexpectedly expose patient vulnerabilities (through loosening reality orientation, lessening structure, generating unfamiliar sensations and perceptions, and intensifying access to interior information such as emotions and imagery); and (b) trance can unexpectedly increase porousness to therapist's attitudes/affects (through heightening mental receptivity to the internal states of others). A century of clinical data from psychoanalysis offers guidance for protecting against such risks. Concepts of structure, interiority, and countertransference are explicated and translated into practical clinical suggestions for harm prevention.

New Horizons in Measurement: a Review of Novel and Innovative Approaches to Eating-Disorder Assessment

PURPOSE OF REVIEW

Eating disorders are serious mental-health concerns that will affect over 30 million individuals in the USA at some point in their lives. Eating disorders occur across the lifespan, in a variety of ethnicities and races, in both men and women, and across the socioeconomic spectrum. Given the prevalence and severity of eating disorders, it is important that clinicians and researchers have access to appropriate assessment tools to aid in the early identification and treatment referral, differential diagnosis, treatment planning, and progress monitoring, and to ensure valid research findings. In this review, we describe novel and innovative assessment tools that were developed within the past 5 years for utilization in research and/or clinical practice with individuals with eating disorders.

RECENT FINDINGS

We identified six multidimensional assessments for eating disorders, all of which can be administered online (with some also offering paper-and-pencil versions). Strengths of the measures included good internal consistency, test-retest reliability, and convergent validity. However, in part, due to problematic scale construction methods, certain scales had poor discriminant validity and most were developed and validated in mostly female samples. There are promising new eating disorder measures from which to choose; however, many measures continue to be limited by poor discriminant validity and need additional validation prior to incorporation into routine research and clinical practice.

Wie wirkt sich mehrmaliges Kompetenz-Feedback auf psychotherapeutische Behandlungen aus?

Zusammenfassung. Theoretischer Hintergrund: Einflüsse von therapeutenorientiertem Kompetenz-Feedback in der Psychotherapieausbildung wurden bislang wenig untersucht. Fragestellung: Wie gehen Ausbildungstherapeuten mit Feedback um? Welchen Einfluss hat ein regelmäßiges Kompetenz-Feedback auf die Qualität psychotherapeutischer Behandlungen (insbesondere Therapiesitzungen, therapeutische Beziehung, Person des Therapeuten, Supervision)? Methode: Elf Therapeuten wurden mithilfe eines halbstrukturierten Interviewleitfadens befragt. Die Auswertung erfolgte mittels qualitativer Inhaltsanalyse nach Mayring (2015) . Ergebnisse: Das auf Basis der Interviews erstellte Kategoriensystem umfasste die Kategorien „Erwartungen an das Feedback“, „Wahrnehmung des Feedbacks“, „Verarbeitung von und Umgang mit Feedback“, „Folgen, Auswirkungen und Veränderungen durch Feedback“ sowie „Verbesserungswünsche“. Schlussfolgerungen: Therapeuten streben eine Umsetzung des Feedbacks an, welches sich auf die Behandlung, die Supervision, die eigene Person und die therapeutische Beziehung auswirkt.

Maximizing Psychotherapy Outcome beyond Evidence-Based Medicine

Despite evidence that psychotherapy has a positive impact on psychological disorders, 30% of patients fail to respond during clinical trials, and as many as 65% of patients in routine care leave treatment without a measured benefit. In addition, therapists appear to overestimate positive outcomes in their patients relative to measured outcomes and are particularly poor at identifying patients at risk for a negative outcome. These problems suggest the need for measuring and monitoring patient treatment response over the course of treatment while applying standardized methods of identifying at-risk cases. Computer-assisted methods for measuring, monitoring, identifying potential deteriorators, and providing feedback to clinicians are described along with a model that explains why feedback is likely to be beneficial to patients. The results of 12 clinical trials are summarized and suggest that deterioration rates can be substantially reduced in at-risk cases (from baseline rates of 21% down to 13%) and that recovery rates are substantially increased in this subgroup of cases (from a baseline of 20% up to 35%) when therapists are provided this information. When problem-solving methods are added to feedback, deterioration in at-risk cases is further reduced to 6% while recovery/improvement rates rise to about 50%. It is suggested that the feedback methods become a standard of practice. Such a change in patterns of care can be achieved through minimal modification to routine practice but may require discussions with patients about their clinical progress.

Change Trajectories: Children's Patterns of Improvement in Acute-Stay Inpatient Care

This study estimated classes of children's acute-stay psychiatric acuity trajectories in terms of shape (i.e., linear, quadratic, cubic) and rate of change (slope). A total of 788 children served on three child units (ages 4-12) were studied. The Children's Acuity of Psychiatric Illness (CAPI) was completed each weekday by trained frontline staff on the milieu. Latent class growth analysis was applied to the data, and seven acuity trajectory classes provided the most parsimonious fit. Four classes evidenced a significant quadratic term, one class a significant linear term, and two classes did not evidence a significant change in acuity. The classes varied in survival time to rehospitalization, in pre-treatment community service use and rates of seclusion, restraint, and emergency medications during the episode. Overall, the results suggest that acute-stay patients may have distinct and identifiable psychiatric acuity change patterns during their episodes and that some may experience non-linear (i.e., quadratic) acuity trajectories.