Effect of feedback of treatment outcome in specialist mental healthcare: meta-analysis

Pre-implementation patient, provider, and administrator perspectives of remote measurement-based care in a safety net outpatient psychiatry department

Introduction

Psychiatric measurement-based care (MBC) can be more effective than usual care, but health systems face implementation challenges. Achieving attitudinal alignment before implementing MBC is critical, yet few studies incorporate perspectives from multiple stakeholders this early in planning. This analysis identifies alignment and themes in pre-implementation feedback from patients, providers, and administrators regarding a planned MBC implementation in a safety net psychiatry clinic.

Methods

We used interview guides informed by Conceptual Model of Implementation Research to gather qualitative pre-implementation attitudes about perceived Appropriateness, Acceptability, and Feasibility of an MBC measure (Computerized Adaptive Test-Mental Health; CAT-MH) from five patients, two providers, and six administrators. We applied rapid qualitative analysis methods to generate actionable feedback for department leadership still planning implementation. [Correction added on 22 January 2025, after first online publication: In the previous sentence, the word 'general' was replaced with the word 'generate'.] We used a multistep process to generate thematic findings with potential relevance for other similar mental health settings.

Results

There was more attitudinal alignment across stakeholder groups regarding MBC's Acceptability and Feasibility than its Appropriateness. All three groups agreed that it was important to contextualize MBC for patients and providers, anticipate MBC's impact on patient-provider relationships, and consider the system's capacity to respond to patient needs unearthed by CAT-MH before implementation began. Our thematic analysis suggests: (1) Introducing MBC may complicate patient-provider relationships by adding a new and potentially conflicting input for decision making, that is, MBC data, to the more typical inputs of patient report and provider expertise; [Correction added on 22 January 2025, after first online publication: In the previous sentence, the word 'complicated' was replaced with the word 'complicate'.] (2) MBC poses theoretical risks to health equity for safety net patients because of limitations in access to MBC tools themselves and the resources needed to respond to MBC data; and (3) Tension exists between individual- and system-level applications of MBC.

Conclusions

Our analysis highlights shifting treatment dynamics, equity considerations, and tension between individual- and population-level needs that our participants anticipated when planning for MBC implementation in a safety net psychiatry clinic.

Psychometric properties of Japanese version of the Recovering Quality of Life (ReQoL)

PURPOSE

This study aims to examine the psychometric properties of the Recovering Quality of Life- Japanese version (ReQoL-J) for use in the community setting.

METHODS

This cross-sectional study was conducted among service users of community mental health service facilities. A series of confirmatory factor analyses (CFAs) was performed. After the best-fitting model was identified, omega indices, and intraclass correlation (ICC) were calculated to evaluate dimensionality and reliability. The correlation coefficients between the ReQoL-J scores and the other scales were calculated for testing construct validity. We also estimated the correlation coefficients between the ReQoL-J-10 and - 20.

RESULTS

A total of 395 service users from 23 facilities in Japan participated in this study. Of these, 66 responded to the test-retest reliability. The bifactor model showed the best fit to the data: χ2/df = 1.74, CFI = 0.993, RMSEA = 0.031, and SRMR = 0.038. ECV and OmegaH indicated unidimensionality. ICC for the Re-QoL-J-10 and - 20 were 0.700 and 0.766, respectively. The ReQoL-J-10 showed a high correlation with the ReQoL-J-20 (r =.95, p <.001). The EQ-5D-5 L, a new brief scale for subjective personal agency (SPA-5), well-being and the quality of life scale (QLS) scores were positively correlated with the ReQoL-J score. On the other hand, the patient health questionnaire-9 (PHQ-9) and the WHODAS scores were negatively correlated with the ReQoL-J score.

CONCLUSION

Factor structure, internal consistency, test-retest reliability, and construct validity of the ReQoL-J were confirmed. The ReQoL-J is a promising tool as a patient-reported outcome measure in mental health services for the Japanese community setting.

Using digitally delivered measurement-based care in substance use disorder treatment: qualitative analysis of patients' perspectives

Background: Measurement-based care (MBC) is a clinical practice where patients complete standardized outcome measures throughout treatment to monitor clinical progress and inform clinical decision-making. However, MBC is rarely adopted in routine substance use disorder (SUD) treatment. We developed a digital MBC system and pilot tested it in an outpatient adult community SUD treatment setting.Objectives: The current study aims to characterize qualitative feedback from the pilot participants about their experiences using the MBC system in SUD treatment, focusing on perceived benefits, drawbacks, and suggestions for improvement.Methods: Participants (N = 30; n = 11 female 37%) completed weekly MBC questionnaires via smartphone for 6 months and completed structured interviews at 6-, 12-, and 24-weeks. Themes were identified using a combination of inductive/deductive thematic analysis.Results: Participants highlighted several benefits of using the digital MBC system, including improved self-reflection (e.g. goal clarification, noticing changes over time), treatment enhancement (e.g. improving patient-clinician communication, extending the reach of treatment beyond scheduled sessions), and ease-of-use (e.g. brief, understandable questions). Drawbacks were less frequently expressed and included limited integration with clinical care, repetitiveness of questionnaires, and some questions being difficult to answer. Suggestions included making elements more personalized and improving interactivity with the digital interface.Conclusion: Patients report several benefits of integrating digitally delivered MBC into SUD treatment, along with recommendations that may improve its usability and usefulness. Integrating MBC technology into SUD treatment may potentially aid patients by enhancing self-reflection, facilitating more efficient communication with clinicians, and extending the reach of treatment beyond scheduled treatment sessions.

Shortening duration of untreated illness in young people with first episode eating disorders: protocol of a randomised controlled feasibility trial of a smartphone friendly multi-modal decision-making tool (FREED-M) to improve help-seeking

BACKGROUND

Early intervention gives young people the best chance to recover from eating disorders (EDs). An important focus of early intervention is shortening the time between a person first developing symptoms and starting treatment (duration of untreated eating disorder; DUED). Patient-related factors (e.g. poor mental health literacy and help-seeking difficulties) are strongly associated with DUED. The aims of our study are to co-design and test the feasibility of FREED-Mobile (FREED-M), an online intervention tool for young people with early-stage EDs. This tool aims to improve knowledge about EDs, increase motivation to seek treatment and teach early steps towards change or recovery, thus reducing DUED.

METHODS

We will carry out a randomised controlled feasibility trial comparing the FREED-M tool with a control intervention where individuals are sign-posted to an ED charity website. The objectives of the proposed trial are to establish/estimate: (a) attrition rates at follow-up (primary feasibility outcome); (b) participant recruitment; (c) intervention uptake, completion rates and acceptability; (d) intervention effect sizes and standard deviations for outcomes to inform the sample size calculation for a large-scale randomised controlled trial (RCT); (e) stakeholder views on the intervention. We aim to recruit 116 participants (young people, aged 16-25, with first episode ED) from primary care, schools and universities, ED services and social media. Online assessments will be carried out at baseline, end of intervention and follow-up (weeks 0, 4 and 12 post-randomisation, respectively). Outcomes will include motivation and readiness to change, attitudes and intentions towards help-seeking, ED symptoms, mood and social functioning, and health-related quality of life. Additionally, we will carry out a qualitative evaluation of participants' views of the intervention and study design.

DISCUSSION

The results of this feasibility trial will inform adaptations to the intervention as needed, as well as the study design (e.g. sample size, primary outcomes) of a future large-scale RCT to assess the effectiveness of the FREED-M intervention. If effective, this novel, online intervention has the potential for wide dissemination and for substantially reducing DUED to improve long-term patient outcomes.

TRIAL REGISTRATION

ISRCTN, ISRCTN15662055. Registered 27 July 2022, https://www.isrctn.com/ISRCTN15662055 .

Measurement-Based Care: A Practical Strategy Toward Improving Behavioral Health Through Primary Care

Behavioral health care access is inadequate and new primary care-based strategies are needed to meet the rising demand. Behavioral health integration (BHI) models, such as collaborative care (CoCM) or the primary care behavioral health (PCBH) model, are often touted as actionable and sustainable solutions. The intent of such models is to bring behavioral health expertise into medical settings with the aims of improving outcomes, increasing treatment capacity, and reducing stigma. BHI models differ across several parameters, though measurement-based care (MBC) is a key component of virtually all effective approaches. MBC employs the repeated and timely use of validated instruments to inform medical decision-making for individual patients at the point of care and has a demonstrated association with improved outcomes. MBC generally has more flexibility for workflow development and fewer financial, staffing, and IT requirements than CoCM, PCBH, or other models. It can also be implemented by primary medical providers independently. Recent encouraging developments include technical assistance opportunities for MBC implementation and emerging payment models that emphasize MBC. However, concerns remain surrounding the limitations of existing MBC billing codes. Ultimately, with continued advocacy and thoughtful policy decision-making, MBC has the potential to be a solution to the current behavioral health crisis.

Continuous individual feedback to nurses at emergency medical dispatch centres: a stepped-wedge, interrupted time series analysis

BACKGROUND

Clinical feedback is often lacking in prehospital care, and while performance data is increasingly available to clinical and operational leadership, it is seldom made available to care providers themselves. In this study, we investigate the impact of a simple intervention consisting of the provision of monthly feedback reports via email to emergency medical dispatch nurses in three Swedish regions.

METHOD

Individualised reports consisting of 14 measures divided into descriptive (eg, priority-setting and call times), process (eg, dispatch times and documentation completeness) and outcome (eg, over/under triage rate) categories were developed with staff and management input. Report delivery was implemented using a stepped-wedge design, and effects were evaluated using a hierarchical regression-based interrupted time series analysis.

RESULTS

40 dispatchers were included in the study between March 2020 and October 2023, who handled a total of 246 353 incidents. Some impacts on documentation-related process measures were identified, with the odds of complete documentation increasing by 7.5% (95% CI 5.1 to 9.9) and the odds of having a documented contact reason increasing by 3.8% (1.5-5.9). These effects remained robust over the post-intervention period. Weaker impacts on outcome measures were identified which could be explained by a higher priority given to emergency medical dispatches overall.

CONCLUSION

Providing performance data can influence care providers to adjust their behaviour to improve process-related quality metrics under their direct control. The intervention may also have induced nurses to more often upgrade the priority of their patients. Improving outcome metrics may however require more intensive, multifaceted interventions.

Using Progress Feedback to Enhance Treatment Outcomes: A Narrative Review

We face increasing demand for greater access to effective routine mental health services, including telehealth. However, treatment outcomes in routine clinical practice are only about half the size of those reported in controlled trials. Progress feedback, defined as the ongoing monitoring of patients' treatment response with standardized measures, is an evidence-based practice that continues to be under-utilized in routine care. The aim of the current review is to provide a summary of the current evidence base for the use of progress feedback, its mechanisms of action and considerations for successful implementation. We reviewed ten available meta-analyses, which report small to medium overall effect sizes. The results suggest that adding feedback to a wide range of psychological and psychiatric interventions (ranging from primary care to hospitalization and crisis care) tends to enhance the effectiveness of these interventions. The strongest evidence is for patients with common mental health problems compared to those with very severe disorders. Effect sizes for not-on-track cases, a subgroup of cases that are not progressing well, are found to be somewhat stronger, especially when clinical support tools are added to the feedback. Systematic reviews and recent studies suggest potential mechanisms of action for progress feedback include focusing the clinician's attention, altering clinician expectations, providing new information, and enhancing patient-centered communication. Promising approaches to strengthen progress feedback interventions include advanced systems with signaling technology, clinical problem-solving tools, and a broader spectrum of outcome and progress measures. An overview of methodological and implementation challenges is provided, as well as suggestions for addressing these issues in future studies. We conclude that while feedback has modest effects, it is a small and affordable intervention that can potentially improve outcomes in psychological interventions. Further research into mechanisms of action and effective implementation strategies is needed.

Putting measurement-based care into action: a multi-method study of the benefits of integrating routine client feedback in coordinated specialty care programs for early psychosis

BACKGROUND

Measurement-based care (MBC) is an effective tool in the delivery of evidence-based practices (EBPs). MBC utilizes feedback loops to share information and drive changes throughout a learning healthcare system. Few studies have demonstrated this practice in team-based care for young people with early psychosis. This paper describes the development of a personalized feedback report derived from routine assessments that is shared with clients and clinicians as part of a MBC process.

METHODS

We used a multi-method approach to evaluate the implementation of a personalized feedback report at 5 early psychosis coordinated specialty care programs (CSC). We compared clients enrolled in CSC who did and did not receive a feedback report over the first 6 months of treatment. The sample included 204 clients: 146 who did not receive the feedback report (treatment as usual, TAU) and were enrolled over 2 years, and 58 who received the feedback report. A subset of 67 clients completed measures at both intake and 6-month follow-up, including 42 who received the personalized feedback report and 25 who did not. We compared the two groups with regard to self-reported symptoms, likelihood of completing treatment, and perception of shared decision making. We conducted qualitative interviews with 5 clients and 5 clinicians to identify the benefits and challenges associated with the personalized feedback report.

RESULTS

The total sample showed significant improvements in shared decision-making and in their intent to complete the program. Post hoc analyses revealed significant increases in the personalized feedback group, and non-significant changes in the TAU group, although group-by-time interactions did not reach statistical significance. The feedback report group engaged in significantly more sessions of Supported Employment and Education (SEE), case management, and peer support, and fewer medication visits over the first 6 months of treatment. Both groups showed significant improvement in symptoms and functioning. Results from the qualitative analysis indicated that the experience of receiving the reports was valuable and validating for both patients and clinicians.

CONCLUSIONS

A personalized feedback report was integrated into standard of care for early psychosis programs. This process may improve shared decision-making, strengthen the likelihood to stay in treatment, and increase treatment attendance in psychosocial interventions. We posit that this process facilitates recovery-oriented care, strengths-focused treatment planning, enhances intrinsic motivation, and strengthens the therapeutic alliance.

The Use of Routine Outcome Monitoring (ROM) Among the Psychotherapists of the Italian National Health Service

Routine outcome monitoring (ROM) is one of the most important methodologies for evaluating client progress and improving the efficiency and quality of psychological assistance. Despite this, the culture of ROM use is struggling to establish itself in the Italian National Health System, shaping up as a sporadic and unevenly used practice. The main objective of the present study was to assess the frequency of use of different outcome monitoring measures and the attitudes toward ROM within psychological services of the Italian National Health System. The study involved 184 psychotherapist (75% female and 25% male) employed in the Italian Health System structures. Participants completed an anonymous questionnaire composed by Outcome monitoring use and Attitudes to ROM. The data reveal a general low-frequency in ROM use, with the exception of the symptom monitoring measures. In our sample, the variables that significantly affect the level of ROM use are psychological capability and physical and social opportunity. The present study provides some empirical evidence to reflect on the importance of increasing the use of ROM within psychological services and to promote interventions to improve clinicians' positive attitudes toward ROM.

Development and usability testing of an online platform for provider training and implementation of cognitive-behavioral therapy guided self-help for eating disorders

Background

Most individuals with eating disorders (EDs) do not receive treatment, and those who do receive care typically do not receive evidence-based treatment, partly due to lack of accessible provider training. This study developed a novel "all-in-one" online platform for disseminating training for mental health providers in cognitive-behavioral therapy guided self-help (CBTgsh) for EDs and supporting its implementation. The aim of the study was to obtain usability data from the online platform prior to evaluating its effects on provider training outcomes and patient ED symptom outcomes in an open pilot trial.

Methods

Nine mental health provider participants (n = 4 in Cycle 1; n = 5 in Cycle 2) and 9 patient participants (n = 4 in Cycle 1; n = 5 in Cycle 2) were enrolled over two cycles of usability testing. In Cycle 1, we recruited providers and patients separately to complete brief platform testing sessions. In Cycle 2, we recruited provider-patient dyads; providers completed training using the platform and subsequently delivered CBTgsh to a patient for three weeks. Usability was assessed using the System Usability Scale (SUS), the Usefulness, Satisfaction, and Ease of Use Questionnaire (USE), and semi-structured interviews.

Results

Interview feedback converged on two themes for providers (applicability of program for real-world use, platform structure and function) and two themes for patients (barriers and facilitators to engagement, perceived treatment effects). SUS and USE scores were in the "average" to "good" ranges across cycles.

Conclusions

Findings from this study demonstrate preliminary feasibility and acceptability of the online platform. Data collected in this study will inform further refinements to the online platform. The platform's effects on provider training outcomes and patient ED symptom outcomes will be evaluated in an open pilot trial. Given the wide treatment gap for EDs and barriers to dissemination and implementation of evidence-based treatments, the online platform represents a scalable solution that could improve access to evidence-based care for EDs.

Sensitivity to change of the Systemic Therapy Inventory of Change (STIC) intersession scales

Objective: The Systemic Therapy Inventory of Change (STIC) is a systemic measurement feedback system that provides therapists with feedback regarding the multidimensional clinical change in individual, couple, and family therapy. The STIC Intersession scales include Individual Problems and Strengths (IPS), Relationship with Partner (RWP), Family/Household (FH), and Child Problems and Strengths (CPS). They are administered to clients before each therapy session. The purpose of the current study is to investigate the STIC Intersession scales' sensitivity to change, the ability to detect reliable and valid changes that occur after an intervention. Method: Participants (N = 583) who voluntarily received individual, couple, or family therapy services in a randomized clinical trial attended the study. Results: By comparing the changes in pre-therapy and post-therapy scores of the STIC Intersession scales with those of the corresponding reference measures, the external sensitivity to change of the STIC Intersession scales was supported. The IPS Intersession scale showed greater change than the Beck Anxiety Inventory. However, no evidence supported the discriminant validity of CPS's change scores. Conclusion: Thus, the STIC Intersession IPS, RWP, and FH can be validly used to assess multi-systemic changes in both research and clinical work.

Leveraging Measurement-Based Care to Reduce Mental Health Treatment Disparities for Populations of Color

Disparities in mental health treatment have consistently been documented for clients of color as compared to White clients. Most mental health care disparities literature focuses on access to care at the point of initial engagement to treatment, resulting in a dearth of viable solutions being explored to retain clients in care once they begin. Measurement-based care (MBC) is a person-centered practice that has been shown to improve the therapeutic relationship, make treatment more personalized, and empower the client to have an active role in their care. Problems with therapeutic alliance and treatment relevance are associated with early termination for communities of color in mental health services. However, MBC has not been explored as a clinical practice to address therapeutic alliance and continual engagement for people of color seeking mental health care. This Point of View describes several MBC features that may be able to impact current sources of disparity in mental health treatment quality and provides a rationale for each. Our hope is that the field of MBC and progress feedback will more explicitly consider the potential of MBC practices to promote equity and parity in mental health services of color and will start to explore these associations empirically. We also discuss whether MBC should be culturally adapted to optimize its relevance and effectiveness for communities of color and other groups experiencing marginalization. We propose that MBC has promise to promote equitable mental health service quality and outcomes for communities of color.

Patient-reported outcome measures for monitoring primary care patients with depression: the PROMDEP cluster RCT and economic evaluation

Background

Guidelines on the management of depression recommend that practitioners use patient-reported outcome measures for the follow-up monitoring of symptoms, but there is a lack of evidence of benefit in terms of patient outcomes.

Objective

To test using the Patient Health Questionnaire-9 questionnaire as a patient-reported outcome measure for monitoring depression, training practitioners in interpreting scores and giving patients feedback.

Design

Parallel-group, cluster-randomised superiority trial; 1 : 1 allocation to intervention and control.

Setting

UK primary care (141 group general practices in England and Wales).

Inclusion criteria

Patients aged ≥ 18 years with a new episode of depressive disorder or symptoms, recruited mainly through medical record searches, plus opportunistically in consultations.

Exclusions

Current depression treatment, dementia, psychosis, substance misuse and risk of suicide.

Intervention

Administration of the Patient Health Questionnaire-9 questionnaire with patient feedback soon after diagnosis, and at follow-up 10-35 days later, compared with usual care.

Primary outcome

Beck Depression Inventory, 2nd edition, symptom scores at 12 weeks.

Secondary outcomes

Beck Depression Inventory, 2nd edition, scores at 26 weeks; antidepressant drug treatment and mental health service contacts; social functioning (Work and Social Adjustment Scale) and quality of life (EuroQol 5-Dimension, five-level) at 12 and 26 weeks; service use over 26 weeks to calculate NHS costs; patient satisfaction at 26 weeks (Medical Informant Satisfaction Scale); and adverse events.

Sample size

The original target sample of 676 patients recruited was reduced to 554 due to finding a significant correlation between baseline and follow-up values for the primary outcome measure.

Randomisation

Remote computerised randomisation with minimisation by recruiting university, small/large practice and urban/rural location.

Blinding

Blinding of participants was impossible given the open cluster design, but self-report outcome measures prevented observer bias. Analysis was blind to allocation.

Analysis

Linear mixed models were used, adjusted for baseline depression, baseline anxiety, sociodemographic factors, and clustering including practice as random effect. Quality of life and costs were analysed over 26 weeks.

Qualitative interviews

Practitioner and patient interviews were conducted to reflect on trial processes and use of the Patient Health Questionnaire-9 using the Normalization Process Theory framework.

Results

Three hundred and two patients were recruited in intervention arm practices and 227 patients were recruited in control practices. Primary outcome data were collected for 252 (83.4%) and 195 (85.9%), respectively. No significant difference in Beck Depression Inventory, 2nd edition, score was found at 12 weeks (adjusted mean difference -0.46, 95% confidence interval -2.16 to 1.26). Nor were significant differences found in Beck Depression Inventory, 2nd Edition, score at 26 weeks, social functioning, patient satisfaction or adverse events. EuroQol-5 Dimensions, five-level version, quality-of-life scores favoured the intervention arm at 26 weeks (adjusted mean difference 0.053, 95% confidence interval 0.013 to 0.093). However, quality-adjusted life-years over 26 weeks were not significantly greater (difference 0.0013, 95% confidence interval -0.0157 to 0.0182). Costs were lower in the intervention arm but, again, not significantly (-£163, 95% confidence interval -£349 to £28). Cost-effectiveness and cost-utility analyses, therefore, suggested that the intervention was dominant over usual care, but with considerable uncertainty around the point estimates. Patients valued using the Patient Health Questionnaire-9 to compare scores at baseline and follow-up, whereas practitioner views were more mixed, with some considering it too time-consuming.

Conclusions

We found no evidence of improved depression management or outcome at 12 weeks from using the Patient Health Questionnaire-9, but patients' quality of life was better at 26 weeks, perhaps because feedback of Patient Health Questionnaire-9 scores increased their awareness of improvement in their depression and reduced their anxiety. Further research in primary care should evaluate patient-reported outcome measures including anxiety symptoms, administered remotely, with algorithms delivering clear recommendations for changes in treatment.

Study registration

This study is registered as IRAS250225 and ISRCTN17299295.

Funding

This award was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme (NIHR award ref: 17/42/02) and is published in full in Health Technology Assessment; Vol. 28, No. 17. See the NIHR Funding and Awards website for further award information.

Using the experience sampling method to support clinical practice: An illustration with problematic cannabis use

The experience sampling method (ESM) has been frequently used in clinical research; however, there is low translational uptake in clinical practice. This may be due to challenges with interpreting individual-level data at granular intervals. We provide an illustrative example of how ESM can be leveraged to generate personalized cognitive-behavioral strategies for problematic cannabis use.

We conducted a descriptive case series analysis using ESM data from 30 individuals reporting on problematic cannabis use, craving, affect, and coping four times daily for 16-days (t = 64, T = 1,920).

Analyzing ESM data using descriptive statistics and visualizations from individuals with similar clinical and demographic profiles supported a diverse array of personalized clinical insights and recommendations for each case. These recommendations included psychoeducation regarding affect- and boredom-regulation strategies, functional analyses of occasions during which cannabis was not used, and discussions on how cannabis use intersects with one's personal values.

While many clinicians utilize measurement-based care, barriers have limited the incorporation of ESM towards personalized, data-informed approaches to treatment. We provide an illustrative example of how ESM data can be used to generate actionable treatment strategies for problematic cannabis use and highlight continued challenges with interpreting time-series data.

The effect of mechanical feedback on outcome in self-care support tool based on solution-focused brief therapy

Little is known about the impact of mechanical feedback in self-care support tools. Technically, natural language processing and machine learning can provide mechanical feedback in self-care support tools. This study compared the differences between mechanical feedback and no feedback conditions in a self-care support tool based on solution-focused brief therapy. In the feedback condition, feedback was provided by mechanically determining the probability that the goal answered in goal setting was concrete or realistic.

A total of 501 participants were recruited and randomly assigned to either the feedback (n = 268) or no feedback (n = 233) condition.

The results showed that the mechanical feedback increased the probability of problem-solving. In contrast, solution-building, positive and negative affect, and the probability of living an ideal life increased when using the self-care support tool based on solution-focused brief therapy, regardless of the feedback. In addition, the higher the probability of goal concreteness and reality, the greater the improvement in solution-building and positive affect.

This study suggests that self-care support tools based on solution-focused brief therapy with feedback are more effective than those without feedback. Self-care support tools based on solution-focused brief therapy with feedback can be used as an easily accessible tool to maintain and promote mental health.

What treatment outcomes matter in adolescent depression? A Q-study of priority profiles among mental health practitioners in the UK and Chile

Evidence-based and person-centred care requires the measurement of treatment outcomes that matter to youth and mental health practitioners. Priorities, however, may vary not just between but also within stakeholder groups. This study used Q-methodology to explore differences in outcome priorities among mental health practitioners from two countries in relation to youth depression. Practitioners from the United Kingdom (UK) (n = 27) and Chile (n = 15) sorted 35 outcome descriptions by importance and completed brief semi-structured interviews about their sorting rationale. By-person principal component analysis (PCA) served to identify distinct priority profiles within each country sample; second-order PCA examined whether these profiles could be further reduced into cross-cultural "super profiles". We identified three UK outcome priority profiles (Reduced symptoms and enhanced well-being; improved individual coping and self-management; improved family coping and support), and two Chilean profiles (Strengthened identity and enhanced insight; symptom reduction and self-management). These could be further reduced into two cross-cultural super profiles: one prioritized outcomes related to reduced depressive symptoms and enhanced well-being; the other prioritized outcomes related to improved resilience resources within youth and families. A practitioner focus on symptom reduction aligns with a long-standing focus on symptomatic change in youth depression treatment studies, and with recent measurement recommendations. Less data and guidance are available to those practitioners who prioritize resilience outcomes. To raise the chances that such practitioners will engage in evidence-based practice and measurement-based care, measurement guidance for a broader set of outcomes may be needed.

Real-time personalized feedback in mHealth for adolescents

Mobile Health (mHealth) interventions have the potential to improve early identification, prevention, and treatment of mental health problems. Grow It! is a multiplayer smartphone app designed for youth aged 12-25, allowing them to monitor their emotions and engage in daily challenges based on Cognitive Behavioral Therapy (CBT) principles. Recently, a personalized mood profile was added to improve the app. We investigated whether real-time personalized feedback on mood enhances app engagement, user experience, and the effects on affective and cognitive well-being. Sample A (N = 1269, age = 18.60 SD = 3.39, 80.6% girls, 95.4% Dutch) played the original app without feedback on their mood, and an independent Sample B (N = 386, age = 16.04 SD = 3.21, 67.6% girls, 82.9% Dutch) received the renewed version with personalized real-time feedback on their mood. Participants who received personal feedback did not have higher app engagement (t(1750,400) = 1.39, P = .206, d = 0.07; t(692,905) = 0.36, P = .971, d = 0.0) nor higher user experience (t(177,596) = 0.21, P = .831, d = 0.02; (t(794) = 1.28, P = .202, d = 0.12; χ2 (659,141) = 2.83, P = .091). Players of the renewed version (Sample B) experienced significant improvements in affective (t(175) = 3.01, P = .003, d = 0.23) and cognitive well-being (t(175) = 3.48, P = <.001, d = 0.26) over the course of three weeks. The renewed version Grow It! has the potential to enhance youths' affective and cognitive well-being. However, adding real-time insights did not seem to affect app engagement nor user experience.

Therapist competencies in the context of group-based exercise programs in medical rehabilitation: a qualitative study with patients and exercise therapists from Germany

BACKGROUND

Group-based exercise programs account for nearly half of exercise therapy services provided in German medical rehabilitation facilities. However, information about necessary therapist competencies for the successful execution of these programs is sparse. Thus, the aim of this qualitative study was to explore relevant therapist competencies in the context of group-based exercise programs from the patients' and therapists' perspective.

METHODS

Semi-structured interviews were conducted with five rehabilitation patients following a 3-week inpatient orthopedic rehabilitation program as well as five exercise therapists with work experience in group-based exercise therapy. Data were analyzed using structuring content analysis according to Kuckartz.

RESULTS

From 155 topic-related text passages, collected over 10 interviews, four competency categories with 16 subcategories and respective characteristics were identified. In addition to professional expertise like biomedical knowledge, exercise therapists were expected to possess a multitude of didactic-methodological, personal, and social-communicative abilities.

CONCLUSION

Our results suggest that the psychosocial, behavioral and educational goals of group-based exercise programs necessitate a wide range of therapist competencies. These conform to the multidimensional nature of exercise therapy and should therefore be covered in vocational and continuing education.

Routine Outcome Monitoring (ROM) and Feedback: Research Review and Recommendations

OBJECTIVE

To provide a research review of the components and outcomes of routine outcome monitoring (ROM) and recommendations for research and therapeutic practice.

METHOD

A narrative review of the three phases of ROM - data collection, feeding back data, and adapting therapy - and an overview of patient outcomes from 11 meta-analytic studies.

RESULTS

Patients support ROM when its purpose is clear and integrated within therapy. Greater frequency of data collection is more important for shorter-term therapies, and use of graphs, greater specificity of feedback, and alerts are helpful. Overall effects on patient outcomes are statistically significant (g ≈ 0.15) and increase when clinical support tools (CSTs) are used for not-on-track cases (g ≈ 0.36-0.53). Effects are additive to standard effects of psychological therapies. Organizational, personnel, and resource issues remain the greatest obstacles to the successful adoption of ROM.

CONCLUSION

ROM offers a low-cost method for enhancing patient outcomes, on average resulting in an ≈ 8% advantage (success rate difference; SRD) over standard care. CSTs are particularly effective for not-on-track patients (SRD between ≈ 20% and 29%), but ROM does not work for all patients and successful implementation is a major challenge, along with securing appropriate cultural adaptations.

A Systematic Review and Meta-Analysis of Measurement Feedback Systems in Treatment for Common Mental Health Disorders

To investigate the effects of measurement feedback systems (MFSs) in therapy on mental health outcomes through a literature review and meta-analysis. Using a three-level modeling approach, we conducted a meta-analysis of all effect sizes from randomized controlled studies of MFSs used in the treatment of common mental health disorders. Eighty-two effect sizes were extracted from the thirty-one included studies. Analyses were performed to consider the post-treatment effects of the MFS-assisted treatment compared to treatment as usual. A separate analysis was done for the subgroup "not-on-track" patients as it is theorized that MFSs will be clinically useful because they make therapists aware of patients who fail to progress. MFSs had a significant effect on mental health outcomes (d = 0.14, 95% CI [0.082-0.206], p < .001). Further analysis found a larger effect in patients identified as less respondent to therapy, the "not-on-track" group (d = 0.29, 95% CI [0.114, 0.464], p = .003). Moderation analyses indicated that the type of outcome measurement and type of feedback system used, and whether it was used for a child and youth or adult population, influenced effect sizes. MFSs seem to have a small positive effect on treatment outcomes. The effects seem to be larger for "not-on-track" patients, the group of patients that would usually not benefit much from treatment.

How patients and clinicians experience the utility of a personalized clinical feedback system in routine practice

OBJECTIVE

The objective was to explore how a person-adaptive clinical feedback system (CFS) effects its users, and how meaning and relevance are negotiated.

METHODS

We conducted a 10-month case-study of the implementation and practice of Norse Feedback, a personalized CFS. The data material consisted of 12 patient interviews, 22 clinician interviews, 23 field notes, and 16 archival documents.

RESULTS

We identified four main categories or themes: (i) patients' use of clinical feedback for enhanced awareness and insight; (ii) patients work to make clinical feedback a communication mode; (iii) patients and clinicians negotiate clinical feedback as a way to influence treatment; and (iv) clinical feedback requires an interactive sense-making effort.

CONCLUSION

Patients and therapists produced the meaning and relevance of the CFS by interpreting the CFS measures to reflect the unique patient experience of the patient-therapist relationship. Patients regarded CFS as a tool to inform therapy with important issues. Patients became more self-aware and prepared for therapy.

The effects of exercise therapy feedback on subjective treatment outcome and patient satisfaction: study protocol for a mono-centric, randomized, controlled trial in orthopedic rehabilitation (FeedYou)

BACKGROUND

The disease burden of musculoskeletal disorders necessitates multidisciplinary and patient-centered models of care. Exercise therapy represents a first-line treatment strategy and a central component of medical rehabilitation. In order to realize the goals of long-term physical activity and participation as proposed by the ICF, exercise therapy can be supplemented by interventional techniques from the field of psychotherapy. Although psychotherapist feedback has been shown to improve therapeutic outcome and patient satisfaction, feedback use in exercise therapy is mostly limited to motor learning and exercise instruction. The present paper therefore describes the use of multidimensional exercise therapy feedback in medical rehabilitation. The aims of the trial presented in this study protocol are to evaluate the effects of this novel feedback approach on rehabilitation outcomes in comparison to usual care.

METHODS

The study is designed as a prospective, mono-centric, randomized controlled, superiority trial (RCT) with two parallel groups and three measuring points: T0 = start of three-week inpatient rehabilitation, T1 = end of three-week inpatient rehabilitation, T2 = 12-week follow-up. In total, 132 patients suffering from chronic neck, shoulder and/or lumbar spine disorders will be recruited. The intervention involves multidimensional exercise therapy feedbacks during the initial and final physical therapist examination, as well as short exercise therapy feedbacks during the course units of the mandatory group-based exercise therapy program. Primary outcomes are the subjective treatment outcome, assessed by BPI and indication-specific questionnaires, as well as patient satisfaction, assessed by ZUF-8 and an intervention-specific questionnaire. The final data collection is expected by May 2023.

DISCUSSION

This study may provide a valuable insight into the effectiveness of multidimensional exercise therapy feedback to improve treatment outcomes and patient satisfaction in medical rehabilitation. This could contribute to rehabilitation quality assurance and the long-term physical activity behavior of rehabilitation patients. Trial registration The trial has been registered with the German Clinical Trial Register (DRKS) under the Registration Number DRKS00027263.

Racial and Ethnic Disparity in Preference-Weighted Quality of Life: Findings from the Selenium and Vitamin E Cancer Prevention Trial

Differences in preference-weighted health-related quality of life (HRQOL) scores by race/ethnicity may be due to social factors. Here, Short-Form Six-Dimension (SF-6D) scores are analyzed among men in a prostate cancer prevention trial to explore such differences. Selenium and vitamin E cancer prevention trial participants who completed the SF-6D at baseline, and in at least 1 of follow-up years 1, 3, and 5 were included. This study compared mean SF-6D scores across race/ethnicity at each point using a linear mixed model controlling for demographic and clinical characteristics. At baseline, 9691 men were eligible for analysis, of whom 7556 (78%) were non-Hispanic White, 1592 (16.4%) were non-Hispanic Black, and 543 (5.6%) were Hispanic. Hispanic and White participants had higher unadjusted mean SF-6D scores than Black participants at every time point (P < 0.05), while white participants had lower mean scores than Hispanic participants at every time point after baseline (P < 0.05). After adjusting for covariates, statistically significant differences in HRQOL among the 3 groups persisted. Hispanic participants had higher preference scores than White participants by 0.073 (P < 0.001), 0.075 (P < 0.001), and 0.040 (P < 0.001) in follow-up years 1, 3, and 5, respectively. Black participants had lower scores than White participants by 0.009 (P = 0.004) and 0.008 (P = 0.02) in follow-up years 1 and 3, respectively. The results suggest there is a preference-weighted HRQOL difference by race/ethnicity that cannot be explained by social and clinical variables alone. Understanding how individuals belonging to different racial/ethnic categories view their own HRQOL is necessary for culturally competent care and cost-effectiveness analyses.

Assessing Internalizing Symptoms and Their Relation with Levels of Impairment: Evidence-Based Cutoffs for Interpreting Inventory of Depression and Anxiety Symptoms (IDAS-II) Scores

Tests and scales measuring psychological disorders should provide information about how scores relate to other constructs such as quality of life or functional impairment. Such information is necessary to allow that their scores contribute to clinical decision making. The current study analyzes the clinical utility of the Spanish version of the Inventory for Depression and Anxiety Symptoms (IDAS-II) to discriminate between different levels of functional impairment and identify the IDAS-II scales that contribute most to explaining impairment. The total sample (N = 1390) consists of two subsamples: a community sample of the general population (n = 1072) selected by random sampling; and a sample of patients (n = 318) from public and private mental health services. The Spanish IDAS-II for measuring internalizing symptoms and WHODAS 2.0 for measuring impairment were administered to all participants. All scales show statistically significant higher scores in the patient sample, with Cohen's d effect sizes values greater than 0.30, except for well-being (d = 0.19). The cutoff values and their confidence intervals do not overlap with the means of either the community or patient sample. AUC values for most of the scales are above .70, except for appetite gain, ordering, euphoria, cleaning, and well-being. Multiple linear regression model using IDAS-II scales explain 57.1% of the variance of the WHODAS 2.0 (F 12.1377 = 155.305; p < .001). Cutoff values provided allow us to reliably differentiate between the patients and community samples. Spanish IDAS-II scores show greater sensitivity and specificity in detecting those with greater impairment. General Depression, Lassitude, Panic and Claustrophobia contribute to impairment in a greater extent. Knowledge of which symptoms are most related with impairment, allows healthcare providers to improve treatment planning based on empirical evidence.

Short measures of youth psychopathology: psychometric properties of the brief problem monitor (BPM) and the behavior and feelings survey (BFS) in a Norwegian clinical sample

Background

Tracking clinical outcomes during therapy can be useful for improving both clinical practice and research. For repeated data collection, short, reliable, and valid measures of central aspects of psychopathology are necessary. The current paper investigates the psychometric properties of two short surveys for measuring central dimensions of psychopathology in youth.

Methods

We investigated the factor structure and validity of the Norwegian translations of the Behavior and Feelings Survey (BFS) and the Brief Problem Monitor (BPM). The BFS has previously shown a two-factor structure and indications of validity as a measure of internalizing and externalizing problems in youth. The BPM has support for a three-factor structure of internalizing, externalizing, and attention problems. In our sample of 503 patients (56% female, age 6 to 18) in a Norwegian outpatient clinic, we conducted confirmatory factor analyses to test the assumed measurement models and further considered the concurrent validity of the measures.

Results

Internal reliability of both measures were good. The results suggest that the assumed measurement models for both questionnaires only partly fit our data but that subscales of the BFS and BPM still indicate convergent validity. Scores on subscales (internalizing and externalizing problems) on both measures converged with relevant subscales as well as with relevant groups of diagnoses.

Conclusions

Alternative measurement models, and the usefulness and limitations of these short-form questionnaires for internalizing and externalizing problems, are discussed.

Using electronic patient-reported measures to characterize symptoms and improvement in inpatient psychiatric units

Patient-reported measures are an important tool in personalizing care and monitoring clinical outcomes. This work presents results from the routine collection of self-report measures from individuals (n = 753) admitted to depression and anxiety inpatient units at McLean Hospital. 93.7% participated in the Clinical Measurement Initiative (CMI) between September 2020 and February 2022 on the most established unit. The average time between admission and discharge measures was 12.6 days and an attrition rate of 10.4% was observed on this unit. Missingness of discharge assessments was unrelated to symptom severity or comorbidities. We discuss the feasibility of deploying patient-reported measures as part of routine care in an inpatient psychiatric setting. Systematic evaluation of potential treatment modifiers (e.g., personality disorder, trauma history, and substance misuse) may be valuable in better serving those impacted by psychiatric illness.

Mental Health Reform: Design and Implementation of a System to Optimize Outcomes for Veterans and Their Families

The social, health, and economic burden of mental health problems in the veteran community is heavy. Internationally, the array of services and support available to veterans and their families are extensive but vary in quality, are often disconnected, complex to navigate, and lack clear coordination. This paper describes a conceptual framework to guide the design and implementation of a system of services and supports to optimize the mental health and wellbeing of all veterans and their families. The framework recognizes the diversity of veterans across intersecting identities that uniquely shape experiences of posttraumatic mental health and wellbeing. It brings together several strands of research: the values and principles that should underpin the system; the needs of diverse veterans and their families; challenges in the current services and supports; evidence-based interventions; and principles of effective implementation. Central to the future system design is a next generation stepped model of care that organizes best and next practice interventions in a coherent system, matches service provision to level of need and addresses access and navigation. Practical guidance on implementation provides an aspirational and flexible structure for system evolution, and a template for all stakeholders-individuals, groups, agencies and organizations-to effect system change.

Does psychological process change during psychotherapy predict long-term depression outcome after successful cognitive therapy or interpersonal psychotherapy? Secondary analysis of a randomized trial

OBJECTIVE

Psychotherapies for depression are similarly effective, but the processes through which these therapies work have not been identified. We focus on psychological process changes during therapy as predictors of long-term depression outcome in treatment responders.

METHOD

Secondary analysis of a randomized trial comparing cognitive therapy (CT) and interpersonal psychotherapy (IPT) that focuses on 85 treatment responders. Using mixed-effects models, changes during therapy (0-7 months) on nine process variables were associated with depression severity (BDI-II) at follow-up (7-24 months).

RESULTS

A decrease in dysfunctional attitudes was associated with a decrease in depression scores over time. Improved self-esteem was associated with less depression at follow-up (borderline significant). More improvement in both work and social functioning and interpersonal problems was associated with better depression outcomes in IPT relative to CT, while less improvement in work and social functioning and interpersonal problems was associated with better outcomes in CT relative to IPT.

CONCLUSIONS

Less negative thinking during therapy is associated with lower depression severity in time, while changes during therapy in work and social functioning and interpersonal problems appear to predict different long-term outcomes in CT vs. IPT. If replicated, these findings can be used to guide clinical decision-making during psychotherapy.

Enhancing the effect of psychotherapy through systematic client feedback in outpatient mental healthcare: A cluster randomized trial

Objective: Systematic client feedback (SCF), the regular monitoring and informing of patients' progress during therapy to patient and therapist, has been found to have effects on treatment outcomes varying from very positive to slightly negative. Several prior studies have been biased by researcher allegiance or lack of an independent outcome measure. The current study has taken this into account and aims to clarify the effects of SCF in outpatient psychological treatment.

Method: Outpatients (n = 1733) of four centers offering brief psychological treatments were cluster randomized to either treatment as usual (TAU) or TAU with SCF based on the Partners for Change Outcome Management System (PCOMS). Primary outcome measure was the Outcome Questionnaire (OQ-45). Effects of the two treatment conditions on treatment outcome, patient satisfaction, dropout rate, costs, and treatment duration were assessed using a three-level multilevel analysis. DSM-classification, sex, and age of each patient were included as covariates.

Results: In both analyses, SCF significantly improved treatment outcome, particularly in the first three months. No significant effects were found on the other outcome variables.

Conclusions: Addition of systematic client feedback to treatment as usual, is likely to have a beneficial impact in outpatient psychological treatment. Implementation requires a careful plan of action.

Clinical or methodological significance of this article: This study, with large sample size and several independent outcome measures, provides strong evidence that addition of systematic client feedback to outpatient psychological treatment can have a beneficial effect on treatment outcome (symptoms and wellbeing), particularly in the first three months. However, implementation requires a careful plan of action.

Symptom change trajectories in patients with persistent somatic symptoms and their association to long-term treatment outcome

OBJECTIVE

This study investigated symptom change trajectory for patients with persistent somatic symptoms (PSS) during psychotherapy and the association of these patterns with pre-treatment characteristics and long-term outcome.

METHODS

Growth mixture modeling was used to identify trajectory curves in a sample of N = 210 outpatients diagnosed with PSS and treated either with conventional cognitive behavioral therapy (CBT) or CBT enriched with emotion regulation training (ENCERT).

RESULTS

We identified three subgroups of patients with similar symptom change patterns over the course of treatment (a "no change," "strong response," and "slow change" subgroup). Higher initial anxiety symptoms were significantly associated with the no change and strong response subgroups; symptom-related disability in daily routine with no changes. Patients with a strong response had the highest proportion of reliable improvement at termination and at six-month-follow-up.

CONCLUSION

Our results indicate that, instead of one common change pattern, patients with PSS respond differently to treatment. Due to the high association of symptom curves with long-term outcome, the identification and prediction of an individual's trajectory could provide important information for clinicians to identify non-responding patients that are at risk for failure. Selecting personalized treatment interventions could increase the effectiveness of psychotherapy.Trial registration: ClinicalTrials.gov identifier: NCT01908855..

Measurement-based care educational programmes for clinical trainees in mental healthcare: a scoping review protocol

INTRODUCTION

Measurement-based care (MBC) represents the approach of regularly using symptom rating scales to guide patient care decisions in mental healthcare. MBC is an effective, feasible and acceptable approach to enhance clinical outcomes in various disciplines, including medicine, psychology, social work and psychotherapy. Yet, it is infrequently used by clinicians, potentially due to limited education for care providers. The objective of this scoping review is to survey the characteristics of MBC educational programmes for undergraduate, graduate and postgraduate clinical trainees in mental healthcare.

METHODS AND ANALYSIS

Using database-tailored search strategies, we plan on searching Medline, PsycINFO, Embase, CINAHL and Cochrane Central for relevant studies. Thereafter, we will analyse the selected studies to extract information on the delivery of educational programmes, the clinical and educational outcomes of these programmes, and the potential enablers and barriers to MBC education. In this paper, we articulate the protocol for this scoping review.

ETHICS AND DISSEMINATION

This scoping review does not require research ethics approval. The findings from this scoping review will be incorporated into the creation of a novel MBC curriculum and handbook. Results will be disseminated at appropriate national or international conferences, as well as in a peer-reviewed journal publication.

Progress feedback in children and adolescents with internalizing and externalizing symptoms in routine care (OPTIE study): study protocol of a randomized parallel-group trial

BACKGROUND

Progress feedback provides therapists with progress notes on a regular basis through the continuous assessment of participants throughout their treatment (e.g., symptoms, therapeutic alliance). While for adults the evidence base has increased over the years, progress feedback in the therapy of children and adolescents has not been sufficiently investigated. This manuscript describes the trial protocol of the OPTIE study: a randomized trial that tests the efficacy of a progress feedback system in children and adolescents under conditions of routine care.

METHODS

The study is based on a randomized parallel-group trial with two treatment groups (routine, feedback) at an outpatient unit of a university hospital. The target sample size is 439 families consisting of children and adolescents aged 6 to17 years old with internalizing and/or externalizing symptoms. Both the patients and the therapists are independently assigned to the treatment groups by stratified block randomization. In both treatment groups patients receive routine care behavioral therapy for a study-related 12 months; additionally, in the feedback group, a progress feedback system with three components is applied (monitoring, report, and supervision). For three informants (caregiver, child [≥ 11 years], therapist) surveys are conducted every 6 weeks (e.g., symptoms, goals, motivation). For both treatment groups, comparison data is collected at baseline and at six and 12 months after the beginning of the intervention (pre, inter, post), and includes five informants (blinded clinician, therapist, caregiver, child [≥ 11 years], teacher).

DISCUSSION

The OPTIE study will contribute to the evidence base of progress feedback in children and adolescents and has the potential to uncover treatments' effects in the small to medium range. Noteworthy features are the inclusion of children younger than 10 years old and the consideration of a blinded clinician rating.

TRIAL REGISTRATION

German Clinical Trials Register (DRKS) DRKS00016737 ( https://www.drks.de/DRKS00016737 ). Registered 17 September, 2019.

Provider perceived barriers and facilitators to integrating routine outcome monitoring into practice in an urban community psychiatry clinic: A mixed-methods quality improvement project

BACKGROUND AND AIMS

Although mental health clinics are under increasing pressure to demonstrate value and routine outcome monitoring (ROM) has become a mandated component of care, providers have been slow to adopt ROM into practice, with some estimating that less than 20% of mental health clinicians use it consistently in the United States. This article explores perceived barriers and facilitators to integrating ROM into practice among clinicians and administrators in a large urban US community psychiatry clinic.

METHOD

One hundred and thirty-eight clinical and administrative staff were administered an anonymous web-based survey to elicit attitudes towards ROM. Responses were summarized descriptively and qualitatively synthesized into a conceptual model using inductive thematic analysis.

RESULTS

Common barriers to integration included insufficient time to collect and/or use measures, not knowing what measures to use, measures being difficult to access, and insufficient training. Facilitators included increased access/ease of use, training and support, measure relevance/validity, and accountability.

CONCLUSIONS

In order for psychiatry clinics to successfully implement ROM into practice, they must diagnose organization-side barriers and translate this knowledge into actionable quality improvement initiatives ranging from the infrastructural to the cultural.

Cost-effectiveness of feedback-informed psychological treatment: Evidence from the IAPT-FIT trial

BACKGROUND

Feedback-informed treatment (FIT) involves using computerized routine outcome monitoring technology to alert therapists to cases that are not responding well to psychotherapy, prompting them to identify and resolve obstacles to improvement. In this study, we present the first health economic evaluation of FIT, compared to usual care, to enable decision makers to judge whether this approach represents a good investment for health systems.

METHODS

This randomised controlled trial included 2233 patients clustered within 77 therapists who were randomly assigned to a FIT group (n = 1176) or a usual care control group (n = 1057). Treatment response was monitored using patient-reported depression (PHQ-9) and anxiety (GAD-7) measures. Therapists in the FIT group had access to a computerized algorithm that alerted them to cases that were "not on track", compared to normative clinical data. Health service costs included the cost of training therapists to use FIT and the cost of therapy sessions in each arm. The incremental cost-effectiveness of FIT was assessed relative to usual care, using multilevel modelling.

RESULTS

FIT was associated with an increased probability of reliable symptomatic improvement by 8.09 percentage points (95% CI: 4.16%-12.03%) which was statistically significant. The incremental cost of FIT was £15.17 (95% CI: £6.95 to £37.29) per patient and was not statistically significant. The incremental cost-effectiveness ratio (ICER) per additional case of reliable improvement was £187.4 (95% CI: £126.7 to £501.5); this confidence interval shows that the relative cost-effectiveness is between FIT being a dominant strategy (i.e. more effective and also cost-saving) to FIT being more effective at a modest incremental cost to the health system.

CONCLUSIONS

The FIT strategy increases the probability of reliable improvement in routine clinical practice and may be associated with a small (but uncertain) incremental cost. FIT is likely to be a cost-effective strategy for mental health services.

Using progress feedback to improve outcomes and reduce drop-out, treatment duration, and deterioration: A multilevel meta-analysis

Progress feedback is an intervention aimed at enhancing patient outcomes in routine clinical practice. This study reports a comprehensive multilevel meta-analysis on the effectiveness of progress feedback in psychological treatments in curative care. The short- and long-term effects of feedback on symptom reduction were investigated using 58 (randomized and non-randomized) studies, analyzing 110 effect sizes in a total of 21,699 patients. Effects of feedback on dropout rate, percentage of deteriorated cases, and treatment duration were also examined. Moderation analyses were conducted for study and feedback characteristics. A small significant effect of progress feedback on symptom reduction (d = 0.15, 95% CI: [0.10, 0.20]) was found, compared to control groups. This was also true for not-on-track cases (d = 0.17, 95% CI: [0.11, 0.22]). In addition, feedback had a small favorable effect on dropout rates (OR = 1.19, 95% CI: [1.03, 1.38]). The moderation analyses identified several potentially interesting variables for further research, including feedback instrument, outcome instrument, type of feedback, feedback frequency, treatment intensity, and country in which the study was conducted. Future studies should report on these variables more consistently so that we can obtain a better understanding of when and why feedback improves outcomes.

Discussing measurement-based care with patients: An analysis of clinician-patient dyads

Abstract Measurement-based care (MBC) refers to the use of three integrated strategies to improve effectiveness of behavioral health care: routine outcomes monitoring using symptom measures; regularly sharing these data with patients; and using these data to inform treatment decisions. This study examined how clinicians discuss MBC data with patients, including identifying what aspects of these discussions contribute to clinician-patient agreement on the value of MBC, and how clinicians use MBC data to inform treatment decisions. Twenty-six clinician-patient dyads participated in semi-structured interviews and provided a treatment session recording in which MBC data were discussed. Qualitative data analyses revealed four subtypes of dyads: clinician and patient both valued MBC; clinician valued MBC, patient passively participated in MBC; clinician valued MBC, patient had mixed perceptions of MBC; clinician and patient reported moderate or low value for MBC. In dyads for whom both the clinician and patient valued MBC, the clinician provided clear and repeated rationale for MBC, discussed data with patients at every administration, and connected observed scores to patient skills or strategies. Emerging best practices for discussing MBC include providing a strong rationale, discussing results frequently, actively engaging patients in discussions, and using graphs to visualize progress.

Selecting the optimal treatment for a depressed individual: Clinical judgment or statistical prediction?

BACKGROUND

Optimizing treatment selection is a way to enhance treatment success in major depressive disorder (MDD). In clinical practice, treatment selection heavily depends on clinical judgment. However, research has consistently shown that statistical prediction is as accurate - or more accurate - than predictions based on clinical judgment. In the context of new technological developments, the current aim was to compare the accuracy of clinical judgment versus statistical predictions in selecting cognitive therapy (CT) or interpersonal psychotherapy (IPT) for MDD.

METHODS

Data came from a randomized trial comparing CT (n=76) with IPT (n=75) for MDD. Prior to randomization, therapists' recommendations were formulated during multidisciplinary staff meetings. Statistical predictions were based on Personalized Advantage Index models. Primary outcomes were post-treatment and 17-month follow-up depression severity. Secondary outcome was treatment dropout.

RESULTS

Individuals receiving treatment according to their statistical prediction were less depressed at post-treatment and follow-up compared to those receiving their predicted non-indicated treatment. This difference was not found for recommended versus non-recommended treatments based on clinical judgment. Moreover, for individuals with an IPT recommendation by therapists, higher post-treatment and follow-up depression severity was found for those that actually received IPT compared to those that received CT. Recommendations based on statistical prediction and clinical judgment were not associated with differences in treatment dropout.

LIMITATIONS

Information on the clinical reasoning behind therapist recommendations was not collected, and statistical predictions were not externally validated.

CONCLUSIONS

Statistical prediction outperforms clinical judgment in treatment selection for MDD and has the potential to personalize treatment strategies.

Implementing Measurement-Based Care for Depression: Practical Solutions for Psychiatrists and Primary Care Physicians

Measurement-based care (MBC) can be defined as the clinical practice in which care providers collect patient data through validated outcome scales and use the results to guide their decision-making processes. Despite growing evidence supporting the effectiveness of MBC for depression and other mental health conditions, many physicians and mental health clinicians have yet to adopt MBC practice. In part, this is due to individual and organizational barriers to implementing MBC in busy clinical settings. In this paper, we briefly review the evidence for the efficacy of MBC focusing on pharmacological management of depression and provide example clinical scenarios to illustrate its potential clinical utility in psychiatric settings. We discuss the barriers and challenges for MBC adoption and then address these by suggesting simple solutions to implement MBC for depression care, including recommended outcome scales, monitoring tools, and technology solutions such as cloud-based MBC services and mobile health apps for mood tracking. The availability of MBC tools, ranging from paper-pencil questionnaires to mobile health technology, can allow psychiatrists and clinicians in all types of practice settings to easily incorporate MBC into their practices and improve outcomes for their patients with depression.

Implementing PROMs in routine clinical care: a qualitative exploration of GP perspectives

BACKGROUND

The recently announced long-term plan for the NHS is based on a model of person-centred care, which relies on the sustained engagement of patients, shared decision making, and capability for self-management. For a primary care service under increasing pressure from an ageing and chronically ill population, Patient Reported Outcome Measures (PROMs) appear capable of supporting many of the requirements for person-centred care, yet little is known of the circumstances of their current implementation or how their use might be optimised.

AIM

To begin the conversation about how successfully PROMs have been integrated into primary care and how their use might be supported.

DESIGN & SETTING

A qualitative investigation of the perspectives of GPs exploring the use of PROMs as part of routine clinical care in England.

METHOD

Semi-structured telephone interviews were conducted with GPs from across England. The data were analysed using the Consolidated Framework for Implementation Research (CFIR).

RESULTS

A total of 25 interviews were conducted and GPs described the potential benefit of PROMs in a range of circumstances, but also voiced concerns about their reliability and their potential to constrain consultations. Their flexibility meant they had the potential to be incorporated into existing care processes but only with the requisite logistical support.

CONCLUSION

Areas that need to be addressed include the creation of a compelling body of evidence of the benefit of PROMs, appropriate training for staff and patients, and a coherent implementation strategy from policymakers and funding bodies.

Routine outcome measurement in specialist non-government alcohol and other drug treatment services: Establishing effectiveness indicators for the NADAbase

INTRODUCTION AND AIMS

The collection of routine outcome measurement (ROM) data provides an opportunity for service providers to conduct benchmarking to inform quality assurance practices. To conduct comparative benchmarking, it is important that services have access to comparative data. This paper aims to establish effectiveness indicators for ROM data collected within the alcohol and other drug (AOD) sector.

DESIGN AND METHODS

ROM data were collected by specialist non-government AOD treatment services within the Network of Alcohol and other Drugs Agencies online database (i.e. NADAbase). All participants were attending treatment within New South Wales, Australia (N = 21 572). Effectiveness indicators were calculated by using effect sizes, standard error of measurement, and rates of reliable and clinically significant change. The study focused on quality of life (EUROHIS Quality of Life Scale), psychological distress (Kessler-10) and substance dependence (Substance Dependence Scale).

RESULTS

Since 2010, 21 572 unique people have completed at least one NADAbase Client Outcome Measure. Amphetamines (36%) and alcohol (32%) were the most commonly reported primary substances of concern. Effectiveness indicators were established for the total sample, as well as for people attending residential rehabilitation (n = 8161) and community-based (n = 10 306) treatment services. Standard error of measurement was the least stringent effectiveness indicator (i.e. a higher proportion of people demonstrated improvement), while the clinically significant change was the most stringent approach.

DISCUSSION AND CONCLUSIONS

The study demonstrated the utility of the NADAbase to establish effectiveness indicators for benchmarking purposes. Recommendations are provided for the use of benchmarking to inform quality assurance activities in the sector.

Why do patients go off track? Examining potential influencing factors for being at risk of psychotherapy treatment failure

BACKGROUND

Routine outcome monitoring can support clinicians to detect patients who deteriorate [not-on-track (NOT)] early in psychotherapy. Implemented Clinical Support Tools can direct clinicians' attention towards potential obstacles to a positive treatment outcome and provide suggestions for suitable interventions. However, few studies have compared NOT patients to patients showing expected progress [on-track (OT)] regarding such obstacles. This study aimed to identify domains that have predictive value for NOT trajectories and to compare OT and NOT patients regarding these domains and the items of the underlying scales.

METHODS

During treatment, 413 outpatients filled in the Hopkins-Symptom-Checklist-11 (depressive and anxious symptom distress) before every therapy session as a routine outcome measure. Further, the Assessment for Signal Clients, Affective Style Questionnaire, and Outcome Questionnaire-30 were applied every fifth session. These questionnaires measure the following domains, which were investigated as potential obstacles to treatment success: risk/suicidality, therapeutic alliance, motivation, social support and life events, as well as emotion regulation. Two groups (OT and NOT patients) were formed by defining a cut-off (failure boundary) as the 90% confidence interval (upper bound) of the respective patients' expected recovery curves. In order to differentiate group membership based on the respective problem areas, multilevel logistic regression analyses were performed. Further, OT and NOT patients were compared with regard to the domains' and items' cut-offs by performing Pearson chi-square tests and independent samples t-tests.

RESULTS

The life events and motivation scale as well as the risk/suicidality scale proved to be significant predictors of being not-on-track. NOT patients also crossed the cut-off significantly more often on the domains risk/suicidality, social support, and life events. For both OT and NOT patients, the emotion regulation domain's cut-off was most commonly exceeded.

CONCLUSION

Life events, motivation, and risk/suicidality seem to be directly linked to treatment failure and should be further investigated for the use in clinical support tools.

Measurement-Based Care in the Treatment of Adolescents with Substance Use Disorders

Measurement-based care in adolescent substance use is an important element of the evidence-based framework of Screening, Brief Intervention, and Referral to Treatment (SBIRT). Use of a validated measure for detecting substance use, misuse, and substance use disorders is significantly more effective than the use of unvalidated tools or clinician intuition. There are now a variety of established and new validated screening tools that are available for use with adolescents and that capture the range of adolescent substance use behaviors. This area, however, continues to evolve rapidly.

Evidence Base for Measurement-Based Care in Child and Adolescent Psychiatry

Measurement-based care (MBC) is the routine collection of data using standardized, validated measures and use of these data to guide treatment. MBC has been implemented throughout medicine to improve patient outcomes, but its use in mental health care remains low. This article summarizes the evidence of MBC's efficacy in adults then reviews the sparser data in youth mental health care. The literature indicates that MBC must be administered immediately before or during every encounter, results must be available to and reviewed by providers immediately, results must be shared with the patient, and results must be used to guide treatment.

Challenges in Investigating the Effective Components of Feedback from Routine Outcome Monitoring (ROM) in Youth Mental Health Care

BackGround

Studies on feedback in youth mental health care are scarce and implementation of feedback into clinical practice is problematic.

Objective

To investigate potentially effective components of feedback from Routine Outcome Monitoring (ROM) in youth mental health care in the Netherlands through a three-arm, parallel-group, randomized controlled trial in which a literature-based, multi-faceted implementation strategy was used.

Method

Participants were randomly allocated to three conditions (basic feedback about symptoms and quality of life; basic feedback supplemented with clinical support tools; discussion of the feedback of the second condition with a colleague while following a standardized format for case consultation) using a block randomization procedure, stratified by location and participants’ age. The youth sample consisted of 225 participants (mean age = 15.08 years; 61.8% female) and the parent sample of 234 mothers and 54 fathers (mean age of children = 12.50 years; 47.2% female). Primary outcome was symptom severity. Secondary outcomes were quality of life and end-of-treatment variables. Additionally, we evaluated whether being Not On Track (NOT) moderated the association between condition and changes in symptom severity.

Results

No significant differences between conditions and no moderating effect of being NOT were found. This outcome can probably be attributed to limited power and implementation difficulties, such as infrequent ROM, unknown levels of viewing and sharing of feedback, and clinicians’ poor adherence to feedback conditions.

Conclusions

The study contributes to our limited knowledge about feedback from ROM and underscores the complexity of research on and implementation of ROM within youth mental health care.

Trial registration Dutch Trial Register NTR4234 .

Introducing a Measurement Feedback System for Youth Mental Health: Predictors and Impact of Implementation in a Community Agency

Measurement feedback systems (MFSs) that routinely collect and report client progress to mental health therapists have demonstrated beneficial impact on outcomes in numerous studies, with evidence that there is a dose-response relationship related to the implementation of the MFS. The current study examined the impact of MFS implementation (Implementation Index) on youth symptom outcomes separately by caregiver and youth self-report. Additionally, we tested the extent to which Implementation Index rates varied by individual therapists and clients, and whether therapist and client characteristics predicted MFS implementation. Methods: Administrative data (client charts, youth- and caregiver-reported Youth Outcome Questionnaires) for 229 youth (52.83% Latinx, 42.79% girls, M age = 10.33) treated during a 1-year period at a community mental health organization in Central Texas were analyzed using multi-level modeling. Caregiver-reported symptoms decreased faster for those with a higher MFS Implementation Index. Between-group differences among therapists accounted for a significant proportion of variance in the Implementation Index for caregiver report, whereas client differences accounted for most of the variance in the Implementation Index for youth self-report. Therapist trainee status predicted a significant increase in the Implementation Index for caregiver-report data. Youth symptom improvement as reported by caregivers varied with the extent of MFS implementation fidelity, and MFS implementation fidelity was higher for clients treated by trainees relative to staff therapists for caregiver report of symptoms.

A qualitative evaluation of Veterans Health Administration's implementation of measurement-based care in behavioral health

Measurement-based care (MBC) in behavioral health involves the repeated collection of patient-reported data that is used to track progress, inform care, and engage patients in shared decision making about their treatment. Research suggests that MBC increases the quality and effectiveness of mental health care. However, there can be challenges to implementing MBC, such as time burden, lack of resources to support MBC, and clinician attitudes. The Veterans Health Administration (VHA) is currently undertaking a multiphase MBC roll-out, the first phase of which included 59 sites across the country. The present study examined implementation of this initiative in an effort to learn more about the process of implementation, including best practices, challenges, and innovations. Semistructured interviews were conducted with 20 MBC site champions and 60 staff members from 25 VHA medical centers across the country. Qualitative data analysis was conducted to identify key themes related to MBC implementation. Results were described for 3 components of MBC implementation: preparing for implementation, administering measures, and using and sharing data. Training and staff buy-in were key to the preparation phase. Staff members reported a variety of methods and frequencies for the collection of MBC data, with many staff members identifying a need to streamline the collection process. Staff members reported using data to track progress and adjust treatment with patients. Efforts to use data on a programmatic level were identified as a next step. Innovative solutions across clinics and sites are described in an effort to inform future MBC implementation, both within and outside of VHA. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

What Gets Measured Gets Done: How Mental Health Agencies can Leverage Measurement-Based Care for Better Patient Care, Clinician Supports, and Organizational Goals

Mental health clinicians and administrators are increasingly asked to collect and report treatment outcome data despite numerous challenges to select and use instruments in routine practice. Measurement-based care (MBC) is an evidence-based practice for improving patient care. We propose that data collected from MBC processes with patients can be strategically leveraged by agencies to also support clinicians and respond to accountability requirements. MBC data elements are outlined using the Precision Mental Health Framework (Bickman et al. in Adm Policy Mental Health Mental Health Serv Res 43:271-276, 2016), practical guidance is provided for agency administrators, and conceptual examples illustrate strategic applications of one or more instruments to meet various needs throughout the organization.

Patient-reported outcome measures for monitoring primary care patients with depression (PROMDEP): study protocol for a randomised controlled trial

BACKGROUND

Benefits to patients from reduced depression have been shown from monitoring progress with patient-reported outcome measures (PROMs) in psychological therapy and mental health settings. This approach has not yet been researched in the United Kingdom for primary care, which is where most people with depression are treated in the United Kingdom.

METHODS

This is a parallel-group cluster randomised trial with 1:1 allocation to intervention and control. Patients who are age 18+ years, with a new episode of depressive disorder/symptoms, meet the inclusion criteria. Patients with current depression treatment, comorbid dementia/psychosis/substance misuse/suicidal ideas are excluded. The intervention includes the Administration of Patient Health Questionnaire (PHQ-9) as a PROM within 2 weeks of diagnosis and at follow-up 4 weeks later. General practitioners are trained in interpreting scores and asked to take them into account in their treatment decisions. Patients are given written feedback on scores and suggested treatments. The primary outcome measure is Depression on the Beck Depression Inventory BDI-II at 12 weeks. Secondary outcomes include BDI-II at 26 weeks, changes in drug treatments and referrals, social functioning (Work & Social Adjustment Scale) and quality of life (EQ-5D) at 12 and 26 weeks, service use over 26 weeks (modified Client Services Receipt Inventory) to calculate NHS costs, and patient satisfaction at 26 weeks (Medical Informant Satisfaction Scale). The sample includes 676 total participants from 113 practices across three centres. Randomisation is achieved by computerised sequence generation. Blinding is impossible given the nature of the intervention (self-report outcome measures prevent rating bias). Differences at 12 and 26 weeks between intervention and controls in depression, social functioning and quality of life are analysed using linear mixed models, adjusted for socio-demographics, baseline depression, anxiety, and clustering, while including practice as a random effect. Patient satisfaction, quality of life (QALYs) and costs over 26 weeks will be compared between arms. Qualitative process analysis includes interviews with 15-20 GP/NPs and 15-20 patients per arm to reflect trial results and implementation issues, using Normalization Process Theory as a theoretical framework.

DISCUSSION

If PROMs are helpful in improving patient outcomes for depression even to a small extent, then they are likely to be good value for money, given their low cost. The benefits could be considerable, given that depression is common, disabling, and costly.

TRIAL REGISTRATION

ISRCTN no: 17299295. Registered 1st October 2018.