Why some clinicians use outcome measures and others do not

Co-Designing a Web-Based and Tablet App to Evaluate Clinical Outcomes of Early Psychosis Service Users in a Learning Health Care Network: User-Centered Design Workshop and Pilot Study

BACKGROUND

The Early Psychosis Intervention Network of California project, a learning health care network of California early psychosis intervention (EPI) programs, prioritized incorporation of community partner feedback while designing its eHealth app, Beehive. Though eHealth apps can support learning health care network data collection aims, low user acceptance or adoption can pose barriers to successful implementation. Adopting user-centered design (UCD) approaches, such as incorporation of user feedback, prototyping, iterative design, and continuous evaluation, can mitigate these potential barriers.

OBJECTIVE

We aimed to use UCD during development of a data collection and data visualization web-based and tablet app, Beehive, to promote engagement with Beehive as part of standard EPI care across a diverse user-base.

METHODS

Our UCD approach included incorporation of user feedback, prototyping, iterative design, and continuous evaluation. This started with user journey mapping to create storyboards, which were then presented in UCD workshops with service users, their support persons, and EPI providers. We incorporated feedback from these workshops into the alpha version of Beehive, which was also presented in a UCD workshop. Feedback was again incorporated into the beta version of Beehive. We provided Beehive training to 4 EPI programs who then piloted Beehive's beta version. During piloting, service users, their support persons, and EPI program providers completed Beehive surveys at enrollment and every 6 months after treatment initiation. To examine preliminary user acceptance and adoption during the piloting phase, we assessed rates of participant enrollment and survey completion, with a particular focus on completion of a prioritized survey: the Modified Colorado Symptom Index.

RESULTS

UCD workshop feedback resulted in the creation of new workflows and interface changes in Beehive to improve the user experience. During piloting, 48 service users, 42 support persons, and 72 EPI program providers enrolled in Beehive. Data were available for 88% (n=42) of service users, including self-reported data for 79% (n=38), collateral-reported data for 42% (n=20), and clinician-entered data for 17% (n=8). The Modified Colorado Symptom Index was completed by 54% (n=26) of service users (total score: mean 24.16, SD 16.81). In addition, 35 service users had a support person who could complete the Modified Colorado Symptom Index, and 56% (n=19) of support persons completed it (mean 26.71, SD 14.43).

CONCLUSIONS

Implementing UCD principles while developing the Beehive app resulted in early workflow changes and produced an app that was acceptable and feasible for collection of self-reported clinical outcomes data from service users. Additional support is needed to increase collateral-reported and clinician-entered data.

The Challenges of Assessing Hidradenitis Suppurativa: Outcome Measures

Accurate assessment of disease severity and treatment response are essential in the clinical management of hidradenitis suppurativa (HS) and vital in research efforts, particularly investigations of potential therapeutics. Key elements of the history and physical examination can inform treatment decisions to meet the needs of each individual patient. Over time, and through diligent and purposeful research, outcome measures capable of accurately and reliably assessing treatment response suitable for both research and clinical use have been developed and refined. This review explores HS clinical assessment, existing outcome measures, and emerging tools to enable accurate assessment, improve care, and optimize treatment strategies.

Measurement-Based Care in the Inpatient Setting

Measurement-based care (MBC) has not been routinely incorporated into the inpatient setting in child and adolescent psychiatry. This article discusses who should be measuring the outcomes and what needs to be considered in selecting outcome measurement scales in the inpatient setting. Characteristics of inpatient populations may pose challenges in selecting appropriate measurements to track outcomes. However, even young patients and patients with psychosis can contribute to the MBC. This article also discusses barriers and possible solutions for implementing MBC in the inpatient setting.

The COMPASS scale for the assessment of individuals with first episode psychotic disorders

BACKGROUND

Psychosis symptom assessment instruments are rarely used in US mental health community clinical practice despite the advantages of measurement-based care. Barriers include the length of typical scales and that data for scale evaluation often come from researcher and not clinician raters.

STUDY DESIGN

The 12-item COMPASS symptom assessment was designed for the RAISE-ETP study of early phase psychosis. Ratings were done by community facility clinicians. COMPASS psychometric properties were examined with a Mokken scale analysis. Subsequently, Mokken analyses were done on 10-item COMPASS data from the ESPRITO learning health system.

STUDY RESULTS

3600 RAISE-ETP COMPASS assessments were examined. The COMPASS 12-item version fulfilled Mokken scale criteria for unidimensionality (H = 0.329 (SE:0.007)) as did a derived reduced 10-item version (H = 0.359 (SE:0.007)) and 5-item version (H = 0.396 (SE = 0.009)). The 12-item version showed one significant monotonicity violation; no significant violations were found in the reduced item versions. Of the reduced item versions, clinicians preferred the 10-item over the 5-item version. In the ESPRITO data, both the 10-item and 5-item versions met unidimensionality criteria (H = 0.458 (SE:0.030) and 0.478 (0.034) respectively) with no monotonicity violations.

CONCLUSIONS

The COMPASS scale offers clinicians versions with varying lengths for assessment of individuals with first episode psychotic disorders in community settings. COMPASS can also facilitate data collection for large scale initiatives; the 10-item version is a symptom assessment option in the US national EPINET project.

Measurement-Based Care in a Remote Intensive Outpatient Program: Pilot Implementation Initiative

BACKGROUND

The ongoing mental health crisis, especially among youth, has led to a greater demand for intensive treatment at the intermediate level, such as intensive outpatient programs (IOPs). Defining best practices in remote IOPs more broadly is critical to understanding the impact of these offerings for individuals with high-acuity mental health service needs in the outpatient setting. Measurement-based care (MBC), or the routine and systematic collection of patient-reported data throughout the course of care to make meaningful changes to treatment, is one such practice that has been shown to improve patient outcomes in mental health treatment. Despite the literature linking MBC to beneficial clinical outcomes, the adoption of MBC in clinical practice has been slow and inconsistent, and more research is needed around MBC in youth-serving settings.

OBJECTIVE

The aim of this paper is to help bridge these gaps, illustrating the implementation of MBC within an organization that provides remote-first, youth-oriented IOP for individuals with high-acuity psychiatric needs.

METHODS

A series of 2 quality improvement pilot studies were conducted with select clinicians and their clients at Charlie Health, a remote IOP program that treats high-acuity teenagers and young adults who present with a range of mental health disorders. Both studies were carefully designed, including thorough preparation and planning, clinician training, feedback collection, and data analysis. Using process evaluation data, MBC deployment was repeatedly refined to enhance the clinical workflow and clinician experience.

RESULTS

The survey completion rate was 80.08% (3216/4016) and 86.01% (4218/4904) for study 1 and study 2, respectively. Quantitative clinician feedback showed marked improvement from study 1 to study 2. Rates of successful treatment completion were 22% and 29% higher for MBC pilot clients in study 1 and study 2, respectively. Depression, anxiety, and psychological well-being symptom reduction were statistically significantly greater for MBC pilot clients (P<.05).

CONCLUSIONS

Our findings support the feasibility and clinician acceptability of a rigorous MBC process in a real-world, youth-serving, remote-first, intermediate care setting. High survey completion data across both studies and improved clinician feedback over time suggest strong clinician buy-in. Client outcomes data suggest MBC is positively correlated with increased treatment completion and symptom reduction. This paper provides practical guidance for MBC implementation in IOPs and can extend to other mental health care settings.

Comparison of the Efficacy Between Standard Measurement-Base Care (MBC) and Enhanced MBC for Major Depressive Disorder: A Pilot Study

Purpose

To validate the efficacy of enhanced measurement-based care against standard measurement-based care in patients with major depressive disorder.

Patients and Methods

In this pilot study of an ongoing multicenter cluster randomized controlled trails, 160 patients diagnosed with major depressive disorder were enrolled from 2 mental health centers, with a plan to include 12 centers in total. One hundred patients engaged in a six-month evaluation using a technology-enhanced measurement-based care tool, including assessments of clinical symptoms, side effects, and functionality at baseline, two months, four months and six months. Simultaneously, the remaining 60 patients underwent standard paper-based measurement-based care, utilizing the same set of scales over the same six-month period, with assessments at the same time points.

Results

Patients utilizing the enhanced measurement-based care tool demonstrated a significantly higher reduction rate in PHQ-9 scores compared to those using standard paper-based measurement-based care during the two-month follow-up. Additionally, a notable positive correlation was observed between the frequency of enhanced measurement-based care tool usage and the quality of life during the two-month follow-up.

Conclusion

Enhanced measurement-based care has the effect of reducing depressive symptoms. Our study emphasized that using enhanced measurement-based care via smartphones is a feasible tool for patients with major depressive disorder. Our future study, including results from additional research centers, may further validate the effectiveness of enhanced measurement-based care.

The administration of the paper and electronic versions of the Manual Ability Measure-36 (MAM-36) and Fatigue Severity Scale (FSS) is equivalent in people with multiple sclerosis

BACKGROUND

The mobile device diffusion has increasingly highlighted the opportunity to collect patient-reported outcomes (PROs) through electronic patient-reported outcomes measurements (ePROMs) during the clinical routine. Despite the ePROMs promises and advantages, the equivalence when a PRO measure is moved from the original paper-and-pencil to the electronic version is still little investigated. This study aims at evaluating equivalence between PROMs and ePROMs self-administration in people with multiple sclerosis (PwMS); in addition, preference of self-administration type was evaluated.

METHODS

The Manual Ability Measure-36 (MAM-36) and Fatigue Severity Scale (FSS) were selected for the equivalence test. The app ABOUTCOME was developed through a user-centered design approach to administer the questionnaires on tablet. Both paper-and-pencil and electronic versions were randomly self-administered. Intrarater reliability between both versions was evaluated through the intraclass correlation coefficient (ICC, excellent for values ≥ 0.75).

RESULTS

Fifty PwMS (35 females) participated to the study (mean age: 54.7±11.0 years, disease course: 27 relapsing-remitting and 23 progressive; mean EDSS: 4.7±1.9; mean disease duration: 13.3±9.5 years). No statistically significant differences were found for the means total scores of MAM-36 (p = 0.61) and FSS (p = 0.78). The ICC value for MAM-36 and FSS was excellent (0.98 and 0.94, respectively). Most of participants preferred the tablet version (84%).

CONCLUSION

The results of the study provide evidence about the equivalence between the paper-and-pencil and electronic versions of PROs administration. In addition, PwMS prefer electronic methods rather than paper because the information can be provided more efficiently and accurately. The results could be easily extended to other MS PROs.

Using a Quality Improvement Approach to Implement Measurement-Based Care (MBC) in Outpatient General Psychiatry

BACKGROUND

Measurement-based care (MBC) is the clinical practice of using patient-reported symptom measurement to inform treatment decisions. MBC has been shown to improve patient outcomes and quality of care in outpatient psychiatry. Despite these benefits, MBC is not routinely used in most psychiatric outpatient settings. This quality improvement (QI) project aimed to achieve 75% completion of symptom scales using an online MBC platform in a general psychiatry clinic in Toronto, Canada, by June 2022.

METHODS

The QI team used the Model for Improvement methodology. The main outcome measure was completion of symptom scales using an online MBC platform. Process measures included counts of invitations to join the MBC platform, counts of online MBC account creation, and counts of symptom scale assignment by clinicians. Balancing measures included administrative task completion and physician workload assessment. Stakeholder interviews explored barriers and facilitators to MBC utilization.

RESULTS

Completion of symptom scales increased from 7/65 (10.8%) preintervention to 40/70 (57.1%) during the 26-week intervention. Clinician reminders and coaching clinicians about how to incorporate MBC into the care process facilitated uptake of MBC. Stakeholders identified several barriers to implementation, particularly physician attitudes toward MBC and perceived administrative burden.

CONCLUSION

Completion of symptom scales increased over the course of this QI initiative. Successful implementation of MBC in general psychiatry outpatient settings requires the availability of a broad range of measurement scales given the diversity of mental health diagnoses. Implementation must also consider health equity, including access to technology and availability of symptom scales in multiple languages.

Enhancing Implementation of Measurement-Based Mental Health Care in Primary Care: A Mixed-Methods Study

OBJECTIVE

The complex practice of measurement-based care (MBC) for mental health conditions has proven challenging to implement. This study aimed to evaluate an intensive strategy to implement MBC in U.S. Department of Veterans Affairs (VA) Primary Care Mental Health Integration clinics.

METHODS

Ten paired sites were randomly assigned to receive national MBC resources alone or with an intensive implementation strategy (external facilitation plus quality improvement teams) between May 2018 and June 2020. The intervention occurred over 12-18 months; two site pairs completed participation before the COVID-19 pandemic. Using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework, the authors conducted qualitative interviews and used administrative data to evaluate the implementation, adoption, reach, and effectiveness of MBC.

RESULTS

All sites improved during the study, suggesting the effectiveness of the VA's national MBC initiative. Sites with facilitation improved more than comparison sites in implementation, adoption, and reach of MBC. The effectiveness of MBC (i.e., clinician responsiveness to high patient-reported outcome measure [PROM] scores) was demonstrated at all sites both before and after facilitation. After the COVID-19 pandemic began, facilitation sites maintained or improved on their implementation gains, whereas comparison sites uniformly reported decreased emphasis on MBC.

CONCLUSIONS

Implementation facilitation resulted in greater gains in outcomes of interest and helped sites retain focus on MBC implementation. Regardless of study condition, clinicians were responsive to elevated PROM scores, but MBC had a larger impact on care at facilitation sites because of increased uptake. Multiple technological and contextual challenges remain, but MBC holds promise for improving routine mental health care.

Client predictors of therapy dropout in a primary care setting: a prospective cohort study

BACKGROUND

Therapy dropout poses a major challenge. Considerable research has been conducted on predictors of dropout, however none in the context of primary mental health services in Norway. The purpose of this study was to investigate which client characteristics can predict dropout from the service Prompt Mental Health Care (PMHC).

METHODS

We performed a secondary analysis of a Randomized Controlled Trial (RCT). Our sample consisted of 526 adult participants receiving PMHC-treatment in the municipalities of Sandnes and Kristiansand, between November 2015 to August 2017. Using logistic regression, we investigated the association between nine client characteristics and dropout.

RESULTS

The dropout rate was 25.3%. The adjusted analysis indicated that older clients had a lower odds ratio (OR) of dropping out compared to younger clients (OR = 0.43, [95% CI = 0.26, 0.71]). Moreover, clients with higher education had a lower odds ratio of dropping out compared to clients with lower levels of education (OR = 00.55, 95% CI [0.34, 0.88]), while clients who were unemployed were more likely to drop-out as compared the regularly employed (OR = 2.30, [95% CI = 1.18, 4.48]). Finally, clients experiencing poor social support had a higher odds ratio of dropping out compared to clients who reported good social support (OR = 1.81, [95% CI = 1.14, 2.87]). Sex, immigrant background, daily functioning, symptom severity and duration of problems did not predict dropout.

CONCLUSION

The predictors found in this prospective study might help PMHC-therapists identify clients at risk of dropout. Strategies for preventing dropout are discussed.

Measurement-based care for suicidal youth: Outcomes and recommendations from the Services for Teens At Risk (STAR) Center

Measurement-based care has demonstrable benefits, but significant implementation barriers slow dissemination in real-world clinical settings, especially youth behavioral health care. Here, we describe use of measurement-based care in a specialty clinic offering a continuum of outpatient care for suicidal youth. We characterize strategies used to facilitate measurement-based care in this population and ways in which challenges to implementation have been addressed. We examined adherence to measurement-based care procedures relative to treatment engagement data from electronic medical records, as well as data from clinicians regarding acceptability and utility of measurement-based care. Results suggest that measurement-based care is both feasible and acceptable for use with suicidal youth. Here we provide future directions in measurement-based care in this, and other, behavioral health settings.

A Survey of Behavioral Health Care Providers on Use and Barriers to Use of Measurement-Based Care

OBJECTIVE

Despite robust evidence for efficacy of measurement-based care (MBC) in behavioral health care, studies suggest that adoption of MBC is limited in practice. A survey from Blue Cross-Blue Shield of North Carolina was sent to behavioral health care providers (BHCPs) about their use of MBC, beliefs about MBC, and perceived barriers to its adoption.

METHODS

The authors distributed the survey by using professional networks and snowball sampling. Provider and clinical practice characteristics were collected. Numerical indices of barriers to MBC use were created. Ordered logistic regression models were used to identify associations among practice and provider characteristics, barriers to MBC use, and level of MBC use.

RESULTS

Of the 922 eligible BHCPs who completed the survey, 426 (46%) reported using MBC with at least half of their patients. Providers were more likely to report MBC use if they were part of a large group practice, had MBC training, had more weekly care hours, or practiced in nonmetropolitan settings. Physicians, self-reported generalists, more experienced providers, and those who did not accept insurance were less likely to report MBC use. Low perceived clinical utility was the barrier most strongly associated with less frequent use of MBC.

CONCLUSIONS

Although evidence exists for efficacy of MBC in behavioral health care, less than half of BHCPs reported using MBC with at least half of their patients, and low perceived clinical utility of MBC was strongly associated with lower MBC use. Implementation strategies that attempt to change negative attitudes toward MBC may effectively target this barrier to use.

Collaborative mental health care: A narrative review

The Collaborative Care model is a systematic strategy for treating behavioral health conditions in primary care through the integration of care managers and psychiatric consultants. Several randomized controlled trials have demonstrated that Collaborative Care increases access to mental health care and is more effective and cost efficient than the current standard of care for treating common mental illnesses. Large healthcare systems and organizations have begun to adopt Collaborative Care initiatives and are seeing improved treatment outcomes and provider and patient satisfaction. This review discusses current research on the effectiveness and cost-efficiency of Collaborative Care. In addition, this paper discusses its ability to adapt to specific patient populations, such as geriatrics, students, substance use, and women with perinatal depression, as well as the significance of measurement-based care and mental health screening in achieving improved clinical outcomes. Current data suggests that Collaborative Care may significantly improve patient outcomes and time-to-treatment in all reviewed settings, and successfully adapts to special patient populations. Despite the high upfront implementation burden of launching a Collaborative Care model program, these costs are generally offset by long term healthcare savings.

Organization-level variation in therapists' attitudes toward and use of measurement-based care

PURPOSE

Despite significant interest in improving behavioral health therapists' implementation of measurement-based care (MBC)-and widespread acknowledgment of the potential importance of organization-level determinants-little is known about the extent to which therapists' use of, and attitudes toward, MBC vary across and within provider organizations or the multilevel factors that predict this variation.

METHODS

Data were collected from 177 therapists delivering psychotherapy to youth in 21 specialty outpatient clinics in the USA. Primary outcomes were use of MBC for progress monitoring and treatment modification, measured by the nationally-normed Current Assessment of Practice Evaluation-Revised. Secondary outcomes were therapist attitudes towards MBC. Linear multilevel regression models tested the association of theory-informed clinic and therapist characteristics with these outcomes.

RESULTS

Use of MBC varied significantly across clinics, with means on progress monitoring ranging from values at the 25th to 93rd percentiles and means on treatment modification ranging from the 18th to 71st percentiles. At the clinic level, the most robust predictor of both outcomes was clinic climate for evidence-based practice implementation; at the therapist level, the most robust predictors were: attitudes regarding practicality, exposure to MBC in graduate training, and prior experience with MBC. Attitudes were most consistently related to clinic climate for evidence-based practice implementation, exposure to MBC in graduate training, and prior experience with MBC.

CONCLUSIONS

There is important variation in therapists' attitudes toward and use of MBC across clinics. Implementation strategies that target clinic climate for evidence-based practice implementation, graduate training, and practicality may enhance MBC implementation in behavioral health.

Dynamics of changes in motor development depending on the quality in the 3rd month of life

The aim of the study was to show that the quantitative and qualitative motor development from the 3rd month of life is key to achieving milestones and that it may be an early warning signal in children at risk of cerebral palsy (CP). The study population included 93 children (69 born at term). Children were born at week 38 ± 4, the mean body weight was 3,102 ± 814 g. All children were evaluated after reaching the 3rd month of life (quantitative and qualitative assessment), and then the 4.5th, 7th, and 12th of life (quantitative assessment). In case of suspected CP, children were followed until the 18th month, when the diagnosis was confirmed. If at the age of 3 months, a child achieved a quadrangle of support and symmetrical support, then its development at the 4.5th month of life was correct, it would creep, and it would assume a crawl position, then in the final assessment (12th month of life), the child would start to walk. If a child failed to achieve a quadrangle of support and symmetrical support and the dynamics of its development were incorrect, the development would be delayed (12th month of life), or CP would develop. A correct qualitative assessment in the 3rd month of life with a high probability guarantees corrects quantitative development at the 4.5th, 7.5th, and 12th months of life. If the qualitative assessment in the 3rd month of life was very low the child would probably be diagnosed with CP at 18 months.

Brief Adjustment Scale-6 for Measurement-Based Care: Psychometric Properties, Measurement Invariance, and Clinical Utility

The Brief Adjustment Scale-6 (BASE-6) was recently developed for measuring general psychological functioning within measurement-based care (MBC). The present study further evaluated psychometric properties, generalizability to race/ethnic populations, and clinical utility of the BASE-6. Three adult samples, Sample 1: online community participants (n = 394); Sample 2: college students (n = 249); Sample 3: outpatient clinic clients (n = 80), were included. The results demonstrated a high level of internal consistency, good test-retest reliability, and convergent validity in all samples. The unidimensional structure of BASE-6 was confirmed and factorial invariance was established across groups. Finally, the BASE-6 captured change over time by demonstrating a large effect size of pre-post treatment changes and significant linear change in multilevel growth modeling. These results support the BASE-6 as a reliable and valid measure regardless of race/ethnicity and can sensitively detect clinical change over the course of the treatment. Thus, the BASE-6 appears to accurately monitor overall psychological adjustment.

Youth Top Problems and Early Treatment Response to the Unified Protocols for Transdiagnostic Treatment of Emotional Disorders in Children and Adolescents

The Top Problems assessment is an idiographic measure of client concerns that may allow clinicians to identify early treatment response. Few studies have examined early response to evidence-based therapies using Top Problems. We collected weekly Top Problems ratings from 95 youth with emotional disorders who received treatment using the Unified Protocols for Transdiagnostic Treatment of Emotional Disorders in Children and Adolescents (UP-C/UP-A). We assessed Top Problems rating change from session 1 to session 4, the role of pre-treatment variables in early Top Problems rating change, and the role of early Top Problems rating change in post-treatment symptom outcomes. Top Problems ratings decreased significantly from session 1 to session 4. Younger child age and higher parent cognitive flexibility were associated with early Top Problems improvement. Controlling for pre-treatment, early Top Problems rating change did not explain the variance in post-treatment outcomes. Future research should examine Top Problems trajectories over treatment course.

Barriers and Opportunities for Patient-Reported Outcome Implementation: A National Pediatrician Survey in the United States

Purpose: To characterize pediatricians’ perceived barriers and areas of confidence in assessing patient-reported outcomes (PROs) in the U.S., and to test associations of these factors with implementing PRO assessment. Methods: Using a random sample from the members of American Medical Association, we recruited general pediatricians and pediatric subspecialists to complete a survey (July 2011 to December 2013). Perceived barriers and confidence in PRO assessment were compared by age, pediatric specialty (general pediatrics, seven subspecialties), practice settings (academic, private), and region of practice. Multivariable logistic regressions tested associations of demographic factors, barriers, and confidence factors with the implementation of PRO assessment. Findings: The survey was completed by 458 participants (response rate 48.5%); of these, 40.4%, 15.9%, 15.5%, and 8.1% were general pediatricians, cardiology, hematology/oncology, and pulmonary specialists, respectively. PRO assessment was implemented by 29.0% of the pediatricians. The top five barriers for PRO assessment included limited time/manpower (79.0%), limited training (77.4%), lengthy PRO instruments (76%), lack of meaningful cut-offs on PRO scores (75.5%), and unavailable PRO instruments (75.0%). Limited knowledge of PROs (OR 4.10; 95% CI 2.21, 7.60) and unavailability of PRO instruments (OR 1.87; 95% CI 1.01, 3.49) increased the odds of not implementing the assessment, whereas confidence in PRO assessments compatible with norms (OR 0.41; 95% CI 0.23, 0.72) and perceived benefit over clinical judgment alone (OR 0.53; 95% CI 0.31, 0.93) decreased the odds of not implementing the assessment. Interpretation: significant barriers to PRO assessment in pediatric settings suggest the need for providing training, resources, and practical guidance toward implementation. Patient or Public Contribution: healthcare service users contributed to this study by completing a survey and providing feedback about the barriers and areas of confidence in assessing PROs for pediatric populations.

Clinician perceptions of nomothetic and individualized patient-reported outcome measures in measurement-based care

Objective: Measurement-based care (MBC), which encompasses routine outcome monitoring (ROM) and measurement feedback systems (MFSs), is an evidence-based practice (EBP) supporting treatment personalization and clinical responsiveness. Despite MBC's effectiveness, clinicians report reservations regarding its utility, which may be a function of overreliance on nomothetic (i.e., standardized) measures. Although research suggests that individualized (i.e., idiographic) patient-reported outcome measures (I-PROMs) may have the potential to overcome these obstacles, little is known regarding clinicians' perceptions of different measurement approaches to MBC. Methods: This study examined clinicians' perceptions of the clinical utility, relevance to treatment planning, and practicality of nomothetic, individualized, and combined clinical feedback provided by a simulated MFS. Three hundred and twenty-nine clinicians were randomized to one of three conditions that presented a clinical vignette comprising: (a) nomothetic, (b) individualized, or (c) combined clinical feedback. Results: Participants' perceptions of the clinical feedback were not affected by the measurement approach. However, cognitive behavioral participants reported more positive perceptions of all aspects associated with the clinical feedback. Conclusion: These results were consistent with previous findings, suggesting that clinicians' theoretical orientation may have a significant impact on their perceptions of MBC, and should be considered when designing and implementing these systems.

Expanding the reach of evidence-based mental health interventions to private practice: Qualitative assessment using a policy ecology framework

Background

Evidence-based interventions (EBIs) for mental health disorders are underutilized in routine clinical practice. Exposure therapy for anxiety disorders is one particularly difficult-to-implement EBI that has robust empirical support. Previous research has examined EBI implementation determinants in publicly funded mental health settings, but few studies have examined EBI implementation determinants in private practice settings. Private practice clinicians likely face unique barriers to implementation, including setting-specific contextual barriers to EBI use. The policy ecology framework considers broad systemic determinants, including organizational, regulatory, social, and political contexts, which are likely relevant to EBI implementation in private practice settings but have not been examined in prior research.

Methods

Qualitative interviews were conducted to assess private practice clinicians' perceptions of EBI implementation determinants using the policy ecology framework. Clinicians were asked about implementing mental health EBIs broadly and exposure therapy specifically. Mixed methods analyses compared responses from clinicians working in solo vs. group private practice and clinicians who reported high vs. low organizational support for exposure therapy.

Results

Responses highlight several barriers and facilitators to EBI implementation in private practice. Examples include determinants related to organizational support (e.g., colleagues using EBIs), payer restrictions (e.g., lack of reimbursement for longer sessions), fiscal incentives (e.g., payment for attending training), and consumer demand for EBIs. There were notable differences in barriers faced by clinicians who work in group private practices compared to those working in solo practices. Solo private practice clinicians described ways in which their practice setting limits their degree of colleague support (e.g., for consultation or exposure therapy planning), while also allowing for flexibility (e.g., in their schedules and practice location) that may not be available to clinicians in group practice.

Conclusions

Using the policy ecology framework provides a broad understanding of contextual factors that impact private practice clinicians' use of EBIs, including exposure therapy. Findings point to potential implementation strategies that may address barriers that are unique to clinicians working in private practice.

A Roadmap for Measurement-based Care Implementation in Intensive Outpatient Treatment Settings for Children and Adolescents

Measurement-based care (MBC), the routine collection and use of patient-reported data to monitor progress and tailor treatment, has been predominantly studied in adult treatment settings. Although growing evidence supports MBC effectiveness with youth in outpatient settings and university training clinics, there is a substantial dearth of findings about successful implementation of MBC in "real world" youth treatment settings, particularly intensive settings offering group-based treatment. The current manuscript provides a foundational model of MBC implementation for "real world" intensive outpatient programs (IOP) for youth using the organizational framework of the Consolidated Framework for Implementation Research (CFIR). We also illustrate MBC implementation within a hospital-based adolescent psychiatric IOP, including enhancements to the foundational model and timely discussion of adjustments necessitated by the COVID-19 pandemic and transition to telehealth. Given the promising transdiagnostic and transtheoretical applicability of MBC, coupled with the MBC mandate for Joint Commission accredited health-care systems, IOP programs are well-positioned to adopt, implement and sustain MBC with careful attention to a phased, multilevel implementation approach.

Tailored isn't always better: Impact of standardized versus tailored training on intention to use measurement-based care

Background: Brief educational trainings are often used for disseminating and implementing evidence-based practices (EBPs). However, many accessible trainings are ubiquitously standardized. Tailored training focused on modifying individual or contextual factors that may hinder EBP implementation is recommended, but there is a dearth of research comparing standardized versus tailored training. This study sought to: (a) assess the impact of MBC training on clinician intention to use measurement-based care (MBC); (b) compare the effect of standardized versus tailored training on clinician intention to MBC; and (c) identify clinician-level predictors of intention. Methods: Clinicians (n = 152) treating adult clients with depression at 12 community mental health clinics were randomized to either tailored or standardized MBC training. Clinic-specific barriers and facilitators were used to inform training content and structure tailoring. Linear mixed modeling tested the association between training condition and post-training intention to use MBC, as well as hypothesized individual-level predictors of post-training intention (e.g., age, gender). Results: Clinician intention pre- and post-training increased across training conditions (B = 0.38, t = -5.95, df = 36.99, p < .01, Cohen's d = 0.58). Results of linear mixed modeling procedures suggest no significant difference in clinician intention between conditions post-training (B = -0.03, SE = .19, p > .05, Cohen's d = .15). Only baseline intention emerged as a predictor of post-training intention (B = 0.39, SE = .05, p < .05). Conclusions: These findings suggest the additional effort to tailor training may not yield incremental benefit over standardized training, at least in the short term. As a result, implementation efforts may be able to reserve time and finances for other elements of implementation beyond the training component.

Plain Language Summary

Educational training is a common approach for enhancing knowledge about research-supported mental health treatments. However, these trainings are often not tailored to meet the needs of the trainees, and there is insufficient evidence about whether tailoring might improve the impact of training compared to a one-size-fits-all, standard version. This study compared the impact of a tailored versus standard training on mental health clinician's intentions to use measurement-based (MBC) care for monitoring treatment progress for clients with depression. Study results indicated that intention to use MBC improved for clinicians receiving both the tailored and standard training after training completion. There were no differences in intention to use MBC care when the two types of training were compared. These study findings suggest that tailoring, which may require substantial time and effort, may not be a necessary step to improve the short-term impact of educational trainings.

Ten outcome measures in forensic mental health: A survey of clinician views on comprehensiveness, ease of use and relevance

BACKGROUND

Measurement of outcomes in forensic mental health services is essential to ensure that these services are delivering good quality care and treatment. Instruments for outcome measurement should cover all important domains, be easy to implement in a routine clinical context and facilitate transfer of relevant information between clinicians as the patient progresses along a recovery and rehabilitation pathway.

AIMS

We sought the views of clinicians on 10 common instruments used as outcome measures in forensic mental health services, especially on their perceived comprehensiveness and ease of use.

METHODS

An online survey was used to gather the views of clinicians from a range of professional backgrounds working in forensic mental health services in the United Kingdom. The selected instruments were identified from a previous systematic review of instruments for measuring outcomes in this context. Questions covered comprehensiveness, ease of use, patient involvement, relevance and use for progressing tracking and care planning.

RESULTS

Complete responses were received from 229 individuals. The range of respondents either agreeing or strongly agreeing that individual instruments were comprehensive was 6-39%; easy to use 19%-69%; relevant 31%-78%; useful to measure progress 7-70%; and useful for care planning 33-81%. Respondents reported that, for each of the 10 instruments, full involvement of patients varied between 3% and 22%; partial involvement 12-45%, patients informed, but not involved 11%-28%; and patients not involved or informed 21%-64%.

CONCLUSIONS

The Health of the Nation Outcome Scale Secure, the only instrument designed as an outcome measure, is not regarded by clinicians as useful in that respect and the majority of clinicians do not inform patients they are using it. Clinicians appear most familiar with the Historical Clinical Risk 20 (HCR-20), which some respondents considered potentially useful as a progress measure but with limited patient involvement. Most respondents did not think that the HCR-20 is comprehensive. There is a need for outcome measures that are comprehensive, easy to use and have adequate patient involvement in their development and rating.

Measurement-Based Care in the Adolescent Partial Hospital Setting: Implementation, Challenges, & Future Directions

In this paper, we describe the process of implementing measurement-based care (MBC) in the adolescent partial hospital program setting. First, we outline the rationale for incorporating MBC in this treatment setting. Second, we describe the partial hospital setting in which implementation took place, including the patient population, treatment providers, and structure of programming. Next, we outline the initial implementation of standardized assessments into our programming, including key initial considerations and challenges during implementation. We describe the importance of considering the primary symptom presentations of the patient population when selecting assessment tools, the importance of leveraging existing electronic health record tools to efficiently track and record data collection, and the ability to integrate assessments into clinical workflows. Fourth, we present data describing compliance with implementation, patient outcomes, and providers' attitudes towards and knowledge of MBC following implementation. We found after the initial implementation period, compliance was high. We also found providers had an overall positive perception of the use of MBC, reporting they perceived it to be helpful to both their clinical practice and patient outcomes. Finally, we discuss future directions for best utilizing standardized assessments in intensive treatment settings.

Barriers and facilitators to implementing measurement-based care for depression in Shanghai, China: a situational analysis

BACKGROUND

Measurement-based care (MBC) is an evidence-based practice for depression, but its use by clinicians remains low. Enhanced MBC (eMBC), which uses digital technologies, can help to facilitate the use of MBC by clinicians and patients. Understanding factors that act as barriers and drivers to the implementation of MBC and eMBC is important to support the design of implementation strategies, promoting uptake by clinicians and patients.

OBJECTIVE

This situational analysis identifies barriers and facilitators to the implementation of standard and eMBC at mental health centers in Shanghai, China.

METHODS

We used mixed methods to develop a comprehensive understanding of the factors influencing MBC and eMBC implementation in Shanghai. This study took place across three mental health centers in Shanghai. We used situational analysis tools to collect contextual information about the three centers, conducted surveys with n = 116 clinicians and n = 301 patients, conducted semi-structured interviews with n = 30 clinicians and six focus groups with a total of n = 19 patients. Surveys were analysed using descriptive statistics, and semi-structured interviews and focus groups were analysed using framework analysis.

RESULTS

Several potential barriers and facilitators to MBC and eMBC implementation were identified. Infrastructure, cost, attitudes and beliefs, and perceptions about feasibility and efficacy emerged as both challenges and drivers to MBC and eMBC implementation in Shanghai.

CONCLUSIONS

The results of this study will directly inform the design of an implementation strategy for MBC and eMBC in Shanghai, that will be tested via a randomized controlled trial. This study contributes to the emerging body of literature on MBC implementation and, to the best of our knowledge, is the first such study to take place in Asia. This study identifies several factors that are relevant to the equitable delivery of MBC, recognizing the need to explicitly address equity concerns in global mental health implementation research.

A systematic review of patient-reported outcome measurement (PROM) and provider assessment in mental health: goals, implementation, setting, measurement characteristics and barriers

PURPOSE

To review and integrate the literature on mental-health-related patient-reported outcome measures (PROMs) and routine outcome measures (ROMs), namely in the domains of goals, characteristics, implementation, settings, measurements and barriers. PROM/ROM aims mainly to ascertain treatment impact in routine clinical practice through systematic service users' health assessment using standardized self-report, caretaker and/or provider assessment.

DATA SOURCES

Psych INFO and PubMed including Medline, Biomed Central, EMBASE Psychiatry and Elsevier Science's Direct.

STUDY SELECTION

Systemized review of literature (2000-2018) on implementation and sustainability of PROMs/ROMs in adult mental health settings (MHS).

DATA EXTRACTION AND SYNTHESIS

Systemized review of literature (2000-2018) on numerous aspects of PROM/ROM implementation and sustainability in adult MHS worldwide.

RESULTS

Based on 103 articles, PROMs/ROMs were implemented mostly in outpatient settings for people with assorted mental health disorders receiving a diversity of services. Frequency of assessments and completion rates varied: one-third of projects had provider assessments; about half had both provider and self-assessments. Barriers to implementation: perceptions that PROM/ROM is intrusive to clinical practice, lack of infrastructure, fear that results may be used for cost containment and service eligibility instead of service quality improvement, difficulties with measures, ethical and confidentiality regulations and web security data management regulations.

CONCLUSION

Improving data input systems, sufficient training, regular feedback, measures to increase administrative and logistic support to improve implementation, acceptability, feasibility and sustainability, follow-up assessments and client attrition rate reduction efforts are only some measures needed to enhance PROM/ROM efficiency and efficacy.

Contextual assessment: evaluating a novel self-guided online therapeutic assessment

BACKGROUND

Paper introduces Conflict Analysis (CA), an online self-guided therapeutic assessment. CA combines a diagnostic self-report scale with narrative exercises and self-analytical tasks. CA automatically generates detailed diagnostic records and frameworks for changes.

OBJECTIVE

To evaluate therapeutic and diagnostic benefits associated with CA over time.

METHODS

This online study compared CA over 2 weeks on outcome measures predicting psychotherapy outcome. Novel scale measuring perceived diagnostic benefit and perceived therapeutic benefit was delivered at post and follow-up. Cohort (n = 59, average age = 35, 50% female) was either in therapy or interested to start therapy in near future.

RESULTS

Repeated-measure ANOVAs suggest that scores significantly changed on measures predicting negative affect, depression, performance and appearance self-esteem, insight, and growth initiative. Agreement rates on items measuring perceived diagnostic and therapeutic benefits were at least 74.5% for both post and follow-up.

CONCLUSIONS

Evidence supports further exploration of CA as a self-guided diagnostic and therapeutic resource.Key pointsResults demonstrate feasibility and utility of online self-guided therapeutic assessment.Described model is associated with increased perceived diagnostic and therapeutic benefits.Described model illustrates therapeutic benefits over time.Results demonstrate that even self-guided assessment can have therapeutic implications.

Screening for Palliative Care Needs: Pilot Data From German Comprehensive Cancer Centers

PURPOSE

Guidelines recommend several screening tools to identify patients with complex palliative needs. This diversity and lack of structural recommendations offer a wide scope for implementing screening. Against this background, the current status of implementation at German Comprehensive Cancer Centers (CCCs) funded by the German Cancer Aid has not yet been investigated.

METHODS

e-mail survey of the 17 hospital sites of the 13 CCCs. The questionnaire asked for structural characteristics of the centers as well as preconditions of the screening process. Structurally established screening procedures (one item) and standardized workflows, modes of performance, screening tools (four items), modes of training how to screen, and responsibilities (two items) were assessed.

RESULTS

In a 2-month period, 15 hospital sites responded; seven hospital sites conducted a palliative care needs (PCN) screening. Only one hospital site carried out PCN screening in almost all oncology departments, but only with the distress thermometer. Other hospital sites determined palliative needs by assessing physical symptoms using the Integrated Palliative Care Outcome Scale or the Minimal Documentation System, and two hospital sites combined tools to determine both physical and psychological stress. The type of screening varied from paper-pencil-based to tablet computer-based documentation. The main barriers to implementation were identified as a lack of human resources and a lack of structural conditions.

CONCLUSION

There is a lack of consensus among palliative care specialists and oncologists in the CCCs supported by the German Cancer Aid in PCN screening as well as of structured guidelines and the professional association. Structural requirements should be adapted to these needs, which include both technical and human resources. A combined psycho-oncologic and palliative care screening might help to formulate best practice recommendations.

Implementing Measurement-Based Care for Depression: Practical Solutions for Psychiatrists and Primary Care Physicians

Measurement-based care (MBC) can be defined as the clinical practice in which care providers collect patient data through validated outcome scales and use the results to guide their decision-making processes. Despite growing evidence supporting the effectiveness of MBC for depression and other mental health conditions, many physicians and mental health clinicians have yet to adopt MBC practice. In part, this is due to individual and organizational barriers to implementing MBC in busy clinical settings. In this paper, we briefly review the evidence for the efficacy of MBC focusing on pharmacological management of depression and provide example clinical scenarios to illustrate its potential clinical utility in psychiatric settings. We discuss the barriers and challenges for MBC adoption and then address these by suggesting simple solutions to implement MBC for depression care, including recommended outcome scales, monitoring tools, and technology solutions such as cloud-based MBC services and mobile health apps for mood tracking. The availability of MBC tools, ranging from paper-pencil questionnaires to mobile health technology, can allow psychiatrists and clinicians in all types of practice settings to easily incorporate MBC into their practices and improve outcomes for their patients with depression.

An Initial Study of Practicing Psychologists' Views of the Utility of Ecological Momentary Assessment for Difficult Psychotherapy Cases

Ecological momentary assessment (EMA) is a burgeoning area of research, and several clinical applications of the resulting data have been identified by researchers, suggesting potential benefit to psychotherapy practice. However, practitioners often do not use traditional empirically-supported tools for diagnosis and outcome monitoring (e.g., validated interview measures and questionnaires). Thus, it is not clear how readily practitioners will take up newer technology-enhanced assessment methods, despite current enthusiasm among researchers. The current study aimed to explore the perceived usefulness of EMA-based tools for clinical assessment and outcome monitoring of difficult psychotherapy cases, as well as to identify correlates of attitudes about the usefulness of these tools. Clinical psychologists in active therapy practice with adults (n = 375) completed an internet survey including the Attitudes toward Standardized Assessment scale and the Attitudes toward Standardized Assessment Scales-Monitoring and Feedback. Respondents characterized their current diagnostic and outcome monitoring practices and rated how helpful they would find several assessment and outcome monitoring resources for a difficult case, including both traditional instruments and EMA-based methods. EMA-based tools had lower perceived usefulness than existing instruments. Attitudes toward standardized assessment and outcome monitoring predicted the perceived utility of these methods, as did several professional variables. Practicing psychologists may not adopt EMA for clinical assessment more readily than traditional assessment tools. Recommendations for facilitating the uptake of new technologies by psychotherapists are offered.

Measurement-Based Care in the Treatment of Anxiety

Treatment of pediatric anxiety disorders is complicated by their number, comorbidity, and the differential impact of a child's anxiety on the child and parents. Measurement-based care, using patient-level rating scales, can guide clinical decisions, track symptom improvement, and monitor treatment response. We review instruments for measurement-based care in pediatric anxiety. Measures used to track pediatric anxiety should be brief, accessible, sensitive to change, and reliable. Because parent-child agreement about a child's anxiety tends to be low, measures from both should be obtained. Measurements can also track functional improvement, expectancy related to treatment, and readiness to change.

Evidence Base for Measurement-Based Care in Child and Adolescent Psychiatry

Measurement-based care (MBC) is the routine collection of data using standardized, validated measures and use of these data to guide treatment. MBC has been implemented throughout medicine to improve patient outcomes, but its use in mental health care remains low. This article summarizes the evidence of MBC's efficacy in adults then reviews the sparser data in youth mental health care. The literature indicates that MBC must be administered immediately before or during every encounter, results must be available to and reviewed by providers immediately, results must be shared with the patient, and results must be used to guide treatment.

Trends in (not) using scales in major depression: A categorization and clinical orientation

Background

Standard depression rating scales like the Hamilton Depression Rating Scale and the Montgomery–Åsberg Depression Rating Scale were developed more than 40 years ago. They are mandatory in clinical trials but are for a variety of reasons seldom used in clinical practice. Moreover, most clinicians are less familiar with more recent trends or with some dilemmas in assessment tools for major depression.

Methods

Narrative review.

Results

Asssessment tools can be observer-rating or self-rating scales, disease-specific or non–disease-specific scales, subjective scales or objective lab assessments, standard questionnaires or experience sampling methods. An overarching question is to what degree current assessment methods really address the individual patient’s needs and treatment expectations.

Conclusions

The present paper aims to offer a framework for understanding the current trends in assessment tools that can orientate and guide the clinician.

A Combined Digital and Biomarker Diagnostic Aid for Mood Disorders (the Delta Trial): Protocol for an Observational Study

Background

Mood disorders affect hundreds of millions of people worldwide, imposing a substantial medical and economic burden. Existing diagnostic methods for mood disorders often result in a delay until accurate diagnosis, exacerbating the challenges of these disorders. Advances in digital tools for psychiatry and understanding the biological basis of mood disorders offer the potential for novel diagnostic methods that facilitate early and accurate diagnosis of patients.

Objective

The Delta Trial was launched to develop an algorithm-based diagnostic aid combining symptom data and proteomic biomarkers to reduce the misdiagnosis of bipolar disorder (BD) as a major depressive disorder (MDD) and achieve more accurate and earlier MDD diagnosis.

Methods

Participants for this ethically approved trial were recruited through the internet, mainly through Facebook advertising. Participants were then screened for eligibility, consented to participate, and completed an adaptive digital questionnaire that was designed and created for the trial on a purpose-built digital platform. A subset of these participants was selected to provide dried blood spot (DBS) samples and undertake a World Health Organization World Mental Health Composite International Diagnostic Interview (CIDI). Inclusion and exclusion criteria were chosen to maximize the safety of a trial population that was both relevant to the trial objectives and generalizable. To provide statistical power and validation sets for the primary and secondary objectives, 840 participants were required to complete the digital questionnaire, submit DBS samples, and undertake a CIDI.

Results

The Delta Trial is now complete. More than 3200 participants completed the digital questionnaire, 924 of whom also submitted DBS samples and a CIDI, whereas a total of 1780 participants completed a 6-month follow-up questionnaire and 1542 completed a 12-month follow-up questionnaire. The analysis of the trial data is now underway.

Conclusions

If a diagnostic aid is able to improve the diagnosis of BD and MDD, it may enable earlier treatment for patients with mood disorders.

International Registered Report Identifier (IRRID)

DERR1-10.2196/18453

A Mobile Technology for Collecting Patient-Reported Physical Activity and Distress Outcomes: Cross-Sectional Cohort Study

Background

Electronic patient-reported outcome (PROs) provides a fast and reliable assessment of a patient’s health-related quality of life. Nevertheless, using PRO in the traditional paper format is not practical for clinical practice due to the limitations associated with data analysis and management. A questionnaire app was developed to address the need for a practical way to group and use distress and physical activity assessment tools.

Objective

The purpose of this study was to assess the level of agreement between electronic (mobile) and paper-and-pencil questionnaire responses.

Methods

We validated the app version of the distress thermometer (DT), International Physical Activity Questionnaire (IPAQ), and Patient Health Questionnaire–9 (PHQ-9). A total of 102 participants answered the paper and app versions of the DT and IPAQ, and 96 people completed the PHQ-9. The study outcomes were the correlation of the data between the paper-and-pencil and app versions.

Results

A total of 106 consecutive breast cancer patients were enrolled and analyzed for validation of paper and electronic (app) versions. The Spearman correlation values of paper and app surveys for patients who responded to the DT questionnaire within 7 days, within 3 days, and on the same day were .415 (P<.001), .437 (P<.001), and .603 (P<.001), respectively. Similarly, the paper and app survey correlation values of the IPAQ total physical activity metabolic equivalent of task (MET; Q2-6) were .291 (P=.003), .324 (P=.005), and .427 (P=.01), respectively. The correlation of the sum of the Patient Health Questionnaire–9 (Q1-9) according to the time interval between the paper-based questionnaire and the app-based questionnaire was .469 for 14 days (P<.001), .574 for 7 days (P<.001), .593 for 3 days (P<.001), and .512 for the same day (P=.03). These were all statistically significant. Similarly, the correlation of the PHQ (Q10) value according to the time interval between the paper-based questionnaire and the app-based questionnaire was .283 for 14 days (P=.005), .409 for 7 days (P=.001), .415 for 3 days (P=.009), and .736 for the same day (P=.001). These were all statistically significant. In the overall trend, the shorter the interval between the paper-and-pencil questionnaire and the app-based questionnaire, the higher the correlation value.

Conclusions

The app version of the distress and physical activity questionnaires has shown validity and a high level of association with the paper-based DT, IPAQ (Q2-6), and PHQ-9. The app-based questionnaires were not inferior to their respective paper versions and confirm the feasibility for their use in clinical practice. The high correlation between paper and mobile app data allows the use of new mobile apps to benefit the overall health care system.

Trial Registration

ClinicalTrials.gov NCT03072966; https://clinicaltrials.gov/ct2/show/NCT03072966

Development and validation of a progress monitoring tool tailored for use in intensive eating disorder treatment

OBJECTIVE

Despite calls for routine use of progress and outcome monitoring in private and intensive treatment centres for eating disorders (EDs), existing measures have limited relevance to these supervised treatment settings. This study sought to develop and validate the progress monitoring tool for eating disorders, a multidimensional measure for progress monitoring in the context of intensive ED treatment.

METHOD

Thirty-seven items were generated by a team of content experts, clinicians, and administrative staff from the target treatment setting. Adolescent and adult females (N = 531) seeking residential ED treatment completed the items at admission as part of the clinic's routine assessment battery; 83% were retained for repeat assessment at discharge. Exploratory factor analysis was conducted for preliminary measure development.

RESULTS

Results yielded a five-factor, 26-item structure explaining 50% of total variance. Final construct domains included weight and shape concern, ED behaviours and urges, emotion avoidance, adaptive coping, and relational connection. The measure demonstrated adequate internal consistency, sensitivity to change during treatment, and convergence with validated assessment measures.

CONCLUSIONS

Preliminary data support the progress monitoring tool for eating disorders as a novel and valid multidimensional measure of treatment-relevant constructs. This measure may have utility in measuring treatment progress for patients receiving intensive treatment for EDs.

Evidence Base Update for Brief, Free, and Accessible Youth Mental Health Measures

Evidence-based assessment (EBA) is foundational to high-quality mental health care for youth and is a critical component of evidence-based practice delivery, yet is underused in the community. Administration time and measure cost are barriers to use; thus, identifying and disseminating brief, free, and accessible measures are critical. This Evidence Base Update evaluates the empirical literature for brief, free, and accessible measures with psychometric support to inform research and practice with youth. A systematic review using PubMed and PsycINFO identified measures in the following domains: overall mental health, anxiety, depression, disruptive behavior, traumatic stress, disordered eating, suicidality, bipolar/mania, psychosis, and substance use. To be eligible for inclusion, measures needed to be brief (50 items or less), free, accessible, and have psychometric support for their use with youth. Eligible measures were evaluated using adapted criteria established by De Los Reyes and Langer (2018) and were classified as having excellent, good, or adequate psychometric properties. A total of 672 measures were identified; 95 (14%) met inclusion criteria. Of those, 21 (22%) were "excellent," 34 (36%) were "good," and 40 (42%) were "adequate." Few measures had support for their use to routinely monitor progress in therapy. Few measures with excellent psychometric support were identified for disordered eating, suicidality, psychosis, and substance use. Future research should evaluate existing measures for use with routine progress monitoring and ease of implementation in community settings. Measure development is needed for disordered eating, suicidality, psychosis, and substance use to increase availability of brief, free, accessible, and validated measures.

Individualized Progress Measures Are More Acceptable to Clinicians Than Standardized Measures: Results of a National Survey

Despite research supporting measurement-based care grounded in standardized progress measures, such measures are underutilized by clinicians. Individualized measures of client-specific targets present an alternative, but little is known about their acceptability or use. We compared attitudes toward and use of standardized and individualized progress measures in a national sample of 504 clinicians. Clinicians reported neutral to positive attitudes toward both types of measures, but strongly preferred and were more likely to use individualized measures. Clinician attitudes, theoretical orientation, and work setting predicted assessment preferences and practices. Implications for dissemination and implementation of measurement-based care are discussed.

The Use of Patient-Reported Outcome Measures: Secondary School Athletic Trainers' Perceptions, Practices, and Barriers

CONTEXT

Incorporating patient-reported outcomes (PROs) into daily routine is essential for patient-centered clinical practice. Secondary school athletic trainers (ATs) may encounter unique barriers that limit their willingness to use PROs.

OBJECTIVE

To explore how secondary school ATs who were using PROs perceived their application, benefits, and problems compared with those who did not.

DESIGN

Cross-sectional study.

SETTING

Web-based survey.

PATIENTS OR OTHER PARTICIPANTS

A total of 2984 secondary school ATs received an e-mail invitation, and 322 completed the survey (response rate = 10.8%). Respondents were 43 ± 10 years old, with most indicating at least 11 years as a Board of Certification-certified AT (n = 276, 85.7%).

MAIN OUTCOME MEASURE(S)

The ATs were invited to complete a Web-based survey regarding the uses and benefits of and problems with PROs. Those using PROs in clinical practice were asked their criteria for selecting the measures, whereas those not using PROs were asked their reasons for not using them. Dependent variables were endorsements of uses and benefits of and problems with PROs.

RESULTS

The most commonly cited uses of PROs were determining treatment effectiveness (193/264, 73%) and demonstrating effectiveness to administration (174/264, 66%). Improving communication with the patient (267/296, 90%) and helping to direct the plan of care (256/297, 86%) were the most frequently endorsed benefits of PROs. Time to score and analyze (152/284, 53%) and time for patients to complete (134/284, 47%) PROs were the problems encountered most often. For ATs not using PROs (223/262, 85%), the most frequent reason was the lack of a support structure (102/219, 46%). For ATs using PROs (39/262, 15%), quick completion times (32/39, 82%) was the most common criterion used to select individual measures.

CONCLUSIONS

A majority of secondary school ATs recognized the benefits of PROs and yet did not use them in clinical practice due to setting-specific barriers.

Implementing Measurement-Based Care in Behavioral Health: A Review

IMPORTANCE

Measurement-based care (MBC) is the systematic evaluation of patient symptoms before or during an encounter to inform behavioral health treatment. Despite MBC's demonstrated ability to enhance usual care by expediting improvements and rapidly detecting patients whose health would otherwise deteriorate, it is underused, with typically less than 20% of behavioral health practitioners integrating it into their practice. This narrative review addresses definitional issues, offers a concrete and evaluable operationalization of MBC fidelity, and summarizes the evidence base and utility of MBC. It also synthesizes the extant literature's characterization of barriers to and strategies for supporting MBC implementation, sustainment, and scale-up.

OBSERVATIONS

Barriers to implementing MBC occur at multiple levels: patient (eg, concerns about confidentiality breach), practitioner (eg, beliefs that measures are no better than clinical judgment), organization (eg, no resources for training), and system (eg, competing requirements). Implementation science-the study of methods to integrate evidence-based practices such as MBC into routine care-offers strategies to address barriers. These strategies include using measurement feedback systems, leveraging local champions, forming learning collaboratives, training leadership, improving expert consultation with clinical staff, and generating incentives.

CONCLUSIONS AND RELEVANCE

This narrative review, informed by implementation science, offers a 10-point research agenda to improve the integration of MBC into clinical practice: (1) harmonize terminology and specify MBC's core components; (2) develop criterion standard methods for monitoring fidelity and reporting quality of implementation; (3) develop algorithms for MBC to guide psychotherapy; (4) test putative mechanisms of change, particularly for psychotherapy; (5) develop brief and psychometrically strong measures for use in combination; (6) assess the critical timing of administration needed to optimize patient outcomes; (7) streamline measurement feedback systems to include only key ingredients and enhance electronic health record interoperability; (8) identify discrete strategies to support implementation; (9) make evidence-based policy decisions; and (10) align reimbursement structures.

Comparing Approaches to Mobile Depression Assessment for Measurement-Based Care: Prospective Study

BACKGROUND

To inform measurement-based care, practice guidelines suggest routine symptom monitoring, often on a weekly or monthly basis. Increasingly, patient-provider contacts occur remotely (eg, by telephone and Web-based portals), and mobile health tools can now monitor depressed mood daily or more frequently. However, the reliability and utility of daily ratings are unclear.

OBJECTIVE

This study aimed to examine the association between a daily depressive symptom measure and the Patient Health Questionnaire-9 (PHQ-9), the most widely adopted depression self-report measure, and compare how well these 2 assessment methods predict patient outcomes.

METHODS

A total of 547 individuals completed smartphone-based measures, including the Patient Health Questionnaire-2 (PHQ-2) modified for daily administration, the PHQ-9, and the Sheehan Disability Scale. Multilevel factor analyses evaluated the reliability of latent depression based on the PHQ-2 (for repeated measures) between weeks 2 and 4 and its correlation with the PHQ-9 at week 4. Regression models predicted week 8 depressive symptoms and disability ratings with daily PHQ-2 and PHQ-9.

RESULTS

The daily PHQ-2 and PHQ-9 are highly reliable (range: 0.80-0.88) and highly correlated (r=.80). Findings were robust across demographic groups (age, gender, and ethnic minority status). Daily PHQ-2 and PHQ-9 were comparable in predicting week 8 disability and were independent predictors of week 8 depressive symptoms and disability, though the unique contribution of the PHQ-2 was small in magnitude.

CONCLUSIONS

Daily completion of the PHQ-2 is a reasonable proxy for the PHQ-9 and is comparable to the PHQ-9 in predicting future outcomes. Mobile assessment methods offer researchers and clinicians reliable and valid new methods for depression assessment that may be leveraged for measurement-based depression care.

Understanding Therapists' Work With Suicidal Patients: An Examination of Qualitative Data

The collaborative assessment and management of suicidality (CAMS) serves as a framework for maintaining a collaborative relationship between the therapist and patient. This study used an original coding manual to examine responses to open-ended questions to better understand the ways in which therapists use CAMS collaboratively as well as their reasons for adhering (or not adhering) to certain aspects of the framework. Results suggest differences in treatment application based on therapist characteristics including amount of experience, intensity of training received, and experience of a patient suicide attempt. Implications of this research include informing therapists interested in using the CAMS framework about the specific ways in which implementation can be made collaborative. Further, this research helps to shed light on how experiencing a client's death by suicide can impact therapists' future work with suicidal clients.

Provider-Associated Measurement Error in Routine Outcome Monitoring in Community Mental Health

Despite the strengths of routine outcome monitoring (ROM) in community mental health settings, there are a number of barriers to effective implementation of ROM, including measurement error due to provider factors (e.g., training level) and non-target client factors (i.e., client characteristics which have no meaningful relationship to the outcome of interest). In this study, ROM data from 80 client-provider dyads were examined for sources of variance due to provider factors and non-target client factors. Results indicated that provider factors and non-target client factors accounted for between 9.6 and 54% of the variance in the ROM measures. Our findings supported past research that provider characteristics impact ROM, and added the novel finding that client gender, age, diagnosis, and cognition also impact ROM. Methods to increase accuracy and utility of ROM in community mental health are discussed.