Individualized Progress Measures Are More Acceptable to Clinicians Than Standardized Measures: Results of a National Survey

Strategic Treatment and Assessment for Youth (STAY): A Theoretically-Driven, Culturally-Tailored MBC Approach

Racial and ethnic minoritized (REM) youth are at greater risk for depression and suicide than their White peers. Despite this, REM youth are much more likely than their White peers to prematurely dropout of treatment. Culturally tailored and scalable engagement models to improve mental health treatment retention among REM youth with depressive symptoms and suicidal thoughts and behaviors (STB) are urgently needed. Strategic Treatment Assessment for Youth (STAY) is a theoretically-driven, culturally tailored measurement-based care (MBC) approach to treatment engagement for REM youth with depressive symptoms and suicide risk. Specifically, STAY uses MBC feedback processes to reduce perceptual barriers to treatment, thus improving treatment retention and ultimately, client outcomes among REM youth. In addition to standard MBC components, STAY includes a greater emphasis on providing a client-centered rationale for MBC which includes assessing and discussing treatment expectations, the use of individualized progress measures and alliance measures, and cultural competence training. The goal of this manuscript is to describe the STAY model based on initial theoretical development and preliminary clinician-informed refinements. Further, a case example of STAY is presented with a particular focus on the use of feedback processes. Finally, the current and future directions to empirically examine STAY as a treatment retention strategy with REM populations are provided.

Effects and experiences of idiographic patient-reported outcome measures for feedback in psychotherapy: A systematic review and secondary analysis of the empirical literature

Objective: There is a growing interest in idiographic patient-reported outcome measures (I-PROMs) for routine outcome monitoring (ROM) and clinical feedback (CF) in psychotherapy, but to our knowledge, no systematic reviews of the empirical literature. Method: We conducted a systematic literature search for empirical papers investigating effects and experiences of I-PROMs for ROM/CF and found a total of 13 papers. There was only one experimental controlled effectiveness study. Results: We formulated a narrative summary of the data set as a whole. We conducted a secondary analysis of nine papers containing qualitative data on stakeholder experiences with I-PROMs and found three superordinate themes and eight subthemes, summarized as "I-PROMs can facilitate self-reflection for patients, assist in identifying and tracking therapeutic topics, and make patients more committed to therapy by giving them a greater sense of responsibility and empowerment. Formulating goals and problems can be difficult, and lack of progress can be demotivating. Time in therapy is precious and must be spent wisely. Effective use of I-PROMs is facilitated by flexibility and therapists' use of clinical skills." Conclusion: We discuss the limitations of the study and provide recommendations for future research and clinical practice.

Measurement-Based Care in a Remote Intensive Outpatient Program: Pilot Implementation Initiative

BACKGROUND

The ongoing mental health crisis, especially among youth, has led to a greater demand for intensive treatment at the intermediate level, such as intensive outpatient programs (IOPs). Defining best practices in remote IOPs more broadly is critical to understanding the impact of these offerings for individuals with high-acuity mental health service needs in the outpatient setting. Measurement-based care (MBC), or the routine and systematic collection of patient-reported data throughout the course of care to make meaningful changes to treatment, is one such practice that has been shown to improve patient outcomes in mental health treatment. Despite the literature linking MBC to beneficial clinical outcomes, the adoption of MBC in clinical practice has been slow and inconsistent, and more research is needed around MBC in youth-serving settings.

OBJECTIVE

The aim of this paper is to help bridge these gaps, illustrating the implementation of MBC within an organization that provides remote-first, youth-oriented IOP for individuals with high-acuity psychiatric needs.

METHODS

A series of 2 quality improvement pilot studies were conducted with select clinicians and their clients at Charlie Health, a remote IOP program that treats high-acuity teenagers and young adults who present with a range of mental health disorders. Both studies were carefully designed, including thorough preparation and planning, clinician training, feedback collection, and data analysis. Using process evaluation data, MBC deployment was repeatedly refined to enhance the clinical workflow and clinician experience.

RESULTS

The survey completion rate was 80.08% (3216/4016) and 86.01% (4218/4904) for study 1 and study 2, respectively. Quantitative clinician feedback showed marked improvement from study 1 to study 2. Rates of successful treatment completion were 22% and 29% higher for MBC pilot clients in study 1 and study 2, respectively. Depression, anxiety, and psychological well-being symptom reduction were statistically significantly greater for MBC pilot clients (P<.05).

CONCLUSIONS

Our findings support the feasibility and clinician acceptability of a rigorous MBC process in a real-world, youth-serving, remote-first, intermediate care setting. High survey completion data across both studies and improved clinician feedback over time suggest strong clinician buy-in. Client outcomes data suggest MBC is positively correlated with increased treatment completion and symptom reduction. This paper provides practical guidance for MBC implementation in IOPs and can extend to other mental health care settings.

Personal recovery self-report outcome measures in serious mental illness: A systematic review of measurement properties

BACKGROUND

Personal recovery represents a paradigm shift in mental healthcare. Validated self-report outcome measures (PROMs) are needed to facilitate the transformation towards recovery-oriented practices and services. Objectives were to identify published measures and analyze their measurement properties using a standardized methodology.

METHODS

Following the COSMIN guidelines, we conducted a systematic review of personal recovery PROMs in serious mental illness. The MEDLINE, PMC, PsycINFO, PsycARTICLES, PBSC and Scopus electronic databases were searched for articles published between May 2012 and February 2024. Full-text articles from a previous systematic review were also examined.

RESULTS

91 studies were included in the review, describing 25 PROMs. Ten of them had not been identified in previous reviews. Quality of evidence was globally poor for most PROM measurement properties. Very little evidence was found for cross-cultural validity, measurement invariance, measurement error and criterion validity. The Recovery Assessment Scale and Questionnaire about the Process of Recovery showed the strongest evidence for sufficient psychometric data on a wide range of measurement properties.

CONCLUSIONS

Several personal recovery measures are now available. While research is still needed to enhance their validity on some psychometric properties, the current tools appear sufficient to cover most research and clinical needs.

Leveraging Measurement-Based Care to Reduce Mental Health Treatment Disparities for Populations of Color

Disparities in mental health treatment have consistently been documented for clients of color as compared to White clients. Most mental health care disparities literature focuses on access to care at the point of initial engagement to treatment, resulting in a dearth of viable solutions being explored to retain clients in care once they begin. Measurement-based care (MBC) is a person-centered practice that has been shown to improve the therapeutic relationship, make treatment more personalized, and empower the client to have an active role in their care. Problems with therapeutic alliance and treatment relevance are associated with early termination for communities of color in mental health services. However, MBC has not been explored as a clinical practice to address therapeutic alliance and continual engagement for people of color seeking mental health care. This Point of View describes several MBC features that may be able to impact current sources of disparity in mental health treatment quality and provides a rationale for each. Our hope is that the field of MBC and progress feedback will more explicitly consider the potential of MBC practices to promote equity and parity in mental health services of color and will start to explore these associations empirically. We also discuss whether MBC should be culturally adapted to optimize its relevance and effectiveness for communities of color and other groups experiencing marginalization. We propose that MBC has promise to promote equitable mental health service quality and outcomes for communities of color.

A Structural Model of Organization and Clinician Factors Associated with Standardized Measure Use in a National Survey of Youth Mental Health Providers

Standardized assessment measures are important for accurate diagnosis of mental health problems and for treatment planning and evaluation. However, little is known about youth mental health providers' typical use of standardized measures across disciplines and outside the context of evidence-based practice initiatives. A multidisciplinary national survey examined the frequency with which 674 youth mental health providers administer standardized and unstandardized measures, and the extent to which organizational (i.e., implementation climate, rigid hierarchical organizational structure) and provider (i.e., attitudes toward standardized assessment measures, highest degree, practice setting) characteristics are associated with standardized measure use. Providers used unstandardized measures far more frequently than standardized measures. Providers' perceptions (a) that standardized measures are practical or feasible, (b) that their organization supports and values evidence-based practices, and (c) that their organization has a rigid hierarchical structure predicted greater use of standardized measures. Working in schools predicted less frequent SMU, while working in higher education and other professional settings predicted more frequent SMU. Standardized measures were not routinely used in this community-based sample. A rigid hierarchical organizational structure may be conducive to more frequent administration of standardized measures, but it is unclear whether such providers actually utilize these measures for clinical decision-making. Alternative strategies to promote standardized measure use may include promoting organizational cultures that value empirical data and encouraging use of standardized measures and training providers to use pragmatic standardized measures for clinical decision making.

Leveraging the Full Continuum of Care to Prevent Opioid Use Disorder

Substance use disorder prevention programs are most effective when matched appropriately to the baseline risk of the population. Individuals who misuse opioids often have unique risk profiles different from those who use other substances such as alcohol or cannabis. However, most substance use prevention programs are geared toward universal audiences, neglecting key inflection points along the continuum of care. The HEAL Prevention Cooperative (HPC) is a unique cohort of research projects that represents a continuum of care, from community-level universal prevention to indicated prevention among older adolescents and young adults who are currently misusing opioids or other substances. This paper describes the theoretical basis for addressing opioid misuse and opioid use disorder across the prevention continuum, using examples from research projects in the HPC.

Free-Association Session Scale: factor structure and preliminary validity test

One of the main concepts of the psychoanalytic method postulated by Freud in 1912 is the fundamental rule, which involves asking the patient to say whatever comes to mind as the analyst follows the patient's speech with fluctuating attention. Despite different theoretical models, this concept has remained an invariant element that characterizes the psychoanalytic method. For this reason, the purpose of the current study is to present a new instrument that measures this process based on the clinician's assessment. The Free-Association Session Scale (FASS) has been designed according to the psychoanalytic framework. Study 1 presented the preliminary validation of the FASS factor structure. Experienced Italian psychoanalysts (N = 281; 196 women) completed the FASS and sociodemographic questionnaire. The following two factors were identified using exploratory factor analysis: (1) Perturbing, and (2) Associativity. Study 2 cross-validated the two factors using an independent sample (N = 259; 187 women) of experienced psychoanalysts and confirmatory factor analysis (CFA). The FASS has been tested for concurrent validity using the Session Evaluation Questionnaire (SEQ) and Linguistic measures of the Referential process. The two-factor model achieved a close-fit test, and the FASS items were found to measure the corresponding factors with good reliability. The Perturbing factor is negatively associated with three SEQ factors (Depth, Smoothness, and Positivity) and negatively correlated with symbolization (IWRAD and IWRAD_IWRRL), confirming a more complex and unexpected session. The Associativity factor is positively associated with all four SEQ factors (Depth, Smoothness, Positivity, and Arousal). In conclusion, the FASS is a promising new questionnaire for assessing psychoanalytic session quality processes with satisfactory validity and reliability.

How patients and clinicians experience the utility of a personalized clinical feedback system in routine practice

OBJECTIVE

The objective was to explore how a person-adaptive clinical feedback system (CFS) effects its users, and how meaning and relevance are negotiated.

METHODS

We conducted a 10-month case-study of the implementation and practice of Norse Feedback, a personalized CFS. The data material consisted of 12 patient interviews, 22 clinician interviews, 23 field notes, and 16 archival documents.

RESULTS

We identified four main categories or themes: (i) patients' use of clinical feedback for enhanced awareness and insight; (ii) patients work to make clinical feedback a communication mode; (iii) patients and clinicians negotiate clinical feedback as a way to influence treatment; and (iv) clinical feedback requires an interactive sense-making effort.

CONCLUSION

Patients and therapists produced the meaning and relevance of the CFS by interpreting the CFS measures to reflect the unique patient experience of the patient-therapist relationship. Patients regarded CFS as a tool to inform therapy with important issues. Patients became more self-aware and prepared for therapy.

Idiographic patient reported outcome measures (I-PROMs) for routine outcome monitoring in psychological therapies: Position paper

Idiographic patient-reported outcome measures (I-PROMs) are a growing set of individualized tools for use in routine outcome monitoring (ROM) in psychological therapies. This paper presents a position statement on their conceptualization, use, and analysis, based on contemporary evidence and clinical practice. Four problem-based, and seven goal-based, I-PROMs, with some evidence of psychometric evaluation and use in psychotherapy, were identified. I-PROMs may be particularly valuable to the evaluation of psychological therapies because of their clinical utility and their alignment with a patient-centered approach. However, there are several challenges for I-PROMs: how to generate items in a robust manner, their measurement model, methods for establishing their reliability and validity, and the meaning of an aggregated I-PROM score. Based on the current state of the literature, we recommend that I-PROMs are used to complement nomothetic measures. Research recommendations are also made regarding the most appropriate methods for analyzing I-PROM data.

Standardized Versus Tailored Implementation of Measurement-Based Care for Depression in Community Mental Health Clinics

Objective

Measurement-based care (MBC) is an evidence-based practice that is rarely integrated into psychotherapy. The authors sought to determine whether tailored MBC implementation can improve clinician fidelity and depression outcomes compared with standardized implementation.

Methods

This cluster-randomized trial enrolled 12 community behavioral health clinics to receive 5 months of implementation support. Clinics randomized to the standardized implementation received electronic health record data captured with the nine-item Patient Health Questionnaire (PHQ-9), a needs assessment, clinical training, guidelines, and group consultation in MBC fidelity. Tailored implementation support included these strategies, but the training content was tailored to clinics’ barriers to MBC, and group consultation centered on overcoming these barriers. Clinicians (N=83, tailored; N=71, standardized) delivering individual psychotherapy to 4,025 adults participated. Adult patients (N=87, tailored; N=141, standardized) contributed data for depression outcome analyses.

Results

The odds of PHQ-9 completion were lower in the tailored group at baseline (odds ratio [OR]=0.28, 95% CI=0.08–0.96) but greater at 5 months (OR=3.39, 95% CI=1.00–11.48). The two implementation groups did not differ in full MBC fidelity. PHQ-9 scores decreased significantly from baseline (mean±SD=17.6±4.4) to 12 weeks (mean=12.6±5.9) (p<0.001), but neither implementation group nor MBC fidelity significantly predicted PHQ-9 scores at week 12.

Conclusions

Tailored MBC implementation outperformed standardized implementation with respect to PHQ-9 completion, but discussion of PHQ-9 scores in clinician-patient sessions remained suboptimal. MBC fidelity did not predict week-12 depression severity. MBC can critically inform collaborative adjustments to session or treatment plans, but more strategic system-level implementation support or longer implementation periods may be needed.

How to make the most of routine outcome monitoring (ROM): A multitude of clinical decisions and nuances to consider

Routine outcome monitoring (ROM) involves the use of patient-reported standardized outcome measures to monitor progress throughout the course of treatment, followed by feedback of the patient's scores to the therapist. The potential benefits of ROM have been established, however, from our own experiences, we know that the implementation in clinical practice can be challenging. We therefore wanted to explore in more detail exactly how we might be able to apply ROM in difficult clinical contexts. The inspiring case illustrations in this issue of Journal of Clinical Psychology: In Session highlight the heterogeneity in ROM systems, and the way in which ROM can be used in treatment. Just as there are many ways of interpreting a survey data-point, there are also many ways in which ROM may be used to complement the treatment and supervision. Whether or not ROM is implemented may partly be determined by clinic policies and routines, but there remain a multitude of clinical decisions that require careful consideration by the individual therapist. To complement the evidence supporting the benefits of using ROM, further empirical support and clinical guidance is needed on how exactly therapists are to use ROM in their work and how ROM may be used in evidence-based practice. We make suggestions for additional uses of ROM for deliberate practice, and teletherapy practice, and look toward novel ways of assessing progress in the near future.

How low can you go? Examining the effects of brief online training and post-training consultation dose on implementation mechanisms and outcomes for measurement-based care

BACKGROUND

Initial training and ongoing post-training consultation (i.e., ongoing support following training, provided by an expert) are among the most common implementation strategies used to change clinician practice. However, extant research has not experimentally investigated the optimal dosages of consultation necessary to produce desired outcomes. Moreover, the degree to which training and consultation engage theoretical implementation mechanisms-such as provider knowledge, skills, and attitudes-is not well understood. This study examined the effects of a brief online training and varying dosages of post-training consultation (BOLT+PTC) on implementation mechanisms and outcomes for measurement-based care (MBC) practices delivered in the context of education sector mental health services.

METHODS

A national sample of 75 clinicians who provide mental health interventions to children and adolescents in schools were randomly assigned to BOLT+PTC or control (services as usual). Those in BOLT+PTC were further randomized to 2-, 4-, or 8-week consultation conditions. Self-reported MBC knowledge, skills, attitudes, and use (including standardized assessment, individualized assessment, and assessment-informed treatment modification) were collected for 32 weeks. Multilevel models were used to examine main effects of BOLT+PTC versus control on MBC use at the end of consultation and over time, as well as comparisons among PTC dosage conditions and theorized mechanisms (skills, attitudes, knowledge).

RESULTS

There was a significant linear effect of BOLT+PTC over time on standardized assessment use (b = .02, p < .01), and a significant quadratic effect of BOLT+PTC over time on individualized assessment use (b = .04, p < .001), but no significant effect on treatment modification. BOLT + any level of PTC resulted in higher MBC knowledge and larger growth in MBC skill over the intervention period as compared to control. PTC dosage levels were inconsistently predictive of outcomes, providing no clear evidence for added benefit of higher PTC dosage.

CONCLUSIONS

Online training and consultation in MBC had effects on standardized and individualized assessment use among clinicians as compared to services as usual with no consistent benefit detected for increased consultation dosage. Continued research investigating optimal dosages and mechanisms of these established implementation strategies is needed to ensure training and consultation resources are deployed efficiently to impact clinician practices.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05041517 . Retrospectively registered on 10 September 2021.

Feasibility of a patient-centered method to determine meaningful change in pain intensity on a survey of patients with a history of cancer

Introduction

Current methods of determining minimally important differences (MIDs) in patient-reported outcomes (PROs) do not incorporate individual patient values.

Objectives

This study tested the feasibility of having cancer patients define a personally meaningful change in pain intensity, a method we have termed Precision PROs.

Methods

Adults with cancer and pain (n = 231) completed an electronic questionnaire twice over 2 weeks. Participants were then given their pain intensity scores with an explanation of score meaning. Participants then defined their own MIDs for an increase and decrease in pain intensity. Participants also answered 3 questions testing their understanding of the MID concept.

Results

The majority of participants could define an individually meaningful increase (97% [n = 223]) and individually meaningful decrease (98% [n = 226]) in pain intensity. Seventy-two percent of participants (n = 166) answered all test questions correctly and 26% (n = 60) answered 2 of 3 correctly. Using the individual MID, 32% (95% CI: 25.3, 40.0) of the sample experienced a meaningful change between the 2 surveys, more than other methods (z-test: 14%, 95% CI: 9.4, 20.6; distribution-based method: 24%, 95% CI: 17.7, 31.1).

Conclusions

This study showed the feasibility of the Precision PRO individual MID, which could be used in clinical care or clinical trials. Further studies are needed to compare the individual MID to current methods.

Tailoring Pain Interference Measurement in People with Cancer: A Feasibility Study

CONTEXT

Most patient-reported outcomes (PRO) are not directly tailored to an individual patient's values, partially because tailored PROs require clinical interviews or are difficult to use in statistical analyses.

OBJECTIVES

This study tested a method for tailoring pain PROs, Precision PROs, that can be implemented, and analyzed using standard statistical tests.

METHODS

People with cancer and pain (n = 231) completed an online survey and then a second survey (n = 161) one to two weeks later. Participants reviewed the PROMIS pain interference item bank, chose the four items most important to their quality of life, and then completed those items. Kappas compared choices between the two surveys. Participants completed measures of pain intensity, physical function, and a standard pain interference measure.

RESULTS

All participants were able to select four items that were personally meaningful. Only one item (enjoyment of life) was chosen by more than half the sample (50.6%). Kappas for item choice were in the moderate to nearly perfect range for 32 of 35 items. The majority of the sample (59%) preferred tailoring their own PRO questions to completing a previously determined, non-patient-specific PRO. The Precision PRO scores had similar associations with pain intensity and physical function as the standard pain interference measure.

CONCLUSION

The Precision PRO approach was feasible, more preferred by patients, and showed consistency over a short timeframe. This approach could be used to make PRO assessment in clinical care and clinical trials more patient-centered. Additional research is needed to determine the generalizability of this approach to other outcomes and populations.

Youth Top Problems and Early Treatment Response to the Unified Protocols for Transdiagnostic Treatment of Emotional Disorders in Children and Adolescents

The Top Problems assessment is an idiographic measure of client concerns that may allow clinicians to identify early treatment response. Few studies have examined early response to evidence-based therapies using Top Problems. We collected weekly Top Problems ratings from 95 youth with emotional disorders who received treatment using the Unified Protocols for Transdiagnostic Treatment of Emotional Disorders in Children and Adolescents (UP-C/UP-A). We assessed Top Problems rating change from session 1 to session 4, the role of pre-treatment variables in early Top Problems rating change, and the role of early Top Problems rating change in post-treatment symptom outcomes. Top Problems ratings decreased significantly from session 1 to session 4. Younger child age and higher parent cognitive flexibility were associated with early Top Problems improvement. Controlling for pre-treatment, early Top Problems rating change did not explain the variance in post-treatment outcomes. Future research should examine Top Problems trajectories over treatment course.

Monitoring and Measurement in Child and Adolescent Mental Health: It's about More than Just Symptoms

Routine outcome monitoring (ROM) provides information to practitioners and others providing healthcare support to demonstrate the impact of interventions and for service evaluation [...].

Within-patient perceptions of alliance and attunement: Associations with progress in psychotherapy

The most frequently examined aspect of the therapeutic relationship is the working alliance, which reflects the conscious collaborative bond, and agreement on task and goal. In addition to the established importance of the working alliance, the therapists' attunement and responsiveness might reflect another important aspect of the therapeutic relationship that can be considered in relation to session-by-session progress over treatments. Emerging research suggests that the quality of the working alliance not only differs between patients but also within patients over time. However, little is known about the quality of the therapeutic relationship between and within patients in relation to progress in psychotherapy. We examined fluctuations of the working alliance measure (WAI) and the newly developed measure of the Patients' Experiences of Attunement and Responsiveness (PEAR) during treatment in a naturalistic sample of patients in an outpatient psychotherapy clinic. Multilevel modelling was used to examine the respective contribution of these measures to subsequent improvement in psychological functioning longitudinally. Results suggest that the within-patient effect, instead of between-patient effect, was significant for WAI (and did not reach significance for PEAR), indicating that the fluctuation of WAI was predictive of psychological functioning in the subsequent month. Based on these findings, therapists and their patients might benefit from regular tracking of the patient-reported working alliance. The findings underscore the importance of the alliance, specifically at the within-patient level. It also highlights the challenge for research to tap into other aspects of the therapeutic relationship that can help explain progress in therapy. Given the breadth and accessibility of the working alliance construct, more work is needed for researchers to examine the construct of attunement and responsiveness.

Clinician perceptions of nomothetic and individualized patient-reported outcome measures in measurement-based care

Objective: Measurement-based care (MBC), which encompasses routine outcome monitoring (ROM) and measurement feedback systems (MFSs), is an evidence-based practice (EBP) supporting treatment personalization and clinical responsiveness. Despite MBC's effectiveness, clinicians report reservations regarding its utility, which may be a function of overreliance on nomothetic (i.e., standardized) measures. Although research suggests that individualized (i.e., idiographic) patient-reported outcome measures (I-PROMs) may have the potential to overcome these obstacles, little is known regarding clinicians' perceptions of different measurement approaches to MBC. Methods: This study examined clinicians' perceptions of the clinical utility, relevance to treatment planning, and practicality of nomothetic, individualized, and combined clinical feedback provided by a simulated MFS. Three hundred and twenty-nine clinicians were randomized to one of three conditions that presented a clinical vignette comprising: (a) nomothetic, (b) individualized, or (c) combined clinical feedback. Results: Participants' perceptions of the clinical feedback were not affected by the measurement approach. However, cognitive behavioral participants reported more positive perceptions of all aspects associated with the clinical feedback. Conclusion: These results were consistent with previous findings, suggesting that clinicians' theoretical orientation may have a significant impact on their perceptions of MBC, and should be considered when designing and implementing these systems.

Patient, family and provider views of measurement-based care in an early-psychosis intervention programme

Background

Measurement-based care (MBC) in mental health improves patient outcomes and is a component of many national guidelines for mental healthcare delivery. Nevertheless, MBC is not routinely integrated into clinical practice. Several known reasons for the lack of integration exist but one lesser explored variable is the subjective perspectives of providers and patients about MBC. Such perspectives are critical to understand facilitators and barriers to improve the integration of MBC into routine clinical practice.

Aims

This study aimed to uncover the perspectives of various stakeholders towards MBC within a single treatment centre.

Method

Researchers conducted qualitative semi-structured interviews with patients (n = 15), family members (n = 7), case managers (n = 8) and psychiatrists (n = 6) engaged in an early-psychosis intervention programme. Data were analysed using thematic analysis, informed by critical realist theory.

Results

Analysis converged on several themes. These include (a) implicit negative assumptions; (b) relevance and utility to practice; (c) equity versus flexibility; and (d) shared decision-making. Providers assumed patients’ perspectives of MBC were negative. Patients’ perspectives of MBC were actually favourable, particularly if MBC was used as an instrument to engage patients in shared decision-making and communication rather than as a dogmatic and rigid clinical decision tool.

Conclusions

This qualitative study presents the views of various stakeholders towards MBC, providing an in-depth examination of the barriers and facilitators to MBC through qualitative investigation. The findings from this study should be used to address the challenges organisations have experienced in implementing MBC.

A comparison of oncologist versus mental health provider attitudes towards standardized and tailored patient-reported outcomes

BACKGROUND

Patient-reported outcomes (PROs) can be used to monitor patients during treatment. Healthcare provider preferences for individualized vs. standardized PROs have been understudied.

METHODS

This study surveyed oncology and mental health providers to compare attitudes towards individualized and standardized PROs. We have developed a method for individualizing PROs, called precision PROs, and the survey specifically assessed preferences for this method. We compared attitudes and preferences by provider type and by whether respondents were current or never users of PROs.

RESULTS

Oncology providers expressed more positive attitudes for standardized PROs in treatment planning compared to mental health providers (F(1,440) = 5.978, p = 0.015). The interaction between provider type (oncology vs. mental health) and type of PRO (individualized vs. standardized) was not significant for the attitudes about the clinical utility of PROs (p = 0.709). When directly asked about the precision PRO approach, oncologists were less likely to prefer standardized items (OR = 0.478, p = 0.001) or have no preference (OR = 0.445, p = 0.007) to the precision PRO approach when compared to mental health providers. Qualitative analyses suggested standardized PROs may be simpler or easier to understand whereas individualized PROs better capture patient variability and the unique aspects of each patient's condition. Some mental health providers expressed reticence about letting patients choose how to tailor PROs. Never users of PROs reported more positive attitudes towards individualized measures than standardized measures whereas current users of PROs did not have a difference in attitudes (p = 0.010). User status was mostly unrelated to preferences.

CONCLUSION

Results suggest that healthcare provider preference for individualized PROs may differ by medical specialty. How PROs are tailored may need to differ by discipline. This is particularly important given that previous research showing a preference for individualized PROs over standardized was conducted with psychotherapists. Further research on patient preferences for individualized and standardized PROs is warranted as is research on the clinical utility of individualized PROs such as the precision PRO approach.

Improving the Quality of Children's Mental Health Care with Progress Measures: A Mixed-Methods Study of PCIT Therapist Attitudes

Progress measures are an evidence-based technique for improving the quality of mental health care, however, clinicians rarely incorporate them into treatment. Research into how measure type impacts clinician preference has been recommended to help improve measure implementation. Parent–Child Interaction Therapy (PCIT) is an assessment-driven treatment that serves as an ideal intervention through which to investigate measure preferences given its routine use of two types of assessments, a behavioral observation (the Dyadic Parent–Child Interaction Coding System) and a parent-report measure (the Eyberg Child Behavior Inventory). This study investigated PCIT therapist attitudes towards progress measures used within PCIT and children’s mental health treatment generally. A mixed-method (QUAN + QUAL) study design examined PCIT therapist attitudes towards two types of progress measures and measures used in two contexts (PCIT and general practice). Multi-level modeling of a survey distributed to 324 PCIT therapists identified predictors of therapist attitudes towards measures, while qualitative interviews with 23 therapists expanded and clarified the rationale for differing perceptions. PCIT therapists reported more positive attitudes towards a behavioral observation measure, the DPICS, than a parent-report measure, the ECBI, and towards measures used in PCIT than in general practice. Clinician race/ethnicity was significantly related to measure-specific attitudes. Qualitative interviews highlighted how perceptions of measure reliability, type of data offered, ease of use, utility in guiding sessions and motivating clients, and embeddedness in treatment protocol impact therapist preferences. Efforts to implement progress monitoring should consider preferences for particular types of measures, as well as how therapists are trained to embed measures in treatment.

How therapists and patients need to develop a clinical feedback system after 18 months of use in a practice-research network: a qualitative study

BACKGROUND

A personalized computer-adaptive system for clinical feedback and routine outcome monitoring in mental health, Norse Feedback aims to bridge the needs for standardized and idiographic measures in ordinary practice.

METHODS

Item response theory analyses of completed treatment processes (n = 800) informed a qualitative study comprising individual in-depth interviews and focus groups with patients (n = 9) and clinicians (n = 10). The research question was: How do clinicians and patients contribute to developing a clinical feedback system in a continuous process aimed at refining its clinical usefulness?

RESULTS

We conducted thematic analyses and found five themes: 1. Added clinical needs, 2. Needs for re-organizing the clinician report, 3.Needs for differentiation of clinical content, 4. User-interface needs, and 5. Item level suggestions.

CONCLUSION

In this article, we detail resulting needs for continuous adaptation to practice, and discuss implications of the concrete experiences with the Norse action research program for the larger field of ROM/CFS implementation.

Illustrating the Applicability of IRT to Implementation Science: Examining an Instrument of Therapist Attitudes

Pragmatic instruments with psychometric support are important to advance dissemination and implementation (D&I) research, but few well-researched D&I instruments exist. Item response theory (IRT), an approach that is underutilized in D&I, can help with the development of actionable and brief instruments. This paper provides an overview of IRT for D&I researchers and examines an instrument of therapist attitudes using IRT measurement models. Eight items of the Attitudes Towards Individualized Assessment-Monitoring and Feedback (AIA-MF) Clinical Utility scale were fit to the Graded Response Model in a national sample of master's level therapists. Various IRT model characteristics including item threshold and discrimination parameters, information, and item and person fit were examined. Discrimination and thresholds parameters showed significant variability across the eight items. Item information curves also showed that each item contributed variably to the total test information, suggesting that items 4 and 5 reliably measure therapist attitudes across the latent continuum and items 3 and 6 warrant further investigation. Results suggest that IRT models can help D&I researchers examine existing instruments with greater specificity than traditional measurement methods, thus increasing measurement precision while lowering response burden, both important considerations for the field.

Implementing Measurement-Based Care for Depression: Practical Solutions for Psychiatrists and Primary Care Physicians

Measurement-based care (MBC) can be defined as the clinical practice in which care providers collect patient data through validated outcome scales and use the results to guide their decision-making processes. Despite growing evidence supporting the effectiveness of MBC for depression and other mental health conditions, many physicians and mental health clinicians have yet to adopt MBC practice. In part, this is due to individual and organizational barriers to implementing MBC in busy clinical settings. In this paper, we briefly review the evidence for the efficacy of MBC focusing on pharmacological management of depression and provide example clinical scenarios to illustrate its potential clinical utility in psychiatric settings. We discuss the barriers and challenges for MBC adoption and then address these by suggesting simple solutions to implement MBC for depression care, including recommended outcome scales, monitoring tools, and technology solutions such as cloud-based MBC services and mobile health apps for mood tracking. The availability of MBC tools, ranging from paper-pencil questionnaires to mobile health technology, can allow psychiatrists and clinicians in all types of practice settings to easily incorporate MBC into their practices and improve outcomes for their patients with depression.

Introducing a Measurement Feedback System for Youth Mental Health: Predictors and Impact of Implementation in a Community Agency

Measurement feedback systems (MFSs) that routinely collect and report client progress to mental health therapists have demonstrated beneficial impact on outcomes in numerous studies, with evidence that there is a dose-response relationship related to the implementation of the MFS. The current study examined the impact of MFS implementation (Implementation Index) on youth symptom outcomes separately by caregiver and youth self-report. Additionally, we tested the extent to which Implementation Index rates varied by individual therapists and clients, and whether therapist and client characteristics predicted MFS implementation. Methods: Administrative data (client charts, youth- and caregiver-reported Youth Outcome Questionnaires) for 229 youth (52.83% Latinx, 42.79% girls, M age = 10.33) treated during a 1-year period at a community mental health organization in Central Texas were analyzed using multi-level modeling. Caregiver-reported symptoms decreased faster for those with a higher MFS Implementation Index. Between-group differences among therapists accounted for a significant proportion of variance in the Implementation Index for caregiver report, whereas client differences accounted for most of the variance in the Implementation Index for youth self-report. Therapist trainee status predicted a significant increase in the Implementation Index for caregiver-report data. Youth symptom improvement as reported by caregivers varied with the extent of MFS implementation fidelity, and MFS implementation fidelity was higher for clients treated by trainees relative to staff therapists for caregiver report of symptoms.

What Gets Measured Gets Done: How Mental Health Agencies can Leverage Measurement-Based Care for Better Patient Care, Clinician Supports, and Organizational Goals

Mental health clinicians and administrators are increasingly asked to collect and report treatment outcome data despite numerous challenges to select and use instruments in routine practice. Measurement-based care (MBC) is an evidence-based practice for improving patient care. We propose that data collected from MBC processes with patients can be strategically leveraged by agencies to also support clinicians and respond to accountability requirements. MBC data elements are outlined using the Precision Mental Health Framework (Bickman et al. in Adm Policy Mental Health Mental Health Serv Res 43:271-276, 2016), practical guidance is provided for agency administrators, and conceptual examples illustrate strategic applications of one or more instruments to meet various needs throughout the organization.

Strategies to enhance communication with telemental health measurement-based care (tMBC)

Telehealth has always held great promise to increase access to mental health care, never more so than in the age of COVID-19, when clients can't or won't come to the clinician's physical location. A feasible and effective alternative to traditional in-person care, telemental health requires that clinicians adopt new strategies to build and maintain communication and the therapeutic relationship. This can be particularly troublesome for clinicians new to the modality, who may feel the loss of the "in-session" experience more acutely. As an evidence-based practice that is transtheoretical and transdiagnostic, telemental health measurement-based care (tMBC) is the ideal complement to enhance systematic ongoing monitoring, treatment engagement, and therapeutic alliance in the context of the virtual encounter. While tMBC mechanisms of actions are still being explored, there is promising evidence that tMBC improves clinician responsivity to acute client concerns. By using client-reported measures, tMBC provides an important pathway for clients to systematically communicate with their clinicians, which can guide therapeutic actions and contribute to shared understanding. This brief report summarizes the evidence for tMBC as a patient-centered communication tool and provides recommendations for evidence-based and practice-informed strategies to integrate tMBC into telehealth solutions, with suggestions for monitoring new concerns related to the COVID-19 crisis.

Individualised or Standardised Outcome Measures: A Co-habitation?

Mental health outcome measurement is conflicted between two different schools of thought which underlie the division between standardised (nomothetic) and individualised or patient-generated (idiographic) measures. The underpinning philosophies of both approaches have very different starting points in terms of how we understand the world. And yet the strengths of both may contribute something useful for patients and mental health services. We suggest a convergence of approaches with new thinking on options for co-habitation.

What Motivates Mental Health Clinicians-in-Training to Implement Evidence-Based Assessment? A Survey of Social Work Trainees

Mental health clinicians do not consistently use evidence-based assessment (EBA), a critical component of accurate case conceptualization and treatment planning. The present study used the Unified Theory of Behavior to examine determinants of intentions to use EBA in clinical practice among a sample of Masters' level social work trainees (N = 241). Social norms had the largest effect on intentions to use EBA. Injunctive norms in reference to respected colleagues accounted for the most variance in EBA intentions. Findings differed for respondents over 29 years of age versus younger respondents. Implications for implementation strategies and further research are discussed.

Individualized and Standardized Outcome Measures: Further Arguments in Favor of Cohabitation

Ashworth et al. (Admin Policy Ment Health Ment Health Serv Res 46:425-428, 2019) recently published a paper in this journal making a cogent argument for the cohabitation of standardized and individualized outcome measures. In the present Point of View article, we consider additional arguments in favor of this cohabitation.

Evidence Base Update for Brief, Free, and Accessible Youth Mental Health Measures

Evidence-based assessment (EBA) is foundational to high-quality mental health care for youth and is a critical component of evidence-based practice delivery, yet is underused in the community. Administration time and measure cost are barriers to use; thus, identifying and disseminating brief, free, and accessible measures are critical. This Evidence Base Update evaluates the empirical literature for brief, free, and accessible measures with psychometric support to inform research and practice with youth. A systematic review using PubMed and PsycINFO identified measures in the following domains: overall mental health, anxiety, depression, disruptive behavior, traumatic stress, disordered eating, suicidality, bipolar/mania, psychosis, and substance use. To be eligible for inclusion, measures needed to be brief (50 items or less), free, accessible, and have psychometric support for their use with youth. Eligible measures were evaluated using adapted criteria established by De Los Reyes and Langer (2018) and were classified as having excellent, good, or adequate psychometric properties. A total of 672 measures were identified; 95 (14%) met inclusion criteria. Of those, 21 (22%) were "excellent," 34 (36%) were "good," and 40 (42%) were "adequate." Few measures had support for their use to routinely monitor progress in therapy. Few measures with excellent psychometric support were identified for disordered eating, suicidality, psychosis, and substance use. Future research should evaluate existing measures for use with routine progress monitoring and ease of implementation in community settings. Measure development is needed for disordered eating, suicidality, psychosis, and substance use to increase availability of brief, free, accessible, and validated measures.

How Routine Patient-Centered Monitoring Relates to Therapeutic Gains in Family Therapy: A Single-Case Study

As routine outcome monitoring systems develop, questions emerge about how therapists incorporate feedback into their practice, and how this relates to therapeutic gains. A case of covert grief was monitored in each session with the Personal Questionnaire and the Helpful Aspects of Therapy instruments. At 4 months follow-up, the Change Interview was administered. Individualized items facilitated access to the private views and needs of each member, which was useful for case formulation and ongoing personalization of the intervention. Qualitative feedback of treatment experiences helped therapists confirm the impacts of interventions, monitor therapeutic alliance, reformulate clinical hypothesis, and plan sessions. Therapists followed a critical triangulation process to decide the clinical meaning of feedback, according to his/her intervention model, expertise, and case-specific context.

Attitudes toward standardized assessment tools and their use among clinicians in a public mental health service

The aim of the present study was to investigate the use and attitudes toward standardized assessment tools among clinicians in a public mental health service in Norway. A total of 606 clinicians provided feedback on their use and attitudes regarding psychometric qualities of such tools, their practicality, and their benefit over clinical judgment alone using the Attitudes toward Standardized Assessment (ASA) Scales. Clinicians working in the adult mental health field scored significantly higher on use of diagnostic interviews, pre-post evaluations, and ongoing evaluations, whereas clinicians working in the child/adolescent mental health field scored significantly higher on use of screening instruments and held more positive attitudes towards using standardized assessment tools. Attitudes toward standardized assessment tools predicted use of such tools, and results were found to be similar to a study on US clinicians. Whereas the US study only found attitudes regarding the practicality of using such instrument as an independent predictor of assessment use, the current study found that attitudes regarding psychometric qualities of such tools, their practicality, and their benefit over clinical judgment alone were independent predictors of use.