Community Study of Outcome Monitoring for Emotional Disorders in Teens (COMET): A comparative effectiveness trial of a transdiagnostic treatment and a measurement feedback system

A collaborative realist review of remote measurement technologies for depression in young people

Digital mental health is becoming increasingly common. This includes use of smartphones and wearables to collect data in real time during day-to-day life (remote measurement technologies, RMT). Such data could capture changes relevant to depression for use in objective screening, symptom management and relapse prevention. This approach may be particularly accessible to young people of today as the smartphone generation. However, there is limited research on how such a complex intervention would work in the real world. We conducted a collaborative realist review of RMT for depression in young people. Here we describe how, why, for whom and in what contexts RMT appear to work or not work for depression in young people and make recommendations for future research and practice. Ethical, data protection and methodological issues need to be resolved and standardized; without this, RMT may be currently best used for self-monitoring and feedback to the healthcare professional where possible, to increase emotional self-awareness, enhance the therapeutic relationship and monitor the effectiveness of other interventions.

External and Internal Validity Considerations in Youth Effectiveness Trials: Lessons Learned from the COMET Study

OBJECTIVE

Effectiveness trials aim to increase the generalizability and public health impact of interventions. However, challenges associated with this design present threats to external and internal validity. This paper illustrates these challenges using data from a two-site randomized effectiveness trial, the Community Study of Outcome Monitoring for Emotional Disorders in Teens (COMET) and presents recommendations for future research.

METHOD

COMET was a randomized effectiveness trial conducted in 19 community mental health clinics in two states comparing three interventions: treatment as usual (TAU), TAU with measurement-based care (TAU+), and the Unified Protocol forTransdiagnostic Treatment of Emotional Disorders in Adolescents with MBC (UPA). Participants included 176 clinicians (mean age = 35.5; 85.8% cisgender female; 53.0% racially and/or ethnically minorized) and 196 adolescents (mean age = 14.7; 65.3% cisgender female; 69.4% racially and/or ethnically minorized). Analyses outlined participant flow from recruitment to study completion, described participant characteristics, and examined site differences.

RESULTS

Analysis of participant flow suggested that recruitment and retention of clinicians and adolescents was challenging, raising questions about whether participants were representative of participating clinics. Both the clinician and adolescent samples were racially and ethnically diverse and adolescents were low income and clinically complex. Significant site differences were observed in clinician and adolescent characteristics.

CONCLUSIONS

While this study was successful in recruiting a diverse and historically under-represented sample, difficulties in recruitment and retention raise questions about external validity and site differences present challenges to internal validity of study findings. Suggestions for future effectiveness studies, drawing from implementation science approaches, are discussed.

Treatment Engagement in Adolescents: The Associations of Sociodemographic Characteristics, Caregiver Perceived Barriers, and Clinical Impairment

OBJECTIVE

To examine the associations between sociodemographic characteristics, perceived barriers to treatment, clinical impairment, and youth treatment engagement.

METHOD

Participants included 196 families (youth: ages 12 to 18; 64.3% cis-gender female; 23.5% Black, 60.7% White, and 12.2% Mixed/Other race; 41.3% Hispanic or Latinx ethnicity) recruited as part of a comparative effectiveness trial for adolescent anxiety and depression. Self-report measures of sociodemographic characteristics and caregiver perceived barriers were completed at intake. Youth clinical impairment was assessed at baseline via clinical interview. Measures of engagement were collected throughout treatment, including initiation status, session attendance, and termination status. Relationships were examined using analyses of variances and hierarchal linear and logistic modeling.

RESULTS

Perceived barriers did not differ by sociodemographic characteristics. Greater perceived stressors and obstacles predicted fewer sessions attended and a lower likelihood of successful termination. Youth of caregivers with an advanced degree and those with caregivers who were employed part time attended more sessions and were more likely to initiate and terminate treatment successfully compared to youth with caregivers of a lower education level or student or unemployed status. At higher levels of youth clinical impairment, greater perceived treatment demands and issues predicted reduced likelihood of treatment initiation.

CONCLUSIONS

Perceived barriers, sociodemographic characteristics, and clinical impairment were all associated with levels of engagement in the treatment process. Baseline and continued assessment of perceived and experienced barriers to treatment may promote individualized strategies for families identified as at-risk for reduced engagement.

Characterizing measurement-based care implementation using therapist report

The effectiveness of measurement-based care (MBC), an evidence-based practice that uses regularly collected assessment data to guide clinical decision-making, is impacted by whether and how therapists use information from MBC tools in treatment. Improved characterization of how therapists use MBC in treatment sessions with youth is needed to guide implementation and understand variability in MBC effectiveness. To meet this need, this study examined therapists' sharing and discussion of MBC in treatment sessions. Thirty therapists were randomly assigned to the MBC condition as part of a comparative effectiveness trail of treatments for adolescent anxiety and depression. A qualitative content analysis was conducted on therapists' written explanations of changes made to the session based on the MBC data. Therapists reported sharing data with youth and caregivers in an average of 34.6% and 27.4% of sessions, respectively. Therapists reported incorporating MBC data in an average of 21.1% of sessions. When data were used, therapists predominately focused changes on short-term (e.g., current symptoms, treatment skill) rather than long-term (e.g., symptom progress, treatment goals) decision-making. Therapists inconsistently used MBC data, highlighting the need for improved training in and monitoring of how therapists use MBC in session to guide collaborative treatment decision-making with youth and caregivers.

Long-term effectiveness and trajectories of change after treatment with SMART, a transdiagnostic CBT for adolescents with emotional problems

Background

There is a need for long-term effectiveness trials of transdiagnostic treatments. This study investigates the effectiveness and diagnosis-specific trajectories of change in adolescent patients attending SMART, a 6-week transdiagnostic CBT for anxiety and depression, with 6-month follow-up.

Methods

A randomized controlled trial with waiting list control (WLC) was performed at three child and adolescent mental health outpatient services (CAMHS) in Norway. Referred adolescents (N = 163, age = 15.72, 90.3% females) scoring 6 or more on the emotional disorders subscale of the Strengths and Difficulties Questionnaire (SDQ) were randomly assigned to treatment or to WLC. Long-term follow-up (N = 83, baseline age = 15.57, 94% females) was performed 6 months after treatment completion (Mean = 7.1 months, SD = 2.5). Linear mixed model analysis was used to assess time by group effects in patients with no diagnosis, probable anxiety, depressive disorder, and combined anxiety and depressive disorder.

Results

Almost one third (31%) obtained full recovery according to the inclusion criterium (SDQ emotional). There was highly significant change in all outcome variables. Effect sizes (ES) were largest for general functioning, measured with CGAS (ES: d = 2.19), and on emotional problems measured with SDQ (ES: d = 2.10), while CORE-17, BDI-II and CGAS all obtained ES’s close to 1. There were no significant time by diagnostic group interactions for any outcomes, indicating similar trajectories of change, regardless of diagnostic group. Waiting 6 weeks for treatment had no significant impact on long-term treatment effects.

Limitations

Possible regression to the mean. Attrition from baseline to follow-up.

Conclusions

Six weeks of transdiagnostic treatment for adolescents with emotional problems showed highly significant change in emotional symptoms and functioning at 6-month follow-up. Patients with anxiety, depression, combined anxiety and depression, and emotional problems with no specific diagnoses, all had similar trajectories of change. Hence this transdiagnostic SMART treatment can be recommended for adolescent patients with symptoms within the broad spectrum of emotional problems.

Trial registration: ClinicalTrials.gov Identifier: NCT02150265. First registered May 29, 2014.

WHO Participates in Effectiveness Research? A Comparison of Effectiveness Trial Clinicians to National Survey Samples

Findings from research participants in effectiveness treatment trials (i.e., randomized control trials conducted in community rather than research settings) are considered more generalizable than those from participants in efficacy trials. This is especially true for clinician participants, whose characteristics like attitudes towards evidence-based practices (EBPs) may impact treatment implementation and the generalizability of research findings from effectiveness studies. This study compared background characteristics, attitudes toward EBPs, and attitudes towards measurement-based care (MBC) among clinicians participating in a National Institute of Mental-Health (NIMH) funded effectiveness trial, the Community Study of Outcome Monitoring for Emotional Disorders in Teens (COMET), to clinician data from nationally representative U.S. survey samples. Results indicated COMET clinicians were significantly younger, less clinically experienced, and were more likely to have a training background in psychology versus other disciplines compared to national survey samples. After controlling for demographics and professional characteristics, COMET clinicians held more positive attitudes towards EBPs and MBC compared to national survey samples. Implications for implementation efforts are discussed.

Psychological Treatments for Depression in Adolescents: More Than Three Decades Later

Depression is a common and impairing disorder which is a serious public health problem. For some individuals, depression has a chronic course and is recurrent, particularly when its onset is during adolescence. The purpose of the current paper was to review the clinical trials conducted between 1980 and 2020 in adolescents with a primary diagnosis of a depressive disorder, excluding indicated prevention trials for depressive symptomatology. Cognitive behavioral therapy (CBT) is the pre-eminent treatment and is well established from an evidence-based treatment perspective. The body of research on the remaining treatments is smaller and the status of these treatments is varied: interpersonal therapy (IPT) is well established; family therapy (FT) is possibly effective; and short-term psychoanalytic therapy (PT) is experimental treatment. Implementation of the two treatments that work well-CBT and IPT-has more support when provided individually as compared to in groups. Research on depression treatments has been expanding through using transdiagnostic and modular protocols, implementation through information and communication technologies, and indicated prevention programs. Despite significant progress, however, questions remain regarding the rate of non-response to treatment, the fading of specific treatment effects over time, and the contribution of parental involvement in therapy.

Measurement-based care as a practice improvement tool: Clinical and organizational applications in youth mental health

Measurement-based care (MBC) is systematic, ongoing assessment to monitor treatment progress and inform clinical decision-making. MBC is considered an evidence-based practice, with extensive research support in adult clinical populations and emerging evidence in youth populations. This paper describes both clinical (e.g., enhancing therapy alliance, informing case conceptualization) and organizational (e.g., informing quality improvement efforts) applications of MBC, and illustrates the clinical applications through two case examples from publicly-funded mental health agency settings. The paper concludes by detailing future research needed to enhance the clinical and organizational utility of MBC.

Evidence Base Update for Brief, Free, and Accessible Youth Mental Health Measures

Evidence-based assessment (EBA) is foundational to high-quality mental health care for youth and is a critical component of evidence-based practice delivery, yet is underused in the community. Administration time and measure cost are barriers to use; thus, identifying and disseminating brief, free, and accessible measures are critical. This Evidence Base Update evaluates the empirical literature for brief, free, and accessible measures with psychometric support to inform research and practice with youth. A systematic review using PubMed and PsycINFO identified measures in the following domains: overall mental health, anxiety, depression, disruptive behavior, traumatic stress, disordered eating, suicidality, bipolar/mania, psychosis, and substance use. To be eligible for inclusion, measures needed to be brief (50 items or less), free, accessible, and have psychometric support for their use with youth. Eligible measures were evaluated using adapted criteria established by De Los Reyes and Langer (2018) and were classified as having excellent, good, or adequate psychometric properties. A total of 672 measures were identified; 95 (14%) met inclusion criteria. Of those, 21 (22%) were "excellent," 34 (36%) were "good," and 40 (42%) were "adequate." Few measures had support for their use to routinely monitor progress in therapy. Few measures with excellent psychometric support were identified for disordered eating, suicidality, psychosis, and substance use. Future research should evaluate existing measures for use with routine progress monitoring and ease of implementation in community settings. Measure development is needed for disordered eating, suicidality, psychosis, and substance use to increase availability of brief, free, accessible, and validated measures.

Patterns and predictors of compliance with utilization management guidelines supporting a state policy to improve the quality of youth mental health services

Despite a need to improve community mental health services for youths, little is known about compliance with state policies created to improve the quality of services in these settings. This study examined rates, patterns, and predictors of compliance with utilization management guidelines developed by the state of Texas to support a public health policy based on empirical evidence of effective mental health services (i.e., an evidence-based policy). Compliance was defined as authorizing policy-recommended service packages, whereas policy "overrides" occurred when recommended service packages were not authorized. The study sample consisted of 688 youths from ethnically and economically diverse backgrounds. Clinics reported that forty-six percent of youths were not authorized the policy-recommended service package. Overrides were primarily based on level of intensity. Most often, authorized services were less intensive than those recommended by the state guidelines. Higher severity at intake across multiple indicators was associated with authorizing less intensive services than what the policy guidelines recommended. Future studies evaluating system-level efforts such as state mental health policies should pay close attention to levels of service intensity, and their relation to the needs of youth in community settings.