Using a Brief Parent-Report Measure to Track Outcomes for Children and Teens with Internalizing Disorders

A Family-Based Mental Health Navigator Intervention for Youth in the Child Welfare System: Protocol for a Randomized Controlled Trial

BACKGROUND

Youth in the child welfare system (child welfare-involved [CWI] youth) have high documented rates of mental health symptoms and experience significant disparities in mental health care services access and engagement. Adolescence is a developmental stage that confers increased likelihood of experiencing mental health symptoms and the emergence of disorders that can persist into adulthood. Despite a high documented need for evidence-based mental health services for CWI youth, coordination between child welfare and mental health service systems to increase access to care remains inadequate, and engagement in mental health services is low. Navigator models developed in the health care field to address challenges of service access, fragmentation, and continuity that affect the quality of care provide a promising approach to increase linkage to, and engagement in, mental health services for CWI youth. However, at present, there is no empirically supported mental health navigator model to address the unique and complex mental health needs of CWI youth and their families.

OBJECTIVE

Using a randomized controlled trial, this study aims to develop and test a foster care family navigator (FCFN) model to improve mental health service outcomes for CWI adolescents (aged 12-17 years).

METHODS

The navigator model leverages an in-person navigator and use of adjunctive digital health technology to engage with, and improve, care coordination, tracking, and monitoring of mental health service needs for CWI youth and families. In total, 80 caregiver-youth dyads will be randomized to receive either the FCFN intervention or standard of care (clinical case management services): 40 (50%) to FCFN and 40 (50%) to control. Qualitative exit interviews will inform the feasibility and acceptability of the services received during the 6-month period. The primary trial outcomes are mental health treatment initiation and engagement. Other pre- and postservice outcomes, such as proportion screened and time to screening, will also be evaluated. We hypothesize that youth receiving the FCFN intervention will have higher rates of mental health treatment initiation and engagement than youth receiving standard of care.

RESULTS

We propose enrollment of 80 dyads by March 2024, final data collection by September 2024, and the publication of main findings in March 2025. After final data analysis and writing of the results, the resulting manuscripts will be submitted to journals for dissemination.

CONCLUSIONS

This study will be the first to produce empirically driven conclusions and recommendations for implementing a family mental health navigation model for CWI youth with long-standing and unaddressed disparities in behavioral health services access. The study findings have potential to have large-scale trial applicability and be feasible and acceptable for eventual system implementation and adoption.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04506437; https://www.clinicaltrials.gov/study/NCT04506437.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/49999.

Mental health symptoms of youth initiating psychiatric care at different phases of the COVID-19 pandemic

OBJECTIVE

To examine differences in caregiver and youth reported mental health symptoms for youth initiating mental health treatment through phases of the Coronavirus Disease (COVID-19) pandemic, compared with symptomology reported the prior year.

STUDY DESIGN

This retrospective study analyzes group differences in mental health symptoms (Pediatric Symptom Checklist; PSC-35) based on 7874 youth seeking treatment in publicly funded mental health treatment programs during California's Stay-At-Home order (March-May, 2020) and the prolonged pandemic (May-December, 2020) phases of the COVID-19 pandemic as compared with matching groups in 2019.

RESULTS

Youth entering mental health treatment services, and their caregivers, reported significantly increased internalizing, externalizing, and attention-related symptoms during the prolonged pandemic phase, but not during the acute stay-at-home phase of the COVID-19 pandemic, and with small effect sizes. Group comparison analyses did not detect a significantly larger effect for Sexual and Gender Diverse (SGD) youth who identify as lesbian, gay, bisexual, asexual, transgender, Two-Spirit, queer, and/or intersex, and Black, Indigenous, People of Color (BIPOC).

CONCLUSIONS

A large-scale comparison of youth mental health symptoms before and during the COVID-19 pandemic suggests that mental health was disrupted for youth seeking treatment as the pandemic prolonged throughout 2020.

Screening, Monitoring, and Referral to Treatment for Young Adolescents at an Urban School-Based Health Center

BACKGROUND

This study describes the experience of implementing a screening, monitoring, and referral to treatment (SMARTT) initiative at an urban middle school school-based health center.

METHODS

Retrospective data were collected for adolescents screened with the Pediatric Symptom Checklist-17-Y. At-risk adolescents having unmet health needs were offered a mental health referral, and those that declined a mental health referral were offered a primary care monitoring (PCM) visit with the medical provider. Chi-square analyses were used to evaluate differences in screening and outcomes by age, sex, and race/ethnicity.

RESULTS

One out of four adolescents had a positive PSC-17-Y or negative screen with other identified concerns. Approximately half of these at-risk adolescents accepted a mental health referral, and 86% of those who declined agreed to the PCM visit. More than two-thirds of the PCM group did not need continued monitoring and support at follow-up, and 85.4% of youth who had a mental health assessment accepted mental health services.

CONCLUSIONS

The SMARTT initiative successfully demonstrated that co-located and integrated mental health services can enhance access and connection to mental health services for at-risk youth. In addition, PCM visits were found to be an effective option for youth who declined mental health referrals.

Overview of Ten Child Mental Health Clinical Outcome Measures: Testing of Psychometric Properties with Diverse Client Populations in the U.S

While many standardized assessment measures exist to track child mental health treatment outcomes, the degree to which such tools have been adequately tested for reliability and validity across race, ethnicity, and class is uneven. This paper examines the corpus of published tests of psychometric properties for the ten standardized measures used in U.S. child outpatient care, with focus on breadth of testing across these domains. Our goal is to assist care providers, researchers, and legislators in understanding how cultural mismatch impacts measurement accuracy and how to select tools appropriate to the characteristics of their client populations. We also highlight avenues of needed research for measures that are in common use. The list of measures was compiled from (1) U.S. state Department of Mental Health websites; (2) a survey of California county behavioral health agency directors; and (3) exploratory literature scans of published research. Ten measures met inclusion criteria; for each one a systematic review of psychometrics literature was conducted. Diversity of participant research samples was examined as well as differences in reliability and validity by gender, race or ethnicity, and socio-economic class. All measures showed adequate reliability and validity, however half lacked diverse testing across all three domains and all lacked testing with Asian American/Pacific Islander and Native American children. ASEBA, PSC, and SDQ had the broadest testing.

Self-Report Rating Scales to Guide Measurement-Based Care in Child and Adolescent Psychiatry

Measurement-based care involves the practice of systematically administrating rating scales to patients in order to use the collected information to enhance clinical evaluation, monitor treatment progress, and directly inform decisions relating to each patient's treatment. Rating scales must be psychometrically validated and efficiently administered within the practice setting. Brief rating scales that are available within the public domain may help to optimize workflows and prevent response fatigue. Clinicians should also have a sufficient understanding of the underlying psychometric properties of rating scales to accurately interpret changes in scores over time and use these results to appropriately direct care.

Systematic Review and Meta-analysis: Outcomes of Routine Specialist Mental Health Care for Young People With Depression and/or Anxiety

OBJECTIVE

Depression and anxiety are the most prevalent mental health problems in youth, yet almost nothing is known about what outcomes are to be expected at the individual level following routine treatment. This paper sets out to address this gap by undertaking a systematic review of outcomes following treatment as usual (TAU) with a particular focus on individual-level outcomes.

METHOD

MEDLINE, Embase and PsycInfo were searched for articles published between 1980 and January 2019 that assessed TAU outcomes for youth depression and anxiety accessing specialist mental health care. Meta-analysis considered change at both group-level pre-post effect size (ES) and individual-level recovery, reliable change, and reliable recovery. Temporal analysis considered stability of primary and secondary outcomes over time. Subgroup analysis considered the moderating effect of informant; presenting problem; study design; study year; mean age of youth; use of medication; intervention dosage and type of treatment offered on outcomes. A protocol was preregistered on PROSPERO (CRD42017063914).

RESULTS

Initial screening of 6,350 publications resulted in 38 that met the inclusion criteria, and that were subsequently included in meta-analyses. This resulted in a final full pooled sample of 11,739 young people (61% of whom were female, mean age 13.8 years). The pre-post ES (Hedges' g) at first/final outcome (13/26 weeks) was -0.74/-0.87. The individual-level change on measures of self-report was 38% reliable improvement, 44% no reliable change, and 6% reliable deterioration. Outcomes varied according to moderators, informant, problem type and dosage.

CONCLUSION

Poor data quantity and quality are limitations, but this is the first study that indicates likely rates of reliable improvement for those accessing TAU. We propose the need for improved reporting of both individual-level metrics and details of TAU to enable greater understanding of likely current outcomes from routine care for youths with depression and anxiety in order to allow the potential for further improvement of impact.

Measurement Based Care in Child Welfare-Involved Children and Youth: Reliability and Validity of the PSC-17

This study evaluates whether the psychometric properties of the Pediatric Symptoms Checklist-17 (PSC-17), a common behavioral health measure typically used as a dichotomous screening tool for mental health needs, support its use as a continuous measure for tracking behavioral health over time. A total of 6492 foster parents of children and youth aged 5.5-17 completed the PSC-17. Convergent and discriminant validity was assessed by comparing raw PSC-17 subscale scores with associated outcomes (e.g. psychiatric diagnoses). Long-term test-retest reliability was assessed over 6 months. Scores on the PSC-17 demonstrated good convergent and divergent validity. PSC-17 subscale scores were most strongly associated with analogous diagnoses. Test-retest reliability was moderate, as expected for a time window of this length. This study provides moderate support for the psychometric qualities of the PSC-17 when used with children and youth in the child welfare system as a continuous measure of psychosocial functioning over time.

Changes in psychosocial health during a 7-week paediatric weight management program

Youth with obesity are at increased risk of psychosocial symptoms; however, little is known regarding the impact of paediatric weight management (PWM) on psychosocial health. The aim of the study was to investigate changes in psychosocial health among children who completed a 7-week PWM program. Participants aged 5 to 16 years with a BMI ≥85th percentile completed a 7-week, family-centred PWM program focused on health behaviour education, exercise and mentored goal setting. The Paediatric Symptom Checklist (PSC) was assessed via parent report to evaluate psychosocial symptoms before and after the program, and subscales were calculated for internalizing (PSC-IS), externalizing (PSC-ES) and attention symptoms (PSC-AS). At baseline, positive screen rates for psychosocial symptoms among the 317 patients included 16.1% for PSC, 14.1% for PSC-ES, 18.6% for PSC-IS and 12.3% for PSC-AS. Among program completers, total PSC scores improved in those with normal (p = 0.010) and elevated p < .001 psychosocial symptoms at baseline. Youth with positive screens for elevated PSC subscales improved their subscale scores, on average, and the majority reduced scores to below elevated levels for PSC (54.2%), PSC-ES (64.7%), PSC-IS (78.3%) and PSC-AS (64.7%). Improvements in PSC remained significant after adjusting for BMI changes during treatment, but BMI differed across PSC-change groups, including BMI increases among participants with PSC deterioration (0.33 ± 0.64 kg m^-2 ) (P = 0.035) and BMI decreases among patients with no reliable PSC change (-0.26 ± 1.04 kg m^-2 ) (P = 0.038) or reliable PSC improvement (-0.22 ± 0.74 kg m^-2 ) (P = 0.025). Youth with positive screens for psychosocial symptoms can improve emotional and behavioural functioning during short-term PWM. Future research is needed to elucidate mechanisms and long-term outcome durability.

The PSC-17: Subscale Scores, Reliability, and Factor Structure in a New National Sample

BACKGROUND

The Pediatric Symptom Checklist-17 (PSC-17) is a widely used, briefer version of the PSC-35, a parent-completed measure of children's psychosocial functioning. Despite the extensive use of the PSC-17 over the past 15 years there has not been a large-scale replication of the original derivation study.

OBJECTIVE

To examine the prevalence of positive screens, reliability, and factor structure of PSC-17 scores in a new national sample and compare them with the derivation sample.

METHODS

Data were collected on 80 680 pediatric outpatients, ages 4 to 15 years, whose parents filled out the PSC-17 from 2006 to 2015 via the Child Health and Development Interactive System, an electronic system that presents and scores clinical measures.

RESULTS

The rates of positive screening on the overall PSC-17 (11.6%) and on the internalizing (10.4%) and attention (9.1%) subscales were comparable to rates found in the original sample, although the rate of externalizing problems (10.2%) was lower than in the derivation study. Reliability was high (internal consistency 0.89; test-retest 0.85), and a confirmatory factor analysis provided support for the original 3-factor model.

CONCLUSIONS

Fifteen years after the PSC-17 was derived in a large nationally representative outpatient pediatric sample, a new and larger national sample found rates of positive screening, reliability, and factor structure that were comparable. Findings from this study support the continued use of the PSC-17 clinically as a screening tool in pediatric settings and in research.

Using a Brief Parent-Report Measure to Track Outcomes for Children and Teens with ADHD

The Pediatric Symptom Checklist (PSC) is a widely used, parent-completed measure of children's emotional and behavioral functioning. Previous research has shown that the PSC and its subscales are responsive to patient progress over the course of psychiatric treatment. In this naturalistic study, parents and clinicians of 1736 patients aged 17 or younger completed standardized measures at intake and 3-month follow-up appointments. We assessed the 5-item PSC Attention Subscale (PSC-AS) as a longitudinal measure of attention-related symptoms in routine outpatient psychiatry treatment. Secondarily, we compared PSC-AS scores with clinician-reported diagnoses, psychomotor excitation symptoms, and overall functioning. Change scores on the PSC-AS were larger among patients with ADHD diagnoses than those with non-ADHD diagnoses. Comparisons between PSC-AS scores and clinician reports also showed acceptable levels of agreement. Given its effectiveness in tracking attention-related symptoms, the PSC may be particularly useful as a quality assurance or treatment outcome measure for clinicians treating ADHD.