1
|
Henderson CE, Woodard GS, Simmonds-Buckley M, Christensen M, Jensen-Doss A, Douglas S, Delgadillo J. Prediction of adolescent psychotherapy outcomes using youth- and caregiver-reported symptoms data. Psychother Res 2024:1-13. [PMID: 39212169 DOI: 10.1080/10503307.2024.2394187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/02/2023] [Revised: 08/01/2024] [Accepted: 08/08/2024] [Indexed: 09/04/2024] Open
Abstract
OBJECTIVE We used longitudinal youth- and caregiver-reports of adolescent psychological symptoms from three samples of youth receiving mental health services in routine treatment settings to derive expected change trajectories and identify cases at risk for treatment failure. METHOD Participants were 1906 youth (1053 caregivers) receiving treatment in community mental health settings, merged across three samples. The Symptoms and Functioning Severity Scale (SFSS) was used as an indicator of weekly clinical change. Multilevel modeling methods were used to develop expected change trajectories and identify cases at risk for treatment failure (not on track; NOT). Logistic regression was used to predict client improvement as a function of NOT status. RESULTS The SFSS was a reliable indicator of therapeutic change according to youth-reported symptoms. Caregiver reports were not as robust. Whereas predictive accuracy of NOT status yielded moderately high sensitivity in detecting improvement according to youth report, caregiver reports were not as predictive. CONCLUSIONS The youth-reported version of the SFSS-based algorithm seems appropriate for implementation in clinical care. Future studies should search for similarly predictive measures for caregivers.
Collapse
Affiliation(s)
- Craig E Henderson
- Department of Psychology and Philosophy, Sam Houston State University, Huntsville, TX, USA
| | - Grace S Woodard
- Department of Psychology, University of Miami, Coral Gables, FL, USA
| | | | - Maxwell Christensen
- Department of Psychiatry, University of Massachusetts Chan Medical School, Worcester, MA, USA
| | | | - Susan Douglas
- Department of Leadership, Policy and Organizations, Vanderbilt University, Nashville, TN, USA
| | - Jaime Delgadillo
- Department of Psychology, Clinical Psychology Unit, University of Sheffield, Sheffield, UK
| |
Collapse
|
2
|
Woodard GS, Casline E, Ehrenreich-May J, Ginsburg GS, Jensen-Doss A. Consultation as an Implementation Strategy to Increase Fidelity of Measurement-Based Care Delivery in Community Mental Health Settings: An Observational Study. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2023:10.1007/s10488-023-01321-7. [PMID: 38052929 DOI: 10.1007/s10488-023-01321-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/01/2023] [Indexed: 12/07/2023]
Abstract
Regularly administering outcome measures to clients to inform clinical decision making, referred to as measurement-based care (MBC), has the potential to improve mental health treatment due to its applicability across disorders and treatment settings. Given the utility of MBC, understanding predictors of high-fidelity MBC implementation is important. Training and consultation are widely used implementation strategies to increase the fidelity of evidence-based practice delivery but have rarely been studied with MBC. The current study will examine the relationship between time clinicians spent discussing a case in consultation ("dosage") and MBC fidelity. Thirty clinicians and 56 youth were in the MBC condition of a randomized controlled trial and completed baseline questionnaires. Consultation dosage was extracted from call notes. MBC fidelity was measured using the implementation index, which combines rates of administering and viewing questionnaires, using objective data from the online MBC system. Multi-level modeling was used. Greater consultation dosage significantly predicted a higher implementation index (ß = 0.27, SE = 0.06, p < .001). For every 30 min spent discussing a case in consultation, the case's MBC fidelity increased by 8.1%. Greater consultation dosage significantly predicted higher rates of administration (ß = 0.07, SE = 0.03, p = 0.033) and feedback report viewing (ß = 0.24, SE = 0.06, p < .001). More consultation at the case level predicts greater MBC fidelity using objective measures. The greatest impact was increasing the clinician feedback report viewing rate. The results of this study can help inform future efforts to increase the fidelity with which MBC is delivered and to make consultation as efficient and effective as possible.
Collapse
Affiliation(s)
- Grace S Woodard
- Department of Psychology, University of Miami, P.O. Box 248185, Coral Gables, FL, 33146, USA.
| | - Elizabeth Casline
- Northwestern University Feinberg School of Medicine, 420 E. Superior Street, Chicago, IL, 60611, USA
| | - Jill Ehrenreich-May
- Department of Psychology, University of Miami, P.O. Box 248185, Coral Gables, FL, 33146, USA
| | - Golda S Ginsburg
- University of Connecticut School of Medicine, 65 Kane Street Room 3022, West Hartford, CT, 06119, USA
| | - Amanda Jensen-Doss
- Department of Psychology, University of Miami, P.O. Box 248185, Coral Gables, FL, 33146, USA
| |
Collapse
|
3
|
Cho E, Cook JR, Hawley KM. A Structural Model of Organization and Clinician Factors Associated with Standardized Measure Use in a National Survey of Youth Mental Health Providers. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2023; 50:876-887. [PMID: 37458956 PMCID: PMC11056910 DOI: 10.1007/s10488-023-01286-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/02/2023] [Indexed: 10/01/2023]
Abstract
Standardized assessment measures are important for accurate diagnosis of mental health problems and for treatment planning and evaluation. However, little is known about youth mental health providers' typical use of standardized measures across disciplines and outside the context of evidence-based practice initiatives. A multidisciplinary national survey examined the frequency with which 674 youth mental health providers administer standardized and unstandardized measures, and the extent to which organizational (i.e., implementation climate, rigid hierarchical organizational structure) and provider (i.e., attitudes toward standardized assessment measures, highest degree, practice setting) characteristics are associated with standardized measure use. Providers used unstandardized measures far more frequently than standardized measures. Providers' perceptions (a) that standardized measures are practical or feasible, (b) that their organization supports and values evidence-based practices, and (c) that their organization has a rigid hierarchical structure predicted greater use of standardized measures. Working in schools predicted less frequent SMU, while working in higher education and other professional settings predicted more frequent SMU. Standardized measures were not routinely used in this community-based sample. A rigid hierarchical organizational structure may be conducive to more frequent administration of standardized measures, but it is unclear whether such providers actually utilize these measures for clinical decision-making. Alternative strategies to promote standardized measure use may include promoting organizational cultures that value empirical data and encouraging use of standardized measures and training providers to use pragmatic standardized measures for clinical decision making.
Collapse
Affiliation(s)
- Evelyn Cho
- University of Missouri, Columbia, USA
- Harvard University, Cambridge, USA
| | - Jonathan R Cook
- University of Missouri, Columbia, USA
- Pacific Anxiety Group, Belmont, USA
| | | |
Collapse
|
4
|
Overview of Ten Child Mental Health Clinical Outcome Measures: Testing of Psychometric Properties with Diverse Client Populations in the U.S. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2021; 49:197-225. [PMID: 34482501 PMCID: PMC8850232 DOI: 10.1007/s10488-021-01157-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/24/2021] [Indexed: 11/11/2022]
Abstract
While many standardized assessment measures exist to track child mental health treatment outcomes, the degree to which such tools have been adequately tested for reliability and validity across race, ethnicity, and class is uneven. This paper examines the corpus of published tests of psychometric properties for the ten standardized measures used in U.S. child outpatient care, with focus on breadth of testing across these domains. Our goal is to assist care providers, researchers, and legislators in understanding how cultural mismatch impacts measurement accuracy and how to select tools appropriate to the characteristics of their client populations. We also highlight avenues of needed research for measures that are in common use. The list of measures was compiled from (1) U.S. state Department of Mental Health websites; (2) a survey of California county behavioral health agency directors; and (3) exploratory literature scans of published research. Ten measures met inclusion criteria; for each one a systematic review of psychometrics literature was conducted. Diversity of participant research samples was examined as well as differences in reliability and validity by gender, race or ethnicity, and socio-economic class. All measures showed adequate reliability and validity, however half lacked diverse testing across all three domains and all lacked testing with Asian American/Pacific Islander and Native American children. ASEBA, PSC, and SDQ had the broadest testing.
Collapse
|
5
|
Kwan B, Rickwood DJ. A routine outcome measure for youth mental health: Clinically interpreting MyLifeTracker. Early Interv Psychiatry 2021; 15:807-817. [PMID: 32662215 PMCID: PMC8359251 DOI: 10.1111/eip.13016] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/27/2019] [Revised: 05/04/2020] [Accepted: 06/24/2020] [Indexed: 12/22/2022]
Abstract
AIM MyLifeTracker is a session-by-session mental health outcome measure for young people aged 12 to 25 years. The aim of this study was to determine clinically significant change indexes for this measure that would identify developmentally appropriate thresholds. The study also aimed to determine expected change trajectories to enable clinicians to compare a client's progress against average rates of change. METHODS Participants comprised young people aged 12 to 25 years from both a clinical and a community sample from Australia. The clinical sample was 63 840 young people that attended a headspace centre. The non-clinical group was an Australian representative community sample of 4034 young people. RESULTS Clinically significant change indexes were developed for MyLifeTracker specific for age and gender groups by comparing clinical and non-clinical samples. Males and young people aged 12 to 14 years needed to reach higher scores to achieve clinically significant change compared to females and other age groups, respectively. MyLifeTracker expected change trajectories followed a cubic pattern for those with lower baseline scores of 0 to 50, whereas those with baseline scores of 51 and above had varying patterns. For those with lower baseline scores, expected change trajectories showed that stronger change was evident early in treatment, which then tapered off before accelerating again later in treatment. CONCLUSIONS The development of MyLifeTracker benchmarks allows the measure to be used for Feedback Informed Treatment by supporting treatment planning and decision-making. This information can help clinicians to identify clients who are not on track or deteriorating and identify when clients are improving.
Collapse
Affiliation(s)
- Benjamin Kwan
- Faculty of Health, University of Canberra, Bruce, Australian Capital Territory, Australia
| | - Debra J Rickwood
- Faculty of Health, University of Canberra, Bruce, Australian Capital Territory, Australia.,headspace National Youth Mental Health Foundation, Melbourne, Victoria, Australia
| |
Collapse
|
6
|
Gelkopf M, Mazor Y, Roe D. A systematic review of patient-reported outcome measurement (PROM) and provider assessment in mental health: goals, implementation, setting, measurement characteristics and barriers. Int J Qual Health Care 2021; 34:ii13–ii27. [PMID: 32159763 DOI: 10.1093/intqhc/mzz133] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2019] [Revised: 11/08/2019] [Accepted: 12/03/2019] [Indexed: 01/27/2023] Open
Abstract
PURPOSE To review and integrate the literature on mental-health-related patient-reported outcome measures (PROMs) and routine outcome measures (ROMs), namely in the domains of goals, characteristics, implementation, settings, measurements and barriers. PROM/ROM aims mainly to ascertain treatment impact in routine clinical practice through systematic service users' health assessment using standardized self-report, caretaker and/or provider assessment. DATA SOURCES Psych INFO and PubMed including Medline, Biomed Central, EMBASE Psychiatry and Elsevier Science's Direct. STUDY SELECTION Systemized review of literature (2000-2018) on implementation and sustainability of PROMs/ROMs in adult mental health settings (MHS). DATA EXTRACTION AND SYNTHESIS Systemized review of literature (2000-2018) on numerous aspects of PROM/ROM implementation and sustainability in adult MHS worldwide. RESULTS Based on 103 articles, PROMs/ROMs were implemented mostly in outpatient settings for people with assorted mental health disorders receiving a diversity of services. Frequency of assessments and completion rates varied: one-third of projects had provider assessments; about half had both provider and self-assessments. Barriers to implementation: perceptions that PROM/ROM is intrusive to clinical practice, lack of infrastructure, fear that results may be used for cost containment and service eligibility instead of service quality improvement, difficulties with measures, ethical and confidentiality regulations and web security data management regulations. CONCLUSION Improving data input systems, sufficient training, regular feedback, measures to increase administrative and logistic support to improve implementation, acceptability, feasibility and sustainability, follow-up assessments and client attrition rate reduction efforts are only some measures needed to enhance PROM/ROM efficiency and efficacy.
Collapse
Affiliation(s)
- Marc Gelkopf
- Department of Community Mental Health, Faculty of Social Welfare and Health Sciences, University of Haifa, Israel.,Center for Community Mental Health, Research, Practice and Policy, Faculty of Social Welfare and Health Sciences, University of Haifa, Israel
| | - Yael Mazor
- Department of Community Mental Health, Faculty of Social Welfare and Health Sciences, University of Haifa, Israel.,Center for Community Mental Health, Research, Practice and Policy, Faculty of Social Welfare and Health Sciences, University of Haifa, Israel
| | - David Roe
- Department of Community Mental Health, Faculty of Social Welfare and Health Sciences, University of Haifa, Israel.,Center for Community Mental Health, Research, Practice and Policy, Faculty of Social Welfare and Health Sciences, University of Haifa, Israel.,Department of Clinical Medicine, Psychiatry, Aalborg University, Denmark
| |
Collapse
|
7
|
Kwan B, Rickwood DJ, Brown PM. Factors affecting the implementation of an outcome measurement feedback system in youth mental health settings. Psychother Res 2020; 31:171-183. [PMID: 33040708 DOI: 10.1080/10503307.2020.1829738] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/17/2022] Open
Abstract
Objective: Measurement feedback systems provide clinicians with regular snapshots of a client's mental health status, which can be used in treatment planning and client feedback. There are numerous barriers to clinicians using outcome measures routinely. This study aimed to investigate factors affecting the use of a measurement feedback system across youth mental health settings. Methods: The participants were 210 clinicians from headspace youth mental health services across Australia. They were surveyed on predictors and use of MyLifeTracker, a routine outcome measure. This was explored through three processes: looking at MyLifeTracker before session, using MyLifeTracker in treatment planning, and providing feedback of MyLifeTracker scores to clients. Results: Clinicians were more likely to look at MyLifeTracker before session, less likely to use it in treatment planning, and least likely to provide MyLifeTracker scores to clients. Each measurement feedback system process had a distinct group of predictors. Perceptions of MyLifeTracker's practicality was the only significant predictor of all three processes. Conclusion: Practically, organisations and supervisors can increase the use of measurement feedback systems through targeted supports.
Collapse
Affiliation(s)
- Benjamin Kwan
- Faculty of Health, University of Canberra, Bruce, ACT, Australia
| | - Debra J Rickwood
- Faculty of Health, University of Canberra, Bruce, ACT, Australia.,Headspace National Youth Mental Health Foundation National Office, Melbourne, VIC, Australia
| | - Patricia M Brown
- Faculty of Health, University of Canberra, Bruce, ACT, Australia
| |
Collapse
|
8
|
Clinical Demonstration of the Potential of Parental Feedback in Reducing Deterioration During Group Psychotherapy With Children. J Nerv Ment Dis 2020; 208:706-714. [PMID: 32541398 DOI: 10.1097/nmd.0000000000001199] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
In recent years, great efforts have been exerted to minimize the rates of deterioration in clinical practice, especially in child psychotherapy. The present study explored the potential effect of routine outcome monitoring (ROM) with parents as a preventive intervention to reduce deterioration in children. Twenty-five children receiving treatment for emotional problems were randomized to parent-based, ROM-assisted group psychotherapy or to treatment as usual (TAU). A mixed-methods approach was utilized, with the number of deteriorating cases compared at the group level and two case illustrations assessed at the individual level. At the group level, there were fewer cases of deterioration in child's anxiety, parental stress, and quality of parent's alliance in the ROM-assisted group, compared with TAU. Case studies illustrated how ROM can be used as a tool to communicate with parents to prevent deterioration. Routine outcome monitoring in child psychotherapy may thus benefit therapy process and outcome. Limitations and directions for future research are discussed.
Collapse
|
9
|
Sale R, Bearman SK, Woo R, Baker N. Introducing a Measurement Feedback System for Youth Mental Health: Predictors and Impact of Implementation in a Community Agency. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2020; 48:327-342. [PMID: 32809082 DOI: 10.1007/s10488-020-01076-5] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
Measurement feedback systems (MFSs) that routinely collect and report client progress to mental health therapists have demonstrated beneficial impact on outcomes in numerous studies, with evidence that there is a dose-response relationship related to the implementation of the MFS. The current study examined the impact of MFS implementation (Implementation Index) on youth symptom outcomes separately by caregiver and youth self-report. Additionally, we tested the extent to which Implementation Index rates varied by individual therapists and clients, and whether therapist and client characteristics predicted MFS implementation. Methods: Administrative data (client charts, youth- and caregiver-reported Youth Outcome Questionnaires) for 229 youth (52.83% Latinx, 42.79% girls, M age = 10.33) treated during a 1-year period at a community mental health organization in Central Texas were analyzed using multi-level modeling. Caregiver-reported symptoms decreased faster for those with a higher MFS Implementation Index. Between-group differences among therapists accounted for a significant proportion of variance in the Implementation Index for caregiver report, whereas client differences accounted for most of the variance in the Implementation Index for youth self-report. Therapist trainee status predicted a significant increase in the Implementation Index for caregiver-report data. Youth symptom improvement as reported by caregivers varied with the extent of MFS implementation fidelity, and MFS implementation fidelity was higher for clients treated by trainees relative to staff therapists for caregiver report of symptoms.
Collapse
Affiliation(s)
- Rafaella Sale
- Department of Educational Psychology, The University of Texas At Austin, 504 SZB, 1 University Station, D5800, Austin, TX, 78712-0383, USA.
| | - Sarah Kate Bearman
- Department of Educational Psychology, The University of Texas At Austin, 504 SZB, 1 University Station, D5800, Austin, TX, 78712-0383, USA
| | - Rebecca Woo
- Department of Educational Psychology, The University of Texas At Austin, 504 SZB, 1 University Station, D5800, Austin, TX, 78712-0383, USA
| | - Nichole Baker
- Department of Educational Psychology, The University of Texas At Austin, 504 SZB, 1 University Station, D5800, Austin, TX, 78712-0383, USA
| |
Collapse
|
10
|
Jensen-Doss A, Douglas S, Phillips DA, Gencdur O, Zalman A, Gomez NE. Measurement-based care as a practice improvement tool: Clinical and organizational applications in youth mental health. EVIDENCE-BASED PRACTICE IN CHILD AND ADOLESCENT MENTAL HEALTH 2020; 5:233-250. [PMID: 33732875 PMCID: PMC7962174 DOI: 10.1080/23794925.2020.1784062] [Citation(s) in RCA: 38] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
Abstract
Measurement-based care (MBC) is systematic, ongoing assessment to monitor treatment progress and inform clinical decision-making. MBC is considered an evidence-based practice, with extensive research support in adult clinical populations and emerging evidence in youth populations. This paper describes both clinical (e.g., enhancing therapy alliance, informing case conceptualization) and organizational (e.g., informing quality improvement efforts) applications of MBC, and illustrates the clinical applications through two case examples from publicly-funded mental health agency settings. The paper concludes by detailing future research needed to enhance the clinical and organizational utility of MBC.
Collapse
|
11
|
Bear HA, Edbrooke-Childs J, Norton S, Krause KR, Wolpert M. Systematic Review and Meta-analysis: Outcomes of Routine Specialist Mental Health Care for Young People With Depression and/or Anxiety. J Am Acad Child Adolesc Psychiatry 2020; 59:810-841. [PMID: 31881268 DOI: 10.1016/j.jaac.2019.12.002] [Citation(s) in RCA: 49] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/16/2019] [Revised: 11/30/2019] [Accepted: 12/19/2019] [Indexed: 12/28/2022]
Abstract
OBJECTIVE Depression and anxiety are the most prevalent mental health problems in youth, yet almost nothing is known about what outcomes are to be expected at the individual level following routine treatment. This paper sets out to address this gap by undertaking a systematic review of outcomes following treatment as usual (TAU) with a particular focus on individual-level outcomes. METHOD MEDLINE, Embase and PsycInfo were searched for articles published between 1980 and January 2019 that assessed TAU outcomes for youth depression and anxiety accessing specialist mental health care. Meta-analysis considered change at both group-level pre-post effect size (ES) and individual-level recovery, reliable change, and reliable recovery. Temporal analysis considered stability of primary and secondary outcomes over time. Subgroup analysis considered the moderating effect of informant; presenting problem; study design; study year; mean age of youth; use of medication; intervention dosage and type of treatment offered on outcomes. A protocol was preregistered on PROSPERO (CRD42017063914). RESULTS Initial screening of 6,350 publications resulted in 38 that met the inclusion criteria, and that were subsequently included in meta-analyses. This resulted in a final full pooled sample of 11,739 young people (61% of whom were female, mean age 13.8 years). The pre-post ES (Hedges' g) at first/final outcome (13/26 weeks) was -0.74/-0.87. The individual-level change on measures of self-report was 38% reliable improvement, 44% no reliable change, and 6% reliable deterioration. Outcomes varied according to moderators, informant, problem type and dosage. CONCLUSION Poor data quantity and quality are limitations, but this is the first study that indicates likely rates of reliable improvement for those accessing TAU. We propose the need for improved reporting of both individual-level metrics and details of TAU to enable greater understanding of likely current outcomes from routine care for youths with depression and anxiety in order to allow the potential for further improvement of impact.
Collapse
Affiliation(s)
- Holly Alice Bear
- University College London, UK; Anna Freud National Centre for Children and Families; The Kantor Centre of Excellence, London, UK.
| | - Julian Edbrooke-Childs
- University College London, UK; Anna Freud National Centre for Children and Families; The Kantor Centre of Excellence, London, UK; Child Outcomes Research Consortium, Brunswick Place London, UK
| | - Sam Norton
- Health Psychology Section at the Institute of Psychiatry, Psychology & Neuroscience, King's College London, Guy's Hospital Campus, London Bridge, London, UK
| | - Karolin Rose Krause
- University College London, UK; Anna Freud National Centre for Children and Families; The Kantor Centre of Excellence, London, UK
| | - Miranda Wolpert
- University College London, UK; Anna Freud National Centre for Children and Families; The Kantor Centre of Excellence, London, UK; Child Outcomes Research Consortium, Brunswick Place London, UK
| |
Collapse
|
12
|
Napoleone E, Evans C, Patalay P, Edbrooke-Childs J, Wolpert M. Trajectories of change of youth depressive symptoms in routine care: shape, predictors, and service-use implications. Eur Child Adolesc Psychiatry 2019; 28:1527-1536. [PMID: 30919053 DOI: 10.1007/s00787-019-01317-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/02/2018] [Accepted: 03/13/2019] [Indexed: 10/27/2022]
Abstract
Depression is one of the main reasons for youth accessing mental health services, yet we know little about how symptoms change once youth are in routine care. This study used multilevel modeling to examine the average trajectory of change and the factors associated with change in depressive symptoms in a large sample of youth seen in routine mental health care services in England. Participants were 2336 youth aged 8-18 (mean age 14.52; 77% females; 88% white ethnic background) who tracked depressive symptoms over a period of up to 32 weeks while in contact with mental health services. Explanatory variables were age, gender, whether the case was closed, total length of contact with services, and baseline severity in depression scores. Faster rates of improvement were found in older adolescents, males, those with shorter time in contact with services, closed cases, and those with more severe symptoms at baseline. This study demonstrates that when youth self-report their depressive symptoms during psychotherapy, symptoms decrease in a linear trajectory. Attention should be paid to younger people, females, and those with lower than average baseline scores, as their symptoms decrease at a slower pace compared to others.
Collapse
Affiliation(s)
- Elisa Napoleone
- Anna Freud National Centre for Children and Families and University College London, 4-8 Rodney Street, London, N1 9JH, UK.
| | - Chris Evans
- University of Sheffield, Western Bank, Sheffield, S10 2TN, UK
| | - Praveetha Patalay
- University of Liverpool, Foundation Building, Brownlow Hill, Liverpool, L69 7ZX, UK
| | - Julian Edbrooke-Childs
- Anna Freud National Centre for Children and Families and University College London, 4-8 Rodney Street, London, N1 9JH, UK
| | - Miranda Wolpert
- Anna Freud National Centre for Children and Families and University College London, 4-8 Rodney Street, London, N1 9JH, UK
| |
Collapse
|
13
|
Dyason KM, Shanley DC, O'Donovan A, Low-Choy S. Does feedback improve psychotherapy outcomes compared to treatment-as-usual for adults and youth? Psychother Res 2019; 30:310-324. [PMID: 31122152 DOI: 10.1080/10503307.2019.1620367] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/26/2022] Open
Abstract
Objective: Client-informed outcome feedback has consistently been shown to enhance psychotherapy outcomes for adults, particularly for clients at risk of treatment failure. However, there is a paucity of studies examining feedback in youth psychotherapy. Specifically, there is no research examining the feedback effect of the Youth-Outcome Questionnaire [Burlingame, G. M., Wells, M. G., & Lambert, M. J. (1996). The youth outcome questionnaire. Stevenson, MD: American Professional Credentialing Services.], despite the dominance of the adult version of the measure (Outcome Questionnaire-45 [Lambert, M. J., & Burlingame, G. M. (1996). Outcome questionnaire 45.2. Wilmington, DE: American Professional Credentialing Services.]) in adult feedback studies. Method: The effectiveness results for adult (N = 398) and youth clients (N = 397) attending psychotherapy at two psychology training clinics are presented and benchmarked against treatment-as-usual (for adults and youth) and feedback (for adults). Results: Psychotherapy with a feedback-informed approach was more effective than treatment-as-usual benchmarks, with 50% of adults and 64% of youth significantly improving after psychotherapy. Rates of adult improvement were similar to feedback-informed benchmarks, although the current sample had a higher rate of deterioration. There are no previously identified feedback-informed benchmarks for the Y-OQ, making this sample the first benchmark for future studies. Conclusions: Results support the benefits of feedback at enhancing psychotherapy outcomes for adults, and replicate this finding in a youth sample. Results also replicate that trainee psychotherapists can be as effective as licenced psychotherapists.
Collapse
|
14
|
Jensen-Doss A, Ehrenreich-May J, Nanda MM, Maxwell CA, LoCurto J, Shaw AM, Souer H, Rosenfield D, Ginsburg GS. Community Study of Outcome Monitoring for Emotional Disorders in Teens (COMET): A comparative effectiveness trial of a transdiagnostic treatment and a measurement feedback system. Contemp Clin Trials 2018; 74:18-24. [PMID: 30282056 PMCID: PMC6249684 DOI: 10.1016/j.cct.2018.09.011] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2018] [Revised: 09/27/2018] [Accepted: 09/28/2018] [Indexed: 11/29/2022]
Abstract
Emotional disorders, encompassing a range of anxiety and depressive disorders, are the most prevalent and comorbid psychiatric disorders in adolescence. Unfortunately, evidence-based psychosocial therapies typically focus on single disorders, are rarely adopted by community mental health center clinicians, and effect sizes are modest. This article describes the protocol for a comparative effectiveness study of two novel interventions designed to address these challenges. The first intervention is a transdiagnostic treatment (the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Adolescents, UP-A), a promising new approach that uses a small number of common strategies to treat a broad range of emotional disorders, and their underlying shared emotional vulnerabilities. The second intervention is a standardized measurement feedback system, the Youth Outcomes Questionnaire (YOQ), designed to improve clinical decision making using weekly symptom and relational data. The three study arms are treatment as usual (TAU), TAU plus the YOQ (TAU+), and UP-A (used in combination with the YOQ). The primary aims of the study are to [1] compare the effects of the UP-A and TAU+ to TAU in community mental health clinics, [2] to isolate the effects of measurement and feedback by comparing the UP-A and TAU+ condition, and [3] to examine the mechanisms of action of both interventions. Design considerations and study methods are provided to inform future effectiveness research.
Collapse
Affiliation(s)
- Amanda Jensen-Doss
- University of Miami, Department of Psychology, P.O. Box 248185, Coral Gables, FL 33124-0751, USA.
| | - Jill Ehrenreich-May
- University of Miami, Department of Psychology, P.O. Box 248185, Coral Gables, FL 33124-0751, USA
| | - Monica M Nanda
- University of Miami, Department of Psychology, P.O. Box 248185, Coral Gables, FL 33124-0751, USA
| | - Colleen A Maxwell
- University of Miami, Department of Psychology, P.O. Box 248185, Coral Gables, FL 33124-0751, USA
| | - Jamie LoCurto
- University of Connecticut School of Medicine, 65 Kane Street Room 3022, West Hartford, CT 06119, USA
| | - Ashley M Shaw
- University of Miami, Department of Psychology, P.O. Box 248185, Coral Gables, FL 33124-0751, USA
| | - Heather Souer
- University of Connecticut School of Medicine, 65 Kane Street Room 3022, West Hartford, CT 06119, USA
| | - David Rosenfield
- Southern Methodist University, Department of Psychology, P.O. Box 750442, Dallas, TX 75275, USA
| | - Golda S Ginsburg
- University of Connecticut School of Medicine, 65 Kane Street Room 3022, West Hartford, CT 06119, USA
| |
Collapse
|
15
|
Becker-Haimes EM, Jensen-Doss A, Birmaher B, Kendall PC, Ginsburg GS. Parent-youth informant disagreement: Implications for youth anxiety treatment. Clin Child Psychol Psychiatry 2018; 23:42-56. [PMID: 28191794 PMCID: PMC5988273 DOI: 10.1177/1359104516689586] [Citation(s) in RCA: 45] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Greater parent-youth disagreement on youth symptomatology is associated with a host of factors (e.g., parental psychopathology, family functioning) that might impede treatment. Parent-youth disagreement may represent an indicator of treatment prognosis. Using data from the Child/Adolescent Anxiety Multimodal Study, this study used polynomial regression and longitudinal growth modeling to examine whether parent-youth agreement prior to and throughout treatment predicted treatment outcomes (anxiety severity, youth functioning, responder status, and diagnostic remission, rated by an independent evaluator). When parents reported more symptoms than youth prior to treatment, youth were less likely to be diagnosis-free post-treatment; this was only true if the youth received cognitive-behavioral therapy (CBT) alone, not if youth received medication, combination, or placebo treatment. Increasing concordance between parents and youth over the course of treatment was associated with better treatment outcomes across all outcome measures ( ps < .001). How parents and youth "co-report" appears to be an indicator of CBT outcome. Clinical implications and future directions are discussed.
Collapse
Affiliation(s)
- Emily M Becker-Haimes
- 1 Department of Psychology, University of Miami, USA
- 2 Perelman School of Medicine, University of Pennsylvania, USA
| | | | - Boris Birmaher
- 3 Western Psychiatric Institute and Clinic, University of Pittsburgh Medical Center, USA
| | | | - Golda S Ginsburg
- 5 Department of Psychiatry, University of Connecticut Health Center, USA
| |
Collapse
|
16
|
Roberts MC, Blossom JB, Evans SC, Amaro CM, Kanine RM. Advancing the Scientific Foundation for Evidence-Based Practice in Clinical Child and Adolescent Psychology. JOURNAL OF CLINICAL CHILD AND ADOLESCENT PSYCHOLOGY 2016; 46:915-928. [PMID: 27218141 DOI: 10.1080/15374416.2016.1152554] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
Evidence-based practice (EBP) has become a central focus in clinical child and adolescent psychology. As originally defined, EBP in psychology is the integration of the best available research evidence, patient characteristics, and clinical expertise. Although evidence-based perspectives have garnered widespread acceptance in recent years, there has also been some confusion and disagreement about the 3-part definition of EBP, particularly the role of research. In this article, we first provide a brief review of the development of EBP in clinical child and adolescent psychology. Next, we outline the following 4 points to help clarify the understanding of EBP: (a) knowledge should not be confused with epistemic processes, (b) research on clinician and client factors is needed for EBP, (c) research on assessment is needed for EBP, and (d) the 3-part conceptualization of EBP can serve as a useful framework to guide research. Based on these principles, we put forth a slightly revised conceptualization of EBP, in which the role of research is expanded and more clearly operationalized. Finally, based on our review of the literature, we offer illustrative examples of specific directions for future research to advance the evidence base for EBP in clinical child and adolescent psychology.
Collapse
|
17
|
Ng MY, Weisz JR. Annual Research Review: Building a science of personalized intervention for youth mental health. J Child Psychol Psychiatry 2016; 57:216-36. [PMID: 26467325 PMCID: PMC4760855 DOI: 10.1111/jcpp.12470] [Citation(s) in RCA: 156] [Impact Index Per Article: 17.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 08/21/2015] [Indexed: 12/17/2022]
Abstract
BACKGROUND Within the past decade, health care service and research priorities have shifted from evidence-based medicine to personalized medicine. In mental health care, a similar shift to personalized intervention may boost the effectiveness and clinical utility of empirically supported therapies (ESTs). The emerging science of personalized intervention will need to encompass evidence-based methods for determining which problems to target and in which order, selecting treatments and deciding whether and how to combine them, and informing ongoing clinical decision-making through monitoring of treatment response throughout episodes of care. We review efforts to develop these methods, drawing primarily from psychotherapy research with youths. Then we propose strategies for building a science of personalized intervention in youth mental health. FINDINGS The growing evidence base for personalizing interventions includes research on therapies adapted for specific subgroups; treatments targeting youths' environments; modular therapies; sequential, multiple assignment, randomized trials; measurement feedback systems; meta-analyses comparing treatments for specific patient characteristics; data-mining decision trees; and individualized metrics. CONCLUSION The science of personalized intervention presents questions that can be addressed in several ways. First, to evaluate and organize personalized interventions, we propose modifying the system used to evaluate and organize ESTs. Second, to help personalizing research keep pace with practice needs, we propose exploiting existing randomized trial data to inform personalizing approaches, prioritizing the personalizing approaches likely to have the greatest impact, conducting more idiographic research, and studying tailoring strategies in usual care. Third, to encourage clinicians' use of personalized intervention research to inform their practice, we propose expanding outlets for research summaries and case studies, developing heuristic frameworks that incorporate personalizing approaches into practice, and integrating personalizing approaches into service delivery systems. Finally, to build a richer understanding of how and why treatments work for particular individuals, we propose accelerating research to identify mediators within and across RCTs, to isolate mechanisms of change, and to inform the shift from diagnoses to psychopathological processes. This ambitious agenda for personalized intervention science, although challenging, could markedly alter the nature of mental health care and the benefit provided to youths and families.
Collapse
Affiliation(s)
- Mei Yi Ng
- Department of Psychology, Harvard University, Cambridge, MA, USA
| | - John R Weisz
- Department of Psychology, Harvard University, Cambridge, MA, USA
| |
Collapse
|
18
|
Kwan B, Rickwood DJ. A systematic review of mental health outcome measures for young people aged 12 to 25 years. BMC Psychiatry 2015; 15:279. [PMID: 26573269 PMCID: PMC4647516 DOI: 10.1186/s12888-015-0664-x] [Citation(s) in RCA: 61] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/20/2015] [Accepted: 10/27/2015] [Indexed: 11/17/2022] Open
Abstract
BACKGROUND Mental health outcome measures are used to monitor the quality and effectiveness of mental health services. There is also a growing expectation for implementation of routine measurement and measures being used by clinicians as a feedback monitoring system to improve client outcomes. The recent focus in Australia and elsewhere targeting mental health services to young people aged 12-25 years has meant that outcome measures relevant to this age range are now needed. This is a shift from the traditional divide of child and adolescent services versus adult services with a transitioning age at 18 years. This systematic review is the first to examine mental health outcome measures that are appropriate for the 12 to 25 year age range. METHODS MEDLINE and PsychINFO databases were systematically searched to identify studies using mental health outcome measures with young people aged 12 to 25 years. The search strategy complied with the relevant sections of the PRISMA statement. RESULTS A total of 184 published articles were identified, covering 29 different outcome measures. The measures were organised into domains that consisted of eight measures of cognition and emotion, nine functioning measures, six quality of life measures, and six multidimensional mental health measures. No measures were designed specifically for young people aged 12 to 25 years and only two had been used by clinicians as a feedback monitoring system. Five measures had been used across the whole 12 to 25 year age range, in a range of mental health settings and were deemed most appropriate for this age group. CONCLUSIONS With changes to mental health service systems that increasingly focus on early intervention in adolescence and young adulthood, there is a need for outcome measures designed specifically for those aged 12 to 25 years. In particular, multidimensional measures that are clinically meaningful need to be developed to ensure quality and effectiveness in youth mental health. Additionally, outcome measures can be clinically useful when designed to be used within routine feedback monitoring systems.
Collapse
Affiliation(s)
- Benjamin Kwan
- Faculty of Health, University of Canberra, Kirinari Street, Bruce, ACT, 2601, Australia.
| | - Debra J Rickwood
- Faculty of Health, University of Canberra, Kirinari Street, Bruce, ACT, 2601, Australia.
- Headspace National Youth Mental Health Foundation National Office, 485 La Trobe Street, Melbourne, VIC, 3000, Australia.
| |
Collapse
|
19
|
Jackson DS, Keir SS, Sender M, Mueller CW. Reliable Change and Outcome Trajectories Across Levels of Care in a Mental Health System for Youth. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2015; 44:141-154. [DOI: 10.1007/s10488-015-0690-5] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
20
|
Nelson PL, Warren JS, Gleave RL, Burlingame GM. Youth psychotherapy change trajectories and early warning system accuracy in a managed care setting. J Clin Psychol 2013; 69:880-95. [PMID: 23381658 DOI: 10.1002/jclp.21963] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
OBJECTIVES To examine change trajectories in routine outpatient mental health services for children and adolescents in a managed care setting, and to use these trajectories to test the accuracy of two variations of an early warning system designed to identify cases at risk for deterioration. METHOD Multilevel modeling procedures were used to examine longitudinal Youth Outcome Questionnaire (YOQ) data for 16,091 youth aged 4-17 years (39% female, mean age 10.5) referred for treatment in a managed care system. RESULTS Clients with more frequent YOQ administrations had slightly lower baselines and faster rates of change. Both the traditional and simplified versions of the early warning system demonstrated good accuracy in identifying clients who deteriorated, with a sensitivity of .63, specificity of .83, and hit rate of .81. CONCLUSIONS Results provide further evidence that patient-focused early warning systems can accurately identify most youth who are at risk for negative outcomes in routine mental health services.
Collapse
|
21
|
Trajectories of symptom reduction during treatment for behavior problems in pediatric primary-care settings. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2012; 38:486-94. [PMID: 21301952 DOI: 10.1007/s10488-011-0335-2] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
We examined trajectories of symptom reduction during the course of on-site treatment for behavior problems in pediatric primary-care settings for a subset of children from a larger clinical trial. Participants (N = 80) were children (ages 6-11) referred for treatment due to moderate elevations (≥75th percentile) on the externalizing subscale of the Pediatric Symptom Checklist (PSC-17). The sample was recruited from six pediatric practices in an urban setting. The treatment (Protocol for an Office-based Nurse-administered Intervention; PONI) was administered on-site by trained nurses over the course of 3-6 months. Overall, symptom reduction from the first session to last session was moderate (ES = 0.61) and gradual. Roughly two-thirds (72%) of symptom reduction took place over the first 8 weeks of treatment. The average trajectory of symptom reduction was characterized by a negative slope that flattened over time, consistent with a quadratic growth model. Initial symptom severity predicted final symptom severity (r = .36, P < .01), even though patients with greater initial symptom severity remained in treatment for a significantly greater number of sessions (r = .24, P < .05). The implications of these findings for enhancing the efficiency and effectiveness of treatment are discussed.
Collapse
|
22
|
Warren JS, Nelson PL, Burlingame GM, Mondragon SA. Predicting patient deterioration in youth mental health services: community mental health vs. managed care settings. J Clin Psychol 2011; 68:24-40. [PMID: 21989865 DOI: 10.1002/jclp.20831] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
OBJECTIVE To examine differences across a community mental health system and a private managed care system in the accuracy of a warning system designed to identify youth at risk for deterioration in mental health services. DESIGN Longitudinal outcome data from the Youth Outcome Questionnaire (Y-OQ) were examined using multilevel modeling for 2,310 youth ages 4-17 who received outpatient treatment. RESULTS The warning system correctly identified 69% of cases that ultimately ended in deterioration in the community mental health setting, compared to 61% in the managed care setting. The overall hit rate (overall accuracy in classifying cases as deteriorators/non-deteriorators) was the same in the two settings (75%). CONCLUSIONS Results are consistent with previous research demonstrating that patient-focused warning systems can be reasonably accurate in identifying youth cases at risk for treatment failure.
Collapse
|
23
|
Affiliation(s)
- Jason L. Whipple
- Department of Psychology, University of Alaska Fairbanks, Fairbanks, Alaska 99775;
| | | |
Collapse
|
24
|
McClendon DT, Warren JS, Green KM, Burlingame GM, Eggett DL, McClendon RJ. Sensitivity to change of youth treatment outcome measures: a comparison of the CBCL, BASC-2, and Y-OQ. J Clin Psychol 2011; 67:111-25. [PMID: 21046644 DOI: 10.1002/jclp.20746] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
This study evaluated the relative sensitivity to change of the Child Behavior Checklist/6-18 (CBCL), the Behavior Assessment System for Children-2 (BASC-2), and the Youth Outcome Questionnaire 2.01 (Y-OQ). Participants were 134 parents and 44 adolescents receiving routine outpatient services in a community mental health system. Hierarchical linear modeling analyses were used to examine change trajectories for the 3 measures across 3 groups: parent informants, parent and adolescent dyads, and adolescent informants. Results indicated that for parent-report measures, the Y-OQ was most change sensitive; the BASC-2 and CBCL were not statistically different from each other. Significant differences in change sensitivity were not observed for youth self-report of symptoms. Results suggest that the Y-OQ may be particularly useful for evaluating change in overall psychosocial functioning in children and adolescents.
Collapse
|