Implementing routine outcome measures in child and adolescent mental health services: from present to future practice

User Satisfaction with Child and Adolescent Mental Health Services: Factor Structure of the Experience of Service Questionnaire (ESQ) in Norway and the UK

BACKGROUND

Child and Adolescent Mental Health Services (CAMHS) are expected to track user satisfaction routinely, and to this end, the Experience of Service Questionnaire (ESQ) is increasingly being adopted worldwide. The literature is inconsistent concerning the underlying factor structure of satisfaction measures, and debate is ongoing regarding the evidence of a general satisfaction factor.

AIM

This study aimed to examine the factor structure and dimensionality of the parent/carer and adolescent versions of the ESQ in the UK and Norway.

METHODS

Data were retrieved from routine CAMHS clinical practice in the UK and Norway. Three models suggested by the research group were tested through Confirmatory Factor Analysis (CFA) and reliability testing.

RESULTS

A series of CFAs revealed sound psychometric properties of the ESQ in all samples. A bifactor model with a general satisfaction factor and two specific factors of Satisfaction with Care and Satisfaction with Environment fitted the data best, except for the Norwegian adolescent version where a unidimensional model was kept.

CONCLUSION

The results support the continued use of the ESQ in CAMHS in the UK and Norway and significantly contribute to the literature on user satisfaction by adding evidence of a general satisfaction factor.

The Rhinoplasty Health Care Monitor: An Update on the Practical and Clinical Benefits after 10 Years of Prospective Outcome Measurements

The era of value-based health care is characterized by an increasing interest in patient-reported health outcomes. For this purpose we developed the rhinoplasty health care monitor (RHM), a streamlined outcome measurement protocol, including all rhinoplasty patients since 2014. Statistical analyses of patient-reported outcome data are automated and visually presented on a custom web-based dashboard. We describe the clinical and practical benefits of the RHM and discuss how routine prospective outcome measurements have upgraded our care standards. For this prospective study, 979 consecutive patients referred for functional (revision) rhinoplasty from April 2014 to August 2023 were included. Preoperative and 3- and 12-month postoperative scores on the Nasal Obstruction Symptom Evaluation scale (NOSE), Utrecht Questionnaire (UQ), and visual analog scales (VAS) were obtained. Of 979 referred patients, 599 (61.2%) were eligible for rhinoplasty. One year postoperatively, mean NOSE scale sum score improved from 69.1 ± 22.8 to 23.1 ± 23.5 (p < 0.001). Functional VAS scores improved from 4.1 ± 2.8 (left) and 4.1 ± 2.8 (right) to 7.5 ± 1.9 (left) and 7.3 ± 2.0 (right; p < 0.001). Mean UQ sum score improved from 12.0 ± 6.4 to 6.8 ± 3.3 and aesthetic VAS score improved from 4.5 ± 2.5 to 7.4 ± 1.7 (p < 0.001) 1 year postoperatively. Benefits of the outcome routine were improved patient selection, data-driven expectation management and patient empowerment, and targeted critical appraisals of surgical performance. In conclusion, routine, automated, prospective outcome monitoring provides physicians with a response to the increasing demand for data-driven insights in health outcomes. The limited effort that is needed to gather and monitor outcome data is heavily repaid by valuable insights into aspects of care that can be improved.

Knowledge, attitudes, and practices on child and adolescent mental health among healthcare workers in sub-Saharan Africa: a scoping review

INTRODUCTION

Child and adolescent mental health is a global priority. In sub-Saharan Africa, despite the high burden, there is a gap in health services for children and adolescents with mental health disorders. To bridge this gap, healthcare workers require a good understanding of child and adolescent mental health, the right attitude, and practices geared to improving child and adolescent mental health. This scoping review examined the knowledge, attitudes, and practices related to child and adolescent mental health among sub-Saharan African healthcare workers.

METHODS

The search was restricted between January 2010, the year when the Mental Health Gap Action Programme guidelines were launched, and April 2024. The review followed the methodological framework proposed by Arksey and O'Malley for conducting scoping reviews. The databases searched included CINHAL, PubMed, Web of Science, PsycINFO, and grey literature databases. Additional articles were identified through cited references of the studies included. A data extraction template was used to retrieve relevant text. A narrative synthesis approach was adopted to explore the relationships within and between the included studies.

RESULTS

The literature search yielded 4658 studies. Among these, 817 were identified as duplicates, and 3740 were excluded after screening. Only twenty-one articles met the criteria for inclusion in the review. The findings showed that healthcare workers have insufficient knowledge of child and adolescent mental health, hold negative attitudes toward children and adolescents with mental health problems, and exhibit poor practices related to child and adolescent mental health.

CONCLUSION

It is crucial to build capacity and improve healthcare workers' practices, knowledge, and attitudes toward child and adolescent mental health in sub-Saharan Africa. This could lead to better access to mental health services for children and adolescents in the region.

Mental health interventions for children and young people with long-term health conditions in Children and Young People's Mental Health Services in England

BACKGROUND

Almost a quarter of children and young people (CYP) in England have a long-term health condition (LTC), which increases the risk of developing mental health difficulties. There is a lack of understanding regarding the routine provision and efficacy of mental health interventions for CYP with LTCs within Children and Young People's Mental Health Services (CYPMHS).

METHODS

This study analysed national service-reported data in England from two secondary datasets. Data were submitted by services between 2011 and 2019. We evaluated data on the presence or absence of a serious physical health or neurological issue, and which interventions were offered.

RESULTS

A total of 789 CYP had serious physical health issues and 635 had neurological issues. The most common interventions delivered to CYP in either group have some evidence in the literature. Most CYP showed improvements across a range of outcomes.

CONCLUSIONS

This study found that prevalence rates and psychological intervention and outcome data were widely under-reported across both datasets, posing questions about their utility for this population. Such data would benefit from triangulation with data from other sources to understand pathways of care for these young people and the extent to which clinical datasets underreport the number of CYP with LTCs.

New Brunswick's mental health action plan: A quantitative exploration of program efficacy in children and youth using the Canadian Community Health Survey

In 2011, the New Brunswick government released the New Brunswick Mental Health Action Plan 2011-2018 (Action Plan). Following the release of the Action Plan in 2011, two progress reports were released in 2013 and 2015, highlighting the implementation status of the Action Plan. While vague in their language, these reports indicated considerable progress in implementing the Action Plan, as various initiatives were undertaken to raise awareness and provide additional resources to facilitate early prevention and intervention in children and youth. However, whether these initiatives have yielded measurable improvements in population-level mental health outcomes in children and youth remains unclear. The current study explored the impact of the Action Plan by visualizing the trend in psychosocial outcomes and service utilization of vulnerable populations in New Brunswick before and after the implementation of the Action Plan using multiple datasets from the Canadian Community Health Survey. Survey-weighted ordinary least square regression analyses were performed to investigate measurable improvements in available mental health outcomes. The result revealed a declining trend in the mental wellness of vulnerable youth despite them consistently reporting higher frequencies of mental health service use. This study highlights the need for a concerted effort in providing effective mental health services to New Brunswick youth and, more broadly, Canadian youth, as well as ensuring rigorous routine outcome monitoring and evaluation plans are consistently implemented for future mental health strategies at the time of their initiation.

Youth, caregiver, and clinician perspectives of youth Patient-Reported Outcome Measures (PROMs) in a psychological training clinic: lessons from early adopters

This study examines the applicability and utility of youth Measurement-Based Care (MBC) in a community-based psychological training clinic. Considering the complexity of youth compared to adult MBC, there is an increasing need to expand the evidence base. This study investigated how doctoral students in clinical psychology managed the selection and usage of Patient Rated Outcome Measures (PROMs) for youth and their parents. Additionally, this study evaluates youth attitudes toward MBC and PROMs and overall appropriateness and completion rates. Youth (N = 79) from 1 to 17-years-old with various mental health disorders (i.e., depression, anxiety, ADHD) completed evidence-based psychotherapy. Clinicians (N = 21) were trained to have therapy clients and their caregivers' complete weekly measures digitally as an integrated part of standard care. All clinicians, youth clients, and their parents reported attitudes supporting the utility of youth PROMs and MBC. Compared to adult clients (N = 81), youth clients were significantly less adherent in regularly completing their weekly measures. These results demonstrate the usage of MBC and utility of implementing this practice for youth clients in a training clinic. Together, there is a need for improving the specificity of training for clinicians who will administer MBC for youth above and beyond what is indicated for adult clients.

What treatment outcomes matter in adolescent depression? A Q-study of priority profiles among mental health practitioners in the UK and Chile

Evidence-based and person-centred care requires the measurement of treatment outcomes that matter to youth and mental health practitioners. Priorities, however, may vary not just between but also within stakeholder groups. This study used Q-methodology to explore differences in outcome priorities among mental health practitioners from two countries in relation to youth depression. Practitioners from the United Kingdom (UK) (n = 27) and Chile (n = 15) sorted 35 outcome descriptions by importance and completed brief semi-structured interviews about their sorting rationale. By-person principal component analysis (PCA) served to identify distinct priority profiles within each country sample; second-order PCA examined whether these profiles could be further reduced into cross-cultural "super profiles". We identified three UK outcome priority profiles (Reduced symptoms and enhanced well-being; improved individual coping and self-management; improved family coping and support), and two Chilean profiles (Strengthened identity and enhanced insight; symptom reduction and self-management). These could be further reduced into two cross-cultural super profiles: one prioritized outcomes related to reduced depressive symptoms and enhanced well-being; the other prioritized outcomes related to improved resilience resources within youth and families. A practitioner focus on symptom reduction aligns with a long-standing focus on symptomatic change in youth depression treatment studies, and with recent measurement recommendations. Less data and guidance are available to those practitioners who prioritize resilience outcomes. To raise the chances that such practitioners will engage in evidence-based practice and measurement-based care, measurement guidance for a broader set of outcomes may be needed.

A Structural Model of Organization and Clinician Factors Associated with Standardized Measure Use in a National Survey of Youth Mental Health Providers

Standardized assessment measures are important for accurate diagnosis of mental health problems and for treatment planning and evaluation. However, little is known about youth mental health providers' typical use of standardized measures across disciplines and outside the context of evidence-based practice initiatives. A multidisciplinary national survey examined the frequency with which 674 youth mental health providers administer standardized and unstandardized measures, and the extent to which organizational (i.e., implementation climate, rigid hierarchical organizational structure) and provider (i.e., attitudes toward standardized assessment measures, highest degree, practice setting) characteristics are associated with standardized measure use. Providers used unstandardized measures far more frequently than standardized measures. Providers' perceptions (a) that standardized measures are practical or feasible, (b) that their organization supports and values evidence-based practices, and (c) that their organization has a rigid hierarchical structure predicted greater use of standardized measures. Working in schools predicted less frequent SMU, while working in higher education and other professional settings predicted more frequent SMU. Standardized measures were not routinely used in this community-based sample. A rigid hierarchical organizational structure may be conducive to more frequent administration of standardized measures, but it is unclear whether such providers actually utilize these measures for clinical decision-making. Alternative strategies to promote standardized measure use may include promoting organizational cultures that value empirical data and encouraging use of standardized measures and training providers to use pragmatic standardized measures for clinical decision making.

Patient-Reported Outcomes Measures in Rhinoplasty: Need for Use and Implementation

Patient-reported outcome metrics (PROMs) are increasingly utilized to capture data about patients' quality of life. PROMs play an important role in the value-based health care movement by providing a patient-centered metric of quality. There are many barriers to the implementation of PROMs, and widespread adoption requires buy-in from numerous stakeholders including patients, clinicians, institutions, and payers. Several validated PROMs have been utilized by facial plastic surgeons to measure both functional and aesthetic outcomes among rhinoplasty patients. These PROMs can help clinicians and rhinoplasty patients participate in shared decision making (SDM), a process via which clinicians and patients arrive at treatment decisions together through a patient-centered approach. However, widespread adoption of PROMs and SDM has not yet been achieved. Further work should focus on overcoming barriers to implementation and engaging key stakeholders to increase the utilization of PROMs in rhinoplasty.

Implementation of child-centred outcome measures in routine paediatric healthcare practice: a systematic review

BACKGROUND

Person-centred outcome measures (PCOMs) are commonly used in routine adult healthcare to measure and improve outcomes, but less attention has been paid to PCOMs in children's services. The aim of this systematic review is to identify and synthesise existing evidence of the determinants, strategies, and mechanisms that influence the implementation of PCOMs into paediatric healthcare practice.

METHODS

The review was conducted and reported in accordance with PRISMA guidelines. Databased searched included CINAHL, Embase, Medline, and PsycInfo. Google scholar was also searched for grey literature on 25th March 2022. Studies were included if the setting was a children's healthcare service, investigating the implementation or use of an outcome measure or screening tool in healthcare practice, and reported outcomes relating to use of a measure. Data were tabulated and thematically analysed through deductive coding to the constructs of the adapted-Consolidated Framework for Implementation Research (CFIR). Results were presented as a narrative synthesis, and a logic model developed.

RESULTS

We retained 69 studies, conducted across primary (n = 14), secondary (n = 13), tertiary (n = 37), and community (n = 8) healthcare settings, including both child self-report (n = 46) and parent-proxy (n = 47) measures. The most frequently reported barriers to measure implementation included staff lack of knowledge about how the measure may improve care and outcomes; the complexity of using and implementing the measure; and a lack of resources to support implementation and its continued use including funding and staff. The most frequently reported facilitators of implementation and continued use include educating and training staff and families on: how to implement and use the measure; the advantages of using PCOMs over current practice; and the benefit their use has on patient care and outcomes. The resulting logic model presents the mechanisms through which strategies can reduce the barriers to implementation and support the use of PCOMs in practice.

CONCLUSIONS

These findings can be used to support the development of context-specific implementation plans through a combination of existing strategies. This will enable the implementation of PCOMs into routine paediatric healthcare practice to empower settings to better identify and improve child-centred outcomes.

TRIAL REGISTRATION

Prospero CRD 42022330013.

Taking a Magnifying Glass to Measurement-Based Care Consultation Sessions: with What Issues Do Mental Health Clinicians Struggle?

PURPOSE

Ongoing consultation following initial training is one of the most commonly deployed implementation strategies to facilitate uptake of evidence-based practices, such as measurement-based care (MBC). Group consultation provides an interactive experience with an expert and colleagues to get feedback on actual issues faced, yet there is little research that unpacks the questions raised in consultation and what types of issues are important to address.

METHODS

The current study characterized the questions and concerns raised by community mental health clinicians (N = 38 across six clinics) during group consultation sessions completed as part of an MBC implementation trial. We conducted a qualitative content analysis of consultation forms completed by clinicians before each MBC consultation session.

RESULTS

Clinicians sought MBC consultation for clients across a range of ages and levels of depression severity. Qualitative results revealed five main questions and concerns in consultation sessions: (1) how to administer the PHQ-9, (2) how to review PHQ-9 scores, (3) how to respond to PHQ-9 score, (4) the types of clients for whom MBC would be appropriate, and (5) how MBC could impact a clinician's usual care.

CONCLUSION

Findings highlight the need for ongoing consultation and limitations of workshop training alone. Practical recommendations for addressing the common questions and concerns identified are presented to support MBC use.

Improving measurement-based care implementation in adult ambulatory psychiatry: a virtual focus group interview with multidisciplinary healthcare professionals

BACKGROUND

Measurement-Based Care (MBC) is an evidence-based practice shown to enhance patient care. Despite being efficacious, MBC is not commonly used in practice. While barriers and facilitators of MBC implementation have been described in the literature, the type of clinicians and populations studied vary widely, even within the same practice setting. The current study aims to improve MBC implementation in adult ambulatory psychiatry by conducting focus group interviews while utilizing a novel virtual brainwriting premortem method.

METHODS

Semi-structured focus group interviews were conducted with clinicians (n = 18) and staff (n = 7) to identify their current attitudes, facilitators, and barriers of MBC implementation in their healthcare setting. Virtual video-conferencing software was used to conduct focus groups, and based on transcribed verbatin, emergent barriers/facilitators and four themes were identified. Mixed methods approach was utilized for this study. Specifically, qualitative data was aggregated and re-coded separately by three doctoral-level coders. Quantitative analyses were conducted from a follow-up questionnaire surveying clinician attitudes and satisfaction with MBC.

RESULTS

The clinician and staff focus groups resulted in 291 and 91 unique codes, respectively. While clinicians identified a similar number of barriers (40.9%) and facilitators (44.3%), staff identified more barriers (67%) than facilitators (24.7%) for MBC. Four themes emerged from the analysis; (1) a description of current status/neutral opinion on MBC; (2) positive themes that include benefits of MBC, facilitators, enablers, or reasons on why they conduct MBC in their practice, (3) negative themes that include barriers or issues that hinder them from incorporating MBC into their practice, and (4) requests and suggestions for future MBC implementation. Both participant groups raised more negative themes highlighting critical challenges to MBC implementation than positive themes. The follow-up questionnaire regarding MBC attitudes showed the areas that clinicians emphasized the most and the least in their clinical practice.

CONCLUSION

The virtual brainwriting premortem focus groups provided critical information on the shortcomings and strengths of MBC in adult ambulatory psychiatry. Our findings underscore implementation challenges in healthcare settings and provide insight for both research and clinical practice in mental health fields. The barriers and facilitators identified in this study can inform future training to increase sustainability and better integrate MBC with positive downstream outcomes in patient care.

Assessing the feasibility of a web-based outcome measurement system in child and adolescent mental health services - myHealthE a randomised controlled feasibility pilot study

BACKGROUND

Interest in internet-based patient reported outcome measure (PROM) collection is increasing. The NHS myHealthE (MHE) web-based monitoring system was developed to address the limitations of paper-based PROM completion. MHE provides a simple and secure way for families accessing Child and Adolescent Mental Health Services to report clinical information and track their child's progress. This study aimed to assess whether MHE improves the completion of the Strengths and Difficulties Questionnaire (SDQ) compared with paper collection. Secondary objectives were to explore caregiver satisfaction and application acceptability.

METHODS

A 12-week single-blinded randomised controlled feasibility pilot trial of MHE was conducted with 196 families accessing neurodevelopmental services in south London to examine whether electronic questionnaires are completed more readily than paper-based questionnaires over a 3-month period. Follow up process evaluation phone calls with a subset (n = 8) of caregivers explored system satisfaction and usability.

RESULTS

MHE group assignment was significantly associated with an increased probability of completing an SDQ-P in the study period (adjusted hazard ratio (HR) 12.1, 95% CI 4.7-31.0; p = <.001). Of those caregivers' who received the MHE invitation (n = 68) 69.1% completed an SDQ using the platform compared to 8.8% in the control group (n = 68). The system was well received by caregivers, who cited numerous benefits of using MHE, for example, real-time feedback and ease of completion.

CONCLUSIONS

MHE holds promise for improving PROM completion rates. Research is needed to refine MHE, evaluate large-scale MHE implementation, cost effectiveness and explore factors associated with differences in electronic questionnaire uptake.

Moving from development to implementation of digital innovations within the NHS: myHealthE, a remote monitoring system for tracking patient outcomes in child and adolescent mental health services

Objective

This paper aims to report our experience of developing, implementing, and evaluating myHealthE (MHE), a digital innovation for Child and Adolescents Mental Health Services (CAMHS), which automates the remote collection and reporting of Patient-Reported Outcome Measures (PROMs) into National Health Services (NHS) electronic healthcare records.

Methods

We describe the logistical and governance issues encountered in developing the MHE interface with patient-identifiable information, and the steps taken to overcome these development barriers. We describe the application's architecture and hosting environment to enable its operability within the NHS, as well as the capabilities needed within the technical team to bridge the gap between academic development and NHS operational teams.

Results

We present evidence on the feasibility and acceptability of this system within clinical services and the process of iterative development, highlighting additional functions that were incorporated to increase system utility.

Conclusion

This article provides a framework with which to plan, develop, and implement automated PROM collection from remote devices back to NHS infrastructure. The challenges and solutions described in this paper will be pertinent to other digital health innovation researchers aspiring to deploy interoperable systems within NHS clinical systems.

How much is enough? Considering minimally important change in youth mental health outcomes

To make decisions in mental health care, service users, clinicians, and administrators need to make sense of research findings. Unfortunately, study results are often presented as raw questionnaire scores at different time points and regression coefficients, which are difficult to interpret with regards to their clinical meaning. Other commonly reported treatment outcome indicators in clinical trials or meta-analyses do not convey whether a given change score would make a noticeable difference to service users. There is an urgent need to improve the interpretability and relevance of outcome indicators in youth mental health (aged 12-24 years), in which shared decision making and person-centred care are cornerstones of an ongoing global transformation of care. In this Personal View, we make a case for considering minimally important change (MIC) as a meaningful, accessible, and user-centred outcome indicator. We discuss what the MIC represents, how it is calculated, and how it can be implemented in dialogues between clinician and researcher, and between youth and clinician. We outline how use of the MIC could enhance reporting in clinical trials, meta-analyses, clinical practice guidelines, and measurement-based care. Finally, we identify current methodological challenges around estimating the MIC and areas for future research. Efforts to select outcome domains and valid measurement instruments that resonate with youth, families, and clinicians have increased in the past 5 years. In this context, now is the time to define demarcations of changes in outcome scores that are clinically relevant, and meaningful to youth and families. Through the use of MIC, youth-centred outcome measurement, analysis, and reporting would support youth-centred therapeutic decision making.

Outcomes Accountability Systems for Early Childhood Disruptive Behaviors: A Scoping Review of Availability

Early childhood disruptive behaviors are common mental health problems among American youth, and if poorly-managed, pose costly psychological and societal burdens. Outcomes accountability systems in clinical practice are vital opportunities to optimize early intervention for common mental health problems; however, such systems seem rare. A scoping review was conducted to summarize the current availability of outcomes accountability systems in clinical programs addressing early childhood disruptive behaviors, particularly in the US. We used PsycINFO to identify peer-reviewed literature published in English from 2005 to 2021, from which we selected 23 publications from the US, UK, and Netherlands on outcomes accountability systems within clinical programs treating common childhood mental health problems. Only 3 out of 23 publications described outcomes accountability efforts specifically for early childhood problems. Within the 3 studies, only one UK-based study specifically targeted early childhood disruptive behaviors. We did not find publications specifically describing outcomes accountability efforts in US-based clinical programs to treat early childhood disruptive behaviors. There are multi-level challenges preventing changes to the prevalent US model of paying a fee for each unit of child mental healthcare, with little regard for patient outcomes. However, opportunities exist to improve US-based accountability efforts; from top-down expansion of financial incentives, accountability initiatives, and PDT evidence-based practices to an iterative, bottom-up development of meaningful outcomes measurement by providers. Greater adoption of outcomes monitoring in US clinical practice for common mental health problems can optimize management of early childhood disruptive behaviors and mitigate long-term societal and economic burdens.

Measuring goal progress using the goal-based outcome measure in Jigsaw - A primary care youth mental health service

BACKGROUND

Jigsaw is a primary care youth mental health service designed to increase access to and utilisation of mental health supports for 12- to 25-year-olds. Effectiveness in community youth mental health services is typically assessed using standardised instruments. The aim of this study was to examine the effectiveness of Jigsaw's brief intervention model of support using an idiographic tool, the goal-based outcome (GBO) measure. The study also aimed to explore the type of goals set by young people engaging with this service.

METHOD

The study sample consisted of a secondary dataset of 4839 young people aged 12-25 years (63.5% female, 36.5% male) who engaged with one of Jigsaw's 13 brief intervention services. Overall, 7366 goals set using the GBO were examined. Inductive thematic analysis was conducted to examine the type of goals set by young people, and inferential analyses were used to examine statistical and reliable changes in goal progress.

RESULTS

The goals young people set focused on developing coping mechanisms and personal growth and managing interpersonal difficulties. Mean scores for progress towards goals improved significantly from pre- to postintervention. The reliable change index (RCI) indicated that change greater than 2.82 points represents reliable change on the GBO, with 78.6% of young people showing reliable improvement. Demographic characteristics did not impact goal progress.

CONCLUSION

These findings suggest Jigsaw's brief intervention model of support is effective in assisting young people reach their goals and that the GBO is a suitable measure for young people attending a community-based youth mental health service.

How to make the most of routine outcome monitoring (ROM): A multitude of clinical decisions and nuances to consider

Routine outcome monitoring (ROM) involves the use of patient-reported standardized outcome measures to monitor progress throughout the course of treatment, followed by feedback of the patient's scores to the therapist. The potential benefits of ROM have been established, however, from our own experiences, we know that the implementation in clinical practice can be challenging. We therefore wanted to explore in more detail exactly how we might be able to apply ROM in difficult clinical contexts. The inspiring case illustrations in this issue of Journal of Clinical Psychology: In Session highlight the heterogeneity in ROM systems, and the way in which ROM can be used in treatment. Just as there are many ways of interpreting a survey data-point, there are also many ways in which ROM may be used to complement the treatment and supervision. Whether or not ROM is implemented may partly be determined by clinic policies and routines, but there remain a multitude of clinical decisions that require careful consideration by the individual therapist. To complement the evidence supporting the benefits of using ROM, further empirical support and clinical guidance is needed on how exactly therapists are to use ROM in their work and how ROM may be used in evidence-based practice. We make suggestions for additional uses of ROM for deliberate practice, and teletherapy practice, and look toward novel ways of assessing progress in the near future.

The effective delivery of digital CBT: a service evaluation exploring the outcomes of young people who completed video conferencing therapy in 2020

Despite its impressive evidence base, there is a widening access gap to receiving cognitive behavioural therapy (CBT). Video conferencing therapy (VCT) offers an effective solution for logistical barriers to treatment, which has been salient throughout the Coronavirus pandemic. However, research concerning the delivery of CBT via VCT for children and young people (CYP) is in its infancy, and clinical outcome data are limited. The aim of this service evaluation was to explore the effectiveness of a VCT CBT intervention for CYP referred from Child and Adolescent Mental Health Services (CAMHS) in the UK. A total of 989 records of CYP who had completed CBT via VCT in 2020 with Healios, a digital mental health company commissioned by the National Health Service (NHS), were examined to determine changes in anxiety, depression and progress towards personalised goals. Routine outcome measures (ROMs) were completed at baseline and endpoint, as well as session by session. Feedback was collected from CYP and their families at the end of treatment. There was a significant reduction in symptoms of anxiety and depression and significant progress towards goals, with pre- to post-effect sizes (Cohen’s d) demonstrating medium to large effects (d=.45 to d=−1.39). Reliable improvement ranged from 31 to 80%, clinical improvement ranged from 33 to 50%, and 25% clinically and reliably improved on at least one measure; 92% reported that they would recommend Healios. This service evaluation demonstrates that Healios’ CBT delivered via VCT is effective for CYP receiving it as part of routine mental health care.

Key learning aims

(1)

Implementation facilitation strategies to promote routine progress monitoring among community therapists

Despite substantial support for the importance of routine progress monitoring (RPM) as part of evidence-based practice, few providers utilize measurement-based care. This study sought to identify the relative importance of facilitation strategies viewed as most helpful for increasing intention to use RPM among 388 ethnically diverse community therapists serving children and families. Four types of facilitation strategies were examined: language/interpretability, automation, staffing/access, and requirements. Mixed analyses of variance found that therapists' reported intentions to use RPM were more influenced by strategies of automating assessment administration, provision of clerical assistance, and agency requirements than by making linguistically appropriate measures available. However, the importance of strategies differed depending on therapist race/ethnicity and current RPM use. Language/interpretability of RPM assessments was less emphasized for non-Hispanic White therapists and therapists who have not yet or only minimally adopted RPM compared with ethnic minority therapists and therapists who regularly use RPM, respectively. Furthermore, therapists who were not current RPM users emphasized automation more than staffing/access. Results may inform prioritization of implementation facilitation strategies for agencies to encourage RPM. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Monitoring and Measurement in Child and Adolescent Mental Health: It's about More than Just Symptoms

Routine outcome monitoring (ROM) provides information to practitioners and others providing healthcare support to demonstrate the impact of interventions and for service evaluation [...].

Evaluation of an Online System for Routine Outcome Monitoring: Cross-sectional Survey Study

BACKGROUND

The use of routine outcome monitoring (ROM) in the treatment of mental health has emerged as a method of improving psychotherapy treatment outcomes. Despite this, very few clinicians regularly use ROM in clinical practice. Online ROM has been suggested as a solution to increase adoption.

OBJECTIVE

The aim of this study is to identify the influence of moving ROM online on client completion rates of self-reported outcome measures and to identify implementation and utilization barriers to online ROM by assessing clinicians' views on their experience using the online system over previous paper-based methods.

METHODS

Client completion rates of self-reported outcome measures were compared pre- and postimplementation of an online system of ROM. In addition, a survey questionnaire was administered to 324 mental health service providers regarding their perception of the benefits with an online system of ROM.

RESULTS

Client completion rates of self-reported measures increased from 15.62% (427/2734) to 53.98% (1267/2347) after they were moved online. Furthermore, 57% (56/98) of service providers found the new system less time-consuming than the previous paper-based ROM, and 64% (63/98) found that it helped monitor clients. However, the perceived value of the system remains in doubt as only 23% (23/98) found it helped them identify clients at risk for treatment failure, and only 18% (18/98) found it strengthened the therapeutic alliance.

CONCLUSIONS

Although the current study suggests mixed results regarding service providers' views on their experience using an online system for ROM, it has identified barriers and challenges that are actionable for improvement.

The Session Wants and Need Outcome Measure: The Development of a Brief Outcome Measure for Single-Sessions of Web-Based Support

Single-session, brief interventions in therapy for young people make up a large proportion of service provision, including in digital mental health settings. Current nomothetic mental health measures are not specifically designed to capture the benefit or ‘change’ directly related to these brief interventions. As a consequence, we set out to design an outcome measure to concretely demonstrate the value of single-session interventions. The Session Wants and Needs Outcome Measure (SWAN-OM) aims to capture in-session goals and focuses on being user-centric, elements critical to the success of single-session and brief interventions which typically are asset-based and solution-focused. We describe the 4-stage process that was followed to develop this measure: (I) classical item generation and development, (II) content and (III) face validity pilot testing, and (IV) a user-experience approach with young people using framework analysis. This final stage was critical to ensure the integration of this outcome tool into a web-based digital therapy setting, a context which adds another layer of design complexity to item and measure development. This iterative methodology was used to overcome the challenges encountered and to place the needs of the young people and service practitioners at the centre of the design process, thus ensuring measure usability. To end, we highlight the main lessons learnt from engaging in this design process. Specifically, the needs of a measure for single-session interventions are considered, before outlining the learning associated with integrating the measure into a digital mental health platform. Both of these areas are emerging fields and, as such, this study contributes to our understanding of how an idiographic patient outcome theory driven measure can be created for use in a web-based digital mental health therapy service.

Digital mental health and neurodevelopmental services: a case-based realist evaluation

Background

The rapid movement of mental health services on the internet following the onset of the COVID-19 pandemic has demonstrated the potential advantages of digital delivery and has highlighted the need to learn from prepandemic digital services.

Objective

The aim of this study is to explore the different elements of interconnected digital mental health and neurodevelopmental services of a well-established provider to the UK National Health Service and how web-based delivery enables young people and their families to access high-quality assessments and interventions in a more timely, flexible, and person-centered manner than in-person delivery.

Methods

A realist evaluation multiple case–study design was used, with 9 pediatric cases (aged 8-15 years) identified as representative of the services provided by Healios. Presenting concerns included autism and ADHD, anxiety and panic attacks, low self-esteem, anger and self-harm. The research literature was used to define the program theory and six context-mechanism-outcome (CMO) statements. The CMOs formed the basis for the initial data extraction, with novel elements added via an iterative process.

Results

We identified 10 key elements of web-based services: flexible delivery and timely response, personalized care to the individual, comprehensive care enabled by multiple interconnected services, effective client engagement and productive therapeutic alliances, use of multiple communication tools, client satisfaction with the service, good clinical outcomes, ease of family involvement throughout sessions or from different locations, facilitation of multi-agency working and integration with National Health Services, and management of risk and safeguarding. These elements supported the six CMOs; there was clear evidence that young people and their families valued the responsiveness and flexibility of the web-based mental health service and, in particular, how quickly they were seen. There was also clear evidence of individual needs being met, good therapeutic alliances, and client satisfaction. Multiple communication tools appeared to maximize engagement and working digitally facilitated multi-agency communication and delivery of safe care. The abovementioned factors may be related to the finding of good clinical outcomes, but the methodology of this study does not allow any conclusions to be drawn regarding causality.

Conclusions

This study demonstrates the effectiveness of interconnected digital mental health and neurodevelopmental services as well as how web-based delivery enables young people and their families to access assessments and interventions in a more timely, flexible, and person-centered manner than in-person delivery. The 10 key elements of web-based service delivery identified through the 9 case studies suggest the potential advantages of web-based work. These elements can inform future research and aid in the delivery of high-quality digital services.

Applying behaviour change theory to understand the barriers to implementing routine outcome monitoring

BACKGROUND

Routine outcome monitoring (ROM) is a valuable tool for monitoring client progress and pre-empting deterioration, however, there is considerable variation in how data are collected and recorded and uptake in clinical practice remains low. The aim of this study was to develop a self-report measure of practitioner attitudes to ROM in order to better understand the barriers to successful implementation in Child and Adolescent Mental Health Services (CAMHS).

METHODS

An anonymous survey was completed by 184 CAMHS practitioners in the United Kingdom. The survey was designed using the Capability, Opportunity, and Motivation Model of Behaviour (COM-B). Practitioners who reported using ROM frequently in their clinical work (53%) were compared to those who used ROM infrequently (47%) across dimensions of the COM-B survey subscales.

RESULTS

Confirmatory factor analysis confirmed the proposed four-factor structure, showing acceptable model fit, with high factor loadings and good reliability for all subscales. Frequent users of ROM exhibited significantly higher psychological capability, physical opportunity, social opportunity, and motivation, compared to infrequent users F (4, 140) = 14.76, p < .0001; Pillai's Trace = .297, partial η²  = .30. Results highlight several barriers to ROM, including the belief that there is not a strong evidence base for ROM, not receiving external training, and not discussing feedback and outcome data in supervision.

IMPLICATIONS

In the hope of improving the successful implementation of ROM, this research provides an evidence-based tool for assessing practitioners' attitudes to ROM, which map on to intervention functions and represent targets for future implementation efforts.

PRACTITIONER POINTS

The value of routine outcome monitoring (ROM) as a means to measure client progress and to elevate the efficiency and quality of mental health care is well-documented in the research literature, however, uptake in practice remains relatively low. This study applied behaviour change theory to develop a psychometrically sound self-report measure of practitioners' perspectives and practices to understand the barriers to implementation in child and adolescent mental health services in the United Kingdom. The complex and multifaceted nature of the barriers to implementation requires multilevel behaviour change strategies at the client, clinician, and organisational level. Recommendations for practice include the need for integrated, multilevel strategies aimed at improving practitioners' capabilities and motivations, strong organisational leadership and a culture of data gathering and sharing, and implementation interventions, which are tailored to target local barriers.

A systematic review of patient-reported outcome measurement (PROM) and provider assessment in mental health: goals, implementation, setting, measurement characteristics and barriers

PURPOSE

To review and integrate the literature on mental-health-related patient-reported outcome measures (PROMs) and routine outcome measures (ROMs), namely in the domains of goals, characteristics, implementation, settings, measurements and barriers. PROM/ROM aims mainly to ascertain treatment impact in routine clinical practice through systematic service users' health assessment using standardized self-report, caretaker and/or provider assessment.

DATA SOURCES

Psych INFO and PubMed including Medline, Biomed Central, EMBASE Psychiatry and Elsevier Science's Direct.

STUDY SELECTION

Systemized review of literature (2000-2018) on implementation and sustainability of PROMs/ROMs in adult mental health settings (MHS).

DATA EXTRACTION AND SYNTHESIS

Systemized review of literature (2000-2018) on numerous aspects of PROM/ROM implementation and sustainability in adult MHS worldwide.

RESULTS

Based on 103 articles, PROMs/ROMs were implemented mostly in outpatient settings for people with assorted mental health disorders receiving a diversity of services. Frequency of assessments and completion rates varied: one-third of projects had provider assessments; about half had both provider and self-assessments. Barriers to implementation: perceptions that PROM/ROM is intrusive to clinical practice, lack of infrastructure, fear that results may be used for cost containment and service eligibility instead of service quality improvement, difficulties with measures, ethical and confidentiality regulations and web security data management regulations.

CONCLUSION

Improving data input systems, sufficient training, regular feedback, measures to increase administrative and logistic support to improve implementation, acceptability, feasibility and sustainability, follow-up assessments and client attrition rate reduction efforts are only some measures needed to enhance PROM/ROM efficiency and efficacy.

Making sense of child and adolescent mental health services (CAMHS): An audit of the referral journey and the use of routine outcome measures (ROMS)

BACKGROUND

There is increased emphasis on the national reporting of Routine Outcome Measures (ROMS) as a way of improving Child and Adolescent Mental Health Services (CAMHS). This data needs to be viewed in context so that reasons for outcome completion rates are understood and monitored over time.

METHOD

We undertook an in-depth prospective audit of consecutive referrals accepted into the Bath and North East Somerset, Swindon and Wiltshire (BSW) CAMHS service from November 2017 to January 2018 (n = 1074) and April to September 2019 (n = 1172).

RESULTS

Across both audits 90% of those offered an appointment were seen with three quarters completing baseline ROMS. One in three were not seen again with around 30% still being open to the service at the end of each audit. Of those closed to the service, paired ROMS were obtained for 46% to 60% of cases. There were few changes in referral problems or complexity factors over time.

CONCLUSION

Understanding the referral journey and the reasons for attrition will help to put nationally collected data in context and can inform and monitor service transformation over time.

Assessing recovery in treatment as usual provided by community child and adolescent mental health services

BACKGROUND

Despite the importance of routinely assessing the outcomes of everyday practice, few studies have reported outcome metrics for child and adolescent mental health services (CAMHS).

AIMS

Our aim is to investigate reliable change and recovery rates for treatment as usual, provided by one community CAMHS over two time periods.

METHOD

We prospectively audited accepted consecutive referrals from November 2017 to January 2018, and April to September 2019. Cases with paired outcomes were identified, and reliable change and recovery rates were calculated.

RESULTS

Baseline outcome data were obtained for 672 (78.2%) and 744 (77.5%) young people in 2018 and 2019, respectively. Of eligible participants, 174 (59.2%) and 155 (45.7%) completed at least one follow-up outcome measure in 2018 and 2019, respectively. Pre- and post-test scores on the Revised Child Anxiety and Depression Scale (RCADS) and Strengths and Difficulties Questionnaire (SDQ) showed a reduction in symptoms. Total RCADS scores showed 21-25% of participants reliably improved, with 44-49% showing reliable improvement on one or more subscale. On the SDQ, 11 (15.5%) and 19 (25.3%) participants reported reliable improvement on at least one subscale in 2018 and 2019, respectively. Reliable recovery rates ranged from 48 to 51% for youth-completed and 40 to 42% for parent-completed RCADS.

CONCLUSIONS

Half of young people receiving treatment as usual from CAMHS reliably improved on at least one routine outcome measure subscale, improvement rates comparable with adult psychological therapies services. Our findings indicate that reliable change and recovery on subscale rather than total scores may be a better indication of outcomes.

Sociodemographic factors associated with routine outcome monitoring: a historical cohort study of 28,382 young people accessing child and adolescent mental health services

BACKGROUND

Patient-reported outcome measures (PROMs) are important tools to inform patients, clinicians and policy-makers about clinical need and the effectiveness of any given treatment. Consistent PROM use can promote early symptom detection, help identify unexpected treatment responses and improve therapeutic engagement. Very few studies have examined associations between patient characteristics and PROM data collection.

METHODS

We used the electronic mental health records for 28,382 children and young people (aged 4-17 years) accessing Child and Adolescent Mental Health Services (CAMHS) across four South London boroughs between the 1st of January 2008 to the 1st of October 2017. We examined the completion rates of the caregiver Strengths and Difficulties Questionnaire (SDQ), a ubiquitous PROM for CAMHS at baseline and 6-month follow-up.

RESULTS AND CONCLUSIONS

SDQs were present for approximately 40% (n = 11,212) of the sample at baseline, and from these, only 8% (n = 928) had a follow-up SDQ. Patterns of unequal PROM collection by sociodemographic factors were identified: males were more likely (aOR 1.07, 95% CI 1.01-1.13), whilst older age (aOR 0.87, 95% CI 0.87-0.88), Black (aOR 0.79 95% CI 0.74-0.84) and Asian ethnicity (aOR 0.75 95% CI 0.66-0.86) relative to White ethnicity, and residence within the most deprived neighbourhood (aOR 0.87 95% CI 0.80-0.94) were less likely to have a record of baseline SDQ. Similar results were found in the sub-group (n = 11,212) with follow-up SDQ collection. Our findings indicate systematic differences in the currently available PROMS data and highlights which groups require increased focus if we are to gain equitable PROM collection. We need to ensure representative PROM collection for all individuals accessing treatment, regardless of ethnic or socioeconomic background; biased data have adverse ramifications for policy and service level decision-making.

A comprehensive mapping of outcomes following psychotherapy for adolescent depression: The perspectives of young people, their parents and therapists

As mental health systems move towards person-centred care, outcome measurement in clinical research and practice should track changes that matter to young people and their families. This study mapped the types of change described by three key stakeholder groups following psychotherapy for depression, and compared the salience of these outcomes with the frequency of their measurement in recent quantitative treatment effectiveness studies for adolescent depression.Using qualitative content analysis, this study identified and categorized outcomes across 102 semi-structured interviews that were conducted with depressed adolescents, their parents, and therapists, as part of a randomized superiority trial. Adolescents had been allocated to Cognitive-Behavioral Therapy, Short-Term Psychoanalytic Psychotherapy, or a Brief Psychosocial Intervention.The study mapped seven high-level outcome domains and 29 outcome categories. On average, participants discussed change in four domains and six outcome categories. The most frequently discussed outcome was an improvement in mood and affect (i.e., core depressive symptoms), but close to half of the participants also described changes in family functioning, coping and resilience, academic functioning, or social functioning. Coping had specific importance for adolescents, while parents and therapists showed particular interest in academic functioning. There was some variation in the outcomes discussed beyond these core themes, across stakeholder groups and treatment arms.Of the outcomes that were frequently discussed in stakeholder narratives, only symptomatic change has been commonly reported in recent treatment studies for adolescent depression. A shift towards considering multiple outcome domains and perspectives is needed to reflect stakeholder priorities and enable more nuanced insights into change processes.

International consensus on a standard set of outcome measures for child and youth anxiety, depression, obsessive-compulsive disorder, and post-traumatic stress disorder

A major barrier to improving care effectiveness for mental health is a lack of consensus on outcomes measurement. The International Consortium for Health Outcomes Measurement (ICHOM) has already developed a consensus-based standard set of outcomes for anxiety and depression in adults (including the Patient Health Questionnaire-9, the Generalised Anxiety Disorder 7-item Scale, and the WHO Disability Schedule). This Position Paper reports on recommendations specifically for anxiety, depression, obsessive-compulsive disorder, and post-traumatic stress disorder in children and young people aged between 6 and 24 years. An international ICHOM working group of 27 clinical, research, and lived experience experts formed a consensus through teleconferences, an exercise using an adapted Delphi technique (a method for reaching group consensus), and iterative anonymous voting, supported by sequential research inputs. A systematic scoping review identified 70 possible outcomes and 107 relevant measurement instruments. Measures were appraised for their feasibility in routine practice (ie, brevity, free availability, validation in children and young people, and language translation) and psychometric performance (ie, validity, reliability, and sensitivity to change). The final standard set recommends tracking symptoms, suicidal thoughts and behaviour, and functioning as a minimum through seven primarily patient-reported outcome measures: the Revised Children's Anxiety and Depression Scale, the Obsessive Compulsive Inventory for Children, the Children's Revised Impact of Events Scale, the Columbia Suicide Severity Rating Scale, the KIDSCREEN-10, the Children's Global Assessment Scale, and the Child Anxiety Life Interference Scale. The set's recommendations were validated through a feedback survey involving 487 participants across 45 countries. The set should be used alongside the anxiety and depression standard set for adults with clinicians selecting age-appropriate measures.

A Patient-reported Outcome Measure of Functional Vision for Children and Young People Aged 8 to 18 Years With Visual Impairment

PURPOSE

To develop age-appropriate extensions of a patient-reported outcome measure for capturing the functional impact of visual impairment on daily activities of children and young people aged 8 up to 18 years.

DESIGN

Questionnaire development and validation study.

METHODS

Pediatric Ophthalmology departments at Great Ormond Street Hospital and Moorfields Eye Hospital, and, in the final study phase, 20 further UK hospitals. Children and young people (aged 6-19 years) with visual impairment (acuity of the logarithm of the minimum angle of resolution (LogMAR) worse than 0.50 in the better eye) due to any cause but without significant non-ophthalmic impairments. We used our prototype FVQ_CYP for 10-15 year olds as the foundation. Twenty-nine semi-structured interviews confirmed relevance of existing, and identified new, age-specific items. Twenty-eight cognitive interviews captured information regarding comprehensibility and format. The FVQ_Child (8-12 years) and FVQ_Young Person (13-18 years) were evaluated with a national sample of 113 children and 96 young people using Rasch analysis.

RESULTS

Issues emerging from interviews with children and young people were largely congruent with those elicited originally with 10-15 year olds. The 28-item FVQ_Child and 38-item FVQ_Young Person versions have goodness-of-fit statistics within the interval 0.5, 1.5 and person separation values of 5.87 and 6.09 respectively. Twenty-four overlapping "core" items enabled their calibration on the same measurement scale. Correlations with acuity (r = 0.47) demonstrated construct validity.

CONCLUSIONS

The FVQ_C and FVQ_Young Person are robust age-appropriate versions of the FVQ_CYP which can be used cross-sectionally or sequentially/longitudinally across the age range of 8 up to 18 years in clinical practice and research.

Factors affecting the implementation of an outcome measurement feedback system in youth mental health settings

Objective: Measurement feedback systems provide clinicians with regular snapshots of a client's mental health status, which can be used in treatment planning and client feedback. There are numerous barriers to clinicians using outcome measures routinely. This study aimed to investigate factors affecting the use of a measurement feedback system across youth mental health settings. Methods: The participants were 210 clinicians from headspace youth mental health services across Australia. They were surveyed on predictors and use of MyLifeTracker, a routine outcome measure. This was explored through three processes: looking at MyLifeTracker before session, using MyLifeTracker in treatment planning, and providing feedback of MyLifeTracker scores to clients. Results: Clinicians were more likely to look at MyLifeTracker before session, less likely to use it in treatment planning, and least likely to provide MyLifeTracker scores to clients. Each measurement feedback system process had a distinct group of predictors. Perceptions of MyLifeTracker's practicality was the only significant predictor of all three processes. Conclusion: Practically, organisations and supervisors can increase the use of measurement feedback systems through targeted supports.

Measurement-based Data to Monitor Quality: Why Specification at the Population Level Matter?

Measurement-based care is conceptualized as a driver for quality improvement. The triple aim in the National Quality Strategy purposively muddles the population levels to provide a health policy goal that is encompassing, transactional, and will stimulate change. Specification of the population level has implications for the purpose, proposed target mechanisms that drive quality improvement, methodologic challenges, and implications for program evaluation and data interpretation. To demonstrate, population levels are conceptualized at the individual (tier 1), clinical aggregate (tier 2), and national level (tier 3).

Clinical Demonstration of the Potential of Parental Feedback in Reducing Deterioration During Group Psychotherapy With Children

In recent years, great efforts have been exerted to minimize the rates of deterioration in clinical practice, especially in child psychotherapy. The present study explored the potential effect of routine outcome monitoring (ROM) with parents as a preventive intervention to reduce deterioration in children. Twenty-five children receiving treatment for emotional problems were randomized to parent-based, ROM-assisted group psychotherapy or to treatment as usual (TAU). A mixed-methods approach was utilized, with the number of deteriorating cases compared at the group level and two case illustrations assessed at the individual level. At the group level, there were fewer cases of deterioration in child's anxiety, parental stress, and quality of parent's alliance in the ROM-assisted group, compared with TAU. Case studies illustrated how ROM can be used as a tool to communicate with parents to prevent deterioration. Routine outcome monitoring in child psychotherapy may thus benefit therapy process and outcome. Limitations and directions for future research are discussed.

The Child Outcome Rating Scale: validating a four-item measure of psychosocial functioning in community and clinic samples of children aged 10-15

Psychosocial functioning is considered an important and valued outcome in relation to young people's mental health as a construct distinct from psychiatric symptomology, especially in the light of an increasing focus on transdiagnostic approaches. Yet, the level of psychosocial functioning is rarely directly asked of young people themselves, despite the widespread recognition that the young person's perspective is valuable and is often at odds with those of other reporters, such as parents or professionals. One possible reason for this is that the field lacks a clear agreed tool to capture this information in a non-burdensome way. To begin to address this gap, this paper describes psychometric analysis of the Child Outcome Rating Scale (CORS), a brief and highly accessible self-report measure of young people's psychosocial functioning already used extensively by mental health professionals around the world but with only limited data on psychometric robustness. Using large community (n = 7822) and clinic (n = 2604) samples, we explore the factor structure, construct validity, internal consistency, differential item functioning, and sensitivity of the CORS. We found that the CORS stands up to psychometric scrutiny, having found satisfactory levels of reliability, validity, and sensitivity in this sample. We also found that the CORS is suitable for use with young people as old as 15 years old. That the CORS has been found to be psychometrically robust while being highly feasible (brief, simple, easy to administer) for use in busy clinical settings, combined with the fact that the CORS has already been widely adopted by clinicians and young people, suggests CORS may be an important tool for international use.

Individualized Progress Measures Are More Acceptable to Clinicians Than Standardized Measures: Results of a National Survey

Despite research supporting measurement-based care grounded in standardized progress measures, such measures are underutilized by clinicians. Individualized measures of client-specific targets present an alternative, but little is known about their acceptability or use. We compared attitudes toward and use of standardized and individualized progress measures in a national sample of 504 clinicians. Clinicians reported neutral to positive attitudes toward both types of measures, but strongly preferred and were more likely to use individualized measures. Clinician attitudes, theoretical orientation, and work setting predicted assessment preferences and practices. Implications for dissemination and implementation of measurement-based care are discussed.

Nanowire-Based Biosensors: From Growth to Applications

Over the past decade, synthesized nanomaterials, such as carbon nanotube, nanoparticle, quantum dot, and nanowire, have already made breakthroughs in various fields, including biomedical sensors. Enormous surface area-to-volume ratio of the nanomaterials increases sensitivity dramatically compared with macro-sized material. Herein we present a comprehensive review about the working principle and fabrication process of nanowire sensor. Moreover, its applications for the detection of biomarker, virus, and DNA, as well as for drug discovery, are reviewed. Recent advances including self-powering, reusability, sensitivity in high ionic strength solvent, and long-term stability are surveyed and highlighted as well. Nanowire is expected to lead significant improvement of biomedical sensor in the near future.

Implementing routine outcome monitoring in public mental health services in Israel: Shared and unique challenges

OBJECTIVES

This study aimed to assess the feasibility, benefits, and challenges of routine outcome monitoring (ROM) in a public mental health centre in Israel. This is the first initiation of ROM implementation in a setting of a large psychiatric hospital, affiliated with the largest health maintenance organization in Israel, Clalit Health Services.

METHODS

Four ambulatory units were invited to participate in the implementation of ROM. Prior to initiation of recruitment, staff meetings were held and broad descriptions of current knowledge regarding benefits and challenges were discussed. Upon initiation of recruitment, patients completed outcome and process questionnaires during each session, and reports of patients' progress were sent to therapists soon after sessions ended.

RESULTS

One hundred sixty-three patients were invited to participate in measurement and feedback of therapy outcomes. Overall, 101 patients and 32 therapists agreed and actively participated in the implementation phase of ROM, producing 535 evaluated measurements and reports. Clinical, methodological, legal, administrative, and ethical aspects of the implementation were encountered and documented throughout the implementation process.

CONCLUSIONS

Medical confidentiality issues, as well as the multidisciplinary nature of hospital staff work, serve as central and unique challenges for incorporating ROM in a public psychiatric hospital. Other challenges that were previously reported in other implementation studies were also encountered and included therapist overload and objections, attrition, and the need for organizational support. Recommendations for future pioneering efforts for ROM implementation in large psychiatric facilities are discussed.

Innovations in Practice: Using clinician-rated outcomes to support improved service decision making in a Child and Adolescent Mental Health Service

BACKGROUND

Clinical outcomes are now routinely collected in most services. However, there is a need to make full use of the information collected in order to improve the use of limited Child and Adolescent Mental Health Service (CAMHS) resources. This paper describes a method of improving service decision making by making the interpretation of outcomes data accessible to frontline staff.

METHOD

Clinician ratings of child outcomes for 2876 cases were routinely collected between 2009 and 2013 in a single CAMHS service. These outcomes were assessed against seven 'point of entry' and 'treatment' variables.

RESULTS

Older children, referred by social care and presenting with multiple problems were associated with worse treatment outcomes than other service users. These findings were used to create an accessible Service Evaluation Chart of outcomes, to support discussion and decision making within the service. This process enabled the identification of a group who had particularly poor outcomes and resulted in consideration about service changes to try to improve outcomes for this specific group.

CONCLUSIONS

Providing clinicians with accessible information about outcomes promotes the likelihood of outcomes being used in service decision making.

Using patient-reported outcome measures to improve service effectiveness for supervisors: a mixed-methods evaluation of supervisors' attitudes and self-efficacy after training to use outcome measures in child mental health

BACKGROUND

Patient-reported outcome measures (PROMs) are recommended by healthcare systems internationally, but there are a number of barriers to implementation. The aim of this research was to examine the impact of training supervisors in using PROMs on clinical practice, given the importance of leadership when changing behaviour.

METHOD

Data included pre-post questionnaires from 42 supervisors, interviews after training with six supervisees and nonparticipant observations of nine video-recorded supervision sessions.

RESULTS

After training, supervisors had more positive attitudes to administering PROMs and using feedback from PROMs and had higher levels of self-efficacy about using PROMs in supervision.

CONCLUSIONS

Findings are in line with the growing body of evidence that training child mental health staff to use PROMs may be associated with changes in attitudes, self-efficacy and use of PROMs.

What are "good outcomes" for adolescents in public mental health settings?

BACKGROUND

In line with the evidence-based paradigm, routine outcome monitoring and clinical feedback systems are now being recommended and implemented in youth mental health services. However, what constitutes a good outcome for young service users is not fully understood. In order to successfully monitor outcomes that are clinically and personally relevant for the service user that are to benefit from these systems, we need to gain more knowledge of what young service users value as meaningful outcomes of youth mental health services.

AIM

To contribute knowledge into what constitutes "good outcomes" from the experiences of adolescent service users in public mental health systems.

METHODS

A qualitative in-depth study of the experiences and reflections from 22 adolescents aged 14-19 years, currently or recently being in public mental health services. The data material was analyzed using a systematic step-wise consensual qualitative research framework for team-based analysis.

RESULTS

An overarching theme of outcome as having developed a stronger autonomy and safer identity emerged from the analysis, with the subsequent five constituent themes, named from the words of the adolescent clients: (1) I've discovered and given names to my emotions, (2) I've started to become the person that I truly am, (3) I've dared to open up and feel connected to others, (4) I've started saying yes where I used to say no, and, (5) I've learned how to cope with challenges in life.

CONCLUSION

"Good outcomes" in youth mental health services should be understood as recovery oriented, sensitive to developmental phases, and based on the personal goals and values of each adolescent client.

Monitoring Treatment Progress and Providing Feedback is Viewed Favorably but Rarely Used in Practice

Numerous trials demonstrate that monitoring client progress and using feedback for clinical decision-making enhances treatment outcomes, but available data suggest these practices are rare in clinical settings and no psychometrically validated measures exist for assessing attitudinal barriers to these practices. This national survey of 504 clinicians collected data on attitudes toward and use of monitoring and feedback. Two new measures were developed and subjected to factor analysis: The monitoring and feedback attitudes scale (MFA), measuring general attitudes toward monitoring and feedback, and the attitudes toward standardized assessment scales-monitoring and feedback (ASA-MF), measuring attitudes toward standardized progress tools. Both measures showed good fit to their final factor solutions, with excellent internal consistency for all subscales. Scores on the MFA subscales (Benefit, Harm) indicated that clinicians hold generally positive attitudes toward monitoring and feedback, but scores on the ASA-MF subscales (Clinical Utility, Treatment Planning, Practicality) were relatively neutral. Providers with cognitive-behavioral theoretical orientations held more positive attitudes. Only 13.9 % of clinicians reported using standardized progress measures at least monthly and 61.5 % never used them. Providers with more positive attitudes reported higher use, providing initial support for the predictive validity of the ASA-MF and MFA. Thus, while clinicians report generally positive attitudes toward monitoring and feedback, routine collection of standardized progress measures remains uncommon. Implications for the dissemination and implementation of monitoring and feedback systems are discussed.

Developing a patient-reported outcome measure for HIV care on perceived barriers to antiretroviral adherence: assessing the needs of HIV clinicians through qualitative analysis

PURPOSE

To identify HIV clinicians' needs for the clinical use of a new patient-reported outcome measure (PRO) on barriers to antiretroviral therapy (ART) adherence.

METHODS

In 2015, five focus groups with 31 clinicians from France were transcribed, coded with Atlas.ti, and submitted to a typological analysis.

RESULTS

The analysis identified seven patient profiles, each tied to distinct barriers to adherence and to specific needs for the PRO's content, data collection and transmission. Clinicians preferred, for the patient who is: (1) 'passive,' that the PRO collect information on ART knowledge, to ensure that the prescription's instructions are being respected; (2) 'misleading,' that it be able to detect adherence to ART and socially desirable responses; (3) 'stoic,' that questions challenge the patient to recognize treatment-specific side effects; (4) 'hedonistic,' that the PRO contains content on lifestyle and risk-taking; (5) 'obsessive,' that the PRO captures quality of life and stressful life events; (6) 'overburdened,' that the PRO provides information on the person's home environment, socioeconomic status and cultural constraints. For all or most patient profiles, the clinicians wished that the PRO be completed, minimally, prior to the medical consultation and to receive alerts, under varying conditions, when problematic scores were detected. Depending on the profile, there was preference for the inclusion of open-ended questions and transmission of cross-sectional, periodic or longitudinal PRO data.

CONCLUSION

Overall, this study's findings suggest that to support the clinical management of ART adherence, our PRO must meet the needs of a wide variety of patients and must perform multiple functions.

Goal formulation and tracking in child mental health settings: when is it more likely and is it associated with satisfaction with care?

Goal formulation and tracking may support preference-based care. Little is known about the likelihood of goal formulation and tracking and associations with care satisfaction. Logistic and Poisson stepwise regressions were performed on clinical data for N = 3757 children from 32 services in the UK (M age = 11; SDage = 3.75; most common clinician-reported presenting problem was emotional problems = 55.6%). Regarding the likelihood of goal formulation, it was more likely for pre-schoolers, those with learning difficulties or those with both hyperactivity disorder and conduct disorder. Regarding the association between goal formulation and tracking and satisfaction with care, parents of children with goals information were more likely to report complete satisfaction by scoring at the maximum of the scale. Findings of the present research suggest that goal formulation and tracking may be an important part of patient satisfaction with care. Clinicians should be encouraged to consider goal formulation and tracking when it is clinically meaningful as a means of promoting collaborative practice.

The Outcomes and Impact Scale - Revised: the psychometric properties of a scale assessing the impact of service provision

BACKGROUND

The Outcomes and Impact Scale - Revised (O&IS-R) was developed to measure the impact of service provision on adults with disability. The aim of this research was to explore the psychometric properties of the scale following a recent revision.

METHOD

Adults with disability and/or their carers or support workers participated in the research. Participants were recruited across Australia using a range of strategies and completed the scale in relation to a service or support that they nominated. Two forms of the scale were developed (easy and standard English), which could be completed in hardcopy or via a bespoke website.

RESULTS

The O&IS-R demonstrated good internal consistency and alternate form reliability. Factor analysis of the scale revealed one factor that clearly corresponded to the whole of life construct that the scale was designed to measure and, in general, participants with disability and staff understood the intent or purpose of the survey. All domains except the spiritual and political domain were considered to be relevant service outcomes. Some changes to wording were suggested to improve clarity.

CONCLUSIONS

The O&IS-R is a psychometrically sound scale that can be used in service and research settings to measure the impact of services and supports.

A qualitative exploration of attitudes towards the use of outcome measures in child and adolescent mental health services

The aim of the present research was to explore clinician attitudes to outcome measures and, in particular, the facilitators and barriers to implementing outcome measures. An up-to-date exploration of clinician attitudes is especially needed in the context of recent policies on the implementation of outcome measures in child and adolescent mental health services (CAMHS), and because evidence suggests that there is a disparity between policy recommendations and the use of outcome measures in clinical practice. Semi-structured interviews were conducted with nine CAMHS clinicians from a Mental Health Trust in South London. Two levels of implementation emerged from the analysis: (1) the service level, regarding the implementation of outcome measures across a service to inform service improvement and (2) the session level, regarding the implementation of outcome measures within individual clinical sessions. The present research described training and ongoing support as a crucial facilitator of use at both service and session levels. This included help overcoming local contextual barriers, such as resources, information systems and administrative processes. The research showed that a balance is needed between a mandatory and uniform approach across a service and providing clinicians with support to use outcome measures with all service users for whom they are appropriate.