Getting More Out of Clinical Documentation: Can Clinical Dashboards Yield Clinically Useful Information?

This study investigated coded data retrieved from clinical dashboards, which are decision-support tools that include a graphical display of clinical progress and clinical activities. Data were extracted from clinical dashboards representing 256 youth (M age = 11.9) from 128 practitioners who were trained in the Managing and Adapting Practice (MAP) system (Chorpita & Daleiden in BF Chorpita EL Daleiden 2014 Structuring the collaboration of science and service in pursuit of a shared vision. 43(2):323 338. 2014, Chorpita & Daleiden in BF Chorpita EL Daleiden 2018 Coordinated strategic action: Aspiring to wisdom in mental health service systems. 25(4):e12264. 2018) in 55 agencies across 5 regional mental health systems. Practitioners labeled up to 35 fields (i.e., descriptions of clinical activities), with the options of drawing from a controlled vocabulary or writing in a client-specific activity. Practitioners then noted when certain activities occurred during the episode of care. Fields from the extracted data were coded and reliability was assessed for Field Type, Practice Element Type, Target Area, and Audience (e.g., Caregiver Psychoeducation: Anxiety would be coded as Field Type = Practice Element; Practice Element Type = Psychoeducation; Target Area = Anxiety; Audience = Caregiver). Coders demonstrated moderate to almost perfect interrater reliability. On average, practitioners recorded two activities per session, and clients had 10 unique activities across all their sessions. Results from multilevel models showed that clinical activity characteristics and sessions accounted for the most variance in the occurrence, recurrence, and co-occurrence of clinical activities, with relatively less variance accounted for by practitioners, clients, and regional systems. Findings are consistent with patterns of practice reported in other studies and suggest that clinical dashboards may be a useful source of clinical information. More generally, the use of a controlled vocabulary for clinical activities appears to increase the retrievability and actionability of healthcare information and thus sets the stage for advancing the utility of clinical documentation.

The role of implementation organizations in scaling evidence-based psychosocial interventions

BACKGROUND

To bring evidence-based interventions (EBIs) to individuals with behavioral health needs, psychosocial interventions must be delivered at scale. Despite an increasing effort to implement effective treatments in communities, most individuals with mental health and behavioral problems do not receive EBIs. We posit that organizations that commercialize EBIs play an important role in disseminating EBIs, particularly in the USA. The behavioral health and implementation industry is growing, bringing the implementation field to an important inflection point: how to scale interventions to improve access while maintaining EBI effectiveness and minimizing inequities in access to psychosocial intervention.

MAIN BODY

We offer a first-hand examination of five illustrative organizations specializing in EBI implementation: Beck Institute for Cognitive Behavioral Therapy; Incredible Years, Inc.; the PAXIS Institute; PracticeWise, LLC; and Triple P International. We use the Five Stages of Small Business Growth framework to organize themes. We discuss practical structures (e.g., corporate structures, intellectual property agreements, and business models) and considerations that arise when trying to scale EBIs including balancing fidelity and reach of the intervention. Business models consider who will pay for EBI implementation and allow organizations to scale EBIs.

CONCLUSION

We propose research questions to guide scaling: understanding the level of fidelity needed to maintain efficacy, optimizing training outcomes, and researching business models to enable organizations to scale EBIs.

Assessing practical implementation of modular psychotherapy for youth in community-based settings using benchmarking

Background

Achieving high quality outcomes in a community context requires the strategic coordination of many activities in a service system, involving families, clinicians, supervisors, and administrators. In modern implementation trials, the therapy itself is guided by a treatment manual; however, structured supports for other parts of the service system may remain less well-articulated (e.g., supervision, administrative policies for planning and review, information/feedback flow, resource availability). This implementation trial investigated how a psychosocial intervention performed when those non-therapy supports were not structured by a research team, but were instead provided as part of a scalable industrial implementation, testing whether outcomes achieved would meet benchmarks from published research trials.

Method

In this single-arm observational benchmarking study, a total of 59 community clinicians were trained in the Modular Approach to Therapy for Children (MATCH) treatment program. These clinicians delivered MATCH treatment to 166 youth ages 6 to 17 naturally presenting for psychotherapy services. Clinicians received substantially fewer supports from the treatment developers or research team than in the original MATCH trials and instead relied on explicit process management tools to facilitate implementation. Prior RCTs of MATCH were used to benchmark the results of the current initiative. Client improvement was assessed using the Top Problems Assessment and Brief Problem Monitor.

Results

Analysis of client symptom change indicated that youth experienced improvement equal to or better than the experimental condition in published research trials. Similarly, caregiver-reported outcomes were generally comparable to those in published trials.

Conclusions

Although results must be interpreted cautiously, they support the feasibility of using process management tools to facilitate the successful implementation of MATCH outside the context of a formal research or funded implementation trial. Further, these results illustrate the value of benchmarking as a method to evaluation industrial implementation efforts. Plain Language Summary: Randomized effectiveness trials are inclusive of clinicians and cases that are routinely encountered in community-based settings, while continuing to rely on the research team for both clinical and administrative guidance. As a result, the field still struggles to understand what might be needed to support sustainable implementation and how interventions will perform when brought to scale in community settings without those clinical trial supports. Alternative approaches are needed to delineate and provide the clinical and operational support needed for implementation and to efficiently evaluate how evidence-based treatments perform. Benchmarking findings in the community against findings of more rigorous clinical trials is one such approach. This paper offers two main contributions to the literature. First, it provides an example of how benchmarking is used to evaluate how the Modular Approach to Therapy for Children (MATCH) treatment program performed outside the context of a research trial. Second, this study demonstrates that MATCH produced comparable symptom improvements to those seen in the original research trials and describes the implementation strategies associated with this success. In particular, although clinicians in this study had less rigorous expert clinical supervision as compared with the original trials, clinicians were provided with process management tools to support implementation. This study highlights the importance of evaluating the performance of intervention programs when brought to scale in community-based settings. This study also provides support for the use of process management tools to assist providers in effective implementation.

Pilot Study of the MAP Curriculum for Psychotherapy Competencies in Child and Adolescent Psychiatry

OBJECTIVE

This pilot study aimed to evaluate the relevance, feasibility, acceptability, and instructional efficacy of the Managing and Adapting Practice (MAP) curriculum for enhancing the teaching of psychotherapy to child and adolescent psychiatry (CAP) fellows. MAP is a system of resources and decision models that supports practitioners in selecting and implementing psychotherapeutic interventions for children and adolescents. The MAP curriculum includes modules to guide education about psychotherapeutic procedures (e.g., behavioral activation) common in evidence-based treatments for an array of childhood problems and to support development of competencies in assessment, treatment planning, and reflective practice.

METHODS

Curriculum coding was used to examine the relevance of MAP's core components to the skills articulated in the Accreditation Council for Graduate Medical Education (ACGME) CAP milestones. Feasibility, acceptability, and learning outcomes were examined after delivery of the MAP curriculum to 12 CAP fellows at two sites, with instructional features tailored according to faculty preferences and training program structure.

RESULTS

Coding suggested that the MAP curriculum was relevant to 95% of the 21 ACGME CAP training subcompetencies. Feasibility was indicated by the successful delivery of 100% of the planned MAP curriculum across the two sites. Acceptability was supported by positive feedback from the CAP fellows, and psychotherapy knowledge increased significantly. Finally, case review scores (mean±SD=2.21±0.15) showed positive posttraining application of MAP to two patients and exceeded scores achieved by other samples of mental health professionals.

CONCLUSIONS

This pilot study demonstrated the potential for the MAP curriculum to support CAP education. MAP's versatility as a curriculum supports broader adoption, with continuing rigorous empirical evaluation.

The value of a modular, multi-focal, therapeutic approach to addressing child maltreatment: Hope for Children and Families Intervention Resources - a discussion article

This discussion article begins by highlighting two trends apparent in the field of child maltreatment. The first, an awareness that multiple forms of maltreatment - polyvictimization - is the rule in populations of abused and neglected children rather than the exception. The second is that current types of child maltreatment are being extended to include Adverse Childhood Experiences (ACEs). These include intra-familial violence, mental health, substance misuse, and inter-generational abuse. The paper introduces an innovative strategy to help the field better organise and prevent the extensive sequelae of polyvictimization and ACEs. This strategy involves the development of a modular approach, which identifies common treatment elements and common factors across the field of effective interventions and organizes them, providing a co-ordinated framework for practitioners to use to address the diverse needs of children and families when vulnerability or maltreatment are identified. The development of this approach, the Hope for Children and Families (HfCF) Intervention Resources, is described using a case example to illustrate its logic and structure. Findings from the HFCF pilot and subsequent training programs suggest that this new approach could be an important milestone in the protection of children from violence, abuse and neglect on the 30th Anniversary of the United Nation's Convention on the Rights of the Child (1989).

Creating a prepared mental health workforce: comparative illustrations of implementation strategies

BACKGROUND

Psychotherapy implementation must contend with the task of preparing a mental health workforce to provide the highest quality services to as much of a service population as possible, in high-income as well as low-to-middle income countries.

OBJECTIVE

We outline general challenges and solutions and investigate how well various implementation strategies would fit a clinical population.

METHODS

Using a data set from a prior cluster randomised trial with a clinically diverse population and 33 intervention practices, we presented multiple illustrations comparing the ability of different implementation strategies to serve youth and families with procedures in which service providers were trained.

FINDINGS

A series of survival functions demonstrated that many common implementation strategies are unlikely to create a prepared workforce, given the large and diverse number of practices needed to be mastered by providers.

CLINICAL IMPLICATIONS

'Benchmark' solutions that afforded superior coverage of the service population could be supported through paced learning approaches (ie, training interventions a little at a time) using extensible, modular intervention designs.

Design process and protocol description for a multi-problem mental health intervention within a stepped care approach for adolescents in India

This paper documents the collaborative design of a mental health intervention for adolescents in India with anxiety, depression, or anger-related concerns. The process was characterized by three phases of formative activities: (1) an intensive review of the service context, (2) selection of an overall design strategy (e.g., whether to choose existing evidence-based treatments or build new treatments in context), and (3) a period of prototyping, testing, and refining. Each phase resulted in specific outputs, which were, respectively, (1) a detailed articulation of values and preferences (setting expectations for what the ideal protocol should be), (2) a set of build parameters representing a blueprint that managed strategic compromises for this context, and (3) a working protocol. We outline the steps of this design process, summarize data from an open-trial clinical case series, and illustrate the resulting working protocol, which will be tested in a future larger trial. We conclude with insights and observations likely to be relevant to protocol design activity in a variety of contexts, most particularly those in low-and-middle-income countries such as India.

Implementing Evidence Based Practices for Children's Mental Health: A Case Study in Implementing Modular Treatments in Community Mental Health

There is strong enthusiasm for utilizing implementation science in the implementation of evidence-based programs in children's community mental health, but there remains work to be done to improve the process. Despite the proliferation of implementation frameworks, there is limited literature providing case examples of overcoming implementation barriers. This article examines whether the use of three implementations strategies, a structured training and coaching program, the use of professional development portfolios for coaching, and a progress monitoring data system, help to overcome barriers to implementation by facilitating four implementation drivers at a community mental health agency. Results suggest that implementation is a process of recognizing and adapting to both predictable and unpredictable barriers. Furthermore, the use of these implementation strategies is important in improving implementation outcomes.

Overlapping and Non-overlapping Practices in Usual and Evidence-Based Care for Youth Anxiety

This study compared consistencies and discrepancies in usual care with practices derived from the evidence-base (PDEB) for youth anxiety in a public mental health system. Youth-level factors (diagnosis, functional impairment) as predictors of the discrepancies were also examined. Psychosocial and service data from 2485 youth with an anxiety disorder and/or receiving services for an anxiety treatment target were extracted. Therapists (N = 616) identified the treatment targets and practices youth received. Although many PDEB for youth anxiety were used by therapists in this sample, Exposure was only used in 15% of cases. Practices not consistent with youth anxiety treatment were also reported and included: PDEB for other conditions, practices common to all therapies, and practices that are not consistent with evidence-based care. Age and diagnosis predicted the delivery of PDEB for youth anxiety. Usual care incorporated many components of evidence-based care but was more diffuse and less focused on well-supported practices.

Evidence-Based Decision Making in Youth Mental Health Prevention

Given the impressive amount of knowledge relevant to prevention efforts, this paper articulates strategies to capitalize on such knowledge through evidence-based decision making. Knowledge, or "evidence," is understood here as coming from multiple sources, including research, individual people, group history, and relevant theory. The presented strategies to facilitate evidence-based decision making are: (1) intervention knowledge management; (2) collaborative design; (3) knowledge resources for intervention; and (4) developmentally sensitive training and supervision. Examples and benefits are outlined for each strategy. It is ultimately argued that evidence-based decision making embodies the scientific approach, and is worth consideration within primary prevention, given its early success in secondary intervention of youth mental health.

The Old Solutions Are the New Problem: How Do We Better Use What We Already Know About Reducing the Burden of Mental Illness?

Kazdin and Blase (2011) propose that traditional models of delivering therapy require more resources than are available to address the scope of mental illness. We argue that finding new platforms and avenues for our existing treatments is a good start but that it is not enough. We contend that the field also needs to develop formal strategies to reorganize its increasing abundance of knowledge to address the scarcity of resources for its application. If we can better utilize our existing knowledge, treatment delivery and service resource allocation can become more efficient and effective. If the field continues with its almost singular emphasis on knowledge proliferation (e.g., developing new treatments), as opposed to knowledge management (e.g., developing new ways to design, apply, and organize existing treatments), the problem outlined by Kazdin and Blase cannot be solved.

Building an evidence-informed service array: Considering evidence-based programs as well as their practice elements

OBJECTIVE

This study empirically examined options for building an evidence-informed service array, comparing strategies to maximize the application of evidence-based treatment literature in a clinical service system. The overall goal was to determine the smallest set of treatments that could serve the largest percentage of clients. Solutions to this problem differ depending on how one defines "treatment."

METHOD

Treatments were conceptualized as (a) programs (integrated treatments produced by specific research laboratories or investigators), and (b) collections of their constituent common procedures, referred to as practice elements. Programs listed by 2 separate government-sanctioned registries were selected to illustrate the effects of "program" conceptualizations, and all available clinical trials testing the programs were analyzed. Practice elements were identified from these same studies and from studies of other treatments that met a standard of evidence but had not been organized into programs on these lists. Relevance mapping methodology was used to identify optimal sets of programs and practice elements.

RESULTS

Among a large, diverse clinical population, results identified 11%-22% of youths for whom practice elements provide an evidence-informed treatment option whereas no programs meeting the standard of evidence were available on the registries. Results for the practice elements were able to be matched by a hybrid combination: "best" programs, which were then extended by practice elements.

CONCLUSIONS

These results demonstrated that there are multiple ways to conceptualize treatments when planning a service array, and these options have significant implications regarding who can be served by treatments supported by evidence.

Doing more with what we know: introduction to the special issue

This article introduces a special issue that provides an overarching conceptual model for advancing the impact of science on service delivery and includes some illustrations of these concepts in action from a variety of research teams in a diversity of contexts. Themes of the special issue include balancing considerations of efficacy, effectiveness, and extensiveness--for example, ensuring that treatments are not only reliable but also robust and widely relevant. It is argued that such a balance might be achieved through an increased focus on improving coordination of system resources (e.g., clients, providers, treatments, training programs) and through dynamic and developmental designs. The special issue is intended to raise the broader question of whether our current paradigms are satisfactory in moving us toward our shared vision, or whether we could do more with what we already know.

MAPping Los Angeles County: taking an evidence-informed model of mental health care to scale

We describe the scaling up of an evidence-informed model of care, Managing and Adapting Practice (MAP) in Los Angeles County, California. MAP complemented an array of evidence-based programs selected by the county as part of a large system reform effort designed to improve care for children and adolescents. In addition, we discuss the MAP model for training therapists and present data both on how the training model performed and on the outcomes of youths treated by therapists trained in MAP. We examined the success of two different training pathways for MAP therapists: (a) national training model and (b) MAP agency supervisor model (i.e., train the trainer). We also examined utilization of MAP and outcomes of clients served by MAP. Both the national training and MAP agency supervisor model were successful in producing MAP therapists in a timely fashion and with acceptable competency scores. Furthermore, a large number of clients were receiving MAP services. Finally, outcomes for youth treated with MAP were strong, with effect sizes ranging from .59 to .80 on the Youth Outcome Questionnaire. These data support the notion that scaling up a mental health services approach in a system can be achieved through a strong and broad partnership among relevant stakeholders, can involve a train-the-trainer model, and can result in strong outcomes for clients.

Structuring the collaboration of science and service in pursuit of a shared vision

The enduring needs of our society highlight the importance of a shared vision to improve human functioning and yield better lives for families and communities. Science offers a powerful strategy for managing the inevitable uncertainty in pursuit of these goals. This article presents ideas and examples of methods that could preserve the strengths of the two major paradigms in children's mental health, evidence-based treatments and individualized care models, but that also have the potential to extend their applicability and impact. As exemplified in some of the articles throughout this issue, new models to connect science and service will likely emerge from novel consideration of better ways to structure and inform collaboration within mental health systems. We contend that the future models for effective systems will involve increased attention to (a) client and provider developmental pathways, (b) explicit frameworks for coordinating people and the knowledge and other resources they use, and (c) a balance of evidence-based planning and informed adaptation. We encourage the diverse community of scientists, providers, and administrators in our field to come together to enhance our collective wisdom through consideration of and reflection on these concepts and their illustrations.

Long-term outcomes for the Child STEPs randomized effectiveness trial: a comparison of modular and standard treatment designs with usual care

OBJECTIVE

This article reports outcomes from the Child STEPs randomized effectiveness trial conducted over a 2-year period to gauge the longer term impact of protocol design on the effectiveness of evidence-based treatment procedures.

METHOD

An ethnoracially diverse sample of 174 youths ages 7- 13 (N = 121 boys) whose primary clinical concerns involved diagnoses or clinical elevations related to anxiety, depression, or disruptive behavior were treated by community therapists randomly assigned to 1 of 3 conditions: (a) standard, which involved the use of 1 or more of 3 manualized evidence-based treatments, (b) modular, which involved a single modular protocol (Modular Approach to Treatment of Children With Anxiety, Depression, or Conduct Problems; MATCH) having clinical procedures similar to the standard condition but flexibly selected and sequenced using a guiding clinical algorithm, and (c) usual care.

RESULTS

As measured with combined Child Behavior Checklist and Youth Self-Report Total Problems, Internalizing, and Externalizing scales, the rate of improvement for youths in the modular condition was significantly better than for those in usual care. On a measure of functional impairment (Brief Impairment Scale), no significant differences were found among the 3 conditions. Analysis of service utilization also showed no significant differences among conditions, with almost half of youths receiving some additional services in the 1st year after beginning treatment, and roughly one third of youths in the 2nd year.

CONCLUSIONS

Overall, these results extend prior findings, supporting incremental benefits of MATCH over usual care over a 2-year period.

Assessment of therapy practices in community treatment for children and adolescents

OBJECTIVE

The Monthly Treatment and Progress Summary (MTPS) was developed to assess treatment techniques applied in clinical practice. This study examined the factor structure of the reported therapeutic practice elements on the MTPS and explored patterns in technique use based on client and therapist characteristics in a community mental health setting.

METHODS

MTPS data from 278 lead therapists in Hawai'i's local system of care were extracted from the online state mental health information management system. Therapists' endorsements (yes-no) of each practice element were examined across 278 completed youth treatment episodes, and an exploratory factor analysis with varimax rotation was conducted on the categorical data set.

RESULTS

Three factors emerged from the analyses: behavior management (behavioral interventions), coping and self-control (self-change practices), and family interventions (family supports). Treatment teams with licensed therapists reported higher use of coping and self-control practice elements, whereas teams with unlicensed therapists and paraprofessionals reported greater use of behavior management practice elements. Lead therapists reported that teams treating younger clients and those with attentional disorders were more likely to use behavior management practice elements, and teams treating youths with more severe impairment at intake utilized more behavior management and family intervention practice elements.

CONCLUSIONS

Overall, the MTPS shows promise as a therapist report of practices. The finding that practice elements organized into theoretical patterns and were applied in expected ways suggests a thoughtful approach to usual care techniques. With the increased focus on health care reform and managed care, the MTPS can inform system monitoring, feedback, and improvement.

Empirically guided coordination of multiple evidence-based treatments: an illustration of relevance mapping in children's mental health services

OBJECTIVE

Despite substantial progress in the development and identification of psychosocial evidence-based treatments (EBTs) in mental health, there is minimal empirical guidance for selecting an optimal set of EBTs maximally applicable and generalizable to a chosen service sample. Relevance mapping is a proposed methodology that addresses this problem through structured comparison of client characteristics in a service sample to participant characteristics from studies of EBTs.

METHOD

The authors demonstrate the feasibility of relevance mapping using data from 1,781 youths in a statewide mental health system and a study data set including 437 randomized clinical trials. Relevance mapping (a) reveals who is "coverable" by any EBT, under different definitions of matches between study participants and clients, and (b) identifies minimum sets of treatments needed to serve maximum numbers of clients, across different levels of analysis for defining treatment operations.

RESULTS

In the illustration sample, all problems targeted by the study data set review were fully coverable when matching only required clients to have the same problem as EBT study participants. At the other extreme, when matching also required age, gender, ethnicity, and setting, the percentage of noncoverable youths increased to 86% in this sample. Two minimal sets of only 8 EBTs were identified that, when added to the one EBT already in place in that system, covered 100% of coverable youths when matching required problem, age, and gender.

CONCLUSIONS

This methodology offers promise for the empirically guided selection and coordination of EBTs, thereby addressing one aspect of the gap between knowledge and practice.

Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: a randomized effectiveness trial

CONTEXT

Decades of randomized controlled trials have produced separate evidence-based treatments for depression, anxiety, and conduct problems in youth, but these treatments are not often used in clinical practice, and they produce mixed results in trials with the comorbid, complex youths seen in practice. An integrative, modular redesign may help.

OBJECTIVE

Standard/separate and modular/integrated arrangements of evidence-based treatments for depression, anxiety, and conduct problems in youth were compared with usual care treatment, with the modular design permitting a multidisorder focus and a flexible application of treatment procedures.

DESIGN

Randomized effectiveness trial.

SETTING

Ten outpatient clinical service organizations in Massachusetts and Hawaii.

PARTICIPANTS

A total of 84 community clinicians were randomly assigned to 1 of 3 conditions for the treatment of 174 clinically referred youths who were 7 to 13 years of age (70% of these youths were boys, and 45% were white). The study was conducted during the period from January 12, 2005 to May 8, 2009.

INTERVENTIONS

Standard manual treatment (59 youths [34% of the sample]; cognitive behavioral therapy for depression, cognitive behavioral therapy for anxiety, and behavioral parent training for conduct problems), modular treatment (62 youths [36%]; integrating the procedures of the 3 separate treatments), and usual care (53 youths [30%]).

MAIN OUTCOME MEASURES

Outcomes were assessed using weekly youth and parent assessments. These assessments relied on a standardized Brief Problem Checklist and a patient-generated Top Problems Assessment (ie, the severity ratings on the problems that the youths and parents had identified as most important). We also conducted a standardized diagnostic assessment before and after treatment.

RESULTS

Mixed effects regression analyses showed that modular treatment produced significantly steeper trajectories of improvement than usual care and standard treatment on multiple Brief Problem Checklist and Top Problems Assessment measures. Youths receiving modular treatment also had significantly fewer diagnoses than youths receiving usual care after treatment. In contrast, outcomes of standard manual treatment did not differ significantly from outcomes of usual care.

CONCLUSIONS

The modular approach outperformed usual care and standard evidence-based treatments on multiple clinical outcome measures. The modular approach may be a promising way to build on the strengths of evidence-based treatments, improving their utility and effectiveness with referred youths in clinical practice settings. Trial Registration  clinicaltrials.gov Identifier: NCT01178554.

Mapping evidence-based treatments for children and adolescents: application of the distillation and matching model to 615 treatments from 322 randomized trials

This study applied the distillation and matching model to 322 randomized clinical trials for child mental health treatments. The model involved initial data reduction of 615 treatment protocol descriptions by means of a set of codes describing discrete clinical strategies, referred to as practice elements. Practice elements were then summarized in profiles, which were empirically matched to client factors (i.e., observed problem, age, gender, and ethnicity). Results of a profile similarity analysis demonstrated a branching of the literature into multiple problem areas, within which some age and ethnicity special cases emerged as higher order splits. This is the 1st study to aggregate evidence-based treatment protocols empirically according to their constituent treatment procedures, and the results point both to the overall organization of therapy procedures according to matching factors and to gaps in the current child and adolescent treatment literature.

Social anxiety and cognitive biases in non-referred children: The interaction of self-focused attention and threat interpretation biases

Cognitive-behavioral models of social phobia emphasize the combined effects of cognitive biases in the maintenance of the condition, and recent findings in adults implicate self-focused attention as one such bias. However, research examining self-focus in youth is limited. This investigation examined the causal role of self-focused attention on threat interpretation biases in a community sample of 175 socially anxious children. Self-focused attention was experimentally induced via a mirror manipulation procedure and self-focused attention was assessed before and after mirror exposure. Social interpretation biases were examined via an ambiguous stories task with half of the children completing the task in front of a mirror and the other half without a mirror. Social anxiety predicted self-focus and threat interpretation bias. The mirror manipulation did not have an effect on focus of attention or on threat interpretation bias, nor did it interact with social anxiety. Implications and future research directions are discussed.

Assessing stability between treatment planning documents in a system of care

Two studies were performed to examine the presence and stability of specific recommendations for treatment practices in a system of care. Study 1 evaluated the reliability of an instrument designed to quantify specific elements of treatment planning documents. Study 2 used reliably coded data from Study 1 to assess stability of treatment practices and targets across the treatment planning process. This study indicated a generally low level of agreement of between documents, with many specific recommendations being dropped between stages of planning. The implications of these findings and the potential for future research are discussed.

Parental Assessment of Childhood Social Phobia: Psychometric Properties of the Social Phobia and Anxiety Inventory for Children–Parent Report

Validity and parent-child agreement of the Social Phobia and Anxiety Inventory for Children-Parent Report (SPAI-C-P) were examined in a racially diverse sample of 158 students in Grades 5 through 8 (87 girls; ages 10 to 14; M = 11.53) and their caregivers. Children completed the Social Phobia and Anxiety Inventory for Children (SPAI-C), and caregivers completed the SPAI-C-P and the Child Behavior Checklist (CBCL). The SPAI-C-P demonstrated good internal consistency and was significantly correlated with child self-reported social anxiety. Confirmatory factor analysis supported a 3-factor model over a 5-factor model, and concurrent validity was evidenced. Implications and directions for future research are discussed.

Evidence-Based Services in a Statewide Public Mental Health System: Do the Services Fit the Problems?

This study examined the degree to which a literature review of evidence-based services identified services appropriate for the actual problems of youth involved in intensive public mental health services. The diagnostic profiles and specific intervention targets reported by treatment providers were coded to determine whether a relevant empirically supported treatment was identified in the literature by the Hawaii Evidence-Based Services Committee for each problem. Of the 2,197 youth with diagnostic information available, 721 youth (33%) had a pure diagnosis for which an evidence-based service was identified in the literature, and 1,953 youth (89%) had a primary diagnosis with a relevant evidence-based service. Of the 1,220 youth with treatment target information, 1,094 (90%) had 1 or more problem areas targeted for intervention with an identified evidence-based service; thus, the vast majority of youth receiving intensive public mental services experienced a mental health difficulty for which an evidence-based service was identified through a review of the empirical literature. Nevertheless, many youth had additional problems for which evidence-based services have not yet been identified through research.

Population and service characteristics of youth with schizophrenia-spectrum diagnoses in the Hawaii system of care

BACKGROUND

Population and service characteristics were compared for youth (age 0-18 years) with and without schizophrenia-spectrum disorders, who received public mental health services in Hawaii's comprehensive system of care between July 1, 2000 and June 30, 2001.

METHODS

Electronic records of youth with a diagnosis in the schizophrenia-spectrum (n=71) were compared to all other youth (n=13,904) who received services with respect to age, gender, ethnicity, comorbidity, type of service, and service cost.

RESULTS

The schizophrenia-spectrum group had higher Asian representation, greater comorbidity, and was more likely to receive restrictive services for a higher average annual expense. When restrictive services were provided, they were of similar duration and intensity across groups. Almost all youth received less intensive services, but the schizophrenia-spectrum group received a higher frequency or longer duration of such services.

CONCLUSIONS

Although youth with schizophrenia-spectrum disorders were uncommon, collectively they represented a distinct population with above average service consumption. Future monitoring of interventions and outcomes may help develop systematic and effective treatment strategies for youth with schizophrenia-spectrum disorders.

Identifying and selecting the common elements of evidence based interventions: a distillation and matching model

A model is proposed whereby the intervention literature can be empirically factored or distilled to derive profiles from evidence-based approaches. The profiles can then be matched to individual clients based on consideration of their target problems, as well as demographic and contextual factors. Application of the model is illustrated by an analysis of the youth treatment literature. Benefits of the model include its potential to facilitate improved understanding of similarities and differences among treatments, to guide treatment selection and matching to clients, to address gaps in the literature, and to point to possibilities for new interventions based on the current research base.

From data to wisdom: quality improvement strategies supporting large-scale implementation of evidence-based services

The Hawaii Department of Health Child and Adolescent Mental Health Division has explored various strategies to promote widespread use of empirical evidence to improve the quality of services and outcomes for youth. This article describes a core set of clinical decisions and how several general and local evidence bases may inform those decisions. Multiple quality improvement strategies are illustrated in the context of a model that outlines four phases of evidence: data, information, knowledge, and wisdom.

Tripartite dimensions of emotion in a child clinical sample: measurement strategies and implications for clinical utility

Several measurement strategies to assess the tripartite model of emotion in child and adolescent samples have been developed. However, no studies have comparatively examined the most suitable strategies in clinical samples of children and adolescents. This study involved the evaluation of 2 distinct measures of tripartite constructs relative to anxiety and depression criterion variables in a clinical sample of 226 children in Grades 1 through 12. Results indicated that the measures performed similarly overall, but some differences were pronounced enough to suggest that the measures indexed slightly different aspects of the same constructs. These differences appear consistent with the scale design of each instrument. Implications for measurement of these constructs in future research are highlighted.

Tripartite dimensions of emotion in a child clinical sample: measurement strategies and implications for clinical utility

Several measurement strategies to assess the tripartite model of emotion in child and adolescent samples have been developed. However, no studies have comparatively examined the most suitable strategies in clinical samples of children and adolescents. This study involved the evaluation of 2 distinct measures of tripartite constructs relative to anxiety and depression criterion variables in a clinical sample of 226 children in Grades 1 through 12. Results indicated that the measures performed similarly overall, but some differences were pronounced enough to suggest that the measures indexed slightly different aspects of the same constructs. These differences appear consistent with the scale design of each instrument. Implications for measurement of these constructs in future research are highlighted.

Factors affecting the reliability of clinical judgments about the function of children's school-refusal behavior

Conducted two studies to examine the interrater reliability, test-retest stability, and the effect of various clinician variables, such as years of clinical experience, theoretical orientation, and prior experience with children, on clinical judgments about the reinforcement functions of children's school-refusal behavior. Results indicated that the judgments by individual clinicians were of questionable reliability. Judgments aggregated across 3 clinicians yielded acceptable interrater and test-retest reliability in Study 1, but a greater number of clinicians were necessary to achieve acceptable reliability in Study 2. Years of clinical experience and training were the only clinician variables related to the reliability of judgments about reinforcement functions. Several recommendations for the clinical assessment of the function of children's school-refusal behavior are discussed.

Childhood anxiety and memory functioning: a comparison of systemic and processing accounts

Information-processing models of childhood anxiety highlight the centrality of memory processes in the maintenance and intensification of anxiety. Recent advances in memory research allow for an increasingly fine-grained analysis of the relation between anxiety and memory. The relation between childhood anxiety and memory was examined in a sample of 160 high- and low-trait-anxious sixth through eighth grade children. Results indicated that anxiety predicted a memory bias toward negative relative to neutral information during conceptual but not perceptual tasks. Further, anxiety predicted a memory bias toward positive relative to neutral information on procedural tasks and a memory bias away from positive relative to neutral information on declarative tasks. These findings accent the complexity and multidimensionality of relations among childhood anxiety, the emotional valence of stimuli, types of cognitive processing, and memory systems in contributing to biases in children's memory functioning.

Methodological strategies in child clinical trials: advancing the efficacy and effectiveness of psychosocial treatments

The present paper reviews issues of treatment efficacy (i.e., potency) and effectiveness (i.e., clinical utility) in applied clinical child research. Threats to treatment evaluation are reviewed in the context of these two dimensions. It is proposed that treatment outcome research faces new challenges stemming from the ever increasing emphasis on generalization of gains and dissemination of interventions outside of clinical research settings. Issues and approaches proposed as warranting further development and attention include development, flexibility, acceptability, and disseminability of psychosocial assessment and treatment methods. A research emphasis is promoted that balances experimental control with the need for treatment generalization and delivery outside of the research setting, in order to maximize the utility of clinical research.