Training research: practical recommendations for maximum impact

Harnessing Innovative Technologies to Train Nurses in Suicide Safety Planning With Hospital Patients: Formative Acceptability Evaluation of an eLearning Continuing Education Training

BACKGROUND

Suicide is the 12th leading cause of death in the United States. Health care provider training is a top research priority identified by the National Action Alliance for Suicide Prevention; however, evidence-based approaches that target skill building are resource intensive and difficult to implement. Novel computer technologies harnessing artificial intelligence are now available, which hold promise for increasing the feasibility of providing trainees opportunities across a range of continuing education contexts to engage in skills practice with constructive feedback on performance.

OBJECTIVE

This pilot study aims to evaluate the feasibility and acceptability of an eLearning training in suicide safety planning among nurses serving patients admitted to a US level 1 trauma center for acute or intensive care. The training included a didactic portion with demonstration, practice of microcounseling skills with a web-based virtual patient (Client Bot Emily), role-play with a patient actor, and automated coding and feedback on general counseling skills based on the role-play via a web-based platform (Lyssn Advisor). Secondarily, we examined learning outcomes of knowledge, confidence, and skills in suicide safety planning descriptively.

METHODS

Acute and intensive care nurses were recruited between November 1, 2021, and May 31, 2022, to participate in a formative evaluation using pretraining, posttraining, and 6-month follow-up surveys, as well as observation of the nurses' performance in delivering suicide safety planning via standardized patient role-plays over 6 months and rated using the Safety Plan Intervention Rating Scale. Nurses completed the System Usability Scale after interacting with Client Bot Emily and reviewing general counseling scores based on their role-play via Lyssn Advisor.

RESULTS

A total of 18 nurses participated in the study; the majority identified as female (n=17, 94%) and White (n=13, 72%). Of the 17 nurses who started the training, 82% (n=14) completed it. On average, the System Usability Scale score for Client Bot Emily was 70.3 (SD 19.7) and for Lyssn Advisor was 65.4 (SD 16.3). On average, nurses endorsed a good bit of knowledge (mean 3.1, SD 0.5) and confidence (mean 2.9, SD 0.5) after the training. After completing the training, none of the nurses scored above the expert-derived cutoff for proficiency on the Safety Plan Intervention Rating Scale (≥14); however, on average, nurses were above the cutoffs for general counseling skills per Lyssn Advisor (empathy: mean 4.1, SD 0.6; collaboration: mean 3.6, SD 0.7).

CONCLUSIONS

Findings suggest the completion of the training activities and use of novel technologies within this context are feasible. Technologic modifications may enhance the training acceptability and utility, such as increasing the virtual patient conversational abilities and adding automated coding capability for specific suicide safety planning skills.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/33695.

Adapting dose-response methodology to improve clinical trial design for psychotherapies

OBJECTIVE

Conventional randomized controlled trials (RCTs) have long served as the foundation of research in clinical psychology; however, most treatments for eating disorders show only modest effects on reduction of symptoms and maintenance of long-term remission. New options for psychotherapy treatment development research, beyond continuing to pursue additive or subpopulation approaches, are needed.

METHODS

One option is to apply dose-response designs, which are commonplace in studies of pharmacology, toxicology, and medical research, and characterized by the evaluation of the amount of exposure (dose) to an intervention, and the resulting changes in body function or health (response).

RESULTS

Eating disorder interventions are particularly well-suited for dose-response treatment designs. The deadly nature of eating disorders makes it imperative that patients are not turned away for not being "ready" to engage with treatment. By identifying optimal doses, research will likely yield a more parsimonious course of treatment, which will lend itself to reduced costs, greater uptake, and reduced drop-out.

DISCUSSION

Limited use of within-subject designs in trials for patients with eating disorders has produced fast-track efficacy studies and omitted key elements in the treatment development pathway. To decrease reliance on RCT's, dose-response methods should be applied as an alternative study design.

PUBLIC SIGNIFICANCE

Eating disorders are associated with medical and psychiatric comorbidities, poor quality of life, and high mortality. Access to evidence-based services for patients with eating disorders is limited, and identifying additional effective treatment options can be difficult because of challenges inherent to randomized-controlled trials. This manuscript describes an alternative trial methodology to maximize the information that can be gathered prior to utilizing a standard large-scale efficacy design.

Identifying Beneficial Training Elements: Clinician Perceptions of Learning the Evidence-Based GenerationPMTO Intervention

Improving the process through which mental health professionals are trained in evidence-based practices (EBPs) represents an important opportunity for extending the implementation of EBPs in community settings. In this study, we used a qualitative approach to examine the specific training elements that were beneficial to clinicians' experiences learning an evidence-based intervention. Individual, semi-structured interviews were conducted with mental health professionals completing training in the GenerationPMTO parenting intervention. Data were analyzed using the tenets of thematic analysis. Overall, participants reported positive experiences in the training and growth in their attitudes, knowledge, and confidence in GenerationPMTO. The qualitative findings also suggested seven specific training elements that participants perceived as beneficial: support, role plays, engagement, structure, writing/visuals, working with training families, and experiencing the GenPMTO model. These results are discussed within the context of the existing literature on EBP training and more broadly as they relate to expanding the implementation of evidence-based interventions. We also suggest implications for practice meant to enhance future EBP training efforts.

How low can you go? Examining the effects of brief online training and post-training consultation dose on implementation mechanisms and outcomes for measurement-based care

BACKGROUND

Initial training and ongoing post-training consultation (i.e., ongoing support following training, provided by an expert) are among the most common implementation strategies used to change clinician practice. However, extant research has not experimentally investigated the optimal dosages of consultation necessary to produce desired outcomes. Moreover, the degree to which training and consultation engage theoretical implementation mechanisms-such as provider knowledge, skills, and attitudes-is not well understood. This study examined the effects of a brief online training and varying dosages of post-training consultation (BOLT+PTC) on implementation mechanisms and outcomes for measurement-based care (MBC) practices delivered in the context of education sector mental health services.

METHODS

A national sample of 75 clinicians who provide mental health interventions to children and adolescents in schools were randomly assigned to BOLT+PTC or control (services as usual). Those in BOLT+PTC were further randomized to 2-, 4-, or 8-week consultation conditions. Self-reported MBC knowledge, skills, attitudes, and use (including standardized assessment, individualized assessment, and assessment-informed treatment modification) were collected for 32 weeks. Multilevel models were used to examine main effects of BOLT+PTC versus control on MBC use at the end of consultation and over time, as well as comparisons among PTC dosage conditions and theorized mechanisms (skills, attitudes, knowledge).

RESULTS

There was a significant linear effect of BOLT+PTC over time on standardized assessment use (b = .02, p < .01), and a significant quadratic effect of BOLT+PTC over time on individualized assessment use (b = .04, p < .001), but no significant effect on treatment modification. BOLT + any level of PTC resulted in higher MBC knowledge and larger growth in MBC skill over the intervention period as compared to control. PTC dosage levels were inconsistently predictive of outcomes, providing no clear evidence for added benefit of higher PTC dosage.

CONCLUSIONS

Online training and consultation in MBC had effects on standardized and individualized assessment use among clinicians as compared to services as usual with no consistent benefit detected for increased consultation dosage. Continued research investigating optimal dosages and mechanisms of these established implementation strategies is needed to ensure training and consultation resources are deployed efficiently to impact clinician practices.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05041517 . Retrospectively registered on 10 September 2021.

Testing a community developed training protocol for an evidence-based treatment

The implementation of evidence-based treatments (EBTs) in community behavioral health settings is a recommended practice, yet training experienced by community-based clinicians may require novel and creative training methods. The current study focused on creating a training protocol for Alternative for Families: a Cognitive-Behavioral Therapy from both evidence-based foundations and community-based agency feedback to promote better EBT integration into agencies. Twenty-four clinicians from three agencies were trained using a community-informed training protocol. Outcomes for clinician-reports of organizational functioning, self-reports of skill and knowledge, and observational single-subject data of clinician skills were assessed. Minimal improvements were found for clinician skills across self-report and observations. More research on tailoring trainings to meet needs of community agencies and clinicians should be explored to determine best practice in wide-scale implementation efforts.

Adapting an evidence-supported optimization program for mental health and sport performance in collegiate athletes to fit youth from ethnic/racial minority and low-income neighborhoods: A National Institutes of Health stage model feasibility study

The current study addresses the need to empirically develop effective mental health interventions for youth from ethnic/racial minority and low-income neighborhoods. Using Stage Model evaluation methods supported by the National Institutes of Health in the US to address underutilization of mental healthcare among racial/ethnic minority youth, this feasibility study demonstrates empirical adaptation of an innovative sport-specific psychological intervention for use in youth from ethnic/racial minority and low-income neighborhoods. An international group of professionals familiar with sport performance and mental health intervention serving the target population experientially examined the adapted intervention protocols in workshops and provided feedback. Survey results indicated the professionals found the intervention components were easy to administer and likely to be safe, enjoyable, engaging and efficacious for youth mental health and sport performance. The protocols were revised based on feedback from these professionals and the intervention was examined in a case trial involving an Asian American youth who evidenced Social Anxiety Disorder. Case study results indicated the intervention could be implemented with integrity, and severity of psychiatric symptoms and factors interfering with sport performance decreased after intervention implementation. The participant's relationships with family, coaches and teammates were also improved.

The Parents under Pressure parenting programme for families with fathers receiving treatment for opioid dependence: the PuP4Dads feasibility study

Background

The impact of parental drug use on children is a major public health problem. However, opioid-dependent fathers have been largely ignored in parenting research.

Objective

To implement and test the feasibility and acceptability of the Parents under Pressure programme (PuP4Dads) for opioid-dependent fathers and their families, and to determine whether or not a full-scale evaluation could be conducted.

Design

A mixed-methods feasibility study.

Setting

Two non-NHS family support services for parents who use drugs in Scotland.

Participants

Fathers prescribed opioid substitution therapy (n = 25), their partners (n = 17) and children, as well as practitioners, supervisors, service managers and referrers.

Intervention

A home-visiting programme, including an integrated theoretical framework, case formulation, collaborative goal-setting and modules designed to improve parenting, the caregiving environment and child welfare. The programme was delivered flexibly over 6 months by accredited practitioners.

Main outcome measures

Feasibility progression criteria included the recruitment target (n = 24 fathers), acceptability of PuP4Dads, father engagement in the study (including a minimum of 66% of fathers completing PuP and a minimum of 10 fathers completing baseline and post-treatment research interviews), engagement in qualitative interviews (including a minimum of 10 fathers and 90% practitioner uptake and 80% manager uptake), focus groups (with a minimum of 80% referrer uptake), adequate fidelity and no adverse events.

Data sources

The following researcher-administered validated questionnaires were used: the Brief Child Abuse Potential Inventory, the Parenting Sense of Competence Scale, the Difficulties in Emotion Regulation Scale, the Paternal Antenatal Attachment Scale, the Maternal Antenatal Attachment Scale, the Emotional Availability Scale, the Brief Infant Toddler Social and Emotional Assessment, the Strengths and Difficulties Questionnaire, the Conflict Tactics Scale, Treatment Outcome Profile and the EuroQol-5 Dimensions, five-level version. Other sources included parent-completed service use (an economic measure), social work child protection data, NHS opioid substitution therapy prescription data and practitioner-reported attendance data. We also conducted interviews with fathers (n = 23), mothers (n = 14), practitioners (n = 8), supervisors (n = 2) and service managers (n = 7); conducted focus groups with referrers (n = 28); and held an ‘expert event’ with stakeholders (n = 39).

Results

The PuP4Dads was successfully delivered within non-NHS settings and was considered acceptable and suitable for the study population. Referrals (n = 44) resulted in 38 (86%) eligible fathers, of whom 25 (66%) fathers and 17 partners/mothers consented to participate. Most fathers reported no previous parenting support. A total of 248 sessions was delivered to the 20 fathers and 14 mothers who started the intervention. Fourteen fathers (and 10 mothers) completed ≥ 6 sessions and six fathers (and four mothers) completed ≤ 5 sessions. Father and mother attendance rates were equal (mean 71%). Median length of engagement for fathers was 26 weeks and for mothers it was 30 weeks. Twenty-three fathers completed interviews at baseline, 16 fathers completed interviews at follow-up 1 and 13 fathers completed interviews at follow-up 2. Outcome measures were well tolerated; however, the suitability of some measures was dependent on family circumstances. The researcher-administered questionnaires had few missing data. The perceived benefits of PuP4Dads reported by parents, practitioners and managers included the following: the therapeutic focus on fathers improved parental emotion regulation, there was improved understanding and responding to child’s needs, there was better multiagency working and the programme was a good fit with practice ‘ethos’ and policy agenda. Learning highlighted the importance of service-wide adoption and implementation support, strategies to improve recruitment and retention of fathers, managing complex needs of both parents concurrently, understanding contextual factors affecting programme delivery and variables affecting intervention engagement and outcomes.

Limitations

Lack of emotional availability and economic (service use) data.

Conclusions

A larger evaluation of PuP4Dads is feasible.

Future work

Further work is required to demonstrate the effectiveness of PuP4Dads and the cost implications. A better understanding is needed of how the intervention works, for whom, under what circumstances and why.

Trial registration

Current Controlled Trials ISRCTN43209618.

Funding

This project was funded by the National Institute for Health Research (NIHR) Public Health Research programme and will be published in full in Public Health Research; Vol. 10, No. 3. See the NIHR Journals Library website for further project information.

Tailored isn't always better: Impact of standardized versus tailored training on intention to use measurement-based care

Background: Brief educational trainings are often used for disseminating and implementing evidence-based practices (EBPs). However, many accessible trainings are ubiquitously standardized. Tailored training focused on modifying individual or contextual factors that may hinder EBP implementation is recommended, but there is a dearth of research comparing standardized versus tailored training. This study sought to: (a) assess the impact of MBC training on clinician intention to use measurement-based care (MBC); (b) compare the effect of standardized versus tailored training on clinician intention to MBC; and (c) identify clinician-level predictors of intention. Methods: Clinicians (n = 152) treating adult clients with depression at 12 community mental health clinics were randomized to either tailored or standardized MBC training. Clinic-specific barriers and facilitators were used to inform training content and structure tailoring. Linear mixed modeling tested the association between training condition and post-training intention to use MBC, as well as hypothesized individual-level predictors of post-training intention (e.g., age, gender). Results: Clinician intention pre- and post-training increased across training conditions (B = 0.38, t = -5.95, df = 36.99, p < .01, Cohen's d = 0.58). Results of linear mixed modeling procedures suggest no significant difference in clinician intention between conditions post-training (B = -0.03, SE = .19, p > .05, Cohen's d = .15). Only baseline intention emerged as a predictor of post-training intention (B = 0.39, SE = .05, p < .05). Conclusions: These findings suggest the additional effort to tailor training may not yield incremental benefit over standardized training, at least in the short term. As a result, implementation efforts may be able to reserve time and finances for other elements of implementation beyond the training component.

Plain Language Summary

Educational training is a common approach for enhancing knowledge about research-supported mental health treatments. However, these trainings are often not tailored to meet the needs of the trainees, and there is insufficient evidence about whether tailoring might improve the impact of training compared to a one-size-fits-all, standard version. This study compared the impact of a tailored versus standard training on mental health clinician's intentions to use measurement-based (MBC) care for monitoring treatment progress for clients with depression. Study results indicated that intention to use MBC improved for clinicians receiving both the tailored and standard training after training completion. There were no differences in intention to use MBC care when the two types of training were compared. These study findings suggest that tailoring, which may require substantial time and effort, may not be a necessary step to improve the short-term impact of educational trainings.

Harnessing Innovative Technologies to Train Nurses in Suicide Safety Planning With Hospitalized Patients: Protocol for Formative and Pilot Feasibility Research

Background

Suicide is the 10th leading cause of death in the United States, with >47,000 deaths in 2019. Most people who died by suicide had contact with the health care system in the year before their death. Health care provider training is a top research priority identified by the National Action Alliance for Suicide Prevention; however, evidence-based approaches that target skill-building are resource intensive and difficult to implement. Advances in artificial intelligence technology hold promise for improving the scalability and sustainability of training methods, as it is now possible for computers to assess the intervention delivery skills of trainees and provide feedback to guide skill improvements. Much remains to be known about how best to integrate these novel technologies into continuing education for health care providers.

Objective

In Project WISE (Workplace Integrated Support and Education), we aim to develop e-learning training in suicide safety planning, enhanced with novel skill-building technologies that can be integrated into the routine workflow of nurses serving patients hospitalized for medical or surgical reasons or traumatic injury. The research aims include identifying strategies for the implementation and workflow integration of both the training and safety planning with patients, adapting 2 existing technologies to enhance general counseling skills for use in suicide safety planning (a conversational agent and an artificial intelligence–based feedback system), observing training acceptability and nurse engagement with the training components, and assessing the feasibility of recruitment, retention, and collection of longitudinal self-report and electronic health record data for patients identified as at risk of suicide.

Methods

Our developmental research includes qualitative and observational methods to explore the implementation context and technology usability, formative evaluation of the training paradigm, and pilot research to assess the feasibility of conducting a future cluster randomized pragmatic trial. The trial will examine whether patients hospitalized for medical or surgical reasons or traumatic injury who are at risk of suicide have better suicide-related postdischarge outcomes when admitted to a unit with nurses trained using the skill-building technology than those admitted to a unit with untrained nurses. The research takes place at a level 1 trauma center, which is also a safety-net hospital and academic medical center.

Results

Project WISE was funded in July 2019. As of September 2021, we have completed focus groups and usability testing with 27 acute care and 3 acute and intensive care nurses. We began data collection for research aims 3 and 4 in November 2021. All research has been approved by the University of Washington institutional review board.

Conclusions

Project WISE aims to further the national agenda to improve suicide prevention in health care settings by training nurses in suicide prevention with medically hospitalized patients using novel e-learning technologies.

International Registered Report Identifier (IRRID)

DERR1-10.2196/33695

Pushing the bench: A mixed methods study of barriers to and facilitators of identification and referral into depression care by professional nurses in KwaZulu-Natal, South Africa

OBJECTIVE

Integration of mental health and chronic disease services in primary care could reduce the mental health treatment gap and improve associated health outcomes in low-resource settings. Low rates of nurse identification and referral of patients with depression limit the effectiveness of integrated mental health care; the barriers to and facilitators of identification and referral in South Africa and comparable settings remain undefined. This study explored barriers to and facilitators of nurse identification and referral of patients with depressive symptoms as part of integrated mental health service delivery in KwaZulu-Natal, South Africa.

DESIGN

Triangulation mixed methods study incorporating qualitative and quantitative data.

METHODS

Data collection, analysis, and interpretation were guided by the Consolidated Framework for Implementation Research (CFIR). Participants were professional nurses at ten primary health care facilities in Amajuba, KwaZulu-Natal, South Africa. Qualitative data collection involved semi-structured interviews targeting specific CFIR constructs with high- and low-referring nurses. Deductive and inductive coding were used to derive primary themes related to barriers and facilitators. Quantitative data collection involved a structured questionnaire assessing determinants explored in the interviews. Qualitative comparative analysis was used to identify the necessary or sufficient conditions for high and low nurse referral.

RESULTS

Twenty-two nurses were interviewed. Primary themes related to insufficient training, supervision, and competency; emotional burden; limited human and physical resources; perceived patient need for integrated services; and intervention acceptability. Sixty-eight nurses completed questionnaires. Quantitative results confirmed and expanded upon the qualitative findings. Low self-assessed competency was a consistent barrier to appropriate service delivery.

CONCLUSIONS

To promote the success of integrated care in a context of severe staff shortages and over-burdened providers, implementation strategies including direct training, structured supervision, and routine behavioral health screening tools are warranted. Interventions to improve mental health literacy of patients as well as emotional support for nurses are also needed.

A Systematic Review of Mental Health Interventions for ASD: Characterizing Interventions, Intervention Adaptations, and Implementation Outcomes

Youth with autism spectrum disorder (ASD) have high rates of co-occurring mental health needs that necessitate mental health interventions. Given the unique clinical characteristics of youth with ASD, there have been significant efforts to adapt and test mental health interventions for this population. Yet, characterization of the nature and types of interventions adaptations is limited, especially across the wide range of interventions tested for youth with ASD with a focus on implementation factors. Additionally, understanding how these interventions may be implemented in community services is limited. The aims of this systematic review are to characterize the (1) types of interventions tested for co-occurring mental health conditions for youth with ASD; (2) adaptations to mental health interventions for use with youth with ASD; and (3) implementation strategies, outcomes, and determinants of mental health interventions to inform their translation to community service settings. Eighty-three articles testing interventions targeting mental health symptoms in youth with ASD that included implementation factors in analyses were reviewed. The Stirman et al. (2013; 2019) FRAME adaptation, Powell et al. (2012;2015) implementation strategies, and Proctor et al. (2011) implementation outcomes taxonomies were applied to characterize the nature and types of adaptations for use with youth with ASD and types of implementation strategies, outcomes, and determinants used, when available, respectively. Of the interventions examined, the majority (64.1%) were originally designed to target youth mental health concerns and were then adapted to be used with ASD. The most common adaptations included those to the intervention content, particularly adding elements with tailoring or refining aspects of the intervention while maintaining core functions. Half of the articles described at least one implementation strategy used during intervention testing. Fidelity and acceptability were the most frequently examined implementation outcomes, with some examination of appropriateness and feasibility. Nineteen percent of articles described implementation determinants (i.e. barriers/facilitators) of these implementation outcomes. The common adaptations for ASD provide direction for future intervention development and for training community therapists. Further examination, specification, and reporting of implementation strategies and outcomes within ongoing efforts to adapt and interventions to meet the co-occurring mental health needs of youth ASD are needed to facilitate their translation to community settings. Areas for future research as well as clinical implications are discussed.

Adaptation to family-based treatment for Medicaid-insured youth with anorexia nervosa in publicly-funded settings: Protocol for a mixed methods implementation scale-out pilot study

BACKGROUND

Family-based treatment (FBT) for anorexia nervosa is an evidence-based treatment, but its effectiveness is untested among socioeconomically disadvantaged and racially diverse youth. Adapting FBT may facilitate "scale-out" for Medicaid-insured youth served in publicly-funded settings and potentially improve outcomes for more diverse populations.

METHODS

This mixed methods effectiveness-implementation Hybrid Type 3 pilot study protocol included a planning period in collaboration with the San Francisco Department of Public Health, culminating in a two-day in-person FBT training for 25 therapists in the county, followed by the opportunity to engage in one year of weekly supervision. The training incorporated FBT adaptations intended to improve fit for low-income families within community-based settings. Treatment appropriateness and acceptability will be measured immediately post-training. Following the training, cases referred for FBT will only be assigned to the trained clinicians who voluntarily opted into long-term group supervision. Clinicians treating at least one FBT case during the supervision period will report on implementation, adaptations, and patient weight gain. Finally, semi-structured interviews with clinician participants will be conducted, focused on implementation challenges and facilitators, local treatment adaptations, and overall satisfaction with FBT.

DISCUSSION

Learning about clinician adaptations will advance knowledge about treatment of eating disorders in publicly-funded community clinics, which serve a racially/ethnically and socioeconomically diverse group of youth. This project is designed to accelerate FBT implementation in publicly-funded mental health systems, and inform service improvements for underserved youth with eating disorders.

Correction to: A Systematic Review of Mental Health Interventions for ASD: Characterizing Interventions, Intervention Adaptations, and Implementation Outcomes

Due to the errors occurred in the originally published version, this article is being reprinted in its entirety as Correction. All errors have been corrected. It is the correct version.

Assess, Plan, Do, Evaluate, and Report: Iterative Cycle to Remove Academic Control of a Community-Based Physical Activity Program

PURPOSE AND OBJECTIVES

Responsive methods and measures are needed to bridge research to practice and address public health issues, such as older adults' need for multicomponent physical activity. The objective of this study was to detail the longitudinal, quasi-experimental work that spans 5 years to describe outcomes across RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) dimensions of integrating a physical activity intervention for older adults into the Cooperative Extension System through the assess, plan, do, evaluate, report (APDER) cycle.

INTERVENTION APPROACH

The participant-level intervention is Lifelong Improvements through Fitness Together (LIFT), an 8-week, group dynamics-based, strength-training program with 16 in-person sessions. The implementation intervention applies the iterative APDER cycle based on feedback for each dimension of RE-AIM. Each year, the APDER cycle was used to embed data collection procedures at the instructor and participant level to reveal the next evolution of the program.

EVALUATION METHODS

Each evolution of LIFT was measured through a pretest and posttest quasi-experimental design. Data were collected on each RE-AIM dimension through participant surveys and functional fitness assessments, number and representativeness of trainees, and process evaluation.

RESULTS

Overall, LIFT was expanded to 4 states with 275 instructors, reaching 816 older adults; consistently improved functional fitness outcome measures; demonstrated strong program adherence; and was seen as feasible and enjoyable by instructors and participants. LIFT is now undergoing adaptations for virtual delivery as well as updating the exercise protocol to introduce yoga postures that target flexibility and balance.

IMPLICATIONS FOR PUBLIC HEALTH

Overall, ongoing adaptations were necessary to ensure the program continued to fit the mission, values, and resources of the delivery system. Public health implications to support the need for ongoing adaptation include embedding pragmatic measures of adaptations and RE-AIM into standard evaluation pathways and using iterative APDER cycles.

The Cultural Formulation Interview since DSM-5: Prospects for training, research, and clinical practice

While social science research has demonstrated the importance of culture in shaping psychiatric illness, clinical methods for assessing the cultural dimensions of illness have not been adopted as part of routine care. Reasons for limited integration include the impression that attention to culture requires specialized skills, is only relevant to a subset of patients from unfamiliar backgrounds, and takes too much time to be useful. The DSM-5 Cultural Formulation Interview (CFI), published in 2013, was developed to provide a simplified approach to collecting information needed for cultural assessment. It offers a 16-question interview protocol that has been field tested at sites around the world. However, little is known about how CFI implementation has affected training, health services, and clinical outcomes. This article offers a comprehensive narrative review that synthesizes peer-reviewed, published studies on CFI use. A total of 25 studies were identified, with sample sizes ranging from 1 to 460 participants. In all pilot CFI studies 960 unique subjects were enrolled, and in final CFI studies 739 were enrolled. Studies focused on how the CFI affects clinical practice; explored the CFI through research paradigms in medical communication, implementation science, and family psychiatry; and examined clinician training. In most studies, patients and clinicians reported that using the CFI improved clinical rapport. This evidence base offers an opportunity to consider implications for training, research, and clinical practice and to identify crucial areas for further research.

A Randomized Controlled Trial Investigating Online Training for Prelinguistic Communication

Purpose This study explored the utility of online training as a platform for teaching early intervention speech-language pathologists to recognize potentially communicative, prelinguistic behaviors in young children with physical disabilities and complex communication needs. Method Using a randomized controlled trial, 45 early intervention speech-language pathologists were randomly assigned to one of three conditions within an online training: practice with implicit problem-solving (identification condition), practice with explicit problem-solving (reflection condition), or no practice (control condition). Knowledge about early communication, skill at recognizing prelinguistic behaviors, time taken to complete the training, and perceptions of the training experience were examined. Results Participants in the no-practice control condition took significantly less time to complete the training, achieved the same positive outcomes on the knowledge and skill assessments, and rated the training as appealing as compared with participants assigned to the more time-intensive identification and reflection practice conditions. Conclusions Results suggest the importance of considering efficiency and appeal when designing successful trainings for moving evidence into practice.

Training Needs of Peer and Non-Peer Transition Service Providers: Results of a National Survey

Participatory action research processes guided a national online survey of service providers working with transition age youth with mental health challenges. The survey investigated transition service providers' ratings of the importance of competencies and skills, self-assessed need for training in these competencies and skills, their preferred training modalities, and obstacles to engaging in training. The 254 participants identified trauma-informed care, understanding youth culture, promoting natural supports, and using culturally responsive practices as most important training needs. Age, years in current job, years in transition work, and race/ethnicity predicted training needs regarding some competencies and skills. Peer providers expressed preferences for young adult-led training. Qualitative responses highlighted training needs for supporting specific underserved populations: youth from communities of color, LGBTQ youth, and those with co-occurring disorders. Results may guide future training initiatives for peer support and non-peer support providers and workforce development initiatives designed to improve behavioral health services for young people.

Unintended Consequences of Evidence-Based Treatment Policy Reform: Is Implementation the Goal or the Strategy for Higher Quality Care?

This study examined patterns of evidence-based treatment (EBT) delivery following a county-wide EBT reform initiative. Data were gathered from 60 youth and their 21 providers, who were instructed to deliver therapy as they normally would under the EBT initiative. Results showed limited applicability of county-supported EBTs to this service sample, and that most youth did not receive traditional delivery of EBTs. Findings suggest that it may be unrealistic to expect providers to deliver EBTs with fidelity with all clients, and that EBT implementation may be best thought of as a strategy for improving mental health services rather than a goal.

Training clinicians to deliver group CBT to manage anxiety in youth with ASD: Results of a multisite trial

OBJECTIVE

Few guidelines are available regarding optimal training models for practitioners delivering cognitive-behavioral therapy (CBT) for anxiety in youth with autism spectrum disorder (ASD). The present study systematically compared 3 instructional conditions for delivering the Facing Your Fears program (FYF) to children with ASD and anxiety.

METHOD

Thirty-four clinicians (Mage = 34 years; 94% women, 88% Caucasian) and an intent-to-treat sample of 91 children with ASD and anxiety (Mage = 11; 84% male 53% Caucasian) met eligibility criteria across 4 sites. A 3-group parallel design via a Latin square procedure was used to randomize 9 teams of clinicians to 1 of 3 training conditions: Manual, Workshop, Workshop-Plus. The effectiveness of instructional condition was assessed via implementation (CBT knowledge, treatment fidelity) and treatment outcomes (reductions in anxiety as measured by the Anxiety Disorders Interview Schedule-Parent (ADIS-P).

RESULTS

Clinicians in both Workshop conditions significantly increased CBT knowledge postworkshop, F(1, 18) = 19.8, p < .001. Excellent treatment fidelity was obtained across conditions (above 89%), although clinicians in the Workshop conditions obtained significantly higher fidelity ratings and delivered FYF with greater quality than the Manual condition. Children with ASD demonstrated significant reductions in anxiety symptoms for three of the four anxiety diagnoses, with no differences noted across instructional condition. Rates of improvement were lower than those obtained in a previous controlled trial.

CONCLUSIONS

Results suggest that although there may be some advantage to participating in a Workshop, clinicians in all conditions could deliver FYF with excellent fidelity and yield positive treatment outcomes. Lack of a no-treatment comparison group limits interpretation of findings. (PsycINFO Database Record

Attitudes of mental health providers towards adoption of evidence-based interventions: relationship to workplace, staff roles and social and psychological factors at work

Background

Gaining insight into factors influencing the adoption of evidence-based interventions (EBI) is essential to ensuring their sustainability in the mental healthcare setting. This article describes 1) differences between professional staff roles in attitudes towards EBI and 2) individual and organizational predictors of attitudes towards adopting EBI.

Methods

The participants were psychologists and psychiatric nurses (N = 792). Student t-tests were used to investigate group differences of global attitude scores on the Evidence-based Practice Attitude Scale-36 (EBPAS-36). A confirmatory factor analysis (CFA) of the EBPAS-36 measurement model, and a principal component analysis (PCA) of the factor scores were used to obtain attitudinal components for the subsequent hierarchical regression analyses.

Results

Three second-order attitudinal components were retained and named: professional concern, attitudes related to work conditions and requirements, and attitudes related to fit and preferences. Nurses’ global attitudinal scores were more positive than those of psychologists, while clinicians had less positive global attitudinal scores than non-clinicians. Hierarchical regression analysis showed that provider demographic, social and psychological factors in the workplace and staff role predicted attitudes towards adopting EBI, e.g. male gender, older age and working in private practice predicted more negative global attitudes, while working in academia, experiencing social support from colleagues and empowering leadership predicted more positive global attitudes to adopt EBI. The prediction outcomes for the specific attitudinal components are presented, as well.

Conclusion

The findings suggest that implementation efforts may benefit from being tailored to the different needs and values of the affected professionals, including the role of the context they operate within. Implications with a special emphasis on training efforts and organizational development are discussed.

The housing first technical assistance and training (HFTAT) implementation strategy: outcomes from a mixed methods study of three programs

BACKGROUND

This paper discusses the initial testing of the Housing First Training and Technical Assistance (HFTAT) Program, a multifaceted, distance-based strategy for the implementation of the Housing First (HF) supportive housing model. HF is a complex housing intervention for serving people living with serious mental illness and a substance use disorder that requires significant individual- and structural-level changes to implement. As such, the HFTAT employs a combined training and consultation approach to target different levels of the organization. Training delivered to all organizational staff focuses on building individual knowledge and uses narrative storytelling to overcome attitudinal implementation barriers. Consultation seeks to build skills through technical assistance and fidelity audit and feedback.

METHOD

We employed a mixed method design to understand both individual-level (e.g., satisfaction with the HFTAT, HF knowledge acquisition and retention, and HF acceptability and appropriateness) and structural-level (e.g., fidelity) outcomes. Quantitative data were collected at various time points, and qualitative data were collected at the end of HFTAT activities. Staff and administrators (n = 113) from three programs across three states participated in the study.

RESULTS

Satisfaction with both training and consultation was high, and discussions demonstrated both activities were necessary. Flexibility of training modality and narrative storytelling were particular strengths, while digital badging and the community of practice were perceived as less valuable because of incompatibilities with the work context. HF knowledge was high post training and retained after 3-month follow-up. Participants reported training helped them better understand the model. Attitudes toward evidence-based interventions improved over 6 months, with qualitative data supporting this but demonstrating some minor concerns related to acceptability and appropriateness. Fidelity scores for all programs improved over 9 months.

CONCLUSION

The HFTAT was a well-liked and generally useful implementation strategy. Results support prior research pointing to the value of both (a) multifaceted strategies and (b) combined training and consultation approaches. The study also provides evidence for narrative storytelling as an approach for changing attitudinal implementation barriers. The need for compatibility between specific elements of an implementation strategy and the work environment was also observed.

Proposing a Mechanistic Model of Clinician Training and Consultation

To make evidence-based treatments deliverable, effective, and scalable in community settings, it is critical to develop a workforce that can deliver evidence-based treatments as designed with skill. However, the science and practice of clinician training and consultation lags behind other areas of implementation science. In this paper, we present the Longitudinal Education for Advancing Practice (LEAP) model designed to help span this gap. The LEAP model is a mechanistic model of clinician training and consultation that details how training inputs, training and consultation strategies, and mechanisms of learning influence training outcomes. We first describe the LEAP model and then discuss how key implications of the model can be used to develop effective training and consultation strategies.

Using Instructional Design, Analyze, Design, Develop, Implement, and Evaluate, to Develop e-Learning Modules to Disseminate Supported Employment for Community Behavioral Health Treatment Programs in New York State

Background

Implementation science lacks a systematic approach to the development of learning strategies for online training in evidence-based practices (EBPs) that takes the context of real-world practice into account. The field of instructional design offers ecologically valid and systematic processes to develop learning strategies for workforce development and performance support.

Objective

This report describes the application of an instructional design framework-Analyze, Design, Develop, Implement, and Evaluate (ADDIE) model-in the development and evaluation of e-learning modules as one strategy among a multifaceted approach to the implementation of individual placement and support (IPS), a model of supported employment for community behavioral health treatment programs, in New York State.

Methods

We applied quantitative and qualitative methods to develop and evaluate three IPS e-learning modules. Throughout the ADDIE process, we conducted formative and summative evaluations and identified determinants of implementation using the Consolidated Framework for Implementation Research (CFIR). Formative evaluations consisted of qualitative feedback received from recipients and providers during early pilot work. The summative evaluation consisted of levels 1 and 2 (reaction to the training, self-reported knowledge, and practice change) quantitative and qualitative data and was guided by the Kirkpatrick model for training evaluation.

Results

Formative evaluation with key stakeholders identified a range of learning needs that informed the development of a pilot training program in IPS. Feedback on this pilot training program informed the design document of three e-learning modules on IPS: Introduction to IPS, IPS Job development, and Using the IPS Employment Resource Book. Each module was developed iteratively and provided an assessment of learning needs that informed successive modules. All modules were disseminated and evaluated through a learning management system. Summative evaluation revealed that learners rated the modules positively, and self-report of knowledge acquisition was high (mean range: 4.4-4.6 out of 5). About half of learners indicated that they would change their practice after watching the modules (range: 48-51%). All learners who completed the level 1 evaluation demonstrated 80% or better mastery of knowledge on the level 2 evaluation embedded in each module. The CFIR was used to identify implementation barriers and facilitators among the evaluation data which facilitated planning for subsequent implementation support activities in the IPS initiative.

Conclusion

Instructional design approaches such as ADDIE may offer implementation scientists and practitioners a flexible and systematic approach for the development of e-learning modules as a single component or one strategy in a multifaceted approach for training in EBPs.

An Exploration of Factors that Effect the Implementation of Peer Support Services in Community Mental Health Settings

This study explored the integration of peer services into community mental health settings through qualitative interviews with peer-providers and non-peer mental health workers. Results show peer job satisfaction was contingent upon role clarity, autonomy, and acceptance by non-peer coworkers. Mental health workers reported the need for organizational support for peer services and guidance about how to utilize peers, negotiate their professional boundaries and accommodate their mental health needs. Effective peer integration requires organizational readiness, staff preparation and clear policies and procedures. Consultation from consumer-based organizations, enhanced professional competencies, and professional development and career advancement opportunities for peers represent important resources.

Mental Health Clinicians' Participation in Web-Based Training for an Evidence Supported Intervention: Signs of Encouragement and Trouble Ahead

Comprehensive scalable clinician training is needed to increase the impact of evidence-supported psychotherapies. This study was designed to ascertain clinician participation in different low-cost training activities, what predicts their training participation, and how participation can be increased. The study enrolled 163 clinicians. Of these, 105 completed a follow-up survey and 20 completed a more in-depth qualitative interview. Some activities (web training) attracted greater participation than others (e.g., discussion boards, role playing). Key findings include the desirability of self-paced learning and the flexibility it afforded practicing clinicians. However, some found the lack of accountability insurmountable. Many desired in-person training as a way to introduce accountability and motivation. While low-cost, relevant, self-paced learning appeals to practicing clinicians, it may need to be combined with opportunities for in-person training and accountability mechanisms in order to encourage large numbers of clinicians to complete training.

Behavioral Rehearsal for Analogue Fidelity: Feasibility in a State-Funded Children's Mental Health Initiative

A substantial number of evidence-based treatments (EBTs) are available, but are delivered infrequently in public mental health. To improve the quality of care, some states and systems have focused on EBT training; however, these efforts have rarely included objective measurement of clinician fidelity because of feasibility issues. The primary goal of the current study was evaluating the feasibility of the behavioral rehearsal (BR) method to assess "analogue fidelity" in a children's mental health quality improvement initiative. Results indicated low-but representative-clinician participation. Participants demonstrated greatest improvement at post-training with maintenance or decreases at 6-months (post-consultation). Implications for future use of BR are discussed.

Examining adherence to components of cognitive-behavioral therapy for youth anxiety after training and consultation

The present study examined 115 service providers' adherence to components of cognitive-behavioral therapy (CBT) for youth anxiety prior to training, post workshop training, and after three months of weekly consultation. Adherence was measured using a role-play with a trained actor. We examined differences in individual adherence to CBT components across time and the relationship between number of consultation sessions attended and adherence ratings following consultation. Findings indicated that somatic arousal identification and relaxation were the most used treatment components prior to training. Adherence to all components of CBT increased following workshop training, except the usage of problem-solving. Adherence to problem-solving, positive reinforcement, the identification of anxious self-talk, and the creation of coping thoughts increased following consultation but usage of problem-solving remained low compared to other treatment components. Overall adherence remained less than optimal at the final measurement point. Number of consultation sessions attended predicted post-consultation adherence to identification of somatic arousal, identification of anxious self-talk, and positive reinforcement. Implications include tailoring future training based on baseline levels of adherence and spending more time during training and consultation on underutilized CBT components, such as problem-solving. Limitations of the present study, including how adherence was measured, are discussed. This study adds to the implementation science literature by providing more nuanced information on changes in adherence over the course of training and consultation of service providers.

Mental health training for secondary school teachers in Haiti: a mixed methods, prospective, formative research study of feasibility, acceptability, and effectiveness in knowledge acquisition

BACKGROUND

Engagement and training of educators in student mental health holds promise for promoting access to care as a task sharing strategy but has not been well-studied in low-income regions.

METHODS

We used a prospective and convergent mixed methods design to evaluate a customized school mental health 2½ day training for teachers in rural Haiti (n = 22) as the initial component of formative research developing a school-based intervention to promote student mental health. Training prepared teachers to respond to student mental health needs by providing psychoeducational and practical support to facilitate access to care. We examined level of participation and evaluated feasibility, acceptability, and perceived effectiveness by calculating mean scores on self-report Likert-style items eliciting participant experience. We examined effectiveness of the training on improving mental health knowledge and attitudes by comparing mean scores on an assessment administered pre- and post-training. Finally, we examined self-report written open-ended responses and focus group discussion (FGD) interview data bearing on perceived feasibility, acceptability, and effectiveness to contextualize participant ratings of training and to identify recommendations for enhancing the utility of mental health training locally for educators.

RESULTS

Mean scores of knowledge and attitudes significantly improved between the pre-test and post-tests; e.g., knowledge improved from 58% correct at baseline to 68% correct on the second post-test (p = 0.039). Mean ratings of the training were favorable across all categories and FGD data demonstrated widespread participant endorsement of training acceptability and effectiveness; participants recommended extending the duration and number of training sessions.

CONCLUSIONS

Findings support feasibility, acceptability, and a limited scope of effectiveness of brief mental health training for secondary school teachers in Haiti. Further development of approaches to engage teachers in promoting school mental health through training is warranted.

Study protocol: implementation of a computer-assisted intervention for autism in schools: a hybrid type II cluster randomized effectiveness-implementation trial

Background

The number of children diagnosed with autism has rapidly outpaced the capacities of many public school systems to serve them, especially under-resourced, urban school districts. The intensive nature of evidence-based autism interventions, which rely heavily on one-to-one delivery, has caused schools to turn to computer-assisted interventions (CAI). There is little evidence regarding the feasibility, effectiveness, and implementation of CAI in public schools. While CAI has the potential to increase instructional time for students with autism, it may also result in unintended consequences such as reduction in the amount of interpersonal (as opposed to computerized) instruction students receive. The purpose of this study is to test the effectiveness of one such CAI—TeachTown—its implementation, and its effects on teachers’ use of other evidence-based practices.

Methods

This study protocol describes a type II hybrid cluster randomized effectiveness-implementation trial. We will train and coach 70 teachers in autism support classrooms in one large school district in the use of evidence-based practices for students with autism. Half of the teachers then will be randomly selected to receive training and access to TeachTown: Basics, a CAI for students with autism, for the students in their classrooms. The study examines: (1) the effectiveness of TeachTown for students with autism; (2) the extent to which teachers implement TeachTown the way it was designed (i.e., fidelity); and (3) whether its uptake increases or reduces the use of other evidence-based practices.

Discussion

This study will examine the implementation of new technology for children with ASD in public schools and will be the first to measure the effectiveness of CAI. As importantly, the study will investigate whether adding a new technology on top of existing practices increases or decreases their use. This study presents a unique method to studying both the implementation and exnovation of evidence-based practices for children with autism in school settings.

Trial registration

NCT02695693. Retrospectively registered on July 8, 2016.

What Predicts Clinician Dropout from State-Sponsored Managing and Adapting Practice Training

Dropouts from system-wide evidence-based practice trainings are high; yet there are few studies on what predicts dropouts. This study examined multilevel predictors of clinician dropout from a statewide training on the Managing and Adapting Practice program. Extra-organizational structural variables, intra-organizational variables and clinician variables were examined. Using multivariable logistic regression analysis, state administrative data and prospectively collected clinician participation data were used to predict dropout. Two characteristics were predictive: younger clinicians and those practicing in upstate-rural areas compared to downstate-urban areas were less likely to drop out from training. Implications for research and policy are described.

User-Centered Design for Psychosocial Intervention Development and Implementation

The current paper articulates how common difficulties encountered when attempting to implement or scale-up evidence-based treatments are exacerbated by fundamental design problems, which may be addressed by a set of principles and methods drawn from the contemporary field of user-centered design. User-centered design is an approach to product development that grounds the process in information collected about the individuals and settings where products will ultimately be used. To demonstrate the utility of this perspective, we present four design concepts and methods: (a) clear identification of end users and their needs, (b) prototyping/rapid iteration, (c) simplifying existing intervention parameters/procedures, and (d) exploiting natural constraints. We conclude with a brief design-focused research agenda for the developers and implementers of evidence-based treatments.

A Structured Protocol Model of Depression Care versus Clinical Acumen: A Cluster Randomized Trial of the Effects on Depression Screening, Diagnostic Evaluation, and Treatment Uptake in Ugandan HIV Clinics

Depression is common among people living with HIV, and it has consequences for both HIV prevention and treatment response, yet depression treatment is rarely integrated into HIV care in sub-Saharan Africa, partly due to the paucity of mental health professionals. We conducted a cluster randomized controlled trial of two task-shifting models to facilitating depression care delivered by medical providers: one that utilized a structured protocol, and one that relied on clinical acumen, in 10 HIV clinics in Uganda. Both models started with routine depression screening of all clients at triage using the 2-item Patient Health Questionnaire (PHQ-2), from which we enrolled 1252 clients (640 at structured protocol clinics, 612 at clinical acumen clinics) who had screened positive over 12 months. We compared the two models on (1) proportion of all client participants, and those clinically depressed (based on survey-administered 9-item PHQ-9>9), who received post-screening evaluation for depression using the PHQ-9; and (2) proportion of clinically depressed who were prescribed antidepressant therapy. Linear probability regression analyses were conducted using a wild cluster bootstrap to control for clustering; patient characteristics, clinic size and time fixed effects were included as covariates. Among all client participants, those in the structured protocol arm were far more likely to have received further evaluation by a medical provider using the PHQ-9 (84% vs. 49%; beta = .33; p = .01). Among the clinically depressed clients (n = 369), the advantage of the structured protocol model over clinical acumen was not statistically significant with regard to PHQ-9 depression evaluation (93% vs. 68%; beta = .21; p = .14) or prescription of antidepressants (69% vs. 58%; beta = .10; p = .50), in part because only 30% of clients who screened positive were clinically depressed. These findings reveal that in both models depression care practices were widely adopted by providers, and depression care reached most depressed clients. The structured protocol model is advantageous for ensuring that positively screened clients receive a depression evaluation, but the two models performed equally well in ensuring the treatment of depressed clients in the context of strong supervision support.

TRIAL REGISTRATION

ClinicalTrials.gov NCT02056106.

Implementing cognitive remediation therapy (CRT) in a mental health service: staff training

OBJECTIVE

This paper describes the establishment of training in cognitive remediation for psychosis within a community mental health service.

METHODS

Clinical staff working in the community of a mental health service were surveyed to ascertain their interest in cognitive aspects of psychosis and skills training in cognitive remediation (CR). Based on the results of the survey a tiered training programme was established with attendance figures reported for each level of training. Fidelity assessment was conducted on the five CR programmes operating.

RESULTS

Of 106 clinical staff working in the community with people diagnosed with a psychotic illness 51 completed the survey (48% response rate). The training needs varied with all 106 staff receiving the fundamental (mandatory) training and 51 staff receiving CR facilitator training. Thirty three percent of staff trained as facilitators were delivering CR.

CONCLUSIONS

Up skilling the mental health workforce to incorporate an understanding of the cognitive aspects of psychosis into care delivery can be facilitated by a tiered training structure. Fundamental training on the psychosocial aspects of psychosis can act as a platform for focussed CR skills based training. There is also a need for accessible therapy based supervision for staff wishing to develop competencies as CR therapists.

Predictive Validity of Addiction Treatment Clinicians' Post-Training Contingency Management Skills for Subsequent Clinical Outcomes

In the context of a contingency management (CM) implementation/effectiveness hybrid trial, the post-training implementation domains of direct-care clinicians (N=19) were examined in relation to a targeted clinical outcome of subsequently CM-exposed clients. Clinicians' CM skillfulness, a behavioral measure of their capability to skillfully deliver the intended CM intervention, was found to be a robust and specific predictor of their subsequent client outcomes. Analyses also revealed CM skillfulness to: (1) fully mediate an association between a general therapeutic effectiveness and client outcome, (2) partially mediate an association of in-training exposure to CM and client outcome, and (3) be composed of six component clinical practice behaviors that each contributed meaningfully to this behavior fidelity index. Study findings offer preliminary evidence of the predictive validity of post-training CM skillfulness for subsequent client outcomes, and inform suggestions for the design and delivery of skills-focused CM training curricula for the addiction treatment workforce.

It Takes a Village: A Mixed Method Analysis of Inner Setting Variables and Dialectical Behavior Therapy Implementation

Guided by the Consolidated Framework for Implementation Research, this mixed method study explored the relationship between inner setting variables and dialectical behavior therapy (DBT) implementation. Intensively trained DBT clinicians completed an online quantitative survey (n = 79) and a subset were sequentially interviewed using qualitative methods (n = 20) to identify relationships between inner setting variables and DBT implementation. Four interpersonal variables-team cohesion, team communication, team climate, and supervision-were correlated with the quantity of DBT elements implemented. Qualitative themes corroborated these findings. Additional variables were connected to implementation by either quantitative or qualitative findings, but not both.

Task sharing in rural Haiti: Qualitative assessment of a brief, structured training with and without apprenticeship supervision for community health workers

Despite growing support for supervision after task sharing trainings in humanitarian settings, there is limited research on the experience of trainees in apprenticeship and other supervision approaches. Studying apprenticeships from trainees' perspectives is crucial to refine supervision and enhance motivation for service implementation. The authors implemented a multi-stage, transcultural adaptation for a pilot task sharing training in Haiti entailing three phases: 1) literature review and qualitative research to adapt a mental health and psychosocial support training; 2) implementation and qualitative process evaluation of a brief, structured group training; and 3) implementation and qualitative evaluation of an apprenticeship training, including a two year follow-up of trainees. Structured group training revealed limited knowledge acquisition, low motivation, time and resource constraints on mastery, and limited incorporation of skills into practice. Adding an apprenticeship component was associated with subjective clinical competency, increased confidence regarding utilising skills, and career advancement. Qualitative findings support the added value of apprenticeship according to trainees.

Sustained Implementation of Cognitive-Behavioral Therapy for Youth Anxiety and Depression: Long-term Effects of Structured Training and Consultation on Therapist Practice in the Field

Identifying factors that promote sustained implementation of evidence-based treatments (EBTs) after therapists receive training is critical for professional psychology. To address the field's minimal knowledge in this area, we interviewed community-based therapists (N = 23) who had completed intensive training in cognitive behavioral therapy (CBT) for either anxiety or depression as part of a randomized effectiveness trial (Southam-Gerow et al., 2010; Weisz et al., 2009). Therapists were interviewed three to five years after completion of the initial trial, representing one of the longest-term follow-ups of therapist practices after training. Therapists viewed each protocol and their individual CBT strategies as effective and appropriate for the majority of their current anxiety and depression caseloads. However, therapists used parts of each protocol much more frequently than the protocol as a whole (i.e., 78.5% used parts of the Coping Cat, and 7.5% used the whole protocol; 58.6% used parts of the PASCET, and 20% used the whole protocol). Therapists reported using problem-solving the most and exposure exercises the least for current anxious cases; they used cognitive restructuring the most and homework the least for current depression cases. Interventions that were more difficult to implement in usual care settings were less likely to be sustained. Future efforts should evaluate the characteristics and structure of EBTs that are most acceptable to therapists and should investigate which kinds of ongoing learning supports will maintain therapist skills in and continued use of EBTs.

Online self-administered training of PTSD treatment providers in cognitive-behavioral intervention skills: results of a randomized controlled trial

Despite potential advantages in scalability and efficiency of web-based training for trauma providers, few controlled trials of feasibility and effectiveness of web-based mental health training have been performed. Our study compared web-based training in 3 intervention skills (motivation enhancement [ME], goal setting [GS], behavioral task assignment [BTA]) with web-based training plus telephone consultation, and a no-training control. The primary outcome measures included objective measures of skills acquisition (standardized patient assessments). Results showed significant differences among the training conditions. The overall tests of differences among the groups were statistically significant for ME and BTA skills (p < .001 and p = .005, respectively), but not for GS (p = .245). The web training plus consultation group improved in ME skills by 0.35 units compared to 0.12 units in the web only group (p < .001) and no change in the control group (p = .001). For BTA skills, the web training plus consultation improved by 0.27 units compared to 0.17 units in the web only group (p = .175) and no change in the control group (p = .004). Overall, these findings support the use of web-based dissemination for large-scale training programs for trauma providers in health care delivery systems. Further studies are needed to clarify the specific role of consultation as an adjunct to web-based training.

A Healthy New World: Emergent Opportunities for Clinical Psychologists in the Patient Protection and Affordable Care Act

The Patient Protection and Affordable Care Act (ACA) is radically transforming the health and mental health care landscape. Emergent opportunities exist for clinical psychologists to redefine their role in healthcare. We reflect on the Chor and colleagues article (this issue) elucidating key issues for psychologists, and present additional recommendations for consideration. Specifically, we highlight three points: (1) moving beyond just training and hoping; (2) recovery, not just symptom reduction; and (3) it's a healthy new world. Under each of these points, we suggest tactics for how to achieve these goals.