Design elements in implementation research: a structured review of child welfare and child mental health studies

A multisector community-engaged collaborative for mental health integration in primary care and housing developments: Protocol for a stepped-wedge randomized controlled trial (the Harlem Strong Program)

BACKGROUND

Addressing mental health disparities following COVID-19 requires adaptive, multi-sectoral, equity-focused, and community-based approaches. Mental health task-sharing in gateway settings has been found to address mental health care gaps in low- and middle-income countries, but is not a common practice in the U.S., especially in non-medical settings, such as low-income housing developments (LIH). This research study will evaluate the effectiveness of a multisectoral community-engaged collaborative for task-sharing mental health care on consumer, provider, and implementation outcomes, as well as identify barriers and facilitators for implementation.

METHODS

In this stepped-wedge randomized controlled trial with technology supplementation, LIH and primary care sites will be randomly assigned to one of five sequences of three implementation strategies: (1) Education and Resources (E&R), which involves online training and resources on basic mental health task-sharing skills, (2) Multisectoral Community Collaborative Care (MCC), which consists of all E&R resources plus additional community responsive implementation supports and participation in a multisectoral coalition and (3) MCC + Technology, which combines the MCC condition resources with a community crowdsourced technology solution to support implementation. The primary outcome is the effectiveness in meeting consumers' needs through direct service (e.g., adequately addressing depression and anxiety symptoms), and through implementation to increase access to mental health care (reach). The secondary outcome examines additional consumer outcomes including health functioning and social risks, as well as implementation outcomes including provider skills, program adoption, and factors related to barriers and facilitators of quality implementation. A total of 700 consumers receiving mental health care at 20 sites will be surveyed at baseline, 6-, and 12-month follow-ups. Additionally, 100 providers will be evaluated at baseline, 6-, 12-, and 24-month follow-ups before training and after randomization.

DISCUSSION

We hypothesize that MCC and MCC + Technology conditions will demonstrate significantly higher efficacy in changing primary outcomes compared to E&R, and the MCC + Technology supplement will show significantly higher levels of reach of mental health tasks compared to the MCC condition alone. These findings will demonstrate the feasibility of mental health integration into accessible, non-medical community settings such as LIH. Moreover, it will help establish a multilevel system solution based on community engagement and planning with a multisectoral collaboration that can be sustained community-wide.

TRIAL REGISTRATION

NCT05833555 on Clinicaltrials.gov. Registered April 26, 2023.

Barriers and facilitators of implementation of evidence-based interventions in children and young people's mental health care - a systematic review

BACKGROUND

Effective evidence-based practices (EBP) for children and young people's (CYP) mental health exist, however, there is low uptake in clinical practice and interventions do not always reach those in need. This review aimed to comprehensively identify and synthesise the barriers and facilitators to implementing EBP in CYP mental health care, mapped according to an implementation framework in order to make pragmatic recommendations for practitioners, commissioners and researchers.

METHODS

Following the PRISMA guidelines, an electronic search of PsycINFO, MEDLINE, CINAHL and Embase in 2021 yielded 1830 results. In total, 107 abstracts were screened, 57 of which were included for full-text review and 26 were included for data extraction and analysis.

RESULTS

We identified a number of organisational and clinician-level barriers which impede the implementation of evidence in 'real world' practice. Barriers included lack of access to funding; poor access to resources; clinician attitudes and flexibility of EBP. Facilitators included targeted funding and access to resources; supportive staff and leadership committed to innovation and skills in the EBP.

CONCLUSIONS

Although the process of translating research into practice is challenging and the solutions are not straightforward, we have identified a set of practical recommendations for ways in which implementation practices can improve. Researchers, commissioners, funders and practitioners can work together to improve the implementation of EBP in CYP mental health settings by ensuring funding is available, prioritise implementation beyond the end of trials, upskill staff on integrating EBP into care, ensure EBPs are flexible and are co-produced with service users.

REGISTRATION

This review was registered on PROSPERO international prospective register of systematic reviews (CRD42021252995).

International Experience of Implementing Cognitive Remediation for People With Psychotic Disorders

BACKGROUND

Cognitive remediation (CR) is an effective therapy for the cognitive impact of mental illness, especially schizophrenia. Global efforts are being made to implement CR into routine mental health services with the aim of improving functional outcomes for the population of people recovering from mental illness. Implementation and dissemination of CR in heterogeneous settings require knowledge gleaned from formal implementation research and pragmatic experiential learning. This article describes cross-cultural approaches to CR implementation, focusing on initiatives in France, the United States, Australia, and Japan.

METHOD

Key leaders in the implementation of CR in France, the United States, Australia, and Japan were asked to describe the implementation and dissemination process in their settings with respect to the categories of context, implementation, outcomes, facilitators, and barriers.

RESULTS

All 4 sites noted the role of collaboration to leverage the implementation of CR into mental health rehabilitation services. In France, high-level, government organizational backing enhanced the dissemination of CR. Academic and clinical service partnerships in the United States facilitated the dissemination of programs. The advocacy from service users, families, and carers can aid implementation. The support from international experts in the field can assist in initiating programs but maintenance and dissemination require ongoing training and supervision of staff.

CONCLUSIONS

CR is an effective intervention for the cognitive impact of schizophrenia. Programs can be implemented in diverse settings globally. Adaptations of CR centering upon the core components of effective CR therapy enhance outcomes and enable programs to integrate into diverse settings.

Integrated psychological care in pediatric hospital settings for children with complex chronic illness and their families: a systematic review

OBJECTIVE

To synthesize and critically evaluate evidence on the effectiveness of integrated psychological care models for children with complex chronic illness within pediatric hospital settings and provide recommendations for successful implementation.

DESIGN

Six electronic databases (Medline, Cochrane, Embase, PsycINFO, Scopus, CINAHL) were systematically searched for English language studies including families of children aged 0-17 years with complex chronic illness. Eligible studies reported on psychology or neuropsychology screening, assessment, intervention, or services provided within a pediatric hospital setting.

RESULTS

Fifteen studies were identified for review; nine assessed a psychological service, five examined psychosocial screening, and one examined a neuropsychology service. Three studies demonstrated the effectiveness of integrated psychological services in improving child or parent physical, psychological, or behavioral health outcomes. Uptake of psychosocial screening was high (84-96%), but only 25-37% of children or families identified as 'at-risk' engaged with on-site psychology services. Integrated psychological services offering consultations at the same time and location as the child's medical visit reported the highest rates of uptake (77-100%).

CONCLUSIONS

The available evidence supports co-location of child medical and psychological services. A more consistent and comprehensive approach to the assessment of patient- and caregiver-reported outcomes and implementation effectiveness is recommended.

Review of family-based treatments from 2010 to 2019 for suicidal ideation and behavior

Suicide ideation and behavior are pervasive public health issues. Given that positive interpersonal relationships can be a protective factor against suicide risk, we conducted a systematic review to examine peer-reviewed publications from 2010 to 2019 that included empirical data, tested an intervention with at least some family component, and included a suicide-related outcome measure. We reviewed and synthesized findings from 22 articles covering 7 intervention categories with 12 interventions to examine the treatment components and the quality of evidence to support them. Using Southam-Gerow and Prinstein's (Child Adolesc Psychol 43:16, 2014) guidelines, we identified two well-established intervention categories that met the highest standards for interventions and three probably efficacious intervention categories. All interventions found focused solely on suicide risk in adolescent populations. More studies are needed for adult populations and to explore the role of family moderators and mediators to test whether suicide outcomes are reduced by improvement in the family environment.

Engaging Families in Voluntary Prevention Services to Reduce Future Child Abuse and Neglect: a Randomized Controlled Trial

Research on secondary prevention is mixed as to whether referrals to evidence-based practices and other community interventions reduce maltreatment recidivism. This evaluation sought to rigorously assess whether a community service-linkage model to evidence-based programs decreased subsequent reports of abuse and neglect among families reported to the child protection system (CPS). Between 2016 and 2018, administrative CPS records were used to identify families with at least one child under 5 years of age recently reported for maltreatment in Orange County, California, but where no follow-up services were mandated. Families were randomized to one of two community outreach and engagement conditions (i.e., targeted provider outreach vs. treatment-as-usual). Re-reporting outcomes were tracked in administrative records for a period of 12 months. A total of 4873 families met eligibility criteria, with 2231 (45.0%) randomized to the intervention arm and 2642 (54.0%) families to the control group. Among families in the intervention group, 811 (36.4%) were successfully contacted by a community provider. Of those families contacted, 145 (18.0%) agreed to participate in voluntary services. Overall, we did not detect any significant difference in re-reporting between our treatment and control groups (P = .433). Likewise, no significant differences in re-reporting were observed when we stratified the treatment group by levels of outreach and service engagement. Findings indicate low levels of successful engagement of families in voluntary services. Notwithstanding the absence of significant findings, this study demonstrates the potential for using community-based RCTs and administrative records to rigorously evaluate secondary prevention programs in the child protection system.

Implementation Patterns of Two Evidence-Based Psychotherapies in Veterans Affairs Residential Posttraumatic Stress Disorder Programs: A Five-Point Longitudinal National Investigation

The present study examined the patterns of adoption of two evidence-based psychotherapies (EBPs)-prolonged exposure (PE) and cognitive processing therapy (CPT)-in U.S. Department of Veterans Affairs (VA) residential posttraumatic stress disorder (PTSD) treatment programs. A total of 526 providers from 39 programs nationwide completed online quantitative surveys and qualitative interviews, collected at five assessment points between 2008 and 2015, concerning the use of PE and CPT. By the midpoint of the study period, responders from most programs reported having adopted one or both EBPs as either core components of their programs or "tracks" for certain patients within their programs, adoption rates were 52.8% of programs at Time 3, 61.0% at Time 4, and 66.7% at Time 5. Evaluation of adoption patterns over time suggested that CPT was used in more programs and with more patients within programs compared to PE. At Time 5, respondents from half of the programs reported little or no adoption of PE, whereas the CPT adoption rate was reported to be "little or none" for one-fifth of the programs. The adoption of PE was generally slower compared to CPT adoption. The slower rate of adoption may be related to the resource-intensive nature of implementing PE on an individual basis in a residential setting as compared to the multiple ways CPT can be delivered: individually or in group settings, and with or without the inclusion of the trauma narrative. Strategies to improve sustainability measurement and implications for implementation science are discussed.

Improving the implementation and sustainment of evidence-based practices in community mental health organizations: a study protocol for a matched-pair cluster randomized pilot study of the Collaborative Organizational Approach to Selecting and Tailoring Implementation Strategies (COAST-IS)

Background

Implementing and sustaining evidence-based programs with fidelity may require multiple implementation strategies tailored to address multi-level, context-specific barriers and facilitators. Ideally, selecting and tailoring implementation strategies should be guided by theory, evidence, and input from relevant stakeholders; however, methods to guide the selection and tailoring of strategies are not well-developed. There is a need for more rigorous methods for assessing and prioritizing implementation determinants (barriers and facilitators) and linking implementation strategies to determinants. The Collaborative Organizational Approach to Selecting and Tailoring Implementation Strategies (COAST-IS) is an intervention designed to increase the effectiveness of evidence-based practice implementation and sustainment. COAST-IS will enable organizational leaders and clinicians to use Intervention Mapping to select and tailor implementation strategies to address their site-specific needs. Intervention Mapping is a multi-step process that incorporates theory, evidence, and stakeholder perspectives to ensure that implementation strategies effectively address key determinants of change.

Methods

COAST-IS will be piloted with community mental health organizations that are working to address the needs of children and youth who experience trauma-related emotional or behavioral difficulties by engaging in a learning collaborative to implement an evidence-based psychosocial intervention (trauma-focused cognitive behavioral therapy). Organizations will be matched and then randomized to participate in the learning collaborative only (control) or to receive additional support through COAST-IS. The primary aims of this study are to (1) assess the acceptability, appropriateness, feasibility, and perceived utility of COAST-IS; (2) evaluate the organizational stakeholders' fidelity to the core elements of COAST-IS; and (3) demonstrate the feasibility of testing COAST-IS in a larger effectiveness trial.

Discussion

COAST-IS is a systematic method that integrates theory, evidence, and stakeholder perspectives to improve the effectiveness and precision of implementation strategies. If effective, COAST-IS has the potential to improve the implementation and sustainment of a wide range of evidence-based practices in mental health and other sectors.

Trial registration

This study was registered in ClinicalTrials.gov (NCT03799432) on January 10, 2019 (last updated August 5, 2019).

Shifting the Lens: An Implementation Study of a Community-Based and Social Network Intervention to Gender-Based Violence

Responding to the call to "shift the lens" and expand gender-based violence remedies beyond individualized direct services and law enforcement remedies, anti-violence providers have struggled to redefine and redirect intervention approaches. This implementation study leverages the framework of implementation science to investigate an exploratory statewide initiative based on the Creative Interventions model and aimed to build organizational and regional capacity to implement community-based or social network interventions within provider organizations. Using data from nine organizations, this mixed-methods study identifies factors related to implementation of this innovative approach including organizational motivation, capacity, and perceived needs related to adoption and implementation.

A modeling framework to inform preexposure prophylaxis initiation and retention scale-up in the context of 'Getting to Zero' initiatives

OBJECTIVE(S)

'Getting to Zero' (GTZ) initiatives aim to eliminate new HIV infections over a projected time frame. Increased preexposure prophylaxis (PrEP) uptake among populations with the highest HIV incidence, such as young Black MSM, is necessary to accomplish this aim. Agent-based network models (ABNMs) can help guide policymakers on strategies to increase PrEP uptake.

DESIGN

Effective PrEP implementation requires a model that incorporates the dynamics of interventions and dynamic feedbacks across multiple levels including virus, host, behavior, networks, and population. ABNMs are a powerful tool to incorporate these processes.

METHODS

An ABNM, designed for and parameterized using data for young Black MSM in Illinois, was used to compare the impact of PrEP initiation and retention interventions on HIV incidence after 10 years, consistent with GTZ timelines. Initiation interventions selected individuals in serodiscordant partnerships, or in critical sexual network positions, and compared with a controlled setting where PrEP initiators were randomly selected. Retention interventions increased the mean duration of PrEP use. A combination intervention modeled concurrent increases in PrEP initiation and retention.

RESULTS

Selecting HIV-negative individuals for PrEP initiation in serodiscordant partnerships resulted in the largest HIV incidence declines, relative to other interventions. For a given PrEP uptake level, distributing effort between increasing PrEP initiation and retention in combination was approximately as effective as increasing only one exclusively.

CONCLUSION

Simulation results indicate that expanded PrEP interventions alone may not accomplish GTZ goals within a decade, and integrated scale-up of PrEP, antiretroviral therapy, and other interventions might be necessary.

Research Needs for Implementing Cancer Prevention and Early Detection in Developing Countries: From Scientists' to Implementers' Perspectives

Implementation of evidence-based cancer prevention and early detection in low- and middle-income countries (LMIC) is challenging. Limited and inappropriate introduction of novel alternatives results in an equity gap whereby low-income populations receive a lower benefit. Implementation research represents an opportunity to foster the adoption and expansion of evidence-based cancer control strategies; however, scientific development in high-income countries does not necessarily fulfill the particular needs of LMIC in the field. A review on the link between implementation research and practice, the tension between theory and pragmatism, the conflict around implementation research methods, and determinants of research priority definition was carried out by considering the perspective of cancer prevention and early detection implementers in LMIC. Basic principles and alternatives to overcome implementation research challenges in these settings are discussed.

Specifying sickle cell disease interventions: a study protocol of the Sickle Cell Disease Implementation Consortium (SCDIC)

BACKGROUND

Sickle cell disease (SCD) is an inherited blood disorder that results in a lifetime of anemia, severe pain, and end-organ damage that can lead to premature mortality. While the SCD field has made major medical advances, much needs to be done to improve the quality of care for people with SCD. This study capitalizes on the Sickle Cell Disease Implementation Consortium (SCDIC), a consortium of eight academic sites aiming to test implementation strategies that could lead to more accelerated application of the NHLBI guidelines for treating SCD. This report documents the process to support the consortium by specifying the interventions being developed.

METHODS

This study consists of three steps. The Principal Investigator of each site and two site representatives who are knowledgeable of the intervention (e.g., study coordinator or the person delivering the intervention) will answer an online survey aiming to capture components of the interventions. This survey will be completed by the site representatives three times during the study: during the development of the interventions, after one year of the interventions being implemented, and at the end of this study (after 2 years). A site visit and semi-structured interview (Step 2) in the first year of the process will capture the context of the sites. Step 3 comprises of the development of a framework with the details of the multi-component SCDIC interventions at the sites.

DISCUSSION

The outcome of this study, a framework of the SCDIC, will enable accurate replication and extension of published research, facilitating the translation of SCD studies to diverse populations and settings and allowing for theory testing of the effects of the intervention components across studies in different contexts and for different populations.

TRIAL REGISTRATION

ClinicalTrial.Gov (# NCT03380351 ). Registered December 21, 2017.

Intentional research design in implementation science: implications for the use of nomothetic and idiographic assessment

The advancement of implementation science is dependent on identifying assessment strategies that can address implementation and clinical outcome variables in ways that are valid, relevant to stakeholders, and scalable. This paper presents a measurement agenda for implementation science that integrates the previously disparate assessment traditions of idiographic and nomothetic approaches. Although idiographic and nomothetic approaches are both used in implementation science, a review of the literature on this topic suggests that their selection can be indiscriminate, driven by convenience, and not explicitly tied to research study design. As a result, they are not typically combined deliberately or effectively. Thoughtful integration may simultaneously enhance both the rigor and relevance of assessments across multiple levels within health service systems. Background on nomothetic and idiographic assessment is provided as well as their potential to support research in implementation science. Drawing from an existing framework, seven structures (of various sequencing and weighting options) and five functions (Convergence, Complementarity, Expansion, Development, Sampling) for integrating conceptually distinct research methods are articulated as they apply to the deliberate, design-driven integration of nomothetic and idiographic assessment approaches. Specific examples and practical guidance are provided to inform research consistent with this framework. Selection and integration of idiographic and nomothetic assessments for implementation science research designs can be improved. The current paper argues for the deliberate application of a clear framework to improve the rigor and relevance of contemporary assessment strategies.

Methods to Improve the Selection and Tailoring of Implementation Strategies

Implementing behavioral health interventions is a complicated process. It has been suggested that implementation strategies should be selected and tailored to address the contextual needs of a given change effort; however, there is limited guidance as to how to do this. This article proposes four methods (concept mapping, group model building, conjoint analysis, and intervention mapping) that could be used to match implementation strategies to identified barriers and facilitators for a particular evidence-based practice or process change being implemented in a given setting. Each method is reviewed, examples of their use are provided, and their strengths and weaknesses are discussed. The discussion includes suggestions for future research pertaining to implementation strategies and highlights these methods' relevance to behavioral health services and research.

Variation in Research Designs Used to Test the Effectiveness of Dissemination and Implementation Strategies: A Review

Background

The need for optimal study designs in dissemination and implementation (D&I) research is increasingly recognized. Despite the wide range of study designs available for D&I research, we lack understanding of the types of designs and methodologies that are routinely used in the field. This review assesses the designs and methodologies in recently proposed D&I studies and provides resources to guide design decisions.

Methods

We reviewed 404 study protocols published in the journal Implementation Science from 2/2006 to 9/2017. Eligible studies tested the efficacy or effectiveness of D&I strategies (i.e., not effectiveness of the underlying clinical or public health intervention); had a comparison by group and/or time; and used ≥1 quantitative measure. Several design elements were extracted: design category (e.g., randomized); design type [e.g., cluster randomized controlled trial (RCT)]; data type (e.g., quantitative); D&I theoretical framework; levels of treatment assignment, intervention, and measurement; and country in which the research was conducted. Each protocol was double-coded, and discrepancies were resolved through discussion.

Results

Of the 404 protocols reviewed, 212 (52%) studies tested one or more implementation strategy across 208 manuscripts, therefore meeting inclusion criteria. Of the included studies, 77% utilized randomized designs, primarily cluster RCTs. The use of alternative designs (e.g., stepped wedge) increased over time. Fewer studies were quasi-experimental (17%) or observational (6%). Many study design categories (e.g., controlled pre-post, matched pair cluster design) were represented by only one or two studies. Most articles proposed quantitative and qualitative methods (61%), with the remaining 39% proposing only quantitative. Half of protocols (52%) reported using a theoretical framework to guide the study. The four most frequently reported frameworks were Consolidated Framework for Implementing Research and RE-AIM (n = 16 each), followed by Promoting Action on Research Implementation in Health Services and Theoretical Domains Framework (n = 12 each).

Conclusion

While several novel designs for D&I research have been proposed (e.g., stepped wedge, adaptive designs), the majority of the studies in our sample employed RCT designs. Alternative study designs are increasing in use but may be underutilized for a variety of reasons, including preference of funders or lack of awareness of these designs. Promisingly, the prevalent use of quantitative and qualitative methods together reflects methodological innovation in newer D&I research.

Multilevel Mechanisms of Implementation Strategies in Mental Health: Integrating Theory, Research, and Practice

A step toward the development of optimally effective, efficient, and feasible implementation strategies that increase evidence-based treatment integration in mental health services involves identification of the multilevel mechanisms through which these strategies influence implementation outcomes. This article (a) provides an orientation to, and rationale for, consideration of multilevel mediating mechanisms in implementation trials, and (b) systematically reviews randomized controlled trials that examined mediators of implementation strategies in mental health. Nine trials were located. Mediation-related methodological deficiencies were prevalent and no trials supported a hypothesized mediator. The most common reason was failure to engage the mediation target. Discussion focuses on directions to accelerate implementation strategy development in mental health.

Sickle cell disease and implementation science: A partnership to accelerate advances

Sickle cell disease (SCD) results in end organ damage and a shortened lifespan. Both the pathophysiology of the disease and the social determinants of health affect patient outcomes. Randomized controlled trials have been completed among this population and resulted in medical advances; however, the gestation of these advances and the lack of penetrance into clinical practice have limited advancements in clinical improvements for many people with SCD. We discuss the role of implementation science in SCD and highlight the need for this science to shorten the length of time to implement evidence-based care for more people with SCD.

A Framework for Valuing Investments in a Nurturing Society: Opportunities for Prevention Research

Investing in strategies that aim to build a more nurturing society offers tremendous opportunities for the field of prevention science. Yet, scientists struggle to consistently take their research beyond effectiveness evaluations and actually value the impact of preventive strategies. Ultimately, it is clear that convincing policymakers to make meaningful investments in children and youth will require estimates of the fiscal impact of such strategies across public service systems. The framework offered here values such investments. First, we review current public spending on children and families. Then, we describe how to quantify and monetize the impact of preventive interventions. This includes a new measurement strategy for assessing multisystem service utilization and a price list for key service provision from public education, social services, criminal justice, health care and tax systems.

Automatic classification of communication logs into implementation stages via text analysis

BACKGROUND

To improve the quality, quantity, and speed of implementation, careful monitoring of the implementation process is required. However, some health organizations have such limited capacity to collect, organize, and synthesize information relevant to its decision to implement an evidence-based program, the preparation steps necessary for successful program adoption, the fidelity of program delivery, and the sustainment of this program over time. When a large health system implements an evidence-based program across multiple sites, a trained intermediary or broker may provide such monitoring and feedback, but this task is labor intensive and not easily scaled up for large numbers of sites. We present a novel approach to producing an automated system of monitoring implementation stage entrances and exits based on a computational analysis of communication log notes generated by implementation brokers. Potentially discriminating keywords are identified using the definitions of the stages and experts' coding of a portion of the log notes. A machine learning algorithm produces a decision rule to classify remaining, unclassified log notes.

RESULTS

We applied this procedure to log notes in the implementation trial of multidimensional treatment foster care in the California 40-county implementation trial (CAL-40) project, using the stages of implementation completion (SIC) measure. We found that a semi-supervised non-negative matrix factorization method accurately identified most stage transitions. Another computational model was built for determining the start and the end of each stage.

CONCLUSIONS

This automated system demonstrated feasibility in this proof of concept challenge. We provide suggestions on how such a system can be used to improve the speed, quality, quantity, and sustainment of implementation. The innovative methods presented here are not intended to replace the expertise and judgement of an expert rater already in place. Rather, these can be used when human monitoring and feedback is too expensive to use or maintain. These methods rely on digitized text that already exists or can be collected with minimal to no intrusiveness and can signal when additional attention or remediation is required during implementation. Thus, resources can be allocated according to need rather than universally applied, or worse, not applied at all due to their cost.

A study in contrasts: Supports and barriers to successful implementation of two evidence-based parenting interventions in child welfare

Although evidence-based interventions (EBIs) are spreading to child welfare, research on real-world dynamics of implementation within this setting is scarce. Using a six-factor implementation framework to examine implementation of two evidence-based parenting interventions, we sought to build greater understanding of key facilitators and barriers by comparing successful versus failed EBI implementation in a child welfare setting. Semi-structured interviews were conducted with a purposive sample of 15 frontline practitioners and state-level managers. Interviews were transcribed verbatim and data analysis used a modified analytic approach. Our results showed the successful EBI was viewed more positively on all six factors; however, implementation was multidimensional, multilevel, and mixed with accomplishments and challenges. An accumulation of strengths across implementation factors proved beneficial. Implementation frameworks may be advantageous in organizing and explaining the numerous factors that may influence successful versus failed implementation. While encountering obstacles is largely inevitable, understanding which factors have shaped the success or failure of EBI implementations in child welfare settings may optimize future implementations in this context.

Building capacity in implementation science research training at the University of Nairobi

BACKGROUND

Health care systems in sub-Saharan Africa, and globally, grapple with the problem of closing the gap between evidence-based health interventions and actual practice in health service settings. It is essential for health care systems, especially in low-resource settings, to increase capacity to implement evidence-based practices, by training professionals in implementation science. With support from the Medical Education Partnership Initiative, the University of Nairobi has developed a training program to build local capacity for implementation science.

METHODS

This paper describes how the University of Nairobi leveraged resources from the Medical Education Partnership to develop an institutional program that provides training and mentoring in implementation science, builds relationships between researchers and implementers, and identifies local research priorities for implementation science.

RESULTS

The curriculum content includes core material in implementation science theory, methods, and experiences. The program adopts a team mentoring and supervision approach, in which fellows are matched with mentors at the University of Nairobi and partnering institutions: University of Washington, Seattle, and University of Maryland, Baltimore. A survey of program participants showed a high degree satisfaction with most aspects of the program, including the content, duration, and attachment sites. A key strength of the fellowship program is the partnership approach, which leverages innovative use of information technology to offer diverse perspectives, and a team model for mentorship and supervision.

CONCLUSIONS

As health care systems and training institutions seek new approaches to increase capacity in implementation science, the University of Nairobi Implementation Science Fellowship program can be a model for health educators and administrators who wish to develop their program and curricula.

Increasing clinicians' EBT exploration and preparation behavior in youth mental health services by changing organizational culture with ARC

OBJECTIVE

Clinician EBT exploration and preparation behavior is essential to the ongoing implementation of new EBTs. This study examined the effect of the ARC organizational intervention on clinician EBT exploration and preparation behavior and assessed the mediating role of organizational culture as a linking mechanism.

METHOD

Fourteen community mental health agencies that serve youth in a major Midwestern metropolis along with 475 clinicians who worked in those agencies, were randomly assigned to either the three-year ARC intervention or control condition. Organizational culture was assessed with the Organizational Social Context (OSC) measure at baseline and follow-up. EBT exploration and preparation behavior was measured as clinician participation in nine separate community EBT workshops held over a three-year period.

RESULTS

There was 69 percent greater odds (OR = 1.69, p < .003) of clinicians in the ARC condition (versus control) attending each subsequent workshop. Workshop attendance in the control group remained under two percent and declined over three years while attendance in the ARC condition grew from 3.6 percent in the first workshop to 12 percent in the ninth and final workshop. Improvement in proficient organizational culture mediated the positive effect of the ARC intervention on clinicians' workshop attendance (a × b = .21; 95% CI:LL = .05, UL = .40).

CONCLUSIONS

Organizational interventions that create proficient mental health agency cultures can increase clinician EBT exploration and preparation behavior that is essential to the ongoing implementation of new EBTs in community youth mental health settings.

Multilevel Mechanisms of Implementation Strategies in Mental Health: Integrating Theory, Research, and Practice

A step toward the development of optimally effective, efficient, and feasible implementation strategies that increase evidence-based treatment integration in mental health services involves identification of the multilevel mechanisms through which these strategies influence implementation outcomes. This article (a) provides an orientation to, and rationale for, consideration of multilevel mediating mechanisms in implementation trials, and (b) systematically reviews randomized controlled trials that examined mediators of implementation strategies in mental health. Nine trials were located. Mediation-related methodological deficiencies were prevalent and no trials supported a hypothesized mediator. The most common reason was failure to engage the mediation target. Discussion focuses on directions to accelerate implementation strategy development in mental health.

Methods to Improve the Selection and Tailoring of Implementation Strategies

Implementing behavioral health interventions is a complicated process. It has been suggested that implementation strategies should be selected and tailored to address the contextual needs of a given change effort; however, there is limited guidance as to how to do this. This article proposes four methods (concept mapping, group model building, conjoint analysis, and intervention mapping) that could be used to match implementation strategies to identified barriers and facilitators for a particular evidence-based practice or process change being implemented in a given setting. Each method is reviewed, examples of their use are provided, and their strengths and weaknesses are discussed. The discussion includes suggestions for future research pertaining to implementation strategies and highlights these methods' relevance to behavioral health services and research.

Building Agency Capacity for Trauma-Informed Evidence-Based Practice and Field Instruction

Through this article the authors describe how schools of social work offering a child and adolescent trauma specialization actively partnered with their community-based field placement agencies to achieve a dual purpose: help agencies sustain the capacity for evidence-based trauma treatment (EBTT) and provide sufficient EBTT MSW student field placement sites that support preparation of trauma-informed practitioners by schools of social work. Development and description of the specific conceptual framework used to inform the trauma-informed organizational change initiative is described. Results of an Organizational Readiness assessment undertaken at six agencies reflect a strong alignment between implementation drivers identified in the literature (Fixsen, Blase, Naoom, & Wallace, 2009) and the conceptual framework. The manner in which these results are being used by schools of social work and their agency partners in sustaining the implementation of evidence-based trauma treatment is reviewed, and implications for future research, education, and practice is discussed.

Cultural Adaptation and Implementation of Evidence-Based Parent-Training: A Systematic Review and Critique of Guiding Evidence

With advances in knowledge regarding efficacious evidence-based interventions, there have been significant attempts to culturally adapt, implement, and disseminate parent training interventions broadly, especially across ethnic and cultural groups. We sought to examine the extent to which researchers and developers of evidence-based parent training programs have used cultural adaptation models, tested implementation strategies, and evaluated implementation outcomes when integrating the interventions into routine care by conducting a systematic review of the literature for four evidence-based parent training interventions: Parent-Child Interaction Therapy (PCIT), The Incredible Years (IY), Parent Management Training-Oregon Model (PMTO™), and the Positive Parenting Program (Triple P). A total of 610 articles across the four programs were identified. Of those, only eight documented a rigorous cultural adaptation process, and only two sought to test the effectiveness of implementation strategies by using rigorous research designs. Our findings suggest that there is much work to be done to move parent-training intervention research towards a more rigorous examination of cultural adaptation and implementation practices.

Sobriety Treatment and Recovery Teams: Implementation Fidelity and Related Outcomes

BACKGROUND

Although integrated programs between child welfare and substance abuse treatment are recommended for families with co-occurring child maltreatment and substance use disorders, implementing integrated service delivery strategies with fidelity is a challenging process.

OBJECTIVE

This study of the first five years of the Sobriety Treatment and Recovery Team (START) program examines implementation fidelity using a model proposed by Carroll et al. (2007). The study describes the process of strengthening moderators of implementation fidelity, trends in adherence to START service delivery standards, and trends in parent and child outcomes.

METHODS

Qualitative and quantitative measures were used to prospectively study three START sites serving 341 families with 550 parents and 717 children.

RESULTS

To achieve implementation fidelity to service delivery standards required a pre-service year and two full years of operation, persistent leadership, and facilitative actions that challenged the existing paradigm. Over four years of service delivery, the time from the child protective services report to completion of five drug treatment sessions was reduced by an average of 75 days. This trend was associated with an increase in parent retention, parental sobriety, and parent retention of child custody. Conclusions/Importance: Understanding the implementation processes necessary to establish complex integrated programs may support realistic allocation of resources. Although implementation fidelity is a moderator of program outcome, complex inter-agency interventions may benefit from innovative measures of fidelity that promote improvement without extensive cost and data collection burden. The implementation framework applied in this study was useful in examining implementation processes, fidelity, and related outcomes.

Using implementation evaluation to uncover a child neglect prevention program

Child neglect is an ecosystemic problem with a great variety of risk factors to consider and, therefore, it requires a multimodal and individualized intervention. Although such an intervention is better for the families, it represents a great challenge for the evaluation process.

OBJECTIVES

The purpose of this study is to document, using Dane and Schneider's model (1998), the differences between the services received by parents participating in a parental group designed to prevent the presence or the recurrence of child neglect.

METHODS

Quantitative program implementation data was collected from 50 families who took part in a four-module program over a two-year period.

RESULTS

The results demonstrate uniformity with regard to the program's central elements despite the differences in the services each family received. Adherence to the program was mainly respected despite slight variations in the number of sessions offered and in the group sizes. On the other hand, dosage varied greatly, with families attending from one to four offered modules. For each module, attendance varied from participation in one group session to participation in all ten group sessions. Moreover, for families who participated in at least two modules, attendance significantly increased between the first and second module. The families' level of participation also differed, with families being rated from low to highly engaged at the end of each group session.

CONCLUSIONS

Interventions must be adjusted to the specific needs of the clientele and to the characteristics of the environment in which they will be implemented. These variations could have important impacts on the effects of the intervention on the families. Therefore, evaluating these programs requires the consideration of these variations and of their repercussions on the program's effects.

Illustrating the multiple facets and levels of fidelity of implementation to a teacher classroom management intervention

Many school-based interventions to promote student mental health rely on teachers as implementers. Thus, understanding the interplay between the multiple domains of fidelity to the intervention and intervention support systems such as coaching and teacher implementation of new skills is an important aspect of implementation science. This study describes a systematic process for assessing multiple domains of fidelity. Data from a larger efficacy trial of the Incredible Years Teacher Classroom Management (IY TCM) program are utilized. Data on fidelity to the IY TCM workshop training sessions and onsite weekly coaching indicate that workshop leaders and the IY TCM coach implemented the training and coaching model with adequate adherence. Further, workshop leaders' ratings of engagement were associated with teacher implementation of specific praise, following training on this content. Lastly, the IY TCM coach differentiation of teacher exposure to coaching was evaluated and found to be associated with teacher implementation of classroom management practices and student disruptive behavior.

The need for targeted implementation research to improve coverage of basic vaccines and introduction of new vaccines

The Decade of Vaccines Collaboration (DoVC) Research and Development (R&D) Working Group identified implementation research as an important step toward achieving high vaccine coverage and the uptake of desirable new vaccines. The R&D Working Group noted that implementation research is highly complex and requires participation of stakeholders from diverse backgrounds to ensure effective planning, execution, interpretation, and adoption of research outcomes. Unlike other scientific disciplines, implementation research is highly contextual and depends on social, cultural, geographic, and economic factors to make the findings useful for local, national, and regional applications. This paper presents the broad framework for implementation research in support of immunization and sets out a series of research questions developed through a Delphi process (during a DoVC-supported workshop in Sitges, Spain) and a literature review.

Implementation of multi-family psychoeducational psychotherapy for childhood mood disorders in an outpatient community setting

Despite advances in evidence-based treatments (EBTs), research suggests these interventions are not utilized in practice settings. This study examined implementation of multi-family psychoeducational psychotherapy (MF-PEP), an EBT for childhood mood disorders, in two outpatient community clinics. Fifteen community therapists facilitated MF-PEP. Twenty community clinicians referred 40 children ages 8-12 with mood disorders and their parents who participated in MF-PEP. Preliminary descriptive findings based on observations and self-report questionnaires demonstrated implementation outcomes of acceptability, adoption, appropriateness, feasibility, implementation cost, penetration, and sustainability of MF-PEP at these clinics. Parents also demonstrated significant improvement in knowledge of mood disorders posttreatment. Preliminary results support implementation of MF-PEP in practice settings and suggest community-based MF-PEP may be associated with improvement in clinical outcomes.

Changes in implementation of two evidence-based psychotherapies for PTSD in VA residential treatment programs: a national investigation

There has been little investigation of the natural course of evidence-based treatments (EBTs) over time following the draw-down of initial implementation efforts. Thus, we undertook qualitative interviews with the providers at 38 U.S. Department of Veterans Affairs' residential treatment programs for posttraumatic stress disorder (PTSD) to understand implementation and adaptation of 2 EBTs, prolonged exposure (PE), and cognitive processing therapy (CPT), at 2 time points over a 4-year period. The number of providers trained in the therapies and level of training improved over time. At baseline, of the 179 providers eligible per VA training requirements, 65 (36.4%) had received VA training in PE and 111 (62.0%) in CPT with 17 (9.5%) completing case consultation or becoming national trainers in both PE and CPT. By follow-up, of the increased number of 190 eligible providers, 87 (45.8%) had received VA training in PE and 135 (71.1%) in CPT, with 69 (36.3%) and 81 (42.6%) achieving certification, respectively. Twenty-two programs (57.9%) reported no change in PE use between baseline and follow-up, whereas 16 (42.1%) reported an increase. Twenty-four (63.2%) programs reported no change in their use of CPT between baseline and follow-up, 12 (31.6%) programs experienced an increase, and 2 (5.2%) programs experienced a decrease in use. A significant number of providers indicated that they made modifications to the manuals (e.g., tailoring, lengthening). Reasons for adaptations are discussed. The need to dedicate time and resources toward the implementation of EBTs is noted.

Expert Recommendations for Implementing Change (ERIC): protocol for a mixed methods study

BACKGROUND

Identifying feasible and effective implementation strategies that are contextually appropriate is a challenge for researchers and implementers, exacerbated by the lack of conceptual clarity surrounding terms and definitions for implementation strategies, as well as a literature that provides imperfect guidance regarding how one might select strategies for a given healthcare quality improvement effort. In this study, we will engage an Expert Panel comprising implementation scientists and mental health clinical managers to: establish consensus on a common nomenclature for implementation strategy terms, definitions and categories; and develop recommendations to enhance the match between implementation strategies selected to facilitate the use of evidence-based programs and the context of certain service settings, in this case the U.S. Department of Veterans Affairs (VA) mental health services.

METHODS/DESIGN

This study will use purposive sampling to recruit an Expert Panel comprising implementation science experts and VA mental health clinical managers. A novel, four-stage sequential mixed methods design will be employed. During Stage 1, the Expert Panel will participate in a modified Delphi process in which a published taxonomy of implementation strategies will be used to establish consensus on terms and definitions for implementation strategies. In Stage 2, the panelists will complete a concept mapping task, which will yield conceptually distinct categories of implementation strategies as well as ratings of the feasibility and effectiveness of each strategy. Utilizing the common nomenclature developed in Stages 1 and 2, panelists will complete an innovative menu-based choice task in Stage 3 that involves matching implementation strategies to hypothetical implementation scenarios with varying contexts. This allows for quantitative characterizations of the relative necessity of each implementation strategy for a given scenario. In Stage 4, a live web-based facilitated expert recommendation process will be employed to establish expert recommendations about which implementations strategies are essential for each phase of implementation in each scenario.

DISCUSSION

Using a novel method of selecting implementation strategies for use within specific contexts, this study contributes to our understanding of implementation science and practice by sharpening conceptual distinctions among a comprehensive collection of implementation strategies.

A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions

OBJECTIVE

This systematic review examines experimental studies that test the effectiveness of strategies intended to integrate empirically supported mental health interventions into routine care settings. Our goal was to characterize the state of the literature and to provide direction for future implementation studies.

METHODS

A literature search was conducted using electronic databases and a manual search.

RESULTS

Eleven studies were identified that tested implementation strategies with a randomized (n = 10) or controlled clinical trial design (n = 1). The wide range of clinical interventions, implementation strategies, and outcomes evaluated precluded meta-analysis. However, the majority of studies (n = 7; 64%) found a statistically significant effect in the hypothesized direction for at least one implementation or clinical outcome.

CONCLUSIONS

There is a clear need for more rigorous research on the effectiveness of implementation strategies, and we provide several suggestions that could improve this research area.

Influence network linkages across implementation strategy conditions in a randomized controlled trial of two strategies for scaling up evidence-based practices in public youth-serving systems

BACKGROUND

Given the importance of influence networks in the implementation of evidence-based practices and interventions, it is unclear whether such networks continue to operate as sources of information and advice when they are segmented and disrupted by randomization to different implementation strategy conditions. The present study examines the linkages across implementation strategy conditions of social influence networks of leaders of youth-serving systems in 12 California counties participating in a randomized controlled trial of community development teams (CDTs) to scale up use of an evidence-based practice.

METHODS

Semi-structured interviews were conducted with 38 directors, assistant directors, and program managers of county probation, mental health, and child welfare departments. A web-based survey collected additional quantitative data on information and advice networks of study participants. A mixed-methods approach to data analysis was used to create a sociometric data set (n = 176) to examine linkages between treatment and standard conditions.

RESULTS

Of those network members who were affiliated with a county (n = 137), only 6 (4.4%) were directly connected to a member of the opposite implementation strategy condition; 19 (13.9%) were connected by two steps or fewer to a member of the opposite implementation strategy condition; 64 (46.7%) were connected by three or fewer steps to a member of the opposite implementation strategy condition. Most of the indirect steps between individuals who were in different implementation strategy conditions were connections involving a third non-county organizational entity that had an important role in the trial in keeping the implementation strategy conditions separate. When these entities were excluded, the CDT network exhibited fewer components and significantly higher betweenness centralization than did the standard condition network.

CONCLUSION

Although the integrity of the RCT in this instance was not compromised by study participant influence networks, RCT designs should consider how influence networks may extend beyond boundaries established by the randomization process in implementation studies.

TRIAL REGISTRATION

NCT00880126.

Creating a national home visiting research network

Home visiting can play a key role in the early childhood system of services. For home visiting to achieve its potential, decision-makers must make informed choices regarding adoption, adaptation, coordination, scale-up, and sustainment. We need a coordinated, focused, and theory-based home visiting research infrastructure to inform such decisions. The transdisciplinary Home Visiting Research Network (HVRN) was established in July 2012 with funding from the Health Resources and Services Administration. Its goal is to promote the translation of research findings into policy and practice. Its objectives are to (1) develop a national home visiting research agenda, (2) advance the use of innovative research methods; and (3) provide a research environment that is supportive of the professional development of emerging researchers interested in home visiting. A Management Team designs and directs activities to achieve these objectives through Work Teams. A Steering Committee of national leaders representing stakeholder groups oversees progress. HVRN's Coordinating Center supports the Work Teams and HVRN's Home visiting Applied Research Collaborative, a practice-based research network of home visiting programs. This article describes HVRN's rationale, approach, and anticipated products. We use home visiting-primary care coordination as an illustration, noting potential roles for pediatric practices and pediatric researchers and research educators in HVRN activities. HVRN creates the infrastructure for a rigorous program of research to inform policy and practice on home visiting as part of the system of services to improve family functioning, parenting, and child outcomes.

Dissemination and implementation of evidence-based practices for child and adolescent mental health: a systematic review

OBJECTIVE

Although there has been a dramatic increase in the number of evidence-based practices (EBPs) to improve child and adolescent mental health, the poor uptake of these EBPs has led to investigations of factors related to their successful dissemination and implementation. The purpose of this systematic review was to identify key findings from empirical studies examining the dissemination and implementation of EBPs for child and adolescent mental health.

METHOD

Of 14,247 citations initially identified, 73 articles drawn from 44 studies met inclusion criteria. The articles were classified by implementation phase (exploration, preparation, implementation, and sustainment) and specific implementation factors examined. These factors were divided into outer (i.e., system level) and inner (i.e., organizational level) contexts.

RESULTS

Few studies used true experimental designs; most were observational. Of the many inner context factors that were examined in these studies (e.g., provider characteristics, organizational resources, leadership), fidelity monitoring and supervision had the strongest empirical evidence. Albeit the focus of fewer studies, implementation interventions focused on improving organizational climate and culture were associated with better intervention sustainment as well as child and adolescent outcomes. Outer contextual factors such as training and use of specific technologies to support intervention use were also important in facilitating the implementation process.

CONCLUSIONS

The further development and testing of dissemination and implementation strategies is needed to more efficiently move EBPs into usual care.

The implementation research institute: training mental health implementation researchers in the United States

BACKGROUND

The Implementation Research Institute (IRI) provides two years of training in mental health implementation science for 10 new fellows each year. The IRI is supported by a National Institute of Mental Health (NIMH) R25 grant and the Department of Veterans Affairs (VA). Fellows attend two annual week-long trainings at Washington University in St. Louis. Training is provided through a rigorous curriculum, local and national mentoring, a 'learning site visit' to a federally funded implementation research project, pilot research, and grant writing.

METHODS

This paper describes the rationale, components, outcomes to date, and participant experiences with IRI.

RESULTS

IRI outcomes include 31 newly trained implementation researchers, their new grant proposals, contributions to other national dissemination and implementation research training, and publications in implementation science authored by the Core Faculty and fellows. Former fellows have obtained independent research funding in implementation science and are beginning to serve as mentors for more junior investigators.

CONCLUSIONS

Based on the number of implementation research grant proposals and papers produced by fellows to date, the IRI is proving successful in preparing new researchers who can inform the process of making evidence-based mental healthcare more available through real-world settings of care and who are advancing the field of implementation science.

Importance of mixed methods in pragmatic trials and dissemination and implementation research

With increased attention to the importance of translating research to clinical practice and policy, recent years have seen a proliferation of particular types of research, including pragmatic trials and dissemination and implementation research. Such research seeks to understand how and why interventions function in real-world settings, as opposed to highly controlled settings involving conditions not likely to be repeated outside the research study. Because understanding the context in which interventions are implemented is imperative for effective pragmatic trials and dissemination and implementation research, the use of mixed methods is critical to understanding trial results and the success or failure of implementation efforts. This article discusses a number of dimensions of mixed methods research, utilizing at least one qualitative method and at least one quantitative method, that may be helpful when designing projects or preparing grant proposals. Although the strengths and emphases of qualitative and quantitative approaches differ substantially, methods may be combined in a variety of ways to achieve a deeper level of understanding than can be achieved by one method alone. However, researchers must understand when and how to integrate the data as well as the appropriate order, priority, and purpose of each method. The ability to demonstrate an understanding of the rationale for and benefits of mixed methods research is increasingly important in today's competitive funding environment, and many funding agencies now expect applicants to include mixed methods in proposals. The increasing demand for mixed methods research necessitates broader methodological training and deepened collaboration between medical, clinical, and social scientists. Although a number of challenges to conducting and disseminating mixed methods research remain, the potential for insight generated by such work is substantial.

A mixed methods multiple case study of implementation as usual in children's social service organizations: study protocol

BACKGROUND

Improving quality in children's mental health and social service settings will require implementation strategies capable of moving effective treatments and other innovations (e.g., assessment tools) into routine care. It is likely that efforts to identify, develop, and refine implementation strategies will be more successful if they are informed by relevant stakeholders and are responsive to the strengths and limitations of the contexts and implementation processes identified in usual care settings. This study will describe: the types of implementation strategies used; how organizational leaders make decisions about what to implement and how to approach the implementation process; organizational stakeholders' perceptions of different implementation strategies; and the potential influence of organizational culture and climate on implementation strategy selection, implementation decision-making, and stakeholders' perceptions of implementation strategies.

METHODS/DESIGN

This study is a mixed methods multiple case study of seven children's social service organizations in one Midwestern city in the United States that compose the control group of a larger randomized controlled trial. Qualitative data will include semi-structured interviews with organizational leaders (e.g., CEOs/directors, clinical directors, program managers) and a review of documents (e.g., implementation and quality improvement plans, program manuals, etc.) that will shed light on implementation decision-making and specific implementation strategies that are used to implement new programs and practices. Additionally, focus groups with clinicians will explore their perceptions of a range of implementation strategies. This qualitative work will inform the development of a Web-based survey that will assess the perceived effectiveness, relative importance, acceptability, feasibility, and appropriateness of implementation strategies from the perspective of both clinicians and organizational leaders. Finally, the Organizational Social Context measure will be used to assess organizational culture and climate. Qualitative, quantitative, and mixed methods data will be analyzed and interpreted at the case level as well as across cases in order to highlight meaningful similarities, differences, and site-specific experiences.

DISCUSSION

This study is designed to inform efforts to develop more effective implementation strategies by fully describing the implementation experiences of a sample of community-based organizations that provide mental health services to youth in one Midwestern city.

Addressing core challenges for the next generation of type 2 translation research and systems: the translation science to population impact (TSci Impact) framework

Evidence-based preventive interventions developed over the past two decades represent great potential for enhancing public health and well-being. Research confirming the limited extent to which these interventions have been broadly and effectively implemented, however, indicates much progress is needed to achieve population-level impact. In part, progress requires Type 2 translation research that investigates the complex processes and systems through which evidence-based interventions are adopted, implemented, and sustained on a large scale, with a strong orientation toward devising empirically-driven strategies for increasing their population impact. In this article, we address two core challenges to the advancement of T2 translation research: (1) building infrastructure and capacity to support systems-oriented scaling up of evidence-based interventions, with well-integrated practice-oriented T2 research, and (2) developing an agenda and improving research methods for advancing T2 translation science. We also summarize a heuristic "Translation Science to Population Impact (TSci Impact) Framework." It articulates key considerations in addressing the core challenges, with three components that represent: (1) four phases of translation functions to be investigated (pre-adoption, adoption, implementation, and sustainability); (2) the multiple contexts in which translation occurs, ranging from community to national levels; and (3) necessary practice and research infrastructure supports. Discussion of the framework addresses the critical roles of practitioner-scientist partnerships and networks, governmental agencies and policies at all levels, plus financing partnerships and structures, all required for both infrastructure development and advances in the science. The article concludes with two sets of recommended action steps that could provide impetus for advancing the next generation of T2 translation science and, in turn, potentially enhance the health and well-being of subsequent generations of youth and families.

A computational future for preventing HIV in minority communities: how advanced technology can improve implementation of effective programs

African Americans and Hispanics in the United States have much higher rates of HIV than non-minorities. There is now strong evidence that a range of behavioral interventions are efficacious in reducing sexual risk behavior in these populations. Although a handful of these programs are just beginning to be disseminated widely, we still have not implemented effective programs to a level that would reduce the population incidence of HIV for minorities. We proposed that innovative approaches involving computational technologies be explored for their use in both developing new interventions and in supporting wide-scale implementation of effective behavioral interventions. Mobile technologies have a place in both of these activities. First, mobile technologies can be used in sensing contexts and interacting to the unique preferences and needs of individuals at times where intervention to reduce risk would be most impactful. Second, mobile technologies can be used to improve the delivery of interventions by facilitators and their agencies. Systems science methods including social network analysis, agent-based models, computational linguistics, intelligent data analysis, and systems and software engineering all have strategic roles that can bring about advances in HIV prevention in minority communities. Using an existing mobile technology for depression and 3 effective HIV prevention programs, we illustrated how 8 areas in the intervention/implementation process can use innovative computational approaches to advance intervention adoption, fidelity, and sustainability.

Implementation of an evidence-based depression treatment into social service settings: the relative importance of acceptability and contextual factors

Listening Visits (LV), an empirically supported depression treatment delivered by non mental health specialists, were implemented into two distinctly structured programs. The relative importance of providers' views and organizational context on implementation were examined. Thirty-seven home visitors completed pre- and post-LV training surveys assessing their views toward implementing LV. Implementation rates markedly differed in the two organizations (73.9% vs. 35.7%). Logistic regression results showed that when predicting the implementation rate, the impact of the organizational setting outweighed home visitors' personal views. These results underscore the importance of organizational context in the implementation of empirically supported treatments.

Partnerships for the design, conduct, and analysis of effectiveness, and implementation research: experiences of the prevention science and methodology group

What progress prevention research has made comes through strategic partnerships with communities and institutions that host this research, as well as professional and practice networks that facilitate the diffusion of knowledge about prevention. We discuss partnership issues related to the design, analysis, and implementation of prevention research and especially how rigorous designs, including random assignment, get resolved through a partnership between community stakeholders, institutions, and researchers. These partnerships shape not only study design, but they determine the data that can be collected and how results and new methods are disseminated. We also examine a second type of partnership to improve the implementation of effective prevention programs into practice. We draw on social networks to studying partnership formation and function. The experience of the Prevention Science and Methodology Group, which itself is a networked partnership between scientists and methodologists, is highlighted.

Implementation of an evidence-based depression care management program (PEARLS): perspectives from staff and former clients

INTRODUCTION

Although researchers develop evidence-based programs for public health practice, rates of adoption and implementation are often low. This qualitative study aimed to better understand implementation of the Program to Encourage Active, Rewarding Lives for Seniors (PEARLS), a depression care management program at a Seattle-King County area agency on aging.

METHODS

We used stratified, purposive sampling in 2008 to identify 38 PEARLS clients and agency staff for participation. In 9 focus groups and 1 one-on-one interview, we asked participants to identify benefits and negative consequences of PEARLS, facilitators of and barriers to program implementation, and strategies for overcoming the barriers. Two independent researchers used thematic analysis to categorize data into key themes and subthemes.

RESULTS

PEARLS benefits clients by decreasing depression symptoms and addressing other concerns, such as health problems. For staff, PEARLS provides "another set of eyes" and is a comprehensive program to help them meet clients' mental health needs. Barriers included issues with implementation process (eg, lack of communication) and the perception that eligibility criteria were more rigid than those of other agency programs. Recommended solutions included changing eligibility criteria, providing additional staff training, increasing communication, and clarifying referral procedures, roles, and responsibilities.

CONCLUSION

Barriers to PEARLS delivery discourage referrals to what is generally viewed as a beneficial program. Implementing participants' strategies for overcoming these barriers can enhance delivery of PEARLS to a greater number of older adults and help them improve their depression symptoms.

The challenges of establishing and researching a sustained nurse home visiting programme within the universal child and family health service system

This paper reflects on the challenges and strategies used to conduct a sustained nurse home visiting randomised trial within the universal child and family health service system in Australia. The Maternal Early Childhood Sustained Home-visiting (MECSH) programme is a complex multilevel intervention acting in parallel at the individual and organisational levels, addressing change in individuals and families, as well as the structural and social factors that affect the individuals, particularly families’ access to support and services. MECSH is targeted towards 20–25% of the population who are at risk of poorer maternal and child health and development outcomes. Establishing the intervention within the service system and conducting the research trial simultaneously presented many challenges. The researchers encountered both technical and ethical problems. The role of researchers as disinterested, objective scientists was constantly challenged. We argue that the MECSH trial was a hybrid research model, testing both efficacy and effectiveness, in a participatory framework. Hybrid research can help to generate evidence of the effectiveness of multilevel interventions in more timely ways, but requires greater investment in the time and resources to conduct the research. We see that such investment would pay dividends in the simultaneous development, testing and embedding of effective interventions for families and sustainable capacity for services.