Addressing core challenges for the next generation of type 2 translation research and systems: the translation science to population impact (TSci Impact) framework

Considering efficacy and effectiveness trials of cognitive behavioral therapy among youth with autism: A systematic review

LAY ABSTRACT

Cognitive behavioral therapy is a common treatment for emotional problems in people with autism. Most studies of cognitive behavioral therapy and autism have focused on efficacy, meaning whether a treatment produces results under "ideal" conditions, like a lab or research setting. Effectiveness trials, by contrast, investigate whether a treatment produces results under "real-world" conditions, like a community setting (e.g. hospital, community mental health center, school). There can be challenges in bringing a cognitive behavioral therapy treatment out of a lab or research setting into the community, and the field of implementation science uses frameworks to help guide researchers in this process. In this study, we reviewed efficacy and effectiveness studies of cognitive behavioral therapy treatments for emotional problems (e.g. anxiety, depression) in children and youth with autism. Our search found 2959 articles, with 33 studies meeting our criteria. In total, 13 studies were labelled as effectiveness and 20 as efficacy. We discuss how the effectiveness studies used characteristics of an implementation science framework, such as studying how individuals learn about the treatment, accept or reject it, how it is used in the community over time, and any changes that happened to the individual or the organization (e.g. hospital, school, community mental health center) because of it. Results help us better understand the use of cognitive behavioral therapy in the community, including how a framework can be used to improve effectiveness studies.

eB4CAST Approach Improves Science Communication With Stakeholders in a College-Based Health Program

Communicating scientific results with community partners is often lacking in intervention programs, thus eB4CAST was developed to facilitate impact sharing. This article investigated using the eB4CAST dissemination tool to communicate impact from a campus-based obesity prevention program. Data from Get Fruved RCT university sites collected at baseline were used to generate eB4CAST reports. Experts (n = 13) and RCT sites (n = 15) were asked to provide feedback on eB4CAST reports based on appeal, understanding, and clarity. On all Likert items, participants rated above 7 on each (out of 10). Positive responses from open-ended questions included eB4CAST reports being clear, visually appealing, and aid in program understanding. Overall, eB4CAST was successful in relaying data and information for the Get Fruved program, thus a means for science communication that could be used in interventions. Utilizing infographics to report data and information is a feasible way to disseminate and communicate in a cost-effective, timely manner.

Translating evidence-based parenting programs for primary care: Stakeholder recommendations for sustainable implementation

AIMS

To translate evidence-based programs (EBP) for a new setting, attention must be given to the characteristics of the intervention and the local setting, as well as evidence that is compelling to decision-makers. This paper describes the history of a partnership and stakeholder recommendations to inform the adaptation of an EBP for primary care.

METHODS

We established a community advisory board (CAB) consisting of stakeholders with expertize in primary care delivery. A thematic analysis was conducted with fieldnotes and transcriptions from CAB meetings and regular meetings with participating clinics.

RESULTS

We found that (a) parenting programs with a focus on behavioral and physical health are appropriate for this setting, (b) variability in the structure of primary care means implementation must be tailorable, and (c) financial and organizational outcomes are compelling for decision-makers.

CONCLUSION

Factors related to the content and structure of evidence-based programs are uniquely related to distinct implementation outcomes of interest to key stakeholders.

Community eligibility and other provisions for universal free meals at school: impact on student breakfast and lunch participation in California public schools

United States Department of Agriculture (USDA) school meal programs are an important part of the safety net for reducing food insecurity, yet not all students who qualify for free or reduced-price meals participate. In 2014-2015, the Community Eligibility Provision became available nationwide. This provision, along with Provisions 1, 2, and 3 of the USDA school meals programs, allows local school food authorities to offer universal free meals at schools with high student poverty. It is expected that adoption of a provision allowing universal free meals will increase rates of student participation in meal programs at schools where many students are at risk for food insecurity. This study examines school-level adoption of any provision for universal free meals and subsequent changes in student participation rates for the School Breakfast Program and National School Lunch Program in California from 2013-2014 to 2016-2017. A database was assembled for 10,343 public schools, including meals served, demographics, eligibility for provisions, and use of provisions in each year. Multilevel regression models were used to examine school adoption and student participation rates over time. Difference-in-difference calculations from lagged longitudinal models adjusting for school demographics showed that when eligible schools adopted provisions, participation rates increased an average of 3.48 percentage points for breakfast and 5.79 points for lunch the following year. By 2016-2017, over half of all eligible schools were using a provision for universal free meals. Among eligible schools, provision adoption was more common at schools that were larger, had predominantly Latino students, and were in rural areas. When eligible schools adopt provisions for universal free meals, student participation rates significantly increase, improving program reach among children most at risk for food insecurity. However, not all eligible schools adopt a provision for universal free meals and some adopters drop out in subsequent years. Research to better understand factors influencing the decision whether to adopt a provision or to continue it could inform policy and program leaders. Increases in breakfast participation are smaller than those for lunch, suggesting that other barriers to breakfast participation warrant further investigation.

Pairing Feeding Content With a Nutrition Education Curriculum: A Comparison of Online and In-Class Delivery

OBJECTIVE

To develop a childhood obesity prevention program, Food, Feeding and Your Family (FFYF), which encourages eating self-regulation in young children. This article describes the research methods for FFYF. Activities that will be used to guide the development of the program are illustrated in a logic model.

DESIGN

A randomized control trial will be conducted with participant groups randomized into 1 of 3 conditions: (1) in-class delivery of feeding content and nutrition education, (2) online delivery of feeding content and in-class delivery of nutrition education, and (3) nutrition education only. Assessments will be collected at baseline, program completion, and 6 and 12 months after completion of the program.

SETTING

Study will be conducted through the Expanded Food and Nutrition Education Program in Colorado and Washington State.

PARTICIPANTS

Parents with 2- to 8-year-old children will be recruited from affiliated community agencies, 540 participants across both states.

INTERVENTIONS

FFYF derives content from an empirically validated parental feeding program, Strategies for Effective Eating Development, and will be administered with Eating Smart • Being Active, an evidence-based, nutrition education curriculum.

MAIN OUTCOME MEASURES

Parents will report on feeding practices, child eating behaviors, feeding styles, and acculturation.

ANALYSIS

Because of the nested nature of the data, multilevel analyses will be used: time points, within parents, and within groups.

Moving beyond the ivory tower – why researchers from the field of education should go ahead

Abstract. Since the beginning of the 21st century universities are increasingly requested to use the results produced by their first (teaching) and second mission (research) to help resolve the growing challenges societies and local communities are faced with. This obligation has been codified as the Third Mission of universities. However, research and its results often seem to remain in the so-called ivory tower and realization of successful transfer often failed. Empirical research clearly shows that the key factor for successful transfer is to involve an intensive cooperation between researchers, policymakers, and practitioners within a mutually respectful, collaborative process. However, the establishment of a high quality and fruitful cooperation among these different groups is difficult. In the paper, possible reasons for poor transfer of research findings on part of researchers, practitioners, and policymakers are discussed as well as demands for successful transfer. A systematic six-step procedure for policy impact from research is presented, which summarizes the most relevant actions to be taken and issues to be considered on the part of (individual) researchers for realizing successful transfer. Universities can provide a supportive environment through the development of a distinct Third Mission profile including criteria and incentives for transfer activities of single researchers. It is the intention of this paper to convince researchers from the field of education to go ahead in moving beyond the ivory tower and to engage in transfer of scientific knowledge. One reason is the high importance of education for society. Another reason is that the competences and experiences necessary for successful transfer of research to the wider field of policy and practice are core competences and experiences of researchers from the field of education.

Making Evidence-Based Interventions Relevant for Users: A Comparison of Requirements for Dissemination Readiness Across Program Registries

This study compares prevention program registries in current use on their level of support for users seeking to implement evidence-based programs. Despite the importance of registries as intermediaries between researchers and the public, and although previous studies have examined how registries define their standards for methodological soundness and evidence of efficacy, little research has focused on the degree to which registries consider programs' dissemination readiness. The result is that registry users are uncertain whether listed programs and their necessary support materials are even available for implementation. This study evaluates 11 publicly and privately funded prevention registries that review the evidence base of programs seeking to improve child health and prosocial outcomes on the degree to which they use dissemination readiness as an evidentiary criterion for rating programs, and the extent and type of information they provide about dissemination readiness to support real-world implementation. The results show wide variability, with few having standards about dissemination readiness or making evidence-based information about interventions easily accessible to users. Findings indicate the need for registries to (1) do more to assess dissemination readiness before including programs on their website and (2) offer more complete information on dissemination readiness and implementation support to users.

Cultural Adaptation of Promising, Evidence-Based, and Best Practices: a Scoping Literature Review

This scoping literature review of nearly 5,000 peer-reviewed articles from myriad disciplines examines usage of two sets of terms that are common to many researchers, but arcane to many practitioners. Aiming to inform researchers about how scholarly literature that invokes these terms might speak to practitioners, and resulting implications for practice, we review scholarly use of three practice designations (promising, evidence-based, best) and five cultural considerations for those practices (adaptation, competence, modification, responsiveness, specificity). In addition to scoping review methods, we apply social cartography and definitional traces. Findings drive our contention that "promising practice" is the designation that might provide practitioners with the most utility, rather than the frequent-often-unarticulated-uses of best and evidence-based. Likewise, we find copious evidence of cultural considerations being invoked without operationalization. Social cartography reveals few international partnerships and limited domestic leadership among 'leading' research institutions regarding the intersection of practice designations and cultural considerations. Themes from the definitional trace prompt us to invite scholarly debate about a ladder from 'promising' to 'evidence-based' to 'best' and to prompt researchers' efforts to transfer knowledge to practitioners.

Applied and Translational Research on Trauma-Responsive Programs and Policy: Introduction to a Special Issue of the American Journal of Community Psychology

The special issue highlights work across systems that include child welfare, education, juvenile justice and health, as well as agencies serving adults who are at-risk for high levels of childhood and adult trauma exposure. While articles appearing in the special issue are not divided equally across these systems, they cover important and overlapping concepts within each. Some articles span more than a single system or domain of research, whereas others fit primarily within single area or domain. Articles provide new insights from research on practices, programs, and policies that help to transform systems so they are increasingly more responsive to the needs of vulnerable populations.

Population Health and Trauma-Informed Practice: Implications for Programs, Systems, and Policies

Population studies indicate that trauma exposure is ubiquitous and has a significant impact on health. Trauma-informed practice seeks to address the health consequences of trauma through integrative responses that incorporate an understanding of the effects of trauma, the multiple pathways to recovery, and the potential for re-traumatization. Current trauma-informed practice considers trauma exposure an individual clinical problem rather than a societal problem with population health consequences. Population health refers to the aggregated health status of individuals who share some characteristic, such as trauma exposure, and includes the study of determinants that shape the distribution of health outcomes in specific populations. In this paper, we describe a population health perspective for trauma-informed practice that complements the current clinical perspective, and then discuss implications of that perspective for programs, systems, and policies. We summarize essential concepts about trauma over the life course and describe principles of population health science relevant to trauma-informed practice. We then discuss implications of these principles by identifying four priorities for trauma-informed practice from a population health perspective: (a) adopting trauma-informed policies to prevent trauma exposure and to foster resilience in the aftermath of trauma; (b) infusing trauma-informed practice into everyday activities so it is a routine part of interpersonal transactions; (c) incorporating trauma-informed practices into existing service systems; and (d) adapting existing treatments to incorporate trauma-informed principles for population health impact.

Individual and organizational factors associated with teacher self-reported implementation of the PATHS curriculum

The current study examined a comprehensive set of individual and organizational factors as potential predictors of how the Promoting Alternative THinking (PATHS) Curriculum was implemented by teachers in an urban Midwestern school district. The study used data from a randomized trial of an implementation support model conducted in 28 urban elementary schools. All schools implemented PATHS in grades K-3. Program fidelity was assessed with teacher self-reported ratings of lesson dosage, frequency of supplemental material use, and quality of delivery over repeated time points. The initial levels of implementation and change over time were examined in a series of three level longitudinal hierarchical liner models (HLM). Over time, teachers reported somewhat lower levels of program use but maintained their quality of delivery. Teachers with more positive attitudes towards PATHS reported more frequent lesson delivery at the intercept (winter Year 1). Teachers from schools with a more positive culture for social-emotional learning (SEL) rated the quality of their PATHS delivery more positively than teachers from schools lacking SEL culture and reported more frequent supplemental materials use. Early career teachers initially described themselves as delivering PATHS with lower quality but improved similarly over time compared to more experienced teachers. Implications of the findings and recommendations for future research are discussed.

A Solutions-Focused Translational Research Framework for Wildlife Health

Wildlife health is of emerging relevance for conservation, human health, and domestic animal health. Increased research on wildlife health problems has not been accompanied by a relative increase in effective solutions. Translational research was developed in human health to overcome blocks impeding the development of solutions out of basic research, and a translational research framework is proposed to overcome the same barriers in wildlife health. This framework has four translational phases: problem definition, potential solution development, efficacious solution development, and effective solution development. Implementation of translational research will require a restructuring of the wildlife health research enterprise with a shift, supported by funding sources and journals, to solutions-focused research including later translational phases, the creation of more deeply integrated multidisciplinary and interdisciplinary teams incorporating better representation from human social sciences, and the inclusion of end user and stakeholder participation in all phases of research.

Scaling up Evidence-Based Interventions in US Public Systems to Prevent Behavioral Health Problems: Challenges and Opportunities

A number of programs, policies, and practices have been tested using rigorous scientific methods and shown to prevent behavioral health problems (Catalano et al., Lancet 379:1653-1664, 2012; National Research Council and Institute of Medicine, 2009). Yet these evidence-based interventions (EBIs) are not widely used in public systems, and they have limited reach (Glasgow et al., American Journal of Public Health 102:1274-1281, 2012; National Research Council and Institute of Medicine 2009; Prinz and Sanders, Clinical Psychology Review 27:739-749, 2007). To address this challenge and improve public health and well-being at a population level, the Society for Prevention Research (SPR) formed the Mapping Advances in Prevention Science (MAPS) IV Translation Research Task Force, which considered ways to scale up EBIs in five public systems: behavioral health, child welfare, education, juvenile justice, and public health. After reviewing other efforts to scale up EBIs in public systems, a common set of factors were identified as affecting scale-up in all five systems. The most important factor was the degree to which these systems enacted public policies (i.e., statutes, regulations, and guidance) requiring or recommending EBIs and provided public funds for EBIs. Across systems, other facilitators of scale-up were creating EBIs that are ready for scale-up, public awareness of and support for EBIs, community engagement and capacity to implement EBIs, leadership support for EBIs, a skilled workforce capable of delivering EBIs, and data monitoring and evaluation capacity. It was concluded that the following actions are needed to significantly increase EBI scale-up in public systems: (1) provide more public policies and funding to support the creation, testing, and scaling up of EBIs; (2) develop and evaluate specific frameworks that address systems level barriers impeding EBI scale-up; and (3) promote public support for EBIs, community capacity to implement EBIs at scale, and partnerships between community stakeholders, policy makers, practitioners, and scientists within and across systems.

Predicting Program Retention in a Flexibly-Delivered Relationship Education Program for Low-Income, Unmarried Parents

Participation rates in couple relationship education (CRE) programs for low-income couples are typically low. We examined predictors of session attendance and early dropout (i.e., dropout after 1 session) among a sample of low-income, unmarried parents of a newborn (N = 467 couples) enrolled in an evidence-based CRE program. Predictors included demographics and socioeconomic status, as well as baseline indicators of relationship commitment, family and individual functioning, infant health, preventive health care utilization, and CRE coach perceptions of participant engagement and alliance in the first session of the program. Couples attended an average of 4.4 (SD = 2.5) of the 7 sessions, with nearly a quarter of couples dropping out after the first session. Attendance at fewer sessions was predicted by younger age. Early dropout was predicted by lower ratings of females' engagement and both partners' therapeutic alliance and, unexpectedly, by commitment. We discuss considerations for engaging low-income couples in CRE.

Acculturation and school adjustment of children and youth from culturally diverse backgrounds: Predictors and interventions for school psychology

In recent decades, classrooms in many countries have become more culturally diverse. However, students from ethnic minorities and students with immigrant backgrounds are at greater risk of lower social, psychological, and academic adjustment than their native peers. Therefore, schools all over the world are challenged by the question of how to help diverse students adjust to school independent of their ethnic background and family resources. The current special issue focuses on how schools and school psychologists can support positive interethnic attitudes and positive relationships in ethnically diverse classrooms as well as individual well-being, belonging, and academic achievement as different facets of school adjustment. The special issue includes three studies with empirical findings on the role of contextual and individual factors for school adjustment among minority and majority youth in diverse school contexts: Geerlings, Thjis, and Verkuyten study the modeling of outgroup attitudes via teachers' attitudes and more or less consistent behavior, Guerra, Rodrigues, Aguiar, Carmona, Alexandre, and Costa Lopes focus on the interplay of acculturation strategies and of perceived discrimination with school achievement and well-being. Caravita, Strohmeier, Salmivalli, and Di Blasio compare bullying and moral disengagement processes in majority and minority children. Five other studies report evaluations of evidence-based interventions that were tested among ethnically diverse youth in different school settings in two European countries, in Israel, and in the US - two on prejudice reduction (Brenick, Lawrence, Carvalheiro & Berger; Mäkinen, Liebkind, Jasinskaja-Lahti, & Renvik), and three on the effects of 'wise interventions' - self-affirmation and belonging interventions - on trust in teachers and behavioral conduct (Binning et al.), on students' sense of belonging and academic outcomes (Marksteiner, Janke, & Dickhäuser), and on math performance of students (Lokhande & Müller). The evaluation studies show differential effects across contexts and samples that point toward important mechanisms and moderators that may help practitioners adjust these programs to specific contexts.

The Pathways for African American Success: Does Delivery Platform Matter in the Prevention of HIV Risk Vulnerability Among Youth?

PURPOSE

Technology provides new possibilities for disseminating effective prevention programming to underserved families, such as those residing in rural communities. The present study is an evaluation of a technology-delivered HIV risk prevention program designed for rural African-American families, Pathways for African American Success (PAAS), to determine its promise for increasing access to evidence-based youth risk prevention programs among those in the greatest need.

METHODS

Four hundred and twelve parent/youth dyads were randomly assigned to one of three conditions: (1) in-person facilitator-led PAAS small group, (2) self-directed PAAS technology, or (3) a literature control with home-mailed educational materials.

RESULTS

Compared with families in the literature control condition, families assigned to the PAAS technology or small group conditions demonstrated significantly stronger intervention induced parent-child protective processes (e.g., enhanced discussion quality, clearly articulated norms, and parental expectations about risk engagement) and lower youth intentions to engage in risky behaviors 6 months postintervention. Although some important nuances were noted, this study suggests that the PAAS technology-delivered modality is just as efficacious as the in-person facilitator-led, small group modality in dissuading HIV-related risk behaviors among rural African-American youths.

CONCLUSIONS

Implications for having a menu of service delivery models that address the diverse needs and contexts of families are discussed, including the promise of technology as an alternative modality for reaching populations often characterized as difficult to reach and to engage in family-based preventive interventions.

Commentary on Participation in Preventive Interventions

In this commentary on the special issue, Preventive Parenting Interventions: Advancing Conceptualizations and Enhancing Reach, operationalization of participation, who engages in prevention interventions, and common themes from the studies are discussed. The papers in the special issue illustrate the importance of studying factors that increase participation in prevention and point out the need for additional research to understand these factors. These papers highlight the diverse conceptualizations of participation as well as a need to move toward standardization of methods to assess related constructs. Research is needed to elucidate the potential of enhanced participation and engagement in interventions to meaningfully impact intervention outcomes and ultimately improve the population-level benefit attributable to prevention efforts. Prevention scientists should attend to factors influencing participation in prevention as early in the intervention research process as possible in order to increase the likelihood that the target population will utilize evidence-based prevention interventions in real-world settings, under real-world conditions.

Predictors of Group Leaders' Perceptions of Parents' Initial and Dynamic Engagement in a Family Preventive Intervention

Attendance and participant engagement are two consistent predictors of the efficacy of preventive interventions. Although both are typically measured and analyzed as static factors, evidence indicates patterns of attendance and participant engagement change over the course of intervention. Understanding parent characteristics that predict engagement may inform strategies to maximize parents' involvement thereby increasing intervention uptake and improving effects. This study examined whether parents' baseline characteristics predicted their engagement in a family-based intervention. The study was conducted with 515 caregivers participating in a randomized comparative trial testing the efficacy of The Mindfulness-Enhanced Strengthening Families Program 10-14 (MSFP 10-14) and The Strengthening Families Program: For Parents and Youth 10-14 (SFP 10-14). Facilitator ratings were used to measure parent engagement. Results indicated generally high levels of initial engagement with small, but a significant linear increase across the intervention. Parental education level and involvement with their youth predicted engagement in the first session, while parents' marital/relationship status, avoidance of conflict with their youth, involvement with their youth, and perceived parent-youth relationship quality at baseline predicted change in engagement. Results highlight engagement as a dynamic construct that changes over time and indicates potential variables that may help identify parents that may need support engaging in this intervention.

The Closing Digital Divide: Delivery Modality and Family Attendance in the Pathways for African American Success (PAAS) Program

Although family-focused, evidence-based programs (EBPs) have the potential to reduce disparities in health and behavioral outcomes for youth, access to such programs is severely limited in the most affected areas, including African American communities in the rural South. As expanding the reach of EBPs is the primary goal of translational research, interest is growing in the potential of technology as a viable platform to disseminate services to areas with limited resources. To test whether African American families in the rural South would be willing to engage in a technology-based family-focused EBP to prevent adolescent risk behavior, we examined attendance using data from two arms of a three-arm community-based trial of the Pathways for African American Success (PAAS) program. In the overall study, sixth graders (N = 412) and their primary caregivers were randomly assigned to the following conditions: (a) in-person, small group sessions led by facilitators; (b) self-directed, technology-based sessions; or (c) a literature control with home-mailed educational materials. Results indicated that attendance was higher in the technology condition than in the small group condition. Parental age, education, and socioeconomic status did not limit attendance in the technology condition. We conclude from these results that the use of technology can be an acceptable strategy for disseminating parenting EBPs to African American families in the rural South.

Predictors of Participation in an eHealth, Family-Based Preventive Intervention for Hispanic Youth

The Familias Unidas intervention is an efficacious family-based preventive intervention for reducing substance use and other health risks among Hispanic youth. A current randomized controlled trial (RCT) is examining this intervention's efficacy when delivered via the Internet (eHealth). eHealth interventions can overcome logistical barriers to participation, yet there is limited information about the feasibility of these interventions, especially among ethnic minorities. This paper examines participation and predictors of participation in the eHealth Familias Unidas intervention in a sample of 113 Hispanic families whose adolescent had behavioral problems. Analyses examined multidimensional ways of characterizing participation, including the following: (1) total intervention participation, (2) initial engagement (participating in at least one of the first three intervention sessions), (3) completing the pre-recorded, eHealth parent group sessions, and (4) participating in the live, facilitator-led, eHealth family sessions. Participation in this eHealth intervention was comparable to, and in most cases higher than, previous, face-to-face Familias Unidas interventions. High levels of baseline family stress were associated with lower initial engagement and lower family session participation. Greater parental Hispanicism was associated with more participation in eHealth parent group sessions and across the total intervention. Higher levels of baseline effective parenting, in other words less intervention need, were significantly associated with lower levels of total intervention participation and lower levels of family session participation. Implications for preventive interventions delivered via Internet are discussed.

Attendance Trajectory Classes Among Divorced and Separated Mothers and Fathers in the New Beginnings Program

We examined attendance trajectories among mothers and fathers in the effectiveness trial of the New Beginnings Program, a parenting-focused prevention program for divorced and separated parents. We also investigated attendance trajectory class differences on two sets of pretest covariates: one set previously linked to participation in programs not specifically targeting divorced parents (i.e., sociodemographics, perceived parenting skills, child problem behaviors, parent psychological distress) and another that might be particularly salient to participation in the context of divorce (i.e., interparental conflict, level of parent-child contact, previous marital status to the ex-spouse). For mothers and fathers, results supported four attendance trajectory classes: (1) non-attenders (NA), (2) early dropouts (ED), (3) declining attenders (DA), and (4) sustained attenders (SA). In the final model testing multiple covariates simultaneously, mothers who were EDs and DAs were more likely to be Latina than SAs, and EDs reported more interparental conflict than SAs. Mother trajectory groups did not differ on parenting skills, child problem behavior, or mother-child contact in the final or preliminary models. In the final model for fathers, EDs rated their children higher on externalizing than DAs, had less contact with their children than DAs and NAs, and reported less distress than SAs. Father trajectory groups did not differ on fathers' age, ethnicity, income, perceived parenting skills, or interparental conflict in the final or preliminary models. Results highlight qualitatively distinct latent classes of mothers and fathers who disengage from a parenting intervention at various points. We discuss implications for intervention engagement strategies and translational science.

Comprehensive Cost Analysis of First Step Next for Preschoolers with Disruptive Behavior Disorder: Using Real-World Intervention Data to Estimate Costs at Scale

While the long-term societal costs for youth with disruptive behavior disorders are well documented, there is a dearth of information about the comprehensive costs of implementing even the most well-regarded early intervention programs, and the costs of scaling effective interventions are even less well understood. This study estimated the costs of delivering and disseminating First Step Next (FSN), an established tier two school-based early intervention, in preschool and kindergarten settings, including the training and ongoing technical assistance that support sustained, high-quality implementation. Using the Ingredients Method, we estimated (a) the per student costs of implementation, (b) the incremental cost of offering FSN to an additional student, and (c) the cost to disseminate FSN to 40 preschool and kindergarten students, including a sensitivity analysis to examine potential areas of cost savings. The per child cost to implement the FSN intervention with 29 triads in two cohorts was $4330. The incremental cost per additional student was only $2970, highlighting efficiencies gained once intervention infrastructure had been established. The cost of disseminating the intervention to a single cohort of 40 students was $170,106, or $4253 per student. The range in sensitivity analysis was $3141-$7829 per student, with variability in personnel wages having the greatest impact on cost estimates. This research expands on existing literature by providing a more comprehensive understanding of the cost of effective disruptive behavior interventions based on real-world implementation data, using these data to estimate dissemination costs, and showing how dissemination costs are particularly sensitive to personnel wages.

Implementing Evidence-Based Strategies to Improve HPV Vaccine Delivery

BACKGROUND

High-quality evidence indicates that intervening with health care providers improves human papillomavirus (HPV) vaccine delivery. However, scaling up evidence-based strategies in real-world clinical practice remains challenging. We sought to improve the reach and impact of strategies for HPV vaccination quality improvement (QI) through local adaptation and implementation in a large, not-for-profit health care system.

METHODS

We conducted an HPV vaccination QI program using existing materials to support physician training coupled with assessment and feedback. Local physicians with high HPV vaccination rates facilitated training, which included didactic instruction and video vignettes modeling effective communication. We randomly assigned 25 clinics with 77 physicians to the QI arm or the wait-list control arm. We used hierarchical linear models to assess HPV vaccination coverage (≥1 dose) over 6 months among patients aged 12 to 14.

RESULTS

Of 45 physicians in the QI arm, the program reached 43 (95%) with training plus assessment and feedback. In the overall sample, HPV vaccination coverage increased in both the QI and control arms (8.6 vs 6.4 percentage points, respectively), although the 2.2-percentage point difference did not reach statistical significance. Sensitivity analyses that excluded physicians with poor data quality indicated a statistically significant advantage of 3.3 percentage points for QI versus control (b = 0.034; SE = 0.015; P < .05).

CONCLUSIONS

Our locally adapted QI program achieved excellent reach, with small improvements in HPV vaccination coverage. Future implementation research is needed to bolster program impact and support health systems in leveraging local resources to conduct these programs efficiently.

Promoting Teachers' Implementation of Classroom-Based Prevention Programming Through Coaching: The Mediating Role of the Coach-Teacher Relationship

There is growing awareness of the importance of implementation fidelity and the supports, such as coaching, to optimize it. This study examined how coaching activities (i.e., check-ins, needs assessment, modeling, and technical assistance) related directly and indirectly to implementation dosage and quality of the PAX Good Behavior Game, via a mediating pathway through working relationship. Mediation analyses of 138 teachers revealed direct effects of modeling and working relationship on implementation dosage, whereas needs assessment was associated with greater dosage indirectly, by higher ratings of the working relationship. Understanding how coaching activities promote implementation fidelity elements has implications for improving program effectiveness.

Implementing Intervention Research into Public Policy-the "I3-Approach"

Evidence-based intervention programs have become highly important in recent years, especially in educational contexts. However, transferring these programs into practice and into the wider field of public policy often fails. As a consequence, the field of implementation research has emerged, several implementation frameworks have been developed, and implementation studies conducted. However, intervention research and implementation research have not yet been connected systematically and different traditions and research groups are involved. Implementation researchers are mostly given mandates by politicians to take on the implementation of already existing interventions. This might be one of the key reasons why there are still many problems in translating programs into widespread community practice. In this paper, we argue for a systematic integration of intervention and implementation research (“I³-Approach”) and recommend a six-step procedure (PASCIT). This requires researchers to design and develop intervention programs using a field-oriented and participative approach. In particular, the perspective of policymakers has to be included as well as an analysis of which factors support or hinder evidence-based policy in contrast to opinion-based policy. How this systematic connection between intervention and implementation research can be realized, is illustrated by means of the development and implementation of the ViSC school program, which intends to reduce aggressive behavior and bullying and to foster social and intercultural competencies.

Advancing the state-level tracking of evidence-based practices: a case study

Background

Despite a sustained focus by policymakers and researchers on improving the standard of clinical care in public mental health services, the use of evidence-based practice remains low. Among other challenges, this reflects the difficulty of translating clinical research into useable policy that can be feasibly funded and monitored by state or large healthcare systems.

Case presentation

In this paper we present a case study of Washington State’s strategy for monitoring the use of clinical elements at the session level for all Medicaid-funded children’s mental health services. The implementation of this strategy reflects policy actions to promote effective practice while also actively influencing multiple other levels of the implementation ecology. The approach is informed by the Policy Ecology Framework, the Consolidated Framework for Implementation Research, the evidence-based policymaking literature, and common ontology and clinical elements models.

Conclusions

We found the strategy developed in Washington State to be a feasible method of collecting session level information about the use of effective clinical mental health practices. In addition, the approach appears to be having influence on multiple layers of the implementation ecology that could be explored through further study.

Digital Presence of a Research Center as a Research Dissemination Platform: Reach and Resources

BACKGROUND

Web-based platforms can be powerful tools for research dissemination. By leveraging the advantages of mass media and interpersonal channels of communication, Web-based dissemination platforms may improve awareness about, and subsequent adoption of, evidence-based practices (EBPs). Digital dissemination strategies can augment traditional dissemination models, improving stakeholder access to digestible and actionable information and promoting translation of EBPs.

OBJECTIVE

This study aimed to describe the reach and content of the Web presence of a National Institute on Drug Abuse Center of Excellence and how it is used to disseminate research related to digital behavioral health approaches.

METHODS

The Center for Technology and Behavioral Health (CTBH) has a website and regularly updated Facebook and Twitter accounts. The website features include summaries of digital behavioral health approaches and related empirical literature, a blog feed focused on the state of the science and technology concerning digital health care approaches, and a newsletter about Center activities. We extracted website usage metrics from Google Analytics and follower counts from social media accounts for the period from March 1, 2013, to July 17, 2018.

RESULTS

Since the implementation of analytic tracking, 70,331 users have initiated 96,995 sessions on the CTBH website. The website includes summaries of 86 digital therapeutic programs, encompassing 447 empirical articles. There are 1160 posts in the CTBH blog feed, including 180 summaries of scholarly articles. The Twitter and Facebook accounts have 577 and 1500 followers, respectively. The newsletter has reached a growing subscriber network and has a high open rate relative to industry standards.

CONCLUSIONS

The CTBH Web presence serves as a model for how to leverage accessible and easily updatable digital platforms as research dissemination channels. Digital dissemination tools can augment traditional dissemination strategies to promote awareness about evidence-based digital therapeutic approaches for behavioral health and health care more broadly.

A transformative translational change programme to introduce genomics into healthcare: a complexity and implementation science study protocol

INTRODUCTION

Translating scientific advances in genomic medicine into evidence-based clinical practice is challenging. Studying the natural translation of genomics into 'early-adopting' health system sectors is essential. We will (a) examine 29 health systems (Australian and Melbourne Genomics Health Alliance flagships) integrating genomics into practice and (b) combine this learning to co-design and test an evidence-based generalisable toolkit for translating genomics into healthcare.

METHODS AND ANALYSIS

Twenty-nine flagships integrating genomics into clinical settings are studied as complex adaptive systems to understand emergent and self-organising behaviours among inter-related actors and processes. The Effectiveness-Implementation Hybrid approach is applied to gather information on the delivery and potential for real-world implementation. Stages '1' and '2a' (representing hybrid model 1) are the focus of this protocol. The Translation Science to Population Impact (TSci Impact) framework is used to study policy decisions and service provision, and the Theoretical Domains Framework (TDF) is used to understand individual level behavioural change; both frameworks are applied across stages 1 and 2a. Stage 1 synthesises interview data from 32 participants involved in developing the genomics clinical practice systems and approaches across five 'demonstration-phase' (early adopter) flagships. In stage 2a, stakeholders are providing quantitative and qualitative data on process mapping, clinical audits, uptake and sustainability (TSci Impact), and psychosocial and environmental determinants of change (TDF). Findings will be synthesised before codesigning an intervention toolkit to facilitate implementation of genomic testing. Study methods to simultaneously test the comparative effectiveness of genomic testing and the implementation toolkit (stage 2b), and the refined implementation toolkit while simply observing the genomics intervention (stage 3) are summarised.

ETHICS AND DISSEMINATION

Ethical approval has been granted. The results will be disseminated in academic forums and used to refine interventions to translate genomics evidence into healthcare. Non-traditional academic dissemination methods (eg, change in guidelines or government policy) will also be employed.

Effectiveness Evaluation of It's Your Game: Keep It Real, a Middle School HIV/Sexually Transmitted Infection/Pregnancy Prevention Program

PURPOSE

This study assessed the effectiveness of the HIV/sexually transmitted infection/pregnancy prevention program, It's Your Game: Keep It Real (IYG).

METHODS

IYG was implemented by classroom teachers in 24 urban middle schools from 2012 to 2015. Using a quasi-experimental design, each year we surveyed ninth-grade students in 10 high schools that were selected based on feeder patterns from project middle schools. We compared two groups of students (n = 4,562): (1) students whose middle school grade cohorts did not receive IYG ("No-IYG"), and (2) students whose middle school grade cohorts received IYG ("IYG"). Multilevel analyses examined differences between the two groups in the initiation of any type of sexual activity (oral, vaginal, or anal sex), presexual behaviors, and psychosocial mediators.

RESULTS

Students in the IYG group were less likely to report initiation of sexual activity by ninth grade compared to students in the No-IYG group (odds ratio .77; 95% confidence interval .66-.90). The IYG group was significantly less likely to have engaged in presexual behaviors, including having been on a date, had a boyfriend/girlfriend, and touched or been touched on private body parts. The IYG group had better outcomes on 11 of 19 psychosocial variables, including knowledge; beliefs about abstinence, sex, friends' beliefs, norms, and behaviors; reasons for not having sex; personal limits; exposure to risky situations; self-efficacy; and quality of dating relationships.

CONCLUSIONS

The results suggest that IYG, when implemented on a large scale by trained classroom teachers in urban public schools, had positive impacts on students' behaviors, beliefs, and knowledge.

The Power of P-3 School Reform

Arthur Reynolds describes the significance, development, and effects of preschool to 3rd grade approaches. This school reform strategy integrates services and supports transitions, thereby increasing achievement, sustaining gains, and realistically reducing achievement gaps. Evidence from the Child-Parent Center (CPC) program is reviewed to illustrate key principles, strategies, and elements. Data from the Chicago Longitudinal Study and the more recent Midwest CPC expansion show that the program is effective in enhancing the transition to school and promoting longer-term well-being.

Randomized Effectiveness Trial of the New Beginnings Program for Divorced Families with Children and Adolescents

This study presents findings from a randomized effectiveness trial of the New Beginnings Program (NBP), which has demonstrated efficacy in 2 prior randomized efficacy trials. Family courts in 4 counties facilitated recruitment of divorcing and separating parents, and providers in community agencies delivered the program. Participants were 830 parents of children ages 3-18 who were randomized to receive either the 10-session NBP or an active 2-session comparison condition in which parents learned about the same parenting skills but did not complete home practice of these skills. Parents were ethnically diverse (59.4% non-Hispanic White, 31.4% Hispanic, 9.2% other race or ethnicity). Multiple rater assessments of parenting, interparental conflict, and child mental health problems were conducted at pretest, posttest, and 10-month follow-up. The results indicated positive moderated effects of the NBP as compared with the active control condition to strengthen parenting at posttest and to reduce child mental health problems at posttest and 10 months. Many of these moderated effects showed positive benefits for non-Hispanic White families but not for Hispanic families. The findings indicate support for the effectiveness of the NBP when delivered by community-based agencies but also indicate the need for further adaptations to make the program effective for Hispanic parents.

Dentist-Perceived Barriers and Attractors to Cognitive-Behavioral Treatment Provided by Mental Health Providers in Dental Practices

Over 1 in 5 dental patients report moderate to severe dental fear. Although the efficacy of cognitive-behavioral treatment (CBT) for dental fear has been examined in over 20 randomized controlled trials-with 2 meta-analyses finding strong average effect sizes ( d > 1)-CBT has received almost no dissemination beyond the specialty clinics that tested it. The challenge, then, is not how to treat dental fear but how to disseminate and implement such an evidence-based treatment in a way that recognizes the rewards and barriers in the US health care system. This mixed-method study investigated the potential of disseminating CBT through care from a mental health provider from within the dental home, a practice known as evidence-based collaborative care (EBCC). Two preadoption studies were conducted with practicing dentists drawn from a self-organized Practice-Based Research Network in the New York City metropolitan area. The first comprised 3 focus groups ( N = 17), and the second involved the administration of a survey ( N = 46). Focus group participants agreed that CBT for dental fear is worthy of consideration but identified several concerns regarding its appeal, feasibility, and application in community dental practices. Survey participants indicated endorsement of factors promoting the use of EBCC as a mechanism for CBT dissemination, with no factors receiving less than 50% support. Taken together, these findings indicate that EBCC may be a useful framework through which an evidence-based treatment for dental fear treatment can be delivered.

Integrating Retention Rates into Economic Analyses of Prevention Interventions

Evidence-based prevention interventions hold great promise for enhancing the well-being of individuals, families, and society. As these interventions are implemented in new contexts and at wider scales, policymakers and private sector organizations are increasingly interested in understanding the economic returns that programs produce through reductions of burden on public service systems, such as criminal justice and human services. Thus, it is important to ensure that economic models account for factors, such as retention, which are important when interventions are implemented in real-world contexts with selective populations and voluntary participation. Yet the field of prevention has provided little guidance to help researchers and policymakers analyze the economics of interventions so that estimates reflect the impact of implementation factors on intervention cost-effectiveness. This paper discusses the role retention plays in the economic efficiency of interventions when the prevention of child maltreatment is the primary motivation for funding these programs. We present a conceptual model to serve as a guide for explicit inclusion of retention rates when calculating cost estimates to be used in cost-effectiveness analysis. A case study is presented, demonstrating the variability in estimates dependent on the definition of retention and the estimated retention rate. The results underscore the importance of improving our understanding of factors underlying and related to retention, such as engagement, which may improve the precision of cost and cost-effectiveness analysis in applied settings.

Perceptions of Heart-Healthy Behaviors among African American Adults: A Mixed Methods Study

African Americans have a disproportionately higher risk of chronic conditions such as cardiovascular disease (CVD), type 2 diabetes, and hypertension than other ethnic or racial groups. Data regarding CVD-related perceptions and beliefs among African Americans are limited, particularly in the Southwest US. Assessment of current views regarding health and health behaviors is needed to tailor interventions to meet the unique needs of specific populations. We sought to examine knowledge, attitudes, and perceptions of African Americans living in Arizona toward CVD and etiological factors associated with health behaviors and chronic disease development to inform state health agency program development. Transcripts from 14 focus groups (n = 103) were analyzed using Grounded Theory for perceived disease risk, knowledge of CVD risk factors, nutrition, preventative behaviors, and barriers and motivators to behavior change. Participants identified CVD, stroke, and diabetes as leading health concerns among African-Americans but were less certain about the physiological consequences of these diseases. Diet, stress, low physical activity, family history, hypertension, and stroke were described as key CVD risk factors, but overweight and obesity were mentioned rarely. Participants described low socio-economic status and limited access to healthy foods as contributors to disease risk. Focus group members were open to modifying health behaviors if changes incorporated their input and were culturally acceptable. Respondents were 41% male and 59% female with a mean age of 46 years. This study provides insight into CVD and associated disease-related perceptions, knowledge, and attitudes among African Americans in the Southwest and recommendations for interventions to reduce CVD risk.

Sustained Effectiveness of Evidence-Based Parenting Programs After the Research Trial Ends

Despite ample evidence of the efficacy and effectiveness of evidence-based parenting programs (EBPPs) within research-led environments, there is very little evidence of maintenance of effectiveness when programs are delivered as part of regular service provision. The present study examined the effectiveness of EBPPs provided during a period of sustained service-led implementation in comparison to research-led effectiveness evaluation. Data from 3706 parents who received EBPPs during sustained implementation by services were compared to data from 1390 parents who had participated in an earlier researcher-led effectiveness trial of a national roll-out of EBPPs in England. In both phases, parents completed measures of child behavior problems, parenting style and parental mental well-being prior to starting parenting programs (pre-test), at the end of the programs (post) and at 12-months follow up. Results from Generalized Estimating Equations controlling for potential covariates indicated significant improvements in child behavior problems during sustained implementation, similar to the effectiveness phase; significant improvements in parenting style which were larger than the effectiveness phase at 12-month follow up; and significant improvements in parental mental well- being. Our findings demonstrate effective maintenance of gains when EBPPs are provided as part of regular provision across a large sample of English parents. Successful long-term implementation should consider effectiveness of EBPPs across the population, given the large contextual changes that take place between researcher-led evaluations and service take-up. Our findings support the integration of EBPPs in public health approaches to addressing child behavior problems and parent well-being.

Long-term school-level effects of the Olweus Bullying Prevention Program (OBPP)

In agreement with two predictions, this somewhat unusual study documented that 70 elementary schools (A-schools) with continued and repeated use of the Olweus Bullying Questionnaire (OBQ) in a four-year follow-up period of 2007-2010, two to eight years after original implementation of the Olweus Bullying Prevention Program (OBPP), had a clearly more favorable long-term development in terms of being-bullied problems, as measured with a completely independent data source, the National Pupil Survey than 102 comparable schools (B-schools) that had not conducted any OBQ-surveys in the same period. The odds of being bullied for students in a Norwegian average elementary school were also almost 40% higher than for students who attended a school with continued use of the OBQ, and very likely, other components of the program. Several alternative explanations of the findings were explored and found wanting. Results suggested that A-schools with continued use had changed their "school culture" for the better with regard to awareness, preparedness and competence in handling and preventing bullying. This form of 'organizational learning' has major consequences in that new groups of students will benefit from such a school environment. It was generally concluded - in spite of a highly stable average of the level of bullying problems in Norway - that it is fully possible to substantially reduce such problems not only in one-year evaluations, as has been amply documented before, but also in the long term, up to eight years after original implementation, with a program such as the Olweus Bullying Prevention Program.

eB4CAST: An Evidence-Based Tool to Promote Dissemination and Implementation in Community-Based, Public Health Research

eB4CAST, evidence-Based forecast C-capture, A-assemble, S-sustain, T-timelessness (eB4CAST), framework was developed from existing dissemination and implementation (D & I) constructs as a dissemination tool to promote community-based program usability and future application in targeted populations. eB4CAST captures and transforms research findings into a dissemination report that shows program need and impact to endorse program continuation and expansion. This is achieved through direct and indirect data collection of community factors and program impact that can showcase the need for program sustainability and potential for future dissemination sites. Testimonials, individual feedback, and program process and outcomes contribute to the direct data while data collected from census, county, and state databases and reports allow for indirect information to be captured and analyzed. Capturing data in the two levels allow eB4CAST to forecast program need and highlight program impact through a footprint. eB4CAST framework for dissemination tool creation is organized into four sections: Capture, Assemble, Sustainability, and Timelessness. Capture encompasses the collection of indirect and direct data related to intervention goals. Assemble is the compilation of the data into a visually appealing and easily understood media. Sustainability encourages the use of dissemination tools to provide forecast of program need and footprint of program impact back to community participants, program leaders, and key stakeholders to endorse program sustainability. Lastly, timelessness encourages cyclic movement through these constructs to continue program monitoring and data sharing to ensure timeless program evaluation and conformation to change in needs. The eB4CAST framework provides a systematic method to capture justification of program need and impact of community-based research that can be modified to fit diverse public health interventions providing a necessary D & I tool.

Testing the Social Interaction Learning Model's Applicability to Adolescent Substance Misuse in an Australian Context

BACKGROUND

Parents and peers both influence the development of adolescent substance misuse, and the Social Interaction Learning (SIL) model provides a theoretical explanation of the paths through which this occurs.

OBJECTIVE

The SIL model has primarily been tested with conduct outcomes and in US samples. This study adds to the literature by testing the SIL model with four substance use outcomes in a sample of Australian youth.

METHOD

We used structural equation modeling to test the fit of the SIL model to a longitudinal sample (n = 907) of students recruited in grade 5 in Victoria, Australia participating in the International Youth Development Study, who were resurveyed in grades 6 and 10.

RESULTS

The model fit was good (χ2(95) = 248.52, p < .001; RMSEA = .04 [90% CI: .036 - .049]; CFI = .94; SRMR = .04). Path estimates from parenting to antisocial behavior and from antisocial behavior to antisocial peers were significant. In turn, having antisocial peers was significantly related to alcohol use, binge drinking, tobacco use, and marijuana use. From parenting, only the direct path to marijuana use was significant, but indirect effects were significant.

CONCLUSIONS

The SIL model illustrates that parenting plays an early role in the formation of adolescent peer relations that influence substance misuse and identifies etiological pathways that can guide the targets of prevention. The SIL pathways appear robust to the Australian social and policy context.

Challenges Facing Evidence-Based Prevention: Incorporating an Abductive Theory of Method

Current systems used to determine whether prevention programs are "evidence-based" rely on the logic of deductive reasoning. This reliance has fostered implementation of strategies with explicitly stated evaluation criteria used to gauge program validity and suitability for dissemination. Frequently, investigators resort to the randomized controlled trial (RCT) combined with null hypothesis significance testing (NHST) as a means to rule out competing hypotheses and determine whether an intervention works. The RCT design has achieved success across numerous disciplines but is not without limitations. We outline several issues that question allegiance to the RCT, NHST, and the hypothetico-deductive method of scientific inquiry. We also discuss three challenges to the status of program evaluation including reproducibility, generalizability, and credibility of findings. As an alternative, we posit that extending current program evaluation criteria with principles drawn from an abductive theory of method (ATOM) can strengthen our ability to address these challenges and advance studies of drug prevention. Abductive reasoning involves working from observed phenomena to the generation of alternative explanations for the phenomena and comparing the alternatives to select the best possible explanation. We conclude that an ATOM can help increase the influence and impact of evidence-based prevention for population benefit.

Expanding the Cultural Adaptation Framework for Population-Level Impact

Attention to cultural diversity and cultural adaptation of evidence-based interventions (EBIs) has been a longstanding priority in prevention science. However, EBIs for diverse populations present several challenges for broad dissemination and population impact. The five papers in this special issue underscore some of these challenges and offer new ways of thinking and recommendations for the next generation of type 2 translation research. This commentary underscores three broad recommendations, including the need for a more expanded conceptualization and empirical understanding of the core tension between fidelity and adaptation; greater focus on the systems of care that deliver EBIs to culturally diverse populations, including increased attention to such issues as access and engagement; and greater flexibility in strategies to adapt and evaluate interventions within and across communities and settings that serve diverse populations. By offering exemplars and suggestions to address these challenges, these papers collectively help to realign research on cultural adaptation with its ultimate goal of reducing health disparities by ensuring greater access, impact, and equity of prevention services in a dynamic, multicultural society. However, other fundamental challenges remain unaddressed, including the need to reduce inequalities that exist in the health, education, social service, and justice systems that will ultimately support broad diffusion of EBIs for diverse populations.

Advances in EBI Development for Diverse Populations: Towards a Science of Intervention Adaptation

This introduction examines major issues and challenges as presented in this special issue of Prevention Science, "Challenges to the Dissemination and Implementation of Evidence Based Prevention Interventions for Diverse Populations." We describe the Fidelity-Adaptation Dilemma that became the origin of dynamic tensions in prevention science. It generated controversies and debates and new perspectives on the dissemination and implementation of evidence-based interventions (EBIs) within diverse populations. The five articles in this special issue address many of these challenges. These dynamic tensions have culminated in a reframing of this dilemma that now argues that fidelity and adaptation are both equally important imperatives. These five articles also examine the abiding challenges of engagement and sustainability. Also, two commentaries from expert research investigators reflect on these five articles and their contributions to prevention science. The current introduction describes this "second generation" of EBIs as they may contribute towards a reduction of the health disparities and inequities that disproportionately affect sectors of the major ethnocultural populations in the USA. We also present a systems analysis of approaches and challenges in the dissemination and implementation of EBIs within the contemporary integrative care environment. Finally, we mention an initiative for, "building a science of intervention adaptation," that proposes systematic research and the creation of an archive of scientific data on the benefits and problems of intervention adaptation. Collectively, these new directions can integrate scientific rigor and sensitivity to cultural factors, for enhancing the effectiveness and reach of this second generation of evidence-based interventions with diverse ethnocultural populations.