Is more better? Examining whether enhanced consultation/coaching improves implementation

Cost-effectiveness of Intervention Implementation Support for Reducing Eating Disorder Symptoms Among College Students

Implementation support for prevention interventions is receiving increased attention, as many organizations receive training in evidence-based practices but do not deliver the interventions optimally. The Body Project, a four-session program, significantly reduces eating disorder symptoms and future disorder onset among group participants when delivered by peer educators at colleges/universities. Costs and cost-effectiveness of the program were examined using data from a randomized trial that compared three levels of implementation support at 63 colleges: (1) a train-the-trainer (TTT) workshop alone, (2) TTT plus a technical assistance (TA) workshop, or (3) TTT plus TA plus monthly quality assurance (QA) consultations. Effectiveness was measured by the production of reliable change in eating disorder symptoms from pretest to posttest. Costs and cost-effectiveness of two levels of implementation support are reported, comparing TTT-only with TTT + TA + QA (effectiveness of the TTT + TA condition did not differ from TTT-only) and using results from an earlier study as a proxy for a no-treatment control. Two perspectives are considered: a sponsoring organization providing the training at multiple sites and a college delivering the intervention to its eligible students. From the perspective of a sponsoring organization, adding both the TA training and QA support improves the cost-effectiveness per eligible student receiving the intervention. From the perspective of costs for a college to deliver the intervention, receiving TA training and QA support is also more cost-effective than the training workshop alone, whether the peer educators are paid or unpaid and whether costs of group supervision are included or excluded. Results converge with previous research showing that more intensive implementation support can be more cost-effective.

Knowledge and attitudes of Implementation Support Practitioners-Findings from a systematic integrative review

BACKGROUND

It requires thoughtful planning and work to successfully apply and sustain research-supported interventions like healthcare treatments, social support, or preventive programs in practice. Implementation support practitioners (ISPs) such as facilitators, technical assistance providers, knowledge brokers, coaches or consultants may be involved to actively support the implementation process. This article presents knowledge and attitudes ISPs bring to their work.

METHODS

Building on a previously developed program logic, a systematic integrative review was conducted. Literature was sourced by searching nine electronic data bases, organizational websites, and by launching a call for publications among selected experts and social media. Article screening was performed independently by two researchers, and data from included studies were extracted by members of the research team and quality-assured by the lead researcher. The quality of included RCTs was assessed based on a framework by Hodder and colleagues. Thematic Analysis was used to capture information on knowledge and attitudes of ISPs across the included studies. Euler diagrams and heatmaps were used to present the results.

RESULTS

Results are based on 79 included studies. ISPs reportedly displayed knowledge about the clinical practice they work with, implementation / improvement practice, the local context, supporting change processes, and facilitating evidence-based practice in general. In particular, knowledge about the intervention to be implemented and its target population, specific improvement / implementation methods and approaches, organizational structures and sensitivities, training, and characteristics of (good) research was described in the literature. Seven themes describing ISPs' attitudes were identified: 1) professional, 2) motivated / motivating / encouraging / empowering, 3) empathetic / respectful / sensitive, 4) collaborative / inclusive, 5) authentic, 6) creative / flexible / innovative / adaptive, and 7) frank / direct / honest. Pertaining to a professional attitude, being responsive and focused were the most prevalent indicators across included publications.

CONCLUSION

The wide range and complexity of knowledge and attitudes found in the literature calls for a comprehensive and systematic approach to collaboratively develop a professional role for ISPs across disciplines. Embedding the ISP role in different health and social welfare settings will enhance implementation capacities considerably.