Implementation and Evaluation of a Training Curriculum for Experienced Nurses in Care Coordination: The VA Rural Transitions Nurse Training Program

The development and evaluation of the Designing for Dissemination and Implementation Learning Hub

There is a growing emphasis on reducing the gap between research and routine practice. Dissemination and Implementation (D&I) science offers theories, models, and frameworks to enhance the implementation, impact, and sustainment of new programs and interventions. Few training opportunities are available that help leaders, researchers, clinicians, and staff (implementers) translate original research into practice settings in a more timely and effective manner without requiring significant time away from their primary clinical duties. To address these needs, we designed a virtual Designing for Dissemination and Implementation (D4D&I) Learning Hub that offered foundational D&I knowledge and opportunities for skill building. We developed the D4D&I Learning Hub curricula to train novice participants in the multicomponent D4D&I implementation strategy bundle when implementing new programs or innovations. The components of the D4D&I strategy bundle include (i) Pre-implementation assessment for proactive planning and multilevel contextual assessment, (ii) Multilevel partner engagement to learn what is important to end-users and obtain buy-in, (iii) Implementation and adaptations guided by a pre-implementation assessment while retaining program fidelity, and (iv) Program evaluation. We utilized a virtual e-learning platform, expert trainers, mentorship, and a Virtual Learning Collaborative to deliver the six-module curricula to support participants' growth and success. We used quantitative and qualitative methods informed by the Kirkpatrick Evaluation Model to evaluate the D4D&I Learning Hub. Thirty-one participants completed the D4D&I Learning Hub across four cohorts. Participants found the D4D&I curricula relevant and favorable, indicating they acquired the intended knowledge and skills. In presentations of their key takeaways, participants cited a greater understanding of how to apply various D&I theories, models, and frameworks to their research, engage multilevel partners during all phases of implementation and evaluation, and assess fidelity and adaptations. Participants planned to incorporate the acquired D&I knowledge and skills in future publications, grant applications, and when implementing new programs and projects in clinical settings. The D4D&I Learning Hub provides foundational education for novice participants of D&I science. It promotes designing, disseminating, implementing, and evaluating effective programs in clinical settings. This article discusses the development and implementation of the D4D&I Learning Hub. In addition, we evaluated the first four cohorts using the Kirkpatrick Evaluation Model.

An implementation strategy postmortem method developed in the VA rural Transitions Nurse Program to inform spread and scale-up

BACKGROUND

High-quality implementation evaluations report on intervention fidelity and adaptations made, but a practical process for evaluating implementation strategies is needed. A retrospective method for evaluating implementation strategies is also required as prospective methods can be resource intensive. This study aimed to establish an implementation strategy postmortem method to identify the implementation strategies used, when, and their perceived importance. We used the rural Transitions Nurse Program (TNP) as a case study, a national care coordination intervention implemented at 11 hospitals over three years.

METHODS

The postmortem used a retrospective, mixed method, phased approach. Implementation team and front-line staff characterized the implementation strategies used, their timing, frequency, ease of use, and their importance to implementation success. The Expert Recommendations for Implementing Change (ERIC) compilation, the Quality Enhancement Research Initiative phases, and Proctor and colleagues' guidance were used to operationalize the strategies. Survey data were analyzed descriptively, and qualitative data were analyzed using matrix content analysis.

RESULTS

The postmortem method identified 45 of 73 ERIC strategies introduced, including 41 during pre-implementation, 37 during implementation, and 27 during sustainment. External facilitation, centralized technical assistance, and clinical supervision were ranked as the most important and frequently used strategies. Implementation strategies were more intensively applied in the beginning of the study and tapered over time.

CONCLUSIONS

The postmortem method identified that more strategies were used in TNP than planned and identified the most important strategies from the perspective of the implementation team and front-line staff. The findings can inform other implementation studies as well as dissemination of the TNP intervention.