Evaluating the implementation and sustainability of a program for enhancing veterans' intimate relationships

Chaplain interventions and outcomes in outpatient settings: a scoping review

As chaplaincy is increasingly practiced in outpatient settings, further understanding is needed of what it entails and is accomplishing within this unique context. This scoping review summarizes 42 articles that describe the types of spiritual care interventions and programs offered by chaplains in outpatient settings, and their outcomes. Findings support that chaplaincy is practiced in outpatient settings, especially in palliative care, oncology, and primary care. Interventions are delivered by chaplains as the sole interventionist, and by interdisciplinary teams with chaplain participants. Results show that outpatient chaplain interventions are feasible and acceptable, with positive psychological and spiritual outcomes. More studies with consistent outcome measurements, and structured chaplain interventions are needed to draw further conclusions about the effectiveness of outpatient chaplain interventions.

Sustainment of diverse evidence-informed practices disseminated in the Veterans Health Administration (VHA): initial development and piloting of a pragmatic survey tool

BACKGROUND

There are challenges associated with measuring sustainment of evidence-informed practices (EIPs). First, the terms sustainability and sustainment are often falsely conflated: sustainability assesses the likelihood of an EIP being in use in the future while sustainment assesses the extent to which an EIP is (or is not) in use. Second, grant funding often ends before sustainment can be assessed. The Veterans Health Administration (VHA) Diffusion of Excellence (DoE) program is one of few large-scale models of diffusion; it seeks to identify and disseminate practices across the VHA system. The DoE sponsors "Shark Tank" competitions, in which leaders bid on the opportunity to implement a practice with approximately 6 months of implementation support. As part of an ongoing evaluation of the DoE, we sought to develop and pilot a pragmatic survey tool to assess sustainment of DoE practices.

METHODS

In June 2020, surveys were sent to 64 facilities that were part of the DoE evaluation. We began analysis by comparing alignment of quantitative and qualitative responses; some facility representatives reported in the open-text box of the survey that their practice was on a temporary hold due to COVID-19 but answered the primary outcome question differently. As a result, the team reclassified the primary outcome of these facilities to Sustained: Temporary COVID-Hold. Following this reclassification, the number and percent of facilities in each category was calculated. We used directed content analysis, guided by the Consolidated Framework for Implementation Research (CFIR), to analyze open-text box responses.

RESULTS

A representative from forty-one facilities (64%) completed the survey. Among responding facilities, 29/41 sustained their practice, 1/41 partially sustained their practice, 8/41 had not sustained their practice, and 3/41 had never implemented their practice. Sustainment rates increased between Cohorts 1-4.

CONCLUSIONS

The initial development and piloting of our pragmatic survey allowed us to assess sustainment of DoE practices. Planned updates to the survey will enable flexibility in assessing sustainment and its determinants at any phase after adoption. This assessment approach can flex with the longitudinal and dynamic nature of sustainment, including capturing nuances in outcomes when practices are on a temporary hold. If additional piloting illustrates the survey is useful, we plan to assess the reliability and validity of this measure for broader use in the field.

Dynamic Diffusion Network: Advancing moral injury care and suicide prevention using an innovative model

Healthcare providers across a wide variety of settings face a common challenge: the need to provide real time care for complex problems that are not adequately addressed by existing protocols. In response to these intervention gaps, frontline providers may utilize existing evidence to develop new approaches that are tailored to specific problems. It is imperative that such approaches undergo some form of evaluation, ensuring quality control while permitting ongoing adaptation and refinement. “Dynamic diffusion” is an innovative approach to intervention improvement and dissemination whereby care practices are delivered and continuously evaluated under real-world conditions as part of a structured network experience. This “dynamic diffusion network” (DDN) promotes cross-pollination of ideas and shared learning to generate relatively rapid improvements in care. The pilot Mental Health and Chaplaincy DDN was developed to advance suicide prevention efforts and moral injury care practices being conducted by 13 chaplain-mental health professional teams across the Veterans Health Administration. Lessons learned from the pilot DDN include the importance of the following: geographic and cultural diversity among innovation collaborators to ensure the broadest possible relevance of solutions; leadership support to facilitate engagement of frontline providers in quality improvement efforts; and participation in a community of practice to motivate providers and offer opportunities for direct collaboration and cross-pollination of ideas.

Measuring sustainability of a grassroots program in a large integrated health care delivery system: the Warrior to Soul Mate Program

Introduction

Veterans experience many physical and psychosocial adjustment problems that challenge personal relationships and social functioning and successful social reintegration. The Warrior to Soul Mate (W2SM) program uses a structured curriculum [i.e., the Practical Application of Intimate Relationships Skills (PAIRS)] to address veterans' interpersonal needs by teaching participants effective interpersonal skills. Veterans who attended the W2SM program reported lower anxiety levels, improvements in marital alterations and satisfaction, and increased intimacy, cohesion, and affection. Therefore, sustaining the W2SM program can have long-term positive effects for veterans, families, and the greater society. The purpose of this paper is to describe the sustainability of the W2SM program.

Methods

The Model of Community-based Program Sustainability conceptually guided the evaluation. Twenty-three VA hospitals in the U.S. that offer W2SM programs completed a self-report survey to measure sustainability.

Results

The highest scoring sustainability elements were "Demonstrating program results" (M=5.82, SD=1.23), "Staff involvement and integration" (M= 5.79, SD= 1.34), and "Program responsivity" (M=4.39, SD= 1.16); the lowest scoring element was "Strategic funding" (M=2.78, SD=1.75). Statistically significant associations were found between the global middle-range program results and three sustainability elements: leadership competence (r = .472, p = .023), effective collaboration (r = .470, p = .024), and strategic funding (r = .507, p = .014).

Discussion

Efforts to sustain programs should focus on leaders planning for sustainability at the onset of program implementation, collaborators must be involved in program design, implementation and evaluation, and long-term funding sources must be secured to support program operations and continuation.