The interplay of contextual elements in implementation: an ethnographic case study

Enhancing Primary Care and Mental Health Integration for Women Veterans with Complex Healthcare Needs Using Evidence-Based Quality Improvement

BACKGROUND

Women Veterans with co-morbid medical and mental health conditions face persistent barriers accessing high-quality health care. Evidence-based quality improvement (EBQI) offers a systematic approach to implementing new care models that can address care gaps for women Veterans.

OBJECTIVE

This study examines factors associated with the successful deployment of EBQI within integrated health systems to improve primary care for women Veterans with complex mental health needs.

DESIGN

Following a 12-site (8 EBQI, 4 control) cluster randomized study to evaluate EBQI effectiveness, we conducted an in-depth case study analysis of one women's health clinic that used EBQI to improve integrated primary care-mental health services for women Veterans.

PARTICIPANTS

Our study sample included providers, program managers, and clinic staff at a women Veteran's health clinic that, at the time of the study, had one Primary Care and Mental Health Integration team and one women's health primary care provider serving 800 women. We analyzed interviews conducted 12 months, 24 months, and 4 years post-implementation and call summaries between the clinic and support team.

MAIN MEASURES

We conducted qualitative thematic analysis of interview and call summary data to identify EBQI elements, clinic characteristics, and reported challenges and successes within project development and execution.

KEY RESULTS

The clinic harnessed core EBQI elements (multi-level stakeholder engagement, data-driven progress-monitoring, PDSA cycles, sharing results) to accomplish pre-defined project goals, strengthen inter-disciplinary partnerships, and bolster team confidence. Clinic characteristics that facilitated implementation success included prior QI experience and an organizational culture responsive to innovation, while lack of pre-existing guidelines and limited access to centralized databases posed implementation challenges.

CONCLUSIONS

Successful practice transformation emerges through the interaction of evidence-based methods and site-specific characteristics. Examining how clinic characteristics support or impede EBQI adaptation can facilitate efforts to improve care within integrated health systems.

Improving safety and preventing falls using an evidence-based, front-line staff huddling practice: protocol for a pragmatic trial to increase quality of care in State Veterans Homes

INTRODUCTION

Falls in nursing homes are a major cause for decreases in residents' quality of life and overall health. This study aims to reduce resident falls by implementing the LOCK Falls Programme, an evidence-based quality improvement intervention. The LOCK Falls Programme involves the entire front-line care team in (1) focusing on evidence of positive change, (2) collecting data through systematic observation and (3) facilitating communication and coordination of care through the practice of front-line staff huddles.

METHODS AND ANALYSIS

The study protocol describes a mixed-methods, 4-year hybrid (type 2) effectiveness-implementation study in State Veterans Homes in the USA. The study uses a pragmatic stepped-wedge randomised trial design and employs relational coordination theory and the Reach, Effectiveness, Adoption, Implementation and Maintenance framework to guide implementation and evaluation. A total of eight State Veterans Homes will participate and data will be collected over an 18-month period. Administrative data inclusive of all clinical assessments and Minimum Data Set assessments for Veterans with a State Veterans Home admission or stay during the study period will be collected (8480 residents total). The primary outcome is a resident having any fall. The primary analysis will be a partial intention-to-treat analysis using the rate of participants experiencing any fall. A staff survey (n=1200) and qualitative interviews with residents (n=80) and staff (n=400) will also be conducted. This research seeks to systematically address known barriers to nursing home quality improvement efforts associated with reducing falls.

ETHICS AND DISSEMINATION

This study is approved by the Central Institutional Review Board (#167059-11). All participants will be recruited voluntarily and will sign informed consent as required. Collection, assessment and managing of solicited and spontaneously reported adverse events, including required protocol alterations, will be communicated and approved directly with the Central Institutional Review Board, the data safety monitoring board and the Office of Research and Development. Study results will be disseminated through peer-reviewed publications and conference presentations at the Academy Health Annual Research Meeting, the Gerontological Society of America Annual Scientific Meeting and the American Geriatrics Society Annual Meeting. Key stakeholders will also help disseminate lessons learnt.

TRIAL REGISTRATION NUMBER

NCT05906095.

Implementing a tobacco-free workplace program at a substance use treatment center: a case study

BACKGROUND

People with substance use disorders smoke cigarettes at much higher rates than the general population in the United States and are disproportionately affected by tobacco-related diseases. Many substance use treatment centers do not provide evidence-based tobacco cessation treatment or maintain comprehensive tobacco-free workplace policies. The goal of the current work is to identify barriers and facilitators to a successful and sustainable implementation of a tobacco-free workplace program, which includes a comprehensive tobacco-free policy and evidence-based cessation treatment services, in a substance use treatment center.

METHODS

This study is based on an ethnographic approach and uses a qualitative case study design. Data were collected via interviews with staff (n = 6) and clients (n = 16) at the substance use treatment center and site visits (n = 8). Data were analyzed using thematic analysis guided by the extended Normalization Process Theory designed to inform the implementation of innovations in healthcare practice.

RESULTS

Staff at the substance use treatment center supported the implementation of the program and shared a good understanding of the purpose of the intervention and its potential benefits. However, the study identified significant challenges faced by the center during implementation, including widespread tobacco use among clients, contributing to attitudes among staff that tobacco cessation was a low-priority problem due to a perceived lack of interest in quitting and inability to quit among their clients. We identified several factors that contributed to changing this attitude, including provision of tobacco training to staff, active leadership support, low number of staff members who smoked, and access to material resources, including nicotine replacement products. The implementation and active enforcement of a comprehensive tobacco-free workplace program contributed to a gradual change in attitudes and improved the provision of evidence-based tobacco cessation care at the substance use treatment center.

CONCLUSIONS

Substance use treatment centers can integrate tobacco cessation practices in their daily operations, despite multiple challenges they face due to the complex behavioral health and socioeconomic needs of their clients. With proper support, substance use treatment centers can provide much needed tobacco cessation care to their clients who are disproportionately affected by tobacco-related health conditions and systemic health inequities.

Process evaluation of a parent-child communication intervention for adolescent sexual and reproductive health in Uganda

BACKGROUND

Previous initiatives concerning adolescent sexual and reproductive health (SRH) education in Low-or-Middle Income Countries (LMICs) have been limited by cultural norms and misinformation perpetuated within families. Responding to the paucity of research on the implementation of SRH interventions in LMICs and limited knowledge regarding their mechanisms, this study undertakes a process evaluation of a parent-focused intervention to promote parent-adolescent communication about SRH in Uganda.

METHODS

This paper explores the implementation, contextual factors and mechanisms of impact of the intervention, using the Medical Research Council (MRC) guidelines for process evaluations. Implementation was evaluated through indicators of dose, fidelity and adaptations, acceptability and feasibility. The contextual factors and mechanisms of impact were evaluated to refine the intervention's causal assumptions. Data was collected during April - October 2021 in South-Western Uganda using a mixed-methods approach, including document analysis, intervention observations, interviews, focus group discussions and most significant change stories.

RESULTS

The acceptability of the intervention was related to its community engagement, the strong rapport with delivery agents, and individual characteristics of participants. Five contextual factors influencing implementation were highlighted; (i) cultural norms, (ii) perceptions about youth SRH, (iii) poverty, (iv) Covid-19 pandemic, and (v) prior research projects in the community. When considering the intervention's mechanisms of impact, four causal pathways were identified; (i) Awareness of SRH needs helped parents overcome stigma, (ii) Parenting skills training improved SRH communication, (iii) Group learning stimulated shared parenting, and (iv) Group learning improved co-parenting.

CONCLUSION

The paper presented three key learnings and corresponding recommendations for future research. Firstly, implementation success was credited to meaningful community engagement which improved acceptability and uptake. Secondly, the complex influences of contextual factors highlighted the need for contextual analysis in research studies to inform intervention design. Finally, this evaluation recognised the interplay between mechanisms of impact and suggested further research consider such combined impacts when designing intervention content.

Facilitators and barriers to the implementation of new critical care practices during COVID-19: a multicenter qualitative study using the Consolidated Framework for Implementation Research (CFIR)

BACKGROUND

The COVID-19 pandemic produced unprecedented demands and rapidly changing evidence and practices within critical care settings. The purpose of this study was to identify factors and strategies that hindered and facilitated effective implementation of new critical care practices and policies in response to the pandemic.

METHODS

We used a cross-sectional, qualitative study design to conduct semi-structured in-depth interviews with critical care leaders across the United States. The interviews were audio-taped and professionally transcribed verbatim. Guided by the Consolidated Framework for Implementation Research (CFIR), three qualitative researchers used rapid analysis methods to develop relevant codes and identify salient themes.

RESULTS

Among the 17 hospitals that agreed to participate in this study, 31 clinical leaders were interviewed. The CFIR-driven rapid analysis of the interview transcripts generated 12 major themes, which included six implementation facilitators (i.e., factors that promoted the implementation of new critical care practices) and six implementation barriers (i.e., factors that hindered the implementation of new critical care practices). These themes spanned the five CFIR domains (Intervention Characteristics, Outer Setting, Inner Setting, Characteristics of Individuals, and Process) and 11 distinct CFIR constructs. Salient facilitators to implementation efforts included staff resilience, commitment, and innovation, which were supported through collaborative feedback and decision-making mechanisms between leadership and frontline staff. Major identified barriers included lack of access to reliable and transferable information, available resources, uncollaborative leadership and communication styles.

CONCLUSIONS

Through applying the CFIR to organize and synthesize our qualitative data, this study revealed important insights into implementation determinants that influenced the uptake of new critical care practices during COVID-19. As the pandemic continues to burden critical care units, clinical leaders should consider emulating the effective change management strategies identified. The cultivation of streamlined, engaging, and collaborative leadership and communication mechanisms not only supported implementation of new care practices across sites, but it also helped reduce salient implementation barriers, particularly resource and staffing shortages. Future critical care implementation studies should seek to capitalize on identified facilitators and reduce barriers.

"It's just not the same": Exploring PWUD' perceptions of and experiences with drug policy and SCS services change in a Canadian City

BACKGROUND AND AIMS

Shifting political contexts can significantly alter drug policy approaches and available supports for People Who Use Drugs (PWUD). The purpose of this study was to explore how shifts in provincial drug policy approaches, specifically the replacement of a Safe Consumption Site (SCS) with a smaller mobile Overdose Prevention Site (OPS) in Lethbridge, Alberta Canada, impacted PWUD' access to and experiences with harm reduction services.

METHODS

We conducted semi-structured interviews with 50 PWUD in the City of Lethbridge, Canada. Through traditional fieldwork, we recruited participants within, and just outside of, downtown Lethbridge. Using a standardized general prompt guide to begin interviews, participants were asked a variety of questions about their experiences with and perceptions of SCS access and changes to SCS provisions. Interviews were audio recorded, then transcribed, coded, and analyzed.

RESULTS

Participants reported regular and frequent access and overall positive experiences with the SCS, despite also noting certain operational barriers (e.g., long wait times). By contrast, participants reported more limited use of the new OPS compared to the SCS because of three main reasons: (1) concerns about location; (2) smoking room elimination; and (3) lack of social space and activities. Overall, changes to SCS provision produced a range of negative consequences for PWUD in Lethbridge. These relate to perceived increases in drug-related harms (e.g., increased overdoses) as well as negative social impacts (e.g., lack of place to meet other people).

CONCLUSION

Findings from this study provide preliminary indications of the importance of understanding how contextual and locally-specific elements (location, limits on permitted route administration, and social aspects) can work together to facilitate SCS uptake and even overcome traditional SCS barriers. Conversely, the absence of such elements can hinder SCS uptake. Results show that the value of SCS might differ across locations, pointing to the need for further locally-grounded examinations of harm reduction service uptake and experience.

Strategic Priorities for Implementation of Father-Inclusive Practice in Mental Health Services for Children and Families: A Delphi Expert Consensus Study

The aim of this study was to investigate expert consensus on barriers and facilitators to the organizational implementation of Father-Inclusive Practice (FIP) in child and family services to establish strategic priorities for implementation. An international panel of 56 experts in child and family service provision and father inclusion were surveyed using the Delphi technique. Three online questionnaires were used to gather opinions and measure experts’ levels of agreement in regard to factors that enable or hinder the organizational implementation of FIP. Survey design, analysis and interpretation was guided by the Consolidated Framework for Implementation Research (CFIR). Consensus was achieved for 46.4% (n = 13) statements. Eight barriers and five facilitators were identified as strategic priorities to organizational implementation of FIP. The key factors were related to the following CFIR themes: leadership engagement, access to information and knowledge, implementation climate, structural characteristics, networks and communication, client needs and resources, external policies and incentives, and reflecting and evaluating. The study findings suggest that issues related to central prioritization, top-down organizational processes and external policy context should represent priority areas for implementation. Our results prioritise methods for improving FIP by highlighting the key areas of organizational practice to be addressed by tailored implementation strategies.

Conceptual and relational advances of the PARIHS and i-PARIHS frameworks over the last decade: a critical interpretive synthesis

BACKGROUND

The number of research publications reporting the use of the Promoting Action on Research Implementation in Health Services (PARIHS) framework and the integrated PARIHS (i-PARIHS) framework has grown steadily. We asked how the last decade of implementation research, predicated on the (i-)PARIHS framework (referring to the PARIHS or i-PARIHS framework), has contributed to our understanding of the conceptualizations of, relationships between, and dynamics among the core framework elements/sub-elements. Building on the Helfrich et al. (2010) review of research on the PARIHS framework, we undertook a critical interpretive synthesis to: (1) identify conceptual and relational advances in the (i-)PARIHS framework and (2) identify conceptual and relational aspects of the (i-)PARIHS framework that warrant further work.

METHODS

We performed a systematic search in PubMed/PubMed Central, Ovid MEDLINE, CINAHL, JSTOR, SCOPUS, Web of Science, and PsycInfo. Articles were eligible for synthesis if they (a) were peer-reviewed articles, written in English, and published between January 2009 and December 2021, (b) applied the (i-)PARIHS framework explicitly to guide implementation research, and (c) made conceptual (expanding the conceptualization of core elements) and/or relational contributions (elaborating relationships among elements/sub-elements, or theorizing the relationships using empirical data). We used a critical interpretive synthesis approach to synthesize conceptual-relational advances of the (i-)PARIHS framework.

RESULTS

Thirty-seven articles were eligible for synthesis. Twenty-four offered conceptual contributions, and 18 offered relational contributions (5 articles contributed in both ways). We found conceptual expansion of all core (i-)PARIHS elements, with most emphasis on context (particularly outer context and leadership), facilitation, and implementation success. Articles also gave insights into the complex relationships and relational dynamism among these elements, characterized as contingent, interactive, multilevel, and temporal effects.

CONCLUSIONS

We observed developmental advances of the (i-)PARIHS framework and proposed several directions to further advance the framework. Conceptualization of (i-)PARIHS elements (particularly evidence/innovation and recipients) need to be further developed by specifying conceptual and operational definitions of underlying sub-elements. Relationships among (i-)PARIHS elements/sub-elements need to be further elaborated through empirical studies that consider situational contingencies and causal complexities. This will require examining necessity and sufficiency of (i-)PARIHS elements/sub-elements in relation to implementation outcomes, interactions among elements, and mechanism-based explanations.

Direct Observation Methods: a Practical Guide for Health Researchers

OBJECTIVE

To provide health research teams with a practical, methodologically rigorous guide on how to conduct direct observation.

METHODS

Synthesis of authors' observation-based teaching and research experiences in social sciences and health services research.

RESULTS

This article serves as a guide for making key decisions in studies involving direct observation. Study development begins with determining if observation methods are warranted or feasible. Deciding what and how to observe entails reviewing literature and defining what abstract, theoretically informed concepts look like in practice. Data collection tools help systematically record phenomena of interest. Interdisciplinary teams--that include relevant community members-- increase relevance, rigor and reliability, distribute work, and facilitate scheduling. Piloting systematizes data collection across the team and proactively addresses issues.

CONCLUSION

Observation can elucidate phenomena germane to healthcare research questions by adding unique insights. Careful selection and sampling are critical to rigor. Phenomena like taboo behaviors or rare events are difficult to capture. A thoughtful protocol can preempt Institutional Review Board concerns.

INNOVATION

This novel guide provides a practical adaptation of traditional approaches to observation to meet contemporary healthcare research teams' needs.

The Implementation of Evidence-Informed Family Nursing Practices: A Scoping Review of Strategies, Contextual Determinants, and Outcomes

There is a lack of knowledge about the successful implementation of family nursing practices. This scoping review maps current knowledge about the implementation of evidence-informed family nursing practices across settings and populations. A systematic search (CINAHL, PubMed, Medline) identified 24 publications, published between 2010 and 2020. We found nurses' implementation experience to be one of disruption, learning, and moving to new ways of practicing. The implementation resulted in benefits to families and self but was marked by fluctuation and partial integration of evidence-informed family nursing practices into care delivery. Uptake was shaped by various contextual determinants, with barriers mainly at the team and organizational levels. We identified low-quality, tentative evidence that capacity-building strategies coupled with dissemination-educational strategies may enable family nursing practice skills and increase the quality of family care. More rigorous research is needed to build further knowledge about effective implementation. Future implementation endeavors should utilize the evolving knowledge base in family nursing and tailor implementation strategies to contextual barriers.

Integrating the complexity of healthcare improvement with implementation science: a longitudinal qualitative case study

Background

Implementation science seeks to enable change, underpinned by theories and frameworks such as the Consolidated Framework for Implementation Research (CFIR). Yet academia and frontline healthcare improvement remain largely siloed, with limited integration of implementation science methods into frontline improvement where the drivers include pragmatic, rapid change. Using the CIFR lens, we aimed to explore how pragmatic and complex healthcare improvement and implementation science can be integrated.

Methods

Our research involved the investigation of a case study that was undertaking the implementation of an improvement intervention at a large public health service. Our research involved qualitative data collection methods of semi-structured interviews and non-participant observations of the implementation team delivering the intervention. Thematic analysis identified key themes from the qualitative data. We examined our themes through the lens of CFIR to gain in-depth understanding of how the CFIR components operated in a ‘real-world’ context.

Results

The key themes emerging from our research outlined that leadership, context and process are the key components that dominate and affect the implementation process. Leadership which cultivates connections with front line clinicians, fosters engagement and trust. Navigating context was facilitated by ‘bottom-up’ governance. Multi-disciplinary and cross-sector capability were key processes that supported pragmatic and agile responses in a changing complex environment. Process reflected the theoretically-informed, and iterative implementation approach. Mapping CFIR domains and constructs, with these themes demonstrated close alignment with the CFIR. The findings bring further depth to CFIR. Our research demonstrates that leadership which has a focus on patient need as a key motivator to engage clinicians, which applies and ensures iterative processes which leverage contextual factors can achieve successful, sustained implementation and healthcare improvement outcomes.

Conclusions

Our longitudinal study highlights insights that strengthen alignment between implementation science and pragmatic frontline healthcare improvement. We identify opportunities to enhance the relevance of CFIR in the ‘real-world’ setting through the interconnected nature of our themes. Our study demonstrates actionable knowledge to enhance the integration of implementation science in healthcare improvement.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-07505-5.

Identifying actionable strategies: using Consolidated Framework for Implementation Research (CFIR)-informed interviews to evaluate the implementation of a multilevel intervention to improve colorectal cancer screening

BACKGROUND

Many evidence-based interventions (EBIs) found to be effective in research studies often fail to translate into meaningful patient outcomes in practice. The purpose of this study was to identify facilitators and barriers that affect the implementation of three EBIs to improve colorectal cancer (CRC) screening in an urban federally qualified health center (FQHC) and offer actionable recommendations to improve future implementation efforts.

METHODS

We conducted 16 semi-structured interviews guided by the Consolidation Framework for Implementation Research (CFIR) to describe diverse stakeholders' implementation experience. The interviews were conducted in the participant's clinic, audio-taped, and professionally transcribed for analysis.

RESULTS

We used the five CFIR domains and 39 constructs and subconstructs as a coding template to conduct a template analysis. Based on experiences with the implementation of three EBIs, stakeholders described barriers and facilitators related to the intervention characteristics, outer setting, and inner setting. Implementation barriers included (1) perceived burden and provider fatigue with EHR (Electronic Health Record) provider reminders, (2) unreliable and ineffectual EHR provider reminders, (3) challenges to providing health care services to diverse patient populations, (4) lack of awareness about CRC screening among patients, (5) absence of CRC screening goals, (6) poor communication on goals and performance, and (7) absence of printed materials for frontline implementers to educate patients. Implementation facilitators included (1) quarterly provider assessment and feedback reports provided real-time data to motivate change, (2) integration with workflow processes, (3) pressure from funding requirement to report quality measures, (4) peer pressure to achieve high performance, and (5) a culture of teamwork and patient-centered mentality.

CONCLUSIONS

The CFIR can be used to conduct a post-implementation formative evaluation to identify barriers and facilitators that influenced the implementation. Furthermore, the CFIR can provide a template to organize research data and synthesize findings. With its clear terminology and meta-theoretical framework, the CFIR has the potential to promote knowledge-building for implementation. By identifying the contextual determinants, we can then determine implementation strategies to facilitate adoption and move EBIs to daily practice.

A scoping review of the use of ethnographic approaches in implementation research and recommendations for reporting

Background:

Researchers have argued for the value of ethnographic approaches to implementation science (IS). The contested meanings of ethnography pose challenges and possibilities to its use in IS. The goal of this study was to identify sources of commonality and variation, and to distill a set of recommendations for reporting ethnographic approaches in IS.

Methods:

We included in our scoping review English-language academic journal articles meeting two criteria: (1) IS articles in the healthcare field and (2) articles that described their approach as ethnographic. In March 2019, we implemented our search criteria in four academic databases and one academic journal. Abstracts were screened for inclusion by at least two authors. We iteratively develop a codebook for full-text analysis and double-coded included articles. We summarized the findings and developed reporting recommendations through discussion.

Results:

Of the 210 articles whose abstracts were screened, 73 were included in full-text analysis. The number of articles increased in recent years. Ethnographic approaches were used within a wide variety of theoretical approaches and research designs. Articles primarily described using interviews and observational methods as part of their ethnographic approaches, though numerous other methods were also employed. The most cited rationales for using ethnographic approaches were to capture context-specific phenomena, understand insiders’ perspective, and study complex interactions. In reporting on ethnographic approaches, we recommend that researchers provide information on researcher training and position, reflect on researchers’ positionality, describe observational methods in detail, and report results from all the methods used.

Conclusion:

The number of IS studies using ethnography has increased in recent years. Ethnography holds great potential for contributing further to IS, particularly to studying implementation strategy mechanisms and understanding complex adaptive systems.

Researchers have proposed that ethnographic methods may be valuable to implementation research and practice. Ethnographic approaches have their roots in the field of anthropology, but they are now used in many fields. These approaches often involve a researcher spending time in “real-world” settings, conducting interviews and observation to understand a group of people. That said, researchers disagree on the meaning of ethnography, which presents a challenge to its use in implementation science (IS). We searched for articles in the field of IS that described their methods as ethnographic. We then reviewed the articles, looking for similarities and differences in how and why ethnographic approaches were used. Many of these articles said they used ethnographic methods because they were interested in issues like context, research participants’ views, and complex interactions. We found a large amount of variation in how ethnographic methods were used. We developed recommendations for describing ethnographic methods in a way that readers can clearly understand. We also made several observations of the value ethnographic approaches can bring to IS. Ethnographic methods may be especially useful to studying unplanned and unexpected changes that take place during implementation. These recommendations and observations could be helpful to implementation researchers wishing to use ethnographic methods.

The Impact of Electronic Media on Patients with Inflammatory Bowel Disease

Introduction and Objectives

Patients with chronic illnesses, such as inflammatory bowel disease (IBD), may often consult the internet, which can cause anguish, fear, stress and anxiety. The aim of our study is to evaluate the use of the internet and its effects on patients with IBD.

Patients and Methods

This is a descriptive, cross-sectional study with quantitative frequency analysis. We applied a questionnaire comprising questions about internet use, and the DASS21 questionnaire to analyze internet impact on patients’ stress and/or anxiety for 36 months.

Results

A total of 104 patients were included over a period of 45 days (82% CD, 18% UC). The mean age was 41.3 years (±15.9 years). Internet use was more frequent in patients with a mean age of 39.5 years (±14.4 years), with the highest frequencies found in the age group of 26–36 years. Internet use were related to: 72.6% general information about the disease, 87.3% symptom information (42.1% once a week, 27.4% never, 18.8% once a month, 10.5% daily, and 3.2% twice a day). The most visited search engine was Google 63.7% and the most visited sites were: patient group sites 16.7%, health sites 16.2% medical sites 12.8%.

Conclusion

The internet is often a resource utilized by patients with IBD and although these patients sought to obtain more information about their disease and their symptoms. The internet was not a factor influencing anxiety and stress for these patients.

The STS case study: an analysis method for longitudinal qualitative research for implementation science

BACKGROUND

Ethnographic approaches offer a method and a way of thinking about implementation. This manuscript applies a specific case study method to describe the impact of the longitudinal interplay between implementation stakeholders. Growing out of science and technology studies (STS) and drawing on the latent archaeological sensibilities implied by ethnographic methods, the STS case-study is a tool for implementors to use when a piece of material culture is an essential component of an innovation.

METHODS

We conducted an ethnographic process evaluation of the clinical implementation of tele-critical care (Tele-CC) services in the Department of Veterans Affairs. We collected fieldnotes and conducted participant observation at virtual and in-person education and planning events (n = 101 h). At Go-Live and 6-months post-implementation, we conducted site visits to the Tele-CC hub and 3 partnered ICUs. We led semi-structured interviews with ICU staff at Go-Live (43 interviews with 65 participants) and with ICU and Tele-CC staff 6-months post-implementation (44 interviews with 67 participants). We used verification strategies, including methodological coherence, appropriate sampling, collecting and analyzing data concurrently, and thinking theoretically, to ensure the reliability and validity of our data collection and analysis process.

RESULTS

The STS case-study helped us realize that we must think differently about how a Tele-CC clinician could be noticed moving from communal to intimate space. To understand how perceptions of surveillance impacted staff acceptance, we mapped the materials through which surveillance came to matter in the stories staff told about cameras, buttons, chimes, motors, curtains, and doorbells.

CONCLUSIONS

STS case-studies contribute to the literature on longitudinal qualitive research (LQR) in implementation science, including pen portraits and periodic reflections. Anchored by the material, the heterogeneity of an STS case-study generates questions and encourages exploring differences. Begun early enough, the STS case-study method, like periodic reflections, can serve to iteratively inform data collection for researchers and implementors. The next step is to determine systematically how material culture can reveal implementation barriers and direct attention to potential solutions that address tacit, deeply rooted challenges to innovations in practice and technology.

Implementing a complex psychosocial intervention for unstably housed Veterans: A realist-informed evaluation case study

Background

Only 7% of individuals with co-occurring mental health and substance use disorder (COD) receive services for both conditions. We implemented and evaluated maintaining independence and sobriety through systems integration, outreach and networking-Veteran's edition (MISSION-Vet), an evidence-based manualized psychosocial intervention for Veterans with CODs. This paper identifies the generative mechanisms that explain "how, for whom, and under what conditions" MISSION-Vet adoption, implementation, and fidelity work when applied in a complex adaptive system with facilitation support.

Methods

Within two VA healthcare systems (Sites A and B), a hybrid III trial tested facilitation to implement MISSION-Vet. We conducted a two-site case study based on 42 semi-structured consolidated framework for implementation research (CFIR) guided interviews with site leadership, implementers (social workers, peer specialists), and team members (facilitators, site leads). Interviews were coded and CFIR constructs used to generate "Context  +  Mechanism  =  Outcome" configurations to understand the conditions of MISSION-Vet adoption, implementation, and fidelity.

Results

Site A was low, and Site B was high in adoption, implementation, and fidelity. Adoption hesitancy/eagerness (outcome) resulted from the interaction of "external policy" (context) dampening/encouraging a "tension for change" (mechanism). Implementation intensity (outcome) was based on how "peer pressure" or practice culture (context) activated staff "self-efficacy" (mechanism) to engage with MISSION-Vet and appraise its "relative advantage" over current practices (mechanism). Fidelity relied on how "staffing structure and availability" (context) activated/muted "facilitation" (mechanism) to result in strategy and intervention adaptation (outcome).

Conclusions

We delineated how specific contexts activated certain mechanisms to drive the different stages of implementation of a multi-faceted COD treatment intervention.

Trial registration

ClinicalTrials.gov, NCT02942979.

Plain language abstract

Implementation is inherently dynamic and influenced by interdependent factors operating at the individual, organizational, and system levels. This is especially true for complex interventions addressing co-occurring mental health and substance use disorders because such interventions involve multiple treatment modalities delivered simultaneously, in busy practice settings, with challenging populations. This paper pairs consolidated framework for implementation research (CFIR) constructs with a realist evaluation approached to generate configurations important to the adoption, implementation, and adaptation stages of a highly complex intervention addressing the behavioural health and housing needs of a vulnerable population. Each configuration describes how contextual factors trigger mechanisms to generate implementation outcomes and answers "what works for whom, in what circumstances and in what respects, and how?" These findings further our understanding of possible mechanisms of change and push us to be more precise about identifying causal relationships among constructs that contribute to the success of implementing complex interventions. This work also moves us to think theoretically and methodologically in a more dynamic fashion, thereby leading to more responsive implementation practice.

An overview of healthcare improvement: unpacking the complexity for clinicians and managers in a learning health system

Given the pace of technological advancement and government mandates for healthcare and system transformation, there is an imperative for change. Health systems are highly complex in their design, networks and interacting components, and experience demonstrates that change is very challenging to enact, sustain and scale. Policy-makers, academics and clinicians all need better insight into the nature of this complexity and an understanding of the evidence-base that can support healthcare improvement (HCI), or quality improvement, interventions and make them more effective in driving change. The evidence base demonstrates the vital role of clinical engagement and leadership in HCI, and it is imperative that clinicians engage to improve front-line healthcare. The literature on HCI is vast, applies different and inconsistent terminology and encompasses often loosely defined and overlapping concepts. An increasingly broad range of disciplines has contributed to the available evidence base, but often discipline-specific perspectives frame these contributions. Available literature can also be overly driven by the generation of theoretical concepts and the advancement of academic understanding. It does not necessarily primarily provide focussed and pragmatic insights to guide and inform frontline practice. We aim to address these issues by summarising theories, frameworks, models and success factors for improvement in complex health systems to assist clinicians and others to engage and lead change. We integrate the field of HCI into the learning health system highlighting the key role of the clinician. We seek to inform stakeholders; clinicians and managers to guide the planning, enacting, sustaining and scaling of HCI.

The use of the PARIHS framework in implementation research and practice-a citation analysis of the literature

BACKGROUND

The Promoting Action on Research Implementation in Health Services (PARIHS) framework was developed two decades ago and conceptualizes successful implementation (SI) as a function (f) of the evidence (E) nature and type, context (C) quality, and the facilitation (F), [SI = f (E,C,F)]. Despite a growing number of citations of theoretical frameworks including PARIHS, details of how theoretical frameworks are used remains largely unknown. This review aimed to enhance the understanding of the breadth and depth of the use of the PARIHS framework.

METHODS

This citation analysis commenced from four core articles representing the key stages of the framework's development. The citation search was performed in Web of Science and Scopus. After exclusion, we undertook an initial assessment aimed to identify articles using PARIHS and not only referencing any of the core articles. To assess this, all articles were read in full. Further data extraction included capturing information about where (country/countries and setting/s) PARIHS had been used, as well as categorizing how the framework was applied. Also, strengths and weaknesses, as well as efforts to validate the framework, were explored in detail.

RESULTS

The citation search yielded 1613 articles. After applying exclusion criteria, 1475 articles were read in full, and the initial assessment yielded a total of 367 articles reported to have used the PARIHS framework. These articles were included for data extraction. The framework had been used in a variety of settings and in both high-, middle-, and low-income countries. With regard to types of use, 32% used PARIHS in planning and delivering an intervention, 50% in data analysis, 55% in the evaluation of study findings, and/or 37% in any other way. Further analysis showed that its actual application was frequently partial and generally not well elaborated.

CONCLUSIONS

In line with previous citation analysis of the use of theoretical frameworks in implementation science, we also found a rather superficial description of the use of PARIHS. Thus, we propose the development and adoption of reporting guidelines on how framework(s) are used in implementation studies, with the expectation that this will enhance the maturity of implementation science.

The influence of contextual factors on healthcare quality improvement initiatives: a realist review

BACKGROUND

Recognising the influence of context and the context-sensitive nature of quality improvement (QI) interventions is crucial to implementing effective improvements and successfully replicating them in new settings, yet context is still poorly understood. To address this challenge, it is necessary to capture generalisable knowledge, first to understand which aspects of context are most important to QI and why, and secondly, to explore how these factors can be managed to support healthcare improvement, in terms of implementing successful improvement initiatives, achieving sustainability and scaling interventions. The research question was how and why does context influence quality improvement initiatives in healthcare?

METHODS

A realist review explored the contextual conditions that influence healthcare improvement. Realist methodology integrates theoretical understanding and stakeholder input with empirical research findings. The review aimed to identify and understand the role of context during the improvement cycle, i.e. planning, implementation, sustainability and transferability; and distil new knowledge to inform the design and development of context-sensitive QI initiatives. We developed a preliminary theory of the influence of context to arrive at a conceptual and theoretical framework.

RESULTS

Thirty-five studies were included in the review, demonstrating the interaction of key contextual factors across healthcare system levels during the improvement cycle. An evidence-based explanatory theoretical model is proposed to illustrate the interaction between contextual factors, system levels (macro, meso, micro) and the stages of the improvement journey. Findings indicate that the consideration of these contextual factors would enhance the design and delivery of improvement initiatives, across a range of improvement settings.

CONCLUSIONS

This is the first realist review of context in QI and contributes to a deeper understanding of how context influences quality improvement initiatives. The distillation of key contextual factors offers the potential to inform the design and development of context-sensitive interventions to enhance improvement initiatives and address the challenge of spread and sustainability. Future research should explore the application of our conceptual model to enhance improvement-planning processes.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42017062135.

'Mind the gaps': the accessibility and implementation of an effective depression relapse prevention programme in UK NHS services: learning from mindfulness-based cognitive therapy through a mixed-methods study

OBJECTIVES

Mindfulness-based cognitive therapy (MBCT) is an evidence-based approach for people at risk of depressive relapse to support their long-term recovery. However, despite its inclusion in guidelines, there is an 'implementation cliff'. The study objective was to develop a better explanation of what facilitates MBCT implementation.

SETTING

UK primary and secondary care mental health services.

DESIGN, PARTICIPANTS AND METHODS

A national two-phase, multi-method qualitative study was conducted, which was conceptually underpinned by the Promoting Action on Research Implementation in Health Services framework. Phase I involved interviews with stakeholders from 40 service providers about current provision of MBCT. Phase II involved 10 purposively sampled case studies to obtain a more detailed understanding of MBCT implementation. Data were analysed using adapted framework analysis, refined through stakeholder consultation.

RESULTS

Access to MBCT is variable across the UK services. Where available, services have adapted MBCT to fit their context by integrating it into their care pathways. Evidence was often important to implementation but took different forms: the NICE depression guideline, audits, evaluations, first person accounts, experiential taster sessions and pilots. These were used to build a platform from which to develop MBCT services. The most important aspect of facilitation was the central role of the MBCT implementers. These were generally self-designated individuals who 'championed' grass-roots implementation. Our explanatory framework mapped out a prototypical implementation journey, often over many years with a balance of bottom-up and top-down factors influencing the fit of MBCT into service pathways. 'Pivot points' in the implementation journey provided windows of either challenge or opportunity.

CONCLUSIONS

This is one of the largest systematic studies of the implementation of a psychological therapy. While access to MBCT across the UK is improving, it remains patchy. The resultant explanatory framework about MBCT implementation provides a heuristic that informed an implementation resource.

Patient Characteristics Associated with Receipt of Prescription Weight-Management Medications Among Veterans Participating in MOVE!

OBJECTIVE

Weight-management medications (WMM) are recommended for the treatment of obesity. This study examined characteristics associated with initial receipt of WMM among eligible veterans in the first year following enrollment in the Veterans Health Administration (VHA) MOVE! behavioral weight-management program.

METHODS

We conducted a retrospective cohort study of VHA patients with obesity or overweight and obesity-related comorbidities who enrolled in MOVE! from October 2013 to September 2016 (N = 153,939). Multivariable logistic regression models estimated predictors of having a filled prescription for WMM and for orlistat.

RESULTS

A total of 1.1% of these veterans received WMM. The most common WMM included orlistat (70.4%), phentermine/topiramate (11.2%), and bupropion/naltrexone (9.7%). Female sex, higher BMI, obstructive sleep apnea, osteoarthritis, depression, lower back pain, and alcohol abuse were associated with greater odds of use of WMM, whereas age over 65 years, Hispanic ethnicity, and required co-payments were associated with lower odds. Among patients receiving WMM, older age, black race, female sex, higher BMI, cardiovascular disease, lower back pain, and congestive heart failure were associated with use of orlistat versus any other WMM.

CONCLUSIONS

Of patients engaged in MOVE! in the VHA, 1.1% received WMM. WMM are underutilized among veterans. Additional research is needed to understand barriers to incorporating WMM into comprehensive obesity treatment plans.

What Influences Sustainment and Nonsustainment of Facilitation Activities in Implementation? Analysis of Organizational Factors in Hospitals Implementing TeamSTEPPS

Implementation processes are often long and complex, requiring sustained facilitation efforts. Drawing on organizational and implementation literature, we examined the influence of senior management support (SMS), middle management support (MMS), facilitator team time availability (TIME) and team continuity (CONTINUITY) on sustainment of internal facilitation activities. For 2 years, we followed 10 small rural hospitals implementing TeamSTEPPS, a patient safety program, and conducted quarterly interviews with key informants. We coded, calibrated, and analyzed the data using the fuzzy-set qualitative comparative analysis. We found that five hospitals sustained facilitation activities and the combination of SMS, MMS, and CONTINUITY (i.e., presence of all three factors) was a sufficient condition for sustainment. Five other hospitals did not sustain facilitation activities and they either lacked MMS or lacked both TIME and CONTINUITY. In follow-up analyses, we found that team leadership continuity also influenced sustainment patterns. We discussed the implications for research and practice.

Contextual Factors Associated With Quality Improvement Success in a Multisite Ambulatory Setting

The Model for Understanding Success in Quality (MUSIQ) is a framework of contextual factors for quality improvement (QI) projects. We sought to determine which MUSIQ contextual factors were associated with successful QI initiatives. In a cross-sectional survey study, at a 21-site, ambulatory, urban primary care network, a modified MUSIQ survey tool questionnaire was administered to QI team members. The primary analysis associated objective measures of QI success with MUSIQ contextual factors. Objective QI success was defined as reaching goal percentages of adult patients with diabetes achieving glycated hemoglobin less than 8% and/or pediatric patients who had received combination toddler vaccines. Objective outcomes were compared with a subjective, self-reported outcome measure of QI success because previous literature found subjective outcomes were associated with specific MUSIQ factors. In the 143 survey responses collected, across 21 sites, no contextual factors from the MUSIQ survey were associated with either the adult or pediatric objective measure of QI project success. In a post hoc analysis, objective and subjective measures of success were often not associated and/or negatively correlated. In conclusion, contextual factors were not associated with objective measures of QI outcomes, in contrast to previous studies finding associations with subjective QI outcome measures.

Pace and determinants of implementation of the self-management of well-being group intervention: a multilevel observational study

Background

When implementing an empirically supported intervention (ESI) arrays of influencing factors operate on the professional and organizational level, but so far dependency between these levels has often been ignored. The aim of this study is to describe the pace and identify determinants of implementation of the Self-Management of Well-being (SMW) group intervention while taking the dependency between professionals and organizations into account.

Methods

Pace of implementation was measured as the time between training of professionals and first use of the SMW intervention in months. Determinants of first use were derived from the Fleuren framework and assessed using web-based questionnaires and telephone interviews. First, univariate analyses, Fisher’s exact tests and t-tests, were performed to identify determinants of first use of the SMW intervention on the individual professional and the organizational level independently. Second, multilevel analyses were performed to correct for the dependency between professionals and organizations. Simple multilevel logistic regression analyses were performed with determinants found significant in the univariate analyses as independent variables, first use as dependent variable, professionals entered in the first level, and organizations in the second level.

Results

Forty-eight professionals from 18 organizations were trained to execute the SMW intervention. Thirty-two professionals achieved first use, at a mean pace of 7.5 months ± 4.2. Determinants on the professional level were ‘ownership’, ‘relative advantage’, ‘support from colleagues’ and ‘compatibility’. Determinants on the organizational level were ‘organizational size’ and ‘innovation-task orientation fit’. Multilevel analysis showed that ‘compatibility’, a factor on the professional level, was the only significant determinant contributing to first use in the multilevel model.

Conclusions

This implementation study revealed a strong dependency between professionals and organizations. Results showed that a majority of professionals used the SMW intervention in about 8 months. When the dependency between professionals and organization was taken into account, the professionals’ perception of compatibility was the only remaining determinant of implementation on the professional level. Organizational size and managers’ perception of ‘innovation-task orientation fit’ were determinants of implementation on the organizational level. It is advisable to discuss the compatibility between new and current tasks among managers and professionals before adopting a new intervention.

Electronic supplementary material

The online version of this article (10.1186/s12913-019-3891-x) contains supplementary material, which is available to authorized users.

Periodic reflections: a method of guided discussions for documenting implementation phenomena

BACKGROUND

Ethnography has been proposed as a valuable method for understanding how implementation occurs within dynamic healthcare contexts, yet this method can be time-intensive and challenging to operationalize in pragmatic implementation. The current study describes an ethnographically-informed method of guided discussions developed for use by a multi-project national implementation program.

METHODS

The EMPOWER QUERI is conducting three projects to implement innovative care models in VA women's health for high-priority health concerns - prediabetes, cardiovascular risk, and mental health - utilizing the Replicating Effective Programs (REP) implementation strategy enhanced with stakeholder engagement and complexity science. Drawing on tenets of ethnographic research, we developed a lightly-structured method of guided "periodic reflections" to aid in documenting implementation phenomena over time. Reflections are completed as 30-60 min telephone discussions with implementation team members at monthly or bi-monthly intervals, led by a member of the implementation core. Discussion notes are coded to reflect key domains of interest and emergent themes, and can be analyzed singly or in triangulation with other qualitative and quantitative assessments to inform evaluation and implementation activities.

RESULTS

Thirty structured reflections were completed across the three projects during a 15-month period spanning pre-implementation, implementation, and sustainment activities. Reflections provide detailed, near-real-time information on projects' dynamic implementation context, including characteristics of implementation settings and changes in the local or national environment, adaptations to the intervention and implementation plan, and implementation team sensemaking and learning. Reflections also provide an opportunity for implementation teams to engage in recurring reflection and problem-solving.

CONCLUSIONS

To implement new, complex interventions into dynamic organizations, we must better understand the implementation process as it unfolds in real time. Ethnography is well suited to this task, but few approaches exist to aid in integrating ethnographic insights into implementation research. Periodic reflections show potential as a straightforward and low-burden method for documenting events across the life cycle of an implementation effort. They offer an effective means for capturing information on context, unfolding process and sensemaking, unexpected events, and diverse viewpoints, illustrating their value for use as part of an ethnographically-minded implementation approach.

TRIAL REGISTRATION

The two implementation research studies described in this article have been registered as required: Facilitating Cardiovascular Risk Screening and Risk Reduction in Women Veterans (NCT02991534); and Implementation of Tailored Collaborative Care for Women Veterans (NCT02950961).

Implementing infection prevention practices across European hospitals: an in-depth qualitative assessment

Objective

The Prevention of Hospital Infections by Intervention and Training (PROHIBIT) project included a cluster-randomised, stepped wedge, controlled study to evaluate multiple strategies to prevent catheter-related bloodstream infection. We report an in-depth investigation of the main barriers, facilitators and contextual factors relevant to successfully implementing these strategies in European acute care hospitals.

Methods

Qualitative comparative case study in 6 of the 14 European PROHIBIT hospitals. Data were collected through interviews with key stakeholders and ethnographic observations conducted during 2-day site visits, before and 1 year into the PROHIBIT intervention. Qualitative measures of implementation success included intervention fidelity, adaptation to local context and satisfaction with the intervention programme.

Results

Three meta-themes emerged related to implementation success: ‘implementation agendas’, ‘resources’ and ‘boundary-spanning’. Hospitals established unique implementation agendas that, while not always aligned with the project goals, shaped subsequent actions. Successful implementation required having sufficient human and material resources and dedicated change agents who helped make the intervention an institutional priority. The salary provided for a dedicated study nurse was a key facilitator. Personal commitment of influential individuals and boundary spanners helped overcome resource restrictions and intrainstitutional segregation.

Conclusion

This qualitative study revealed patterns across cases that were associated with successful implementation. Consideration of the intervention–context relation was indispensable to understanding the observed outcomes.

Evidence-Based Best Practices for Outpatient Management of Warfarin

Many best practices have been described for organizing a clinic to manage warfarin. Although these practices may have face validity, they may not be based on empirical analysis. Here, we describe our decade-long effort to apply the Structure-Process-Outcome model of quality measurement as a basis for measuring and improving outpatient warfarin management in the Veterans Health Administration. The purpose of the article is to raise awareness of this body of work with pharmacists who could potentially incorporate the findings of this work into their own practice settings. We conclude with concrete suggestions for immediate implementation in clinical settings.

A qualitative study of implementation and adaptations to Progressive Tinnitus Management (PTM) delivery

Background

Tinnitus is a common condition, especially prevalent among military Veterans. Progressive Tinnitus Management (PTM) is an interdisciplinary, structured, stepped-care approach to providing clinical services, including teaching coping skills, to people bothered by tinnitus. PTM has been shown to be effective at reducing functional distress, but implementation of the intervention outside of a research setting has not been studied, even though dissemination is underway within the Veterans Health Administration (VHA) system in the United States. This study was designed to address a gap in knowledge of PTM clinical implementation to date, with a focus on factors facilitating or hindering implementation in VHA audiology and mental health clinic contexts, and whether implementing sites had developed intervention adaptations.

Methods

Qualitative interviews were conducted with 21 audiology and mental health clinicians and service chiefs across a regional service network. Interviews were transcribed and coded using a hybrid inductive-deductive analytic approach guided by existing implementation research frameworks and then iteratively developed for emergent themes.

Results

PTM prioritization was rare overall, with providers across disciplines challenged by lack of capacity for implementation, but with differences by discipline in challenges to prioritization. Where PTM was prioritized and delivered, this was facilitated by perception of unique value, provider’s own experience of tinnitus, observation/experience with PTM delivery, intervention fit with provider’s skills, and an environment with supportive leadership and adaptive reserve. PTM was frequently adapted to local contexts to address delivery challenges and diversify patient options. Adaptations included shifting from group to individual formats, reducing or combining sessions, and employing novel therapeutic approaches.

Conclusions

Existing adaptations highlight the need to better understand mechanisms underlying PTM’s effectiveness, and research on the impact of adaptations on patient outcomes is an important next step. Prioritization of PTM is a key barrier to the scale up and spread of this evidence-based intervention. Developing clinician champions may facilitate dissemination, especially if accompanied by signals of systemic prioritization. Novel approaches exposing clinicians and administrators to PTM may identify and develop clinical champions. Acknowledging the potential for PTM adaptations may make delivery more feasible in the context of existing system constraints and priorities.

Organizational contextual features that influence the implementation of evidence-based practices across healthcare settings: a systematic integrative review

BACKGROUND

Organizational contextual features have been recognized as important determinants for implementing evidence-based practices across healthcare settings for over a decade. However, implementation scientists have not reached consensus on which features are most important for implementing evidence-based practices. The aims of this review were to identify the most commonly reported organizational contextual features that influence the implementation of evidence-based practices across healthcare settings, and to describe how these features affect implementation.

METHODS

An integrative review was undertaken following literature searches in CINAHL, MEDLINE, PsycINFO, EMBASE, Web of Science, and Cochrane databases from January 2005 to June 2017. English language, peer-reviewed empirical studies exploring organizational context in at least one implementation initiative within a healthcare setting were included. Quality appraisal of the included studies was performed using the Mixed Methods Appraisal Tool. Inductive content analysis informed data extraction and reduction.

RESULTS

The search generated 5152 citations. After removing duplicates and applying eligibility criteria, 36 journal articles were included. The majority (n = 20) of the study designs were qualitative, 11 were quantitative, and 5 used a mixed methods approach. Six main organizational contextual features (organizational culture; leadership; networks and communication; resources; evaluation, monitoring and feedback; and champions) were most commonly reported to influence implementation outcomes in the selected studies across a wide range of healthcare settings.

CONCLUSIONS

We identified six organizational contextual features that appear to be interrelated and work synergistically to influence the implementation of evidence-based practices within an organization. Organizational contextual features did not influence implementation efforts independently from other features. Rather, features were interrelated and often influenced each other in complex, dynamic ways to effect change. These features corresponded to the constructs in the Consolidated Framework for Implementation Research (CFIR), which supports the use of CFIR as a guiding framework for studies that explore the relationship between organizational context and implementation. Organizational culture was most commonly reported to affect implementation. Leadership exerted influence on the five other features, indicating it may be a moderator or mediator that enhances or impedes the implementation of evidence-based practices. Future research should focus on how organizational features interact to influence implementation effectiveness.

Using implementation facilitation to foster clinical practice quality and adherence to evidence in challenged settings: a qualitative study

Background

We evaluated a facilitation strategy to help clinical sites likely to experience challenges implement evidence-based Primary Care-Mental Health Integration (PC-MHI) care models within the context of a Department of Veterans Affairs (VA) initiative. This article describes our assessment of whether implementation facilitation (IF) can foster development of high quality PC-MHI programs that adhere to evidence, are sustainable and likely to improve clinical practices and outcomes.

Methods

Utilizing a matched pair design, we conducted a qualitative descriptive evaluation of the IF strategy in sixteen VA primary care clinics. To assess program quality and adherence to evidence, we conducted one-hour structured telephone interviews, at two time points, with clinicians and leaders who knew the most about the clinics’ programs. We then created structured summaries of the interviews that VA national PC-MHI experts utilized to rate the programs on four dimensions (overall quality, adherence to evidence, sustainability and level of improvement).

Results

At first assessment, seven of eight IF sites and four of eight comparison sites had implemented a PC-MHI program. Our qualitative assessment suggested that experts rated IF sites’ programs higher than comparison sites’ programs with one exception. At final assessment, all eight IF but only five comparison sites had implemented a PC-MHI program. Again, experts rated IF sites’ programs higher than their matched comparison sites with one exception. Over time, all ratings improved in five of seven IF sites and two of three comparison sites.

Conclusions

Implementing complex evidence-based programs, particularly in settings that lack infrastructure, resources and support for such efforts, is challenging. Findings suggest that a blend of external expert and internal regional facilitation strategies that implementation scientists have developed and tested can improve PC-MHI program uptake, quality and adherence to evidence in primary care clinics with these challenges. However, not all sites showed these improvements. To be successful, facilitators likely need at least a moderate level of leaders’ support, including provision of basic resources. Additionally, we found that IF and strength of leadership structure may have a synergistic effect on ability to implement higher quality and evidence-based programs.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-017-2217-0) contains supplementary material, which is available to authorized users.

Forming and activating an internal facilitation group for successful implementation: A qualitative study

BACKGROUND

This study focuses on an implementation facilitation strategy to improve the delivery of anticoagulation care within pharmacy-run clinics across 8 Veterans Health Administration (VA) medical centers. Other studies have explored various models of implementation facilitation, including external facilitation (EF), internal facilitation (IF), and blended facilitation (BF) combining both approaches. This study focuses on the use of an internal facilitation team of anticoagulation coordinators representing 8 VA anticoagulation clinics to enhance the implementation process. This study examines how the team became instrumental in the successful implementation of evidence-based practice change.

METHODS

Semi-structured interviews were conducted annually over 4 years with representatives from each site, the internal facilitators (site champions), at 8 VA hospitals (47 interviews). Additionally, five external facilitators, experts in quality improvement and anticoagulation care who guided the implementation, were interviewed. Analysis drew on a deductive approach based on the Promoting Action on Research Implementation in Health Services (PARIHS) model and emergent thematic analysis to identify factors related to effectiveness of the internal facilitation team.

RESULTS

Key findings are that the following factors enhanced successful uptake of the anticoagulation initiative: 1) Regular participation by the site champion in the internal facilitation team; 2) Champion strongly committed to being an agent of change; and 3) Champion received greater support from their supervisors. The first and second factors are interrelated, as internal facilitators who actively and regularly participated in the internal facilitation team often became truly committed to the improvement project. Both factors relate to the third, as supervisor support not only facilitated changes in practice, but also facilitated regular team attendance and stronger participation.

CONCLUSIONS

Our study adds to implementation science by detailing how internal facilitators learn their skills over time, and how a group of internal facilitators can help each other succeed. These findings can guide those who wish to incorporate internal facilitation teams as an implementation strategy, and demonstrate how sites can build capacity for implementation efforts.

SYNOPSIS

This study focuses on an implementation facilitation strategy to improve the delivery of anticoagulation care within pharmacy-run clinics across 8 Veterans Health Administration medical centers. Internal facilitators (IFs) guided by and supported by an external facilitators (EF), successfully implemented the clinical innovation. This study examines how the IF group became instrumental in the successful implementation of evidence-based practice change.

Study protocol: improving the transition of care from a non-network hospital back to the patient's medical home

Background

The process of transitioning Veterans to primary care following a non-Veterans Affairs (VA) hospitalization can be challenging. Poor transitions result in medical complications and increased hospital readmissions. The goal of this transition of care quality improvement (QI) project is to identify gaps in the current transition process and implement an intervention that bridges the gap and improves the current transition of care process within the Eastern Colorado Health Care System (ECHCS).

Methods

We will employ qualitative methods to understand the current transition of care process back to VA primary care for Veterans who received care in a non-VA hospital in ECHCS. We will conduct in-depth semi-structured interviews with Veterans hospitalized in 2015 in non-VA hospitals as well as both VA and non-VA providers, staff, and administrators involved in the current care transition process. Participants will be recruited using convenience and snowball sampling. Qualitative data analysis will be guided by conventional content analysis and Lean Six Sigma process improvement tools. We will use VA claim data to identify the top ten non-VA hospitals serving rural and urban Veterans by volume and Veterans that received inpatient services at non-VA hospitals.

Informed by both qualitative and quantitative data, we will then develop a transitions care coordinator led intervention to improve the transitions process. We will test the transition of care coordinator intervention using repeated improvement cycles incorporating salient factors in value stream mapping that are important for an efficient and effective transition process. Furthermore, we will complete a value stream map of the transition process at two other VA Medical Centers and test whether an implementation strategy of audit and feedback (the value stream map of the current transition process with the Transition of Care Dashboard) versus audit and feedback with Transition Nurse facilitation of the process using the Resource Guide and Transition of Care Dashboard improves the transition process, continuity of care, patient satisfaction and clinical outcomes.

Discussion

Our current transition of care process has shortcomings. An intervention utilizing a transition care coordinator has the potential to improve this process. Transitioning Veterans to primary care following a non-VA hospitalization is a crucial step for improving care coordination for Veterans

Results of a Regional Effort to Improve Warfarin Management

BACKGROUND

Improved anticoagulation control with warfarin reduces adverse events and represents a target for quality improvement. No previous study has described an effort to improve anticoagulation control across a health system.

OBJECTIVE

To describe the results of an effort to improve anticoagulation control in the New England region of the Veterans Health Administration (VA).

METHODS

Our intervention encompassed 8 VA sites managing warfarin for more than 5000 patients in New England (Veterans Integrated Service Network 1 [VISN 1]). We provided sites with a system to measure processes of care, along with targeted audit and feedback. We focused on processes of care associated with site-level anticoagulation control, including prompt follow-up after out-of-range international normalized ratio (INR) values, minimizing loss to follow-up, and use of guideline-concordant INR target ranges. We used a difference-in-differences (DID) model to examine changes in anticoagulation control, measured as percentage time in therapeutic range (TTR), as well as process measures and compared VISN 1 sites with 116 VA sites located outside VISN 1.

RESULTS

VISN 1 sites improved on TTR, our main indicator of quality, from 66.4% to 69.2%, whereas sites outside VISN 1 improved from 65.9% to 66.4% (DID 2.3%, P < 0.001). Improvement in TTR correlated strongly with the extent of improvement on process-of-care measures, which varied widely across VISN 1 sites.

CONCLUSIONS

A regional quality improvement initiative, using performance measurement with audit and feedback, improved TTR by 2.3% more than control sites, which is a clinically important difference. Improving relevant processes of care can improve outcomes for patients receiving warfarin.

A Practical Guide to Using the Positive Deviance Method in Health Services Research

OBJECTIVE

To provide practical tips for health services researchers considering the use of positive deviance (PD) methods to help explain variations in quality of care or other meaningful parameters.

DATA SOURCES

Published literature and personal experience.

STUDY DESIGN

Narrative review.

PRINCIPAL FINDINGS

This review includes a discussion of possible applications of PD to health services research, some methodological choices applicable to PD, and some brief tips regarding publishing the results and incorporating them into future interventions.

CONCLUSIONS

It is hoped that this article will help health services researchers to use this valuable research method more effectively, especially those who have not done so before.