Factors Influencing Implementation of a Colorectal Cancer Screening Improvement Program in Community Health Centers: an Applied Use of Configurational Comparative Methods

The difference-making role of staff support in implementing nurse care management for opioid use disorder treatment: A configurational analysis

INTRODUCTION

Understanding conditions in which interventions succeed or fail is critical. The PRimary care Opioid Use Disorders treatment (PROUD) trial, a cluster-randomized hybrid study, tested whether implementation of office-based addiction treatment supported by a nurse increased medication of OUD. Six health systems each provided two primary care (PC) clinics that were randomly assigned to implement the intervention or usual care. This secondary, exploratory study used an innovative mixed methods approach to understand contextual factors that consistently distinguished intervention clinics that increased OUD treatment from those that did not.

METHODS

The study collected contextual information through field notes, health system debriefs, and nurse interviews. Rapid qualitative analysis using a template based on the Practical, Robust Implementation and Sustainability Model identified themes reflecting the external environment, recipients, and implementation infrastructure. The study used qualitative themes to create binary factors reflecting barriers and facilitators potentially critical to implementation success and assigned clinics a factor value of 1 if present and 0 if absent. Two clinic-level outcomes were defined: 1) significant increase in patient-years of OUD treatment from baseline to two-year follow-up; and 2) high rate of OUD treatment at two-year follow-up (≥20 per 10,000 patient-years). Coincidence analysis, a cross-case configurational method, identified difference-makers for both OUD outcomes across intervention clinics.

RESULTS

Qualitative analysis yielded 11 themes which were dichotomized and consolidated into 9 factors. Two factor values perfectly distinguished between intervention clinics with and without increased OUD treatment (outcome #1): (a) presence of strong support from PC staff and providers and (b) lack of OUD treatment in the community. Intervention clinics increased OUD treatment when either factor value was present; when both were absent, clinics did not increase treatment. Strong support from PC staff and providers was independently sufficient to achieve high rates of OUD treatment (outcome #2) while the absence of support explained low rates of treatment. Importantly, strong support from leadership was not sufficient for either outcome.

CONCLUSION

Strong support from staff and providers consistently differentiated between clinics with increased OUD treatment across both outcomes in the PROUD trial from those without. OUD programs should consider increasing support across clinic roles.

Diagnostic safety and quality optimization in sepsis study protocol

BACKGROUND

Sepsis ranks among the "Big Three" conditions most prone to harmful diagnostic errors. Despite its high prevalence and severity, health systems lack effective and contextually tailored strategies to optimize diagnostic accuracy for sepsis.

OBJECTIVES

The purpose of this study is to understand factors related to high sepsis diagnostic accuracy using principles and tools of safety and implementation science.

METHODS

This is a multi-site study involving 20 hospitals across four states in the United States. The primary objectives are to (1) describe hospital-level variability and understand barriers and facilitators to sepsis diagnostic accuracy and (2) apply cross-case and coincidence analysis to determine minimally sufficient and necessary conditions for optimal sepsis diagnosis that minimizes under- and overtreatment. To identify barriers and facilitators of acute sepsis diagnosis, we will conduct electronic surveys and in-depth interviews with key informants from each hospital. We will use data from electronic health records (EHR) and data warehouses to operationalize sepsis diagnostic accuracy.

RESULTS

We have enrolled 20 hospitals and begum data collection. The findings of this study will be used to develop a context-specific toolkit that guides the selection of feasible and important strategies to promote optimal sepsis diagnosis in diverse hospitals settings.

CONCLUSIONS

The study uses tools and principles from safety and implementation science to generate first-of-its-kind evidence to improve diagnostic excellence in sepsis.

Organizational readiness for implementation: a qualitative assessment to explain survey responses

BACKGROUND

One factor considered essential to successful implementation is organizational readiness. The purpose of this study was to explore ways to improve the measurement of organizational readiness, and in particular to refine a preliminary measure based on the Readiness = Motivation x innovation Specific Capacity x General Capacity (R = MC2) heuristic. We assessed the experiences of staff in Federally Qualified Health Centers (FQHC) implementing evidence-based interventions (EBIs) designed to increase colorectal cancer screening (CRCS) who previously completed the survey and aimed to understand their perspectives on why our data were positively skewed.

METHODS

We conducted a series of qualitative interviews with FQHC employees who had previously completed the readiness survey and/or been involved with the distribution of the readiness survey. Interviews were conducted via Zoom, recorded, transcribed. Data was analyzed using an inductive approach to identify key emergent themes.

RESULTS

Analyses revealed numerous contributors to high organizational readiness assessment scores including concerns about confidentiality, social desirability bias, knowledge of respondents about the survey content, and the survey format. Specific to the survey format, we found that survey length and response scaling likely impacted scores and the overall survey experience. Lastly, some participants shared that the tendency for high scores may reflect actual perceptions because FQHC staff are passionate, work well in teams, and typically have already worked hard to improve CRCS rates through evidence-based interventions.

CONCLUSION

Study findings reinforce the importance of collaborative and community-engaged survey design and the need to address the common challenges dissemination and implementation surveys may be vulnerable to. Lessons learned can be applied to other measurement work and surveys conducted across public health research. The findings will inform continued organizational readiness measure development and have implications for measurement of other factors influencing implementation.

Barriers and proposed solutions to at-home colorectal cancer screening tests in medically underserved health centers across three US regions to inform a randomized trial

INTRODUCTION

At-home colorectal cancer (CRC) screening is an effective way to reduce CRC mortality, but screening rates in medically underserved groups are low. To plan the implementation of a pragmatic randomized trial comparing two population-based outreach approaches, we conducted qualitative research on current processes and barriers to at-home CRC screening in 10 community health centers (CHCs) that serve medically underserved groups, four each in Massachusetts and California, and two tribal facilities in South Dakota.

METHODS

We conducted 53 semi-structured interviews with clinical and administrative staff at the participating CHCs. Participants were asked about CRC screening processes, categorized into eight domains: patient identification, outreach, risk assessment, fecal immunochemical test (FIT) workflows, FIT-DNA (i.e., Cologuard) workflows, referral for a follow-up colonoscopy, patient navigation, and educational materials. Transcripts were analyzed using a Rapid Qualitative Analysis approach. A matrix was used to organize and summarize the data into four sub-themes: current process, barriers, facilitators, and solutions to adapt materials for the intervention.

RESULTS

Each site's process for stool-based CRC screening varied slightly. Interviewees identified the importance of offering educational materials in English and Spanish, using text messages to remind patients to return kits, adapting materials to address health literacy needs so patients can access instructions in writing, pictures, or video, creating mailed workflows integrated with a tracking system, and offering patient navigation to colonoscopy for patients with an abnormal result.

CONCLUSION

Proposed solutions across the three regions will inform a multilevel intervention in a pragmatic trial to increase CRC screening uptake in CHCs.

Factors Affecting Post-trial Sustainment or De-implementation of Study Interventions: A Narrative Review

In contrast to traditional randomized controlled trials, embedded pragmatic clinical trials (ePCTs) are conducted within healthcare settings with real-world patient populations. ePCTs are intentionally designed to align with health system priorities leveraging existing healthcare system infrastructure and resources to ease intervention implementation and increase the likelihood that effective interventions translate into routine practice following the trial. The NIH Pragmatic Trials Collaboratory, funded by the National Institutes of Health (NIH), supports the conduct of large-scale ePCT Demonstration Projects that address major public health issues within healthcare systems. The Collaboratory has a unique opportunity to draw on the Demonstration Project experiences to generate lessons learned related to ePCTs and the dissemination and implementation of interventions tested in ePCTs. In this article, we use case studies from six completed Demonstration Projects to summarize the Collaboratory's experience with post-trial interpretation of results, and implications for sustainment (or de-implementation) of tested interventions. We highlight three key lessons learned. First, ineffective interventions (i.e., ePCT is null for the primary outcome) may be sustained if they have other measured benefits (e.g., secondary outcome or subgroup) or even perceived benefits (e.g., staff like the intervention). Second, effective interventions-even those solicited by the health system and/or designed with significant health system partner buy-in-may not be sustained if they require significant resources. Third, alignment with policy incentives is essential for achieving sustainment and scale-up of effective interventions. Our experiences point to several recommendations to aid in considering post-trial sustainment or de-implementation of interventions tested in ePCTs: (1) include secondary outcome measures that are salient to health system partners; (2) collect all appropriate data to allow for post hoc analysis of subgroups; (3) collect experience data from clinicians and staff; (4) engage policy-makers before starting the trial.

Reducing sickness absence among public-sector healthcare employees: the difference-making roles of managerial and employee participation

PURPOSE

Evaluations of organizational-level interventions to prevent work-related illness have identified enabling factors, but knowledge of necessary and sufficient conditions for intervention success is needed. The aim was to identify difference-making factors that distinguish intervention groups with and without a positive intervention effect on sickness absence.

METHODS

An organizational-level intervention designed to decrease sickness absence by providing support from process facilitators was implemented at eight healthcare workplaces in Sweden between 2017 and 2018. We applied coincidence analysis (CNA) to analyze 34 factors and determine which factors were necessary and sufficient for a successful implementation of tailored interventional measures on an organizational level (dichotomous) and reduced sickness absence (trichotomous).

RESULTS

Two factors perfectly explained both the presence and absence of a successful implementation: "a high sense of urgency" and "good anchoring and participation from the strategic management". The presence of either of these factors alone was sufficient for successful implementation, whereas the joint absence of both conditions was necessary and sufficient for the absence of successful implementation and an intervention effect. In addition, high employee participation was both necessary and sufficient for a high intervention effect. For organizations without high employee participation, successful implementation led to a medium-effect size.

CONCLUSIONS

This study identified participation as a difference-maker in the implementation process. Participation from different stakeholders turned out to be important in different phases. When implementing organizational-level interventions, high participation from both strategic management and employees appears to be crucial in terms of the intervention's effect on sickness absence.

Realizing the Potential of Social Determinants Data: A Scoping Review of Approaches for Screening, Linkage, Extraction, Analysis and Interventions

Background

Social determinants of health (SDoH) like socioeconomics and neighborhoods strongly influence outcomes, yet standardized SDoH data is lacking in electronic health records (EHR), limiting research and care quality.

Methods

We searched PubMed using keywords "SDOH" and "EHR", underwent title/abstract and full-text screening. Included records were analyzed under five domains: 1) SDoH screening and assessment approaches, 2) SDoH data collection and documentation, 3) Use of natural language processing (NLP) for extracting SDoH, 4) SDoH data and health outcomes, and 5) SDoH-driven interventions.

Results

We identified 685 articles, of which 324 underwent full review. Key findings include tailored screening instruments implemented across settings, census and claims data linkage providing contextual SDoH profiles, rule-based and neural network systems extracting SDoH from notes using NLP, connections found between SDoH data and healthcare utilization/chronic disease control, and integrated care management programs executed. However, considerable variability persists across data sources, tools, and outcomes.

Discussion

Despite progress identifying patient social needs, further development of standards, predictive models, and coordinated interventions is critical to fulfill the potential of SDoH-EHR integration. Additional database searches could strengthen this scoping review. Ultimately widespread capture, analysis, and translation of multidimensional SDoH data into clinical care is essential for promoting health equity.

Methods for scaling up an outreach intervention to increase colorectal cancer screening rates in rural areas

BACKGROUND

Mailed fecal immunochemical test (FIT) outreach and patient navigation are evidence-based practices shown to improve rates of colorectal cancer (CRC) and follow-up in various settings, yet these programs have not been broadly adopted by health systems and organizations that serve diverse populations. Reasons for low adoption rates are multifactorial, and little research explores approaches for scaling up a complex, multi-level CRC screening outreach intervention to advance equity in rural settings.

METHODS

SMARTER CRC, a National Cancer Institute Cancer Moonshot project, is a cluster-randomized controlled trial of a mailed FIT and patient navigation program involving 3 Medicaid health plans and 28 rural primary care practices in Oregon and Idaho followed by a national scale-up trial. The SMARTER CRC intervention combines mailed FIT outreach supported by clinics, health plans, and vendors and patient navigation for colonoscopy following an abnormal FIT result. We applied the framework from Perez and colleagues to identify the intervention's components (including functions and forms) and scale-up dissemination strategies and worked with a national advisory board to support scale-up to additional organizations. The team is recruiting health plans, primary care clinics, and regional and national organizations in the USA that serve a rural population. To teach organizations about the intervention, activities include Extension for Community Healthcare Outcomes (ECHO) tele-mentoring learning collaboratives, a facilitation guide and other materials, a patient navigation workshop, webinars, and individualized technical assistance. Our primary outcome is program adoption (by component), measured 6 months after participation in an ECHO learning collaborative. We also assess engagement and adaptations (implemented and desired) to learn how the multicomponent intervention might be modified to best support broad scale-up.

DISCUSSION

Findings may inform approaches for adapting and scaling evidence-based approaches to promote CRC screening participation in underserved populations and settings.

TRIAL REGISTRATION

Registered at ClinicalTrials.gov (NCT04890054) and at the NCI's Clinical Trials Reporting Program (CTRP no.: NCI-2021-01032) on May 11, 2021.

Understanding Whether and How a Digital Health Intervention Improves Transition Care for Emerging Adults Living With Type 1 Diabetes: Protocol for a Mixed Methods Realist Evaluation

BACKGROUND

Emerging adults living with type 1 diabetes (T1D) face a series of challenges with self-management and decreased health system engagement, leading to an increased risk of acute complications and hospital admissions. Effective and scalable strategies are needed to support this population to transfer seamlessly from pediatric to adult care with sufficient self-management capability. While digital health interventions for T1D self-management are a promising strategy, it remains unclear which elements work, how, and for which groups of individuals.

OBJECTIVE

This study aims to evaluate the design and implementation of a multicomponent SMS text message-based digital health intervention to support emerging adults living with T1D in real-world settings. The objectives are to identify the intervention components and associated mechanisms that support user engagement and T1D health care transition experiences and determine the individual characteristics that influence the implementation process.

METHODS

We used a realist evaluation embedded alongside a randomized controlled trial, which uses a sequential mixed methods design to analyze data from multiple sources, including intervention usage data, patient-reported outcomes, and realist interviews. In step 1, we conducted a document analysis to develop a program theory that outlines the hypothesized relationships among "individual-level contextual factors, intervention components and features, mechanisms, and outcomes," with special attention paid to user engagement. Among them, intervention components and features depict 10 core characteristics such as transition support information, problem-solving information, and real-time interactivity. The proximal outcomes of interest include user engagement, self-efficacy, and negative emotions, whereas the distal outcomes of interest include transition readiness, self-blood glucose monitoring behaviors, and blood glucose. In step 2, we plan to conduct semistructured realist interviews with the randomized controlled trial's intervention-arm participants to test the hypothesized "context-intervention-mechanism-outcome" configurations. In step 3, we plan to triangulate all sources of data using a coincidence analysis to identify the necessary combinations of factors that determine whether and how the desired outcomes are achieved and use these insights to consolidate the program theory.

RESULTS

For step 1 analysis, we have developed the initial program theory and the corresponding data collection plan. For step 2 analysis, participant enrollment for the randomized controlled trial started in January 2023. Participant enrollment for this realist evaluation was anticipated to start in July 2023 and continue until we reached thematic saturation or achieved informational power.

CONCLUSIONS

Beyond contributing to knowledge on the multiple pathways that lead to successful engagement with a digital health intervention as well as target outcomes in T1D care transitions, embedding the realist evaluation alongside the trial may inform real-time intervention refinement to improve user engagement and transition experiences. The knowledge gained from this study may inform the design, implementation, and evaluation of future digital health interventions that aim to improve transition experiences.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/46115.

The role of organizational capacity in intervention efficacy in a church-based cancer education program: A configurational analysis

It is well-established in the field of implementation science that the context in which an intervention is delivered can play a crucial role in how well it is implemented. However, less is known about how organizational context or capacity relates to efficacy outcomes, particularly with health promotion interventions delivered outside of healthcare settings. The present study examined whether organizational capacity indicators were linked to key efficacy outcomes in an evidence-based cancer control intervention delivered in 13 African American churches in Maryland. Outcomes included increases in colorectal cancer knowledge and self-report colonoscopy screening behavior from baseline to follow-up. We used Coincidence Analysis to identify features of organizational capacity that uniquely distinguished churches with varying levels of cancer knowledge and screening. Indicators of organizational capacity (e.g., congregation size, prior health promotion experience) were from an existing measure of church organizational capacity for health promotion. A single solution pathway accounted for greater increases in colorectal cancer knowledge over 12 months, a combination of two conditions: conducting 3 or more health promotion activities in the prior 2 years together with not receiving any technical assistance from outside partners in the prior 2 years. A single condition accounted for greater increases in colonoscopy screening over 24 months: churches that had conducted health promotion activities in 1-4 different topical areas in the prior 2 years. Findings highlight aspects of organizational capacity (e.g., prior experience in health promotion) that may facilitate intervention efficacy and can help practitioners identify organizational settings most promising for intervention impact.

Delivery of Cervical and Colorectal Cancer Screenings During the Pandemic in Community Health Centers: Practice Changes and Recovery Strategies

BACKGROUND

The coronavirus disease 2019 pandemic led to clinical practice changes, which affected cancer preventive care delivery.

OBJECTIVES

To investigate the impact of the coronavirus disease 2019 pandemic on the delivery of colorectal cancer (CRC) and cervical cancer (CVC) screenings.

RESEARCH DESIGN

Parallel mixed methods design using electronic health record data (extracted between January 2019 and July 2021). Study results focused on 3 pandemic-related periods: March-May 2020, June-October 2020, and November 2020-September 2021.

SUBJECTS

Two hundred seventeen community health centers located in 13 states and 29 semistructured interviews from 13 community health centers.

MEASURES

Monthly up-to-date CRC and CVC screening rates and monthly rates of completed colonoscopies, fecal immunochemical test (FIT)/fecal occult blood test (FOBT) procedures, Papanicolaou tests among age and sex-eligible patients. Analysis used generalized estimating equations Poisson modeling. Qualitative analysts developed case summaries and created a cross-case data display for comparison.

RESULTS

The results showed a reduction of 75% for colonoscopy [rate ratio (RR) = 0.250, 95% CI: 0.224-0.279], 78% for FIT/FOBT (RR = 0.218, 95% CI: 0.208-0.230), and 87% for Papanicolaou (RR = 0.130, 95% CI: 0.125-0.136) rates after the start of the pandemic. During this early pandemic period, CRC screening was impacted by hospitals halting services. Clinic staff moved toward FIT/FOBT screenings. CVC screening was impacted by guidelines encouraging pausing CVC screening, patient reluctance, and concerns about exposure. During the recovery period, leadership-driven preventive care prioritization and quality improvement capacity influenced CRC and CVC screening maintenance and recovery.

CONCLUSIONS

Efforts supporting quality improvement capacity could be key actionable elements for these health centers to endure major disruptions to their care delivery system and to drive rapid recovery.

Engaging Operational Partners Is Critical for Successful Implementation of Research Products: a Coincidence Analysis of Access-Related Projects in the Veterans Affairs Healthcare System

BACKGROUND/OBJECTIVE

The Veterans Health Administration (VHA) has prioritized timely access to care and has invested substantially in research aimed at optimizing veteran access. However, implementing research into practice remains challenging. Here, we assessed the implementation status of recent VHA access-related research projects and explored factors associated with successful implementation.

DESIGN

We conducted a portfolio review of recent VHA-funded or supported projects (1/2015-7/2020) focused on healthcare access ("Access Portfolio"). We then identified projects with implementable research deliverables by excluding those that (1) were non-research/operational projects; (2) were only recently completed (i.e., completed on or after 1/1/2020, meaning that they were unlikely to have had time to be implemented); and (3) did not propose an implementable deliverable. An electronic survey assessed each project's implementation status and elicited barriers/facilitators to implementing deliverables. Results were analyzed using novel Coincidence Analysis (CNA) methods.

PARTICIPANTS/KEY RESULTS

Among 286 Access Portfolio projects, 36 projects led by 32 investigators across 20 VHA facilities were included. Twenty-nine respondents completed the survey for 32 projects (response rate = 88.9%). Twenty-eight percent of projects reported fully implementing project deliverables, 34% reported partially implementing deliverables, and 37% reported not implementing any deliverables (i.e., resulting tool/intervention not implemented into practice). Of 14 possible barriers/facilitators assessed in the survey, two were identified through CNA as "difference-makers" to partial or full implementation of project deliverables: (1) engagement with national VHA operational leadership; (2) support and commitment from local site operational leadership.

CONCLUSIONS

These findings empirically highlight the importance of operational leadership engagement for successful implementation of research deliverables. Efforts to strengthen communication and engagement between the research community and VHA local/national operational leaders should be expanded to ensure VHA's investment in research leads to meaningful improvements in veterans' care. The Veterans Health Administration (VHA) has prioritized timely access to care and has invested substantially in research aimed at optimizing veteran access. However, implementing research findings into clinical practice remains challenging, both within and outside VHA. Here, we assessed the implementation status of recent VHA access-related research projects and explored factors associated with successful implementation. Only two factors were identified as "difference-makers" to adoption of project findings into practice: (1) engagement with national VHA leadership or (2) support and commitment from local site leadership. These findings highlight the importance of leadership engagement for successful implementation of research findings. Efforts to strengthen communication and engagement between the research community and VHA local/national leaders should be expanded to ensure VHA's investment in research leads to meaningful improvements in veterans' care.

Using qualitative comparative analysis to understand the conditions that produce successful PrEP implementation in family planning clinics

BACKGROUND

Title X-funded family planning clinics have been identified as optimal sites for delivery of pre-exposure prophylaxis (PrEP) for HIV prevention to U.S. women. However, PrEP has not been widely integrated into family planning services, especially in the Southern U.S., and data suggest there may be significant implementation challenges in this setting.

METHODS

To understand contextual factors that are key to successful PrEP implementation in family planning clinics, we conducted in-depth qualitative interviews with key informants from 38 family planning clinics (11 clinics prescribed PrEP and 27 did not). Interviews were guided by constructs from the Consolidated Framework for Implementation Research (CFIR), and qualitative comparative analysis (QCA) was used to uncover the configurations of CFIR factors that led to PrEP implementation.

RESULTS

We identified 3 distinct construct configurations, or pathways, that led to successful PrEP implementation: (1) high "Leadership Engagement" AND high "Available Resources"; OR (2) high "Leadership Engagement" AND NOT located in the Southeast region; OR (3) high "Access to Knowledge and Information" AND NOT located in the Southeast region. Additionally, there were 2 solution paths that led to absence of PrEP implementation: (1) low "Access to Knowledge and Information" AND low "Leadership Engagement"; OR (2) low "Available Resources" AND high "External Partnerships".

DISCUSSION

We identified the most salient combinations of co-occurring organizational barriers or facilitators associated with PrEP implementation across Title X clinics in the Southern U.S. We discuss implementation strategies to promote pathways that led to implementation success, as well as strategies to overcome pathways to implementation failure. Notably, we identified regional differences in the pathways that led to PrEP implementation, with Southeastern clinics facing the most obstacles to implementation, specifically substantial resource constraints. Identifying implementation pathways is an important first step for packaging multiple implementation strategies that could be employed by state-level Title X grantees to help scale up PrEP.

Achieving transformation to lean management systems in health care

OBJECTIVE

To understand what factors and organizational dynamics enable Lean transformation of health care organizations.

DATA SOURCES

Primary data were collected through two waves of interviews in 2016-2017 with leaders and staff at seven veterans affairs medical centers participating in Lean enterprise transformation.

STUDY DESIGN

Using an observational study design, for each site we coded and rated seven potential enablers of transformation. The outcome measure was the extent of Lean transformation, constructed by coding and rating 11 markers of depth and spread of transformation. Using multivalue coincidence analysis (CNA), we identified enablers that distinguished among sites having different levels of transformation. We identified representative quotes for the enablers.

DATA COLLECTION METHODS

We interviewed 121 executive leaders, middle managers, expert consultants, systems redesign staff, frontline supervisors, and staff.

PRINCIPAL FINDINGS

Two sites achieved high Lean transformation, three medium, and two low. Together leadership support and capability development were sufficient for the three-level Lean transformation outcomes with 100% consistency and 100% coverage. High scores on both corresponded to high Lean transformation; medium on either one corresponded to medium transformation; and low on both corresponded to low transformation. Additionally, low scores in communication and availability of data and very low scores in alignment characterized low-transformation sites. Sites with high leadership support also had a high veteran engagement.

CONCLUSIONS

This multisite study develops a novel measure of the extent of organization-wide Lean transformation and uses CNA to identify enablers linked to transformation. It provides insights into why and how some organizations are more successful at transformation than others. Findings support the applicability of the organization transformation model that guided the study and highlight the roles of executive leadership and capability development in the dynamics of transformation.

Preferences for Colorectal Cancer Screening Modalities Among the General Population in Saudi Arabia

BACKGROUND

Colorectal cancer (CRC) could be a leading explanation for cancer-related death. Numerous studies have shown the benefit of early screening for colorectal cancer in reducing mortality. Screening for colorectal cancer is a rational and cost-effective strategy for reducing the incidence of colorectal cancer and related mortality. Despite endorsement by academic and healthcare organizations, patient awareness and compliance with screening are low, partly due to patient-related barriers to screening.

AIM

This study aimed to explore the preferred screening method for colorectal cancer in Saudi Arabia in general.

METHODS

This is a cross-sectional study conducted among the Saudi adult population from September 2021 through February 2022. A self-developed questionnaire was distributed among the population using an online platform. Data were tabulated in Google Forms, and all statistical analyses were performed using SPSS version 26 (IBM Corp., Armonk, NY).

RESULTS

During this study, data from 10,781 participants were analyzed. Among them, the most preferred screening modality for colorectal cancer was the stool fecal immunochemical test (41.7%) and the most suitable (33.5%). The most commonly mentioned qualities that influenced choosing a particular screening test were "how the test was performed" (50.4%).

CONCLUSION

Because the stool fecal immunochemical test is the most preferred screening modality for colorectal cancer, this study could serve as a database to aid in the implementation of a colorectal cancer screening program that meets the preferences of the general population of Saudi Arabia.

Implementing organized colorectal cancer screening programs in Europe-protocol for a systematic review of determinants and strategies

BACKGROUND

With a high mortality of 12.6% of all cancer cases, colorectal cancer (CRC) accounts for substantial burden of disease in Europe. In the past decade, more and more countries have introduced organized colorectal cancer screening programs, making systematic screening available to entire segments of a population, typically based on routine stool tests and/or colonoscopy. While the effectiveness of organized screening in reducing CRC incidence and mortality has been confirmed, studies continuously report persistent program implementation challenges. This systematic review will synthesize the literature on organized CRC screening programs. Its aim is to understand what is currently known about the barriers and facilitators that influence the implementation of these programs and about the implementation strategies used to navigate these determinants.

METHODS

A systematic review of primary studies of any research design will be conducted. CENTRAL, CINAHL, EMBASE, International Clinical Trials Registry Platform, MEDLINE, PsycINFO, and Scopus will be searched. Websites of (non-)government health care organizations and websites of organizations affiliated with authors of included studies will be screened for unpublished evaluation reports. Existing organized CRC screening programs will be contacted with a request to share program-specific grey literature. Two researchers will independently screen each publication in two rounds for eligibility. Included studies will focus on adult populations involved in the implementation of organized CRC screening programs and contain information about implementation determinants/ strategies. Publications will be assessed for their risk of bias. Data extraction will include study aim, design, location, setting, sample, methods, and measures; program characteristics; implementation stage, framework, determinants, strategies, and outcomes; and service and other outcome information. Findings will be synthesized narratively using the three stages of thematic synthesis.

DISCUSSION

With its sole focus on the implementation of organized CRC screening programs, this review will help to fill a central knowledge gap in the literature on colorectal cancer screening. Its findings can inform the decision-making in policy and practice needed to prioritize resources for establishing new and maintaining existing programs in the future.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO (CRD42022306580).

Data Challenges in Identifying Patients Due for Colorectal Cancer Screening in Rural Clinics

INTRODUCTION

Colorectal cancer (CRC) incidence and mortality are disproportionately high among rural residents despite the availability of effective screening methods. Outreach activities can improve CRC screening rates but rely on accurate identification of patients due for screening. We report on data challenges in rural clinics and Medicaid health plans in Oregon in identifying patients eligible for CRC screening, in a large project implementing mailed fecal immunochemical tests (FIT) and patient navigation.

METHODS

We analyzed data from clinic intake surveys and administrative claims. Clinics were asked to identify total population numbers relevant to CRC screening and follow-up. Health plans also identified enrollees eligible for CRC screening in Spring, 2021. Clinic staff validated patient lists for eligibility using their electronic health records (EHR).

RESULTS

EHR features varied across the 29 participating and 28 responding clinics. Among the 28 responding clinics, 21 were able to report their Medicaid population (75%), 19 reported the number of patients aged 50 to 75 (68%) and the number screened for CRC in the last year (68%). Only 8 (29%) were able to report screening details such as number screened by FIT and 9 were able to report on patients with an abnormal FIT or colonoscopy completed after FIT (32%). Health plans had challenges properly identifying where enrollees received care and had missing data for race and ethnicity (range 22 to 34% unknown race, <1% to 24% unknown ethnicity).

DISCUSSION

Most participating rural primary care clinics and Medicaid health plans experienced challenges identifying the population due for a CRC screening outreach program. Better EHR functionality and data reporting capabilities could help rural clinics apply population-based strategies and ultimately attenuate disparities in cancer screening and follow-up.

Job crafting interventions: what works, for whom, why, and in which contexts? Research protocol for a systematic review with coincidence analysis

BACKGROUND

Recent challenges in the working world that resulted from the pandemic and technological advances have underlined the importance of flexibility in how jobs are designed. Job crafting (JC) refers to self-initiated changes that employees introduce to their jobs to optimize their job design and increase the fit between the job and their needs and preferences. These behaviors can be stimulated by job crafting training interventions, which aim to change how individual employees design, organize, or manage their work. However, since the interventions are implemented in various ways, we do not know which context and intervention factors are necessary or sufficient to achieve desired outcomes. Without this knowledge, benefitting from the potential of job crafting interventions is limited. The overall aim of this project will be to investigate what combinations of context, intervention, and mechanism factors are linked with effective JC interventions. Specifically, we will detect what factors are minimally sufficient and/or necessary to produce a successful JC intervention, how they combine, as well as what are the multiple alternative paths to their success.

METHODS

We will perform a systematic review of the JC interventions literature combined with coincidence analysis (CNA). We will search electronic databases of journals and utilize Rayyan software to make decisions regarding inclusion. Data regarding context (e.g., fit), intervention (e.g., types of activities), mechanisms (e.g., intention implementation), and outcomes (e.g., employee well-being, job performance) will be extracted using a pre-piloted form and coded into a crisp-set (factor present vs. absent). Analyses will be carried out using the CNA package in R.

DISCUSSION

This review will address gaps in knowledge about the context, intervention, and mechanism-related factors that may impact the effects of JC interventions. Consequently, this review will help develop a program theory for JC interventions that explains what works, how and under which circumstances. Applying CNA to synthesize these complex solutions across multiple studies provides an innovative method that may be used in future review attempts evaluating the implementation of interventions. Finally, our synthesis will provide knowledge relevant to organizational practitioners and scholars who want to implement JC interventions.

TRIAL REGISTRATION

https://osf.io/2g6yx.

Modeling Contingency in Veteran Community Reintegration: A Mixed Methods Approach

Researchers need approaches for analyzing complex phenomena when assessing contingency relationships where specific conditions explain an outcome only when combined with other conditions. Using a mixed methods design, we paired configurational methods and qualitative thematic analysis to model contingency in veteran community reintegration outcomes, identifying combinations of conditions that led to success or lack of success in community reintegration among US military veterans. This pairing allowed for modeling contingency at a detailed level beyond the capabilities of either approach alone. Our analysis revealed multiple contingent relationships at work in explaining reintegration, including social support, purpose, cultural adjustment, and military separation experiences. This study contributes to the field of mixed methods by pairing a mathematical cross-case method with a qualitative method to model contingency.

Determinants of inter-organizational implementation success: A mixed-methods evaluation of Veteran Directed Care

BACKGROUND

Veteran Directed Care (VDC) aims to keep Veterans at risk for nursing home placement in their communities. VA medical centers (VAMCs) purchase VDC from third-party organizational providers who then partner with them during implementation. Experiences with VDC implementation have varied.

OBJECTIVES

We sought to identify conditions differentiating partnerships with higher enrollment (implementation success).

METHODS

We conducted a case-based study with: qualitative data on implementation determinants two and eight months after program start, directed content analysis to assign numerical scores (-2 strong barrier to +2 strong facilitator), and mathematical modeling using Coincidence Analysis (CNA) to identify key determinants of implementation success. Cases consisted of VAMCs and partnering non-VAMC organizations who started VDC during 2017 or 2018. The Consolidated Framework for Implementation Research (CFIR) guided analysis.

RESULTS

Eleven individual organizations within five partnerships constituted our sample. Two CFIR determinants- Networks & Communication and External Change Agent-uniquely and consistently identified implementation success. At an inter-organizational partnership level, Networks & Communications and External Change Agent +2 (i.e., present as strong facilitators) were both necessary and sufficient. At a within-organization level, Networks & Communication +2 was necessary but not sufficient for the non-VAMC providers, whereas External Change Agent +2 was necessary and sufficient for VAMCs.

CONCLUSION

Networks & Communication and External Change Agent played difference-making roles in inter-organizational implementation success, which differ by type of organization and level of analysis.

IMPLICATIONS

This multi-level approach identified crucial difference-making conditions for inter-organizational implementation success when putting a program into practice requires partnerships across multiple organizations.

Facility-level program components leading to population impact: a coincidence analysis of obesity treatment options within the Veterans Health Administration

Obesity is a well-established risk factor for increased morbidity and mortality. Comprehensive lifestyle interventions, pharmacotherapy, and bariatric surgery are three effective treatment approaches for obesity. The Veterans Health Administration (VHA) offers all three domains but in different configurations across medical facilities. Study aim was to explore the relationship between configurations of three types of obesity treatments, context, and population impact across VHA using coincidence analysis. This was a cross-sectional analysis of survey data describing weight management treatment components linked with administrative data to compute population impact for each facility. Coincidence analysis was used to identify combinations of treatment components that led to higher population impact. Facilities with higher impact were in the top two quintiles for (1) reach to eligible patients and (2) weight outcomes. Sixty-nine facilities were included in the analyses. The final model explained 88% (29/33) of the higher-impact facilities with 91% consistency (29/32) and was comprised of five distinct pathways. Each of the five pathways depended on facility complexity-level plus factors from one or more of the three domains of weight management: comprehensive lifestyle interventions, pharmacotherapy, and/or bariatric surgery. Three pathways include components from multiple treatment domains. Combinations of conditions formed "recipes" that lead to higher population impact. Our coincidence analyses highlighted both the importance of local context and how combinations of specific conditions consistently and uniquely distinguished higher impact facilities from lower impact facilities for weight management.

Assessing the impact of multicomponent interventions on colorectal cancer screening through simulation: What would it take to reach national screening targets in North Carolina?

Healthy People 2020 and the National Colorectal Cancer Roundtable established colorectal cancer (CRC) screening targets of 70.5% and 80%, respectively. While evidence-based interventions (EBIs) have increased CRC screening, the ability to achieve these targets at the population level remains uncertain. We simulated the impact of multicomponent interventions in North Carolina over 5 years to assess the potential for meeting national screening targets. Each intervention scenario is described as a core EBI with additional components indicated by the "+" symbol: patient navigation for screening colonoscopy (PN-for-Col+), mailed fecal immunochemical testing (MailedFIT+), MailedFIT+ targeted to Medicaid enrollees (MailedFIT + forMd), and provider assessment and feedback (PAF+). Each intervention was simulated with and without Medicaid expansion and at different levels of exposure (i.e., reach) for targeted populations. Outcomes included the percent up-to-date overall and by sociodemographic subgroups and number of CRC cases and deaths averted. Each multicomponent intervention was associated with increased CRC screening and averted both CRC cases and deaths; three had the potential to reach screening targets. PN-for-Col + achieved the 70.5% target with 97% reach after 1 year, and the 80% target with 78% reach after 5 years. MailedFIT+ achieved the 70.5% target with 74% reach after 1 year and 5 years. In the Medicaid population, assuming Medicaid expansion, MailedFIT + forMd reached the 70.5% target after 5 years with 97% reach. This study clarifies the potential for states to reach national CRC screening targets using multicomponent EBIs, but decision-makers also should consider tradeoffs in cost, reach, and ability to reduce disparities when selecting interventions.

Protocol for evaluating external facilitation as a strategy to nationally implement a novel stigma reduction training tool for healthcare providers

Background

Identity Development Evolution and Sharing (IDEAS) is a theatre-based intervention for reducing healthcare provider stigma. IDEAS films are created by collecting narratives from people who have experienced discrimination and healthcare inequity, partnering with professional playwrights to create theatrical scripts that maintain the words of the narratives while arranging them into compelling storylines involving several interviews, and hiring professional actors to perform and record scenes. IDEAS implementation requires a moderator to establish a respectful learning environment, play the filmed performance, set ground rules for discussion, and moderate a discussion between healthcare providers who viewed the film and invited panelists who are members of the minoritized population being discussed. IDEAS’ impact on provider stigma is measured via pre/post Acceptance and Action Questionnaire – Stigma (AAQ-S) data collected from participating providers. The objectives of this manuscript are to provide narrative review of how provider stigma may lead to healthcare inequity and health disparities, describe the conceptual frameworks underpinning the IDEAS intervention, and outline methods for IDEAS implementation and implementation evaluation.

Methods

This manuscript describes a hybrid type 3 design study protocol that uses the Consolidated Framework for Implementation Research (CFIR) to evaluate external facilitation, used as an implementation strategy to expand the reach of IDEAS. CFIR is also used to assess the impact of characteristics of the intervention and implementation climate on implementation success. Implementation success is defined by intervention feasibility and acceptability as well as self-efficacy of internal facilitators. This manuscript details the protocol for collection and evaluation of implementation data alongside that of effectiveness data. The manuscript provides new information about the use of configurational analysis, which uses Boolean algebra to analyze pathways to implementation success considering each variable, within and across diverse clinical sites across the USA.

Discussion

The significance of this protocol is that it outlines important information for future hybrid type 3 designs wishing to incorporate configurational analyses and/or studies using behavioral or atypical, complex, innovative interventions. The current lack of evidence supporting occupational justice-focused interventions and the strong evidence of stigma influencing health inequities underscore the necessity for the IDEAS intervention.

Coincidence Analysis: A Novel Approach to Modeling Nurses' Workplace Experience

OBJECTIVES

The purpose of this study is to identify combinations of workplace conditions that uniquely differentiate high, medium, and low registered nurse (RN) ratings of appropriateness of patient assignment during daytime intensive care unit (ICU) work shifts.

METHODS

A collective case study design and coincidence analysis were employed to identify combinations of workplace conditions that link directly to high, medium, and low RN perception of appropriateness of patient assignment at a mid-shift time point. RN members of the study team hypothesized a set of 55 workplace conditions as potential difference makers through the application of theoretical and empirical knowledge. Conditions were derived from data exported from electronic systems commonly used in nursing care.

RESULTS

Analysis of 64 cases (25 high, 24 medium, and 15 low) produced three models, one for each level of the outcome. Each model contained multiple pathways to the same outcome. The model for "high" appropriateness was the simplest model with two paths to the outcome and a shared condition across pathways. The first path comprised of the absence of overtime and a before-noon patient discharge or transfer, and the second path comprised of the absence of overtime and RN assignment to a single ICU patient.

CONCLUSION

Specific combinations of workplace conditions uniquely distinguish RN perception of appropriateness of patient assignment at a mid-shift time point, and these difference-making conditions provide a foundation for enhanced observability of nurses' work experience during hospital work shifts. This study illuminates the complexity of assessing nursing work system status by revealing that multiple paths, comprised of multiple conditions, can lead to the same outcome. Operational decision support tools may best reflect the complex adaptive nature of the work systems they intend to support by utilizing methods that accommodate both causal complexity and equifinality.

Pairing regression and configurational analysis in health services research: modelling outcomes in an observational cohort using a split-sample design

BACKGROUND

Configurational methods are increasingly being used in health services research.

OBJECTIVES

To use configurational analysis and logistic regression within a single data set to compare results from the two methods.

DESIGN

Secondary analysis of an observational cohort; a split-sample design involved randomly dividing patients into training and validation samples.

PARTICIPANTS AND SETTING

Patients who had a transient ischaemic attack (TIA) in US Department of Veterans Affairs hospitals.

MEASURES

The patient outcome was the combined endpoint of all-cause mortality or recurrent ischaemic stroke within 1 year post-TIA. The quality-of-care outcome was the without-fail rate (proportion of patients who received all processes for which they were eligible, among seven processes).

RESULTS

For the recurrent stroke or death outcome, configurational analysis yielded a three-pathway model identifying a set of (validation sample) patients where the prevalence was 15.0% (83/552), substantially higher than the overall sample prevalence of 11.0% (relative difference, 36%). The configurational model had a sensitivity (coverage) of 84.7% and specificity of 40.6%. The logistic regression model identified six factors associated with the combined endpoint (c-statistic, 0.632; sensitivity, 63.3%; specificity, 63.1%). None of these factors were elements of the configurational model. For the quality outcome, configurational analysis yielded a single-pathway model identifying a set of (validation sample) patients where the without-fail rate was 64.3% (231/359), nearly twice the overall sample prevalence (33.7%). The configurational model had a sensitivity (coverage) of 77.3% and specificity of 78.2%. The logistic regression model identified seven factors associated with the without-fail rate (c-statistic, 0.822; sensitivity, 80.3%; specificity, 84.2%). Two of these factors were also identified in the configurational analysis.

CONCLUSIONS

Configurational analysis and logistic regression represent different methods that can enhance our understanding of a data set when paired together. Configurational models optimise sensitivity with relatively few conditions. Logistic regression models discriminate cases from controls and provided inferential relationships between outcomes and independent variables.

How education and racial segregation intersect in neighborhoods with persistently low COVID-19 vaccination rates in Philadelphia

BACKGROUND

COVID-19 infection has disproportionately affected socially disadvantaged neighborhoods. Despite this disproportionate burden of infection, these neighborhoods have also lagged in COVID-19 vaccinations. To date, we have little understanding of the ways that various types of social conditions intersect to explain the complex causes of lower COVID-19 vaccination rates in neighborhoods.

METHODS

We used configurational comparative methods (CCMs) to study COVID-19 vaccination rates in Philadelphia by neighborhood (proxied by zip code tabulation areas). Specifically, we identified neighborhoods where COVID-19 vaccination rates (per 10,000) were persistently low from March 2021 - May 2021. We then assessed how different combinations of social conditions (pathways) uniquely distinguished neighborhoods with persistently low vaccination rates from the other neighborhoods in the city. Social conditions included measures of economic inequities, racial segregation, education, overcrowding, service employment, public transit use, health insurance and limited English proficiency.

RESULTS

Two factors consistently distinguished neighborhoods with persistently low COVID-19 vaccination rates from the others: college education and concentrated racial privilege. Two factor values together - low college education AND low/medium concentrated racial privilege - identified persistently low COVID-19 vaccination rates in neighborhoods, with high consistency (0.92) and high coverage (0.86). Different values for education and concentrated racial privilege - medium/high college education OR high concentrated racial privilege - were each sufficient by themselves to explain neighborhoods where COVID-19 vaccination rates were not persistently low, likewise with high consistency (0.93) and high coverage (0.97).

CONCLUSIONS

Pairing CCMs with geospatial mapping can help identify complex relationships between social conditions linked to low COVID-19 vaccination rates. Understanding how neighborhood conditions combine to create inequities in communities could inform the design of interventions tailored to address COVID-19 vaccination disparities.

A Centralized Program with Stepped Support Increases Adherence to Colorectal Cancer Screening Over 9 Years: a Randomized Trial

BACKGROUND

Screening over many years is required to optimize colorectal cancer (CRC) outcomes.

OBJECTIVE

To evaluate the effect of a CRC screening intervention on adherence to CRC screening over 9 years.

DESIGN

Randomized trial.

SETTING

Integrated health care system in Washington state.

PARTICIPANTS

Between August 2008 and November 2009, 4653 adults in a Washington state integrated health care system aged 50-74 due for CRC screening were randomized to usual care (UC; N =1163) or UC plus study interventions (interventions: N = 3490).

INTERVENTIONS

Years 1 and 2: (arm 1) UC or this plus study interventions; (arm 2) mailed fecal tests or information on scheduling colonoscopy; (arm 3) mailings plus brief telephone assistance; or (arm 4) mailings and assistance plus nurse navigation. In year 3, stepped-intensity participants (arms 2, 3, and 4 combined) still eligible for screening were randomized to either stopped or continued interventions in years 3 and 5-9.

MAIN MEASURES

Time in adherence to CRC testing over 9 years (covered time, primary outcome), and percent with no CRC testing in participants assigned to any intervention compared to UC only. Poisson regression models estimated incidence rate ratios for covered time, adjusting for patient characteristics and accounting for variable follow-up time.

KEY RESULTS

Compared to UC, intervention participants had 21% more covered time over 9 years (57.5% vs. 69.1%; adjusted incidence rate ratio 1.21, 95% confidence interval 1.16-1.25, P<0.001). Fecal testing accounted for almost all additional covered time among intervention patients. Compared to UC, intervention participants were also more likely to have completed at least one CRC screening test over 9 years or until censorship (88.6% vs. 80.6%, P<0.001).

CONCLUSIONS

An outreach program that included mailed fecal tests and phone follow-up led to increased adherence to CRC testing and fewer age-eligible individuals without any CRC testing over 9 years.

TRIAL REGISTRATION

Systems of Support (SOS) to Increase Colon Cancer Screening and Follow-up (SOS), NCT00697047, clinicaltrials.gov/ct2/show/NCT00697047.

Clinic Factors Associated With Mailed Fecal Immunochemical Test (FIT) Completion: The Difference-Making Role of Support Staff

PURPOSE

Mailed fecal immunochemical test (FIT) programs can facilitate colorectal cancer (CRC) screening. We sought to identify modifiable, clinic-level factors that distinguish primary care clinics with higher vs lower FIT completion rates in response to a centralized mailed FIT program.

METHODS

We used baseline observational data from 15 clinics within a single urban federally qualified health center participating in a pragmatic trial to optimize a mailed FIT program. Clinic-level data included interviews with leadership using a guide informed by the Consolidated Framework for Implementation Research (CFIR) and FIT completion rates. We used template analysis to identify explanatory factors and configurational comparative methods to identify specific combinations of clinic-level conditions that uniquely distinguished clinics with higher and lower FIT completion rates.

RESULTS

We interviewed 39 clinic leaders and identified 58 potential explanatory factors representing clinic workflows and the CFIR inner setting domain. Clinic-level FIT completion rates ranged from 30% to 56%. The configurational model for clinics with higher rates (≥37%) featured any 1 of the following 3 factors related to support staff: (1) adding back- or front-office staff in past 12 months, (2) having staff help patients resolve barriers to CRC screening, and (3) having staff hand out FITs/educate patients. The model for clinics with lower rates involved the combined absence of these same 3 factors.

CONCLUSIONS

Three factors related to support staff differentiated clinics with higher and lower FIT completion rates. Adding nonphysician support staff and having those staff provide enabling services might help clinics optimize mailed FIT screening programs.

Evaluation of organizational capacity in the implementation of a church-based cancer education program

Implementation evaluations have increasingly taken into account how features of local context help determine implementation outcomes. The purpose of this study was to determine which contextual features of organizational capacity led directly to the RE-AIM Framework implementation outcomes of intervention reach and number of days taken to implement, in an implementation trial of a series of cancer education workshops conducted across 13 African American churches in Maryland. We used a configurational approach with Coincidence Analysis to identify specific features of organizational capacity that uniquely distinguished churches with implementation success from those that were less successful. Aspects of organizational capacity (e.g., congregation size, staffing/volunteers, health ministry experience) were drawn from an existing measure of church organizational capacity for health promotion. Solution pathways leading to higher intervention reach included: having a health ministry in place for 1-4 years; or having fewer than 100 members; or mid-size churches that had conducted health promotion activities in 1-4 different topics in the past 2 years. Solution pathways to implementing the intervention in fewer number of days included: having conducted 1-2 health promotion activities in the past 2 years; or having 1-5 part-time staff and a pastor without additional outside employment; or churches with a doctorally prepared pastor and a weekly attendance of 101-249 members. Study findings can inform future theory, research, and practice in implementation of evidence-based health promotion interventions delivered in faith-based and other limited-resource community settings. Findings support the important role of organizational capacity in implementation outcomes in these settings.

Facility-level conditions leading to higher reach: a configurational analysis of national VA weight management programming

Background

While the Veterans Health Administration (VHA) MOVE! weight management program is effective in helping patients lose weight and is available at every VHA medical center across the United States, reaching patients to engage them in treatment remains a challenge. Facility-based MOVE! programs vary in structures, processes of programming, and levels of reach, with no single factor explaining variation in reach. Configurational analysis, based on Boolean algebra and set theory, represents a mathematical approach to data analysis well-suited for discerning how conditions interact and identifying multiple pathways leading to the same outcome. We applied configurational analysis to identify facility-level obesity treatment program arrangements that directly linked to higher reach.

Methods

A national survey was fielded in March 2017 to elicit information about more than 75 different components of obesity treatment programming in all VHA medical centers. This survey data was linked to reach scores available through administrative data. Reach scores were calculated by dividing the total number of Veterans who are candidates for obesity treatment by the number of “new” MOVE! visits in 2017 for each program and then multiplied by 1000. Programs with the top 40 % highest reach scores (n = 51) were compared to those in the lowest 40 % (n = 51). Configurational analysis was applied to identify specific combinations of conditions linked to reach rates.

Results

One hundred twenty-seven MOVE! program representatives responded to the survey and had complete reach data. The final solution consisted of 5 distinct pathways comprising combinations of program components related to pharmacotherapy, bariatric surgery, and comprehensive lifestyle intervention; 3 of the 5 pathways depended on the size/complexity of medical center. The 5 pathways explained 78 % (40/51) of the facilities in the higher-reach group with 85 % consistency (40/47).

Conclusions

Specific combinations of facility-level conditions identified through configurational analysis uniquely distinguished facilities with higher reach from those with lower reach. Solutions demonstrated the importance of how local context plus specific program components linked together to account for a key implementation outcome. These findings will guide system recommendations about optimal program structures to maximize reach to patients who would benefit from obesity treatment such as the MOVE! program.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06774-w.

Improving Smoking and Blood Pressure Outcomes: The Interplay Between Operational Changes and Local Context

PURPOSE

We undertook a study to identify conditions and operational changes linked to improvements in smoking and blood pressure (BP) outcomes in primary care.

METHODS

We purposively sampled and interviewed practice staff (eg, office managers, clinicians) from a subset of 104 practices participating in EvidenceNOW-a multisite cardiovascular disease prevention initiative. We calculated Clinical Quality Measure improvements, with targets of 10-point or greater absolute improvements in the proportion of patients with smoking screening and, if relevant, counseling and in the proportion of hypertensive patients with adequately controlled BP. We analyzed interview data to identify operational changes, transforming these into numeric data. We used Configurational Comparative Methods to assess the joint effects of multiple factors on outcomes.

RESULTS

In clinician-owned practices, implementing a workflow to routinely screen, counsel, and connect patients to smoking cessation resources, or implementing a documentation change or a referral to a resource alone led to an improvement of at least 10 points in the smoking outcome with a moderate level of facilitation support. These patterns did not manifest in health- or hospital system-owned practices or in Federally Qualified Health Centers, however. The BP outcome improved by at least 10 points among solo practices after medical assistants were trained to take an accurate BP. Among larger, clinician-owned practices, BP outcomes improved when practices implemented a second BP measurement when the first was elevated, and when staff learned where to document this information in the electronic health record. With 50 hours or more of facilitation, BP outcomes improved among larger and health- and hospital system-owned practices that implemented these operational changes.

CONCLUSIONS

There was no magic bullet for improving smoking or BP outcomes. Multiple combinations of operational changes led to improvements, but only in specific contexts of practice size and ownership, or dose of external facilitation.

What's the "secret sauce"? How implementation variation affects the success of colorectal cancer screening outreach

BACKGROUND

Mailed fecal immunochemical testing (FIT) programs can improve colorectal cancer (CRC) screening rates, but health systems vary how they implement (i.e., adapt) these programs for their organizations. A health insurance plan implemented a mailed FIT program (named BeneFIT), and participating health systems could adapt the program. This multi-method study explored which program adaptations might have resulted in higher screening rates.

METHODS

First, we conducted a descriptive analysis of CRC screening rates by key health system characteristics and program adaptations. Second, we generated an overall model by fitting a weighted regression line to our data. Third, we applied Configurational Comparative Methods (CCMs) to determine how combinations of conditions were linked to higher screening rates. The main outcome measure was CRC screening rates.

RESULTS

Seventeen health systems took part in at least 1 year of BeneFIT. The overall screening completion rate was 20% (4-28%) in year 1 and 25% (12-35%) in year 2 of the program. Health systems that used two or more adaptations had higher screening rates, and no single adaptation clearly led to higher screening rates. In year 1, small systems, with just one clinic, that used phone reminders (n = 2) met the implementation success threshold (≥ 19% screening rate) while systems with > 1 clinic were successful when offering a patient incentive (n = 4), scrubbing mailing lists (n = 4), or allowing mailed FIT returns with no other adaptations (n = 1). In year 2, larger systems with 2-4 clinics were successful with a phone reminder (n = 4) or a patient incentive (n = 3). Of the 10 systems that implemented BeneFIT in both years, seven improved their CRC screening rates in year 2.

CONCLUSIONS

Health systems can choose among many adaptations and successfully implement a health plan's mailed FIT program. Different combinations of adaptations led to success with health system size emerging as an important contextual factor.

Coincidence analysis: a new method for causal inference in implementation science

BACKGROUND

Implementation of multifaceted interventions typically involves many diverse elements working together in interrelated ways, including intervention components, implementation strategies, and features of local context. Given this real-world complexity, implementation researchers may be interested in a new mathematical, cross-case method called Coincidence Analysis (CNA) that has been designed explicitly to support causal inference, answer research questions about combinations of conditions that are minimally necessary or sufficient for an outcome, and identify the possible presence of multiple causal paths to an outcome. CNA can be applied as a standalone method or in conjunction with other approaches and can reveal new empirical findings related to implementation that might otherwise have gone undetected.

METHODS

We applied CNA to a publicly available dataset from Sweden with county-level data on human papillomavirus (HPV) vaccination campaigns and vaccination uptake in 2012 and 2014 and then compared CNA results to the published regression findings.

RESULTS

The original regression analysis found vaccination uptake was positively associated only with the availability of vaccines in schools. CNA produced different findings and uncovered an additional solution path: high vaccination rates were achieved by either (1) offering the vaccine in all schools or (2) a combination of offering the vaccine in some schools and media coverage.

CONCLUSIONS

CNA offers a new comparative approach for researchers seeking to understand how implementation conditions work together and link to outcomes.