Developing measures to assess constructs from the Inner Setting domain of the Consolidated Framework for Implementation Research

HPV Multilevel Intervention Strategies Targeting Immunization in Community Settings (HPV MISTICS): Study protocol for a hybrid 1 stepped-wedge cluster randomized trial

BACKGROUND

This protocol paper describes the overall design for HPV MISTICS, a multilevel intervention to increase human papillomavirus (HPV) vaccination initiation and completion rates among adolescents aged 11-17.

METHODS

We will conduct a hybrid type 1 implementation-effectiveness trial using a stepped-wedge cluster randomized trial in eight federally qualified health centers (FQHCs) in Florida. Intervention components target three levels: system, providers, and parents. Outcomes will be assessed using quantitative (e.g., vaccination data, survey data) and qualitative methods (e.g., staff and parent interviews). We expect to quantify changes in HPV vaccine series initiation and completion rates for adolescents ages 11-17 in the eight FQHCs. We have hypothesized a 20-percentage point increase in HPV vaccine series initiation and a 10-percentage point increase in series completion. We also anticipate being able to explore factors at the system, provider, and patient levels as potential covariates. Implementation outcomes, barriers, and facilitators identified in the study will help characterize the implementation process and inform potential future intervention scale-up.

RESULTS

The project is ongoing; effectiveness and implementation outcomes will be determined following project completion.

CONCLUSIONS

Findings will provide evidence of an equity-informed research design and implementation procedures that could help improve HPV vaccination rates in similar health systems.

CLINICAL TRIALS IDENTIFIER

NCT05677360 (date registered: 2022-12-22); https://clinicaltrials.gov/study/NCT05677360?lead=Moffitt%20Cancer%20Center%20&aggFilters=status:rec&page=2&rank=17.

Adapting and testing measures of organizational context in primary care clinics in KwaZulu-Natal, South Africa

BACKGROUND

Implementation science frameworks situate intervention implementation and sustainment within the context of the implementing organization and system. Aspects of organizational context such as leadership have been defined and measured largely within US health care settings characterized by decentralization and individual autonomy. The relevance of these constructs in other settings may be limited by differences like collectivist orientation, resource constraints, and hierarchical power structures. We aimed to adapt measures of organizational context in South African primary care clinics.

METHODS

We convened a panel of South African experts in social science and HIV care delivery and presented implementation domains informed by existing frameworks and prior work in South Africa. Based on panel input, we selected contextual domains and adapted candidate items. We conducted cognitive interviews with 25 providers in KwaZulu-Natal Province to refine measures. We then conducted a cross-sectional survey of 16 clinics with 5-20 providers per clinic (N = 186). We assessed reliability using Cronbach's alpha and calculated interrater agreement (awg) and intraclass correlation coefficient (ICC) at the clinic level. Within clinics with moderate agreement, we calculated correlation of clinic-level measures with each other and with hypothesized predictors - staff continuity and infrastructure - and a clinical outcome, patient retention on antiretroviral therapy.

RESULTS

Panelists emphasized contextual factors; we therefore focused on elements of clinic leadership, stress, cohesion, and collective problem solving (critical consciousness). Cognitive interviews confirmed salience of the domains and improved item clarity. After excluding items related to leaders' coordination abilities due to missingness and low agreement, all other scales demonstrated individual-level reliability and at least moderate interrater agreement in most facilities. ICC was low for most leadership measures and moderate for others. Measures tended to correlate within facility, and higher stress was significantly correlated with lower staff continuity. Organizational context was generally more positively rated in facilities that showed consistent agreement.

CONCLUSIONS

As theorized, organizational context is important in understanding program implementation within the South African health system. Most adapted measures show good reliability at individual and clinic levels. Additional revision of existing frameworks to suit this context and further testing in high and low performing clinics is warranted.

Implementing weight maintenance with existing staff and electronic health record tools in a primary care setting: Baseline results from the MAINTAIN PRIME trial

BACKGROUND

There is need for interventions that can assist with long-term maintenance of healthy body weight and be sustainably integrated into existing primary care teams. The goal of MAINTAIN PRIME (Promoting Real (World) IMplEmentation) is to evaluate whether a successful electronic health record (EHR)-based weight maintenance intervention can be adapted to a new clinical setting with primary care staff serving as coaches.

METHODS

EHR tools include tracking tools, standardized surveys, and standardized "SmartPhrases" for coaching. Inclusion criteria were age 18-75 years, voluntary 5% weight loss in the past 2 years with prior BMI ≥ 25 kg/m2, and no bariatric procedures in past 2 years. Participants were randomized 1:1 to tailored online coaching with EHR tracking tools (coaching) or EHR tracking tools alone (tracking).

RESULTS

We screened 405 individuals between September 2021 and April 2023; 269 participants enrolled (134 coaching; 135 tracking). The most common reason for not enrolling was ineligibility (55%). At baseline, participants were 50.3 (SD 15.02) years old, 66.4% female, and 84% White; 83.7% reported moderate physical activity. Average weight and BMI at baseline were 205.0 (SD 48.9) lbs. and 33.2 (6.8) kg/m2, respectively. Participants lost an average of 10.7% (SD 5.2) of their body weight before enrolling. We recruited 39 primary care coaches over the same period. Conclusion The study successfully identified and recruited primary care patients with recent intentional weight loss for participation in a weight maintenance program that uses EHR-based tools. We also successfully recruited and trained primary care staff as coaches.

Exemplar Hospital initiation trial to Enhance Treatment Engagement (EXHIT ENTRE): protocol for CTN-0098B a randomized implementation study to support hospitals in caring for patients with opioid use disorder

BACKGROUND

Hospitalizations involving opioid use disorder (OUD) are increasing. Medications for opioid use disorder (MOUD) reduce mortality and acute care utilization. Hospitalization is a reachable moment for initiating MOUD and arranging for ongoing MOUD engagement following hospital discharge. Despite existing quality metrics for MOUD initiation and engagement, few hospitals provide hospital based opioid treatment (HBOT). This protocol describes a cluster-randomized hybrid type-2 implementation study comparing low-intensity and high-intensity implementation support strategies to help community hospitals implement HBOT.

METHODS

Four state implementation hubs with expertise in initiating HBOT programs will provide implementation support to 24 community hospitals (6 hospitals/hub) interested in starting HBOT. Community hospitals will be randomized to 24-months of either a low-intensity intervention (distribution of an HBOT best-practice manual, a lecture series based on the manual, referral to publicly available resources, and on-demand technical assistance) or a high-intensity intervention (the low-intensity intervention plus funding for a hospital HBOT champion and regular practice facilitation sessions with an expert hub). The primary efficacy outcome, adapted from the National Committee on Quality Assurance, is the proportion of patients engaged in MOUD 34-days following hospital discharge. Secondary and exploratory outcomes include acute care utilization, non-fatal overdose, death, MOUD engagement at various time points, hospital length of stay, and discharges against medical advice. Primary, secondary, and exploratory outcomes will be derived from state Medicaid data. Implementation outcomes, barriers, and facilitators are assessed via longitudinal surveys, qualitative interviews, practice facilitation contact logs, and HBOT sustainability metrics. We hypothesize that the proportion of patients receiving care at hospitals randomized to the high-intensity arm will have greater MOUD engagement following hospital discharge.

DISCUSSION

Initiation of MOUD during hospitalization improves MOUD engagement post hospitalization. Few studies, however, have tested different implementation strategies on HBOT uptake, outcome, and sustainability and only one to date has tested implementation of a specific type of HBOT (addiction consultation services). This cluster-randomized study comparing different intensities of HBOT implementation support will inform hospitals and policymakers in identifying effective strategies for promoting HBOT dissemination and adoption in community hospitals.

TRIAL REGISTRATION

NCT04921787.

Sustainability Planning for a Community Network to Increase Participation in Evidence-Based Lifestyle Change Programs: A Mixed-Methods Approach

Community-based chronic disease prevention programs can have long-term, broad public health benefits. Yet, only 40 to 60% of evidence-based health programs are sustained. Using established frameworks and evidence-based tools to characterize sustainability allows programs to develop structures and processes to leverage resources effectively to sustain effective program activities and systems. This study used a mixed-methods, partner-engaged approach to identify barriers and facilitators to sustaining a community network (the Alliance program) aimed to increase participation in evidence-based lifestyle change programs delivered in the community. Surveys and qualitative interviews were conducted with the Alliance partners based on the Program Sustainability Assessment Tool and Consolidated Framework for Implementation Research. Overall, partners felt Alliance had a high capacity for sustainability. Strategic planning, communication, and partnerships were areas partners prioritized to improve the potential for sustaining the program. Results informed the co-development of a sustainability action plan. This paper furthers our understanding of factors critical for the sustainability of community-based programs for chronic disease prevention and health equity and presents a process for developing action plans to build sustainability capacity.

Contextual determinants of guideline-based family support during end-of-life cancer care and subsequent bereavement care: A cross-sectional survey of registered nurses

PURPOSE

In end-of-life cancer care, 10-20% of bereaved family members experience adverse mental health effects, including prolonged grief disorder. Despite great efforts, evidence-based recommendations to support their grieving process and well-being are often not successfully adopted into routine clinical care. This study identified facilitators and barriers using implementation science methodology.

METHODS

81 registered nurses working in cancer care from four hospitals and three home care services in Switzerland assessed their current family support practices in end-of-life care and bereavement care. They then assessed organisational attributes of their institution and their own individual characteristics and skills regarding literature-based factors of potential relevance. Facilitators and barriers to guideline-based family support were determined using fractional logistic regression.

RESULTS

Service specialisation in palliative care, a culture that supports change, the availability of family support guidelines, billing/reimbursement of bereavement support services, and individual knowledge of family support and skill were systematically associated with higher adoption of guideline-based family support practices. Lack of privacy with families and insufficient training acted as significant barriers.

CONCLUSIONS

While several potentially relevant factors have emerged in the literature, certain organisational and individual determinants actually empirically predict guideline-based family support according to nurses in end-of-life cancer care, with some determinants having much stronger implications than others. This provides crucial guidance for focussing quality improvement and implementation efforts through tailored strategies, especially with scarce resources. Furthermore, adoption is lower in bereavement care than in end-of-life care, suggesting a particular need for supportive organisational cultures including specific training and billing/reimbursement options.

Protocol for the process evaluation of an intervention to improve antenatal smoking cessation support (MOHMQuit) in maternity services in New South Wales, Australia

INTRODUCTION

Smoking cessation in pregnancy remains a public health priority. Our team used the Behaviour Change Wheel to develop the Midwives and Obstetricians Helping Mothers to Quit smoking (MOHMQuit) intervention with health system, leader (including managers and educators) and clinician components. MOHMQuit addresses a critical evidence to practice gap in the provision of smoking cessation support in antenatal care. It involves nine maternity services in New South Wales in a cluster randomised stepped-wedge controlled trial of effectiveness. This paper describes the design and rationale for the process evaluation of MOHMQuit. The process evaluation aims to assess to what extent and how MOHMQuit is being implemented (acceptability; adoption/uptake; appropriateness; feasibility; fidelity; penetration and sustainability), and the context in which it is implemented, in order to support further refinement of MOHMQuit throughout the trial, and aid understanding and interpretation of the results of the trial.

METHODS AND ANALYSIS

The process evaluation is an integral part of the stepped-wedge trial. Its design is underpinned by implementation science frameworks and adopts a mixed methods approach. Quantitative evidence from participating leaders and clinicians in our study will be used to produce individual and site-level descriptive statistics. Qualitative evidence of leaders' perceptions about the implementation will be collected using semistructured interviews and will be analysed descriptively within-site and thematically across the dataset. The process evaluation will also use publicly available data and observations from the research team implementing MOHMQuit, for example, training logs. These data will be synthesised to provide site-level as well as individual-level implementation outcomes.

ETHICS AND DISSEMINATION

The study received ethical approval from the Population Health Services Research Ethics Committee for NSW, Australia (Reference 2021/ETH00887). Results will be communicated via the study's steering committee and will also be published in peer-reviewed journals and presented at conferences.

TRIAL REGISTRATION NUMBER

Australian New Zealand Trials Registry ACTRN12622000167763. https://www.australianclinicaltrials.gov.au/anzctr/trial/ACTRN12622000167763.

Navigating the field of implementation science towards maturity: challenges and opportunities

BACKGROUND

The field of implementation science has significantly expanded in size and scope over the past two decades, although work related to understanding implementation processes have of course long preceded the more systematic efforts to improve integration of evidence-based interventions into practice settings. While this growth has had significant benefits to research, practice, and policy, there are some clear challenges that this period of adolescence has uncovered.

MAIN BODY

This invited commentary reflects on the development of implementation science, its rapid growth, and milestones in its establishment as a viable component of the biomedical research enterprise. The authors reflect on progress in research and training, and then unpack some of the consequences of rapid growth, as the field has grappled with the competing challenges of legitimacy among the research community set against the necessary integration and engagement with practice and policy partners. The article then enumerates a set of principles for the field's next developmental stage and espouses the aspirational goal of a "big tent" to support the next generation of impactful science.

CONCLUSION

For implementation science to expand its relevance and impact to practice and policy, researchers must not lose sight of the original purpose of the field-to support improvements in health and health care at scale, the importance of building a community of research and practice among key partners, and the balance of rigor, relevance, and societal benefit.

Examining associations between school-level determinants and the implementation of physical activity opportunities

School-based physical activity (PA) opportunities can help students engage in greater amounts of daily PA, meet PA guidelines, and lead to improved health and educational outcomes. However, we do not completely understand the organizational challenges to implementing these opportunities successfully. This exploratory study examined associations between school-level determinants and the implementation of school-based PA opportunities. We analyzed cross-sectional survey data from schools (n = 46) participating in the Healthy Zone School Program (HZSP) (Dallas, Texas, USA) during 2019-2020. Respondents completed an electronic survey that included measures of school-level determinants (e.g. culture, leadership, priority) and the implementation of school-based PA opportunities. We used linear regression models to examine associations between determinants and implementation outcomes (number of PA opportunities delivered, perceived overall success of each PA program/activity used). After adjusting for campus type (i.e. elementary, middle, high, K-12), student race/ethnicity, and percentage of economically disadvantaged students, no constructs were associated with the number of PA opportunities implemented. Linear regression models suggest access to knowledge and information (β = 0.39, P = .012, 95% CI = 0.24-1.44) and implementation climate (β = 0.34, P = .045, 95% CI = 0.02-1.59) were positively associated with the success of school-based PA opportunities. Our findings provide suggestive evidence that access to knowledge and information and a supportive school climate may improve the overall success of PA opportunities provided to students. Future research should examine additional school-level determinants to understand their importance to implementation and inform the development of strategies to improve schools' capacity for implementing PA opportunities successfully.

Uncovering determinants of perceived feasibility of TF-CBT through coincidence analysis

Introduction

A mental health provider's perception of how well an intervention can be carried out in their context (i.e., feasibility) is an important implementation outcome. This article aims to identify determinants of feasibility of trauma-focused cognitive behavioral therapy (TF-CBT) through a case-based causal approach.

Method

Data come from an implementation-effectiveness study in which lay counselors (teachers and community health volunteers) implemented a culturally adapted manualized mental health intervention, TF-CBT, delivered to teens who were previously orphaned and were experiencing posttraumatic stress symptoms and prolonged grief in Western Kenya. The intervention team identified combinations of determinants that led to feasibility among teacher- and community health volunteer-counselors through coincidence analysis.

Results

Among teacher-counselors, organizational-level factors (implementation climate, implementation leadership) determined moderate and high levels of feasibility. Among community health volunteer-counselors, a strong relationship between a clinical supervisor and the supervisee was the most influential determinant of feasibility.

Conclusion

Methodology and findings from this article can guide the assessment of determinants of feasibility and the development of implementation strategies for manualized mental health interventions in contexts like Western Kenya.

Plain Language Summary

A mental health provider's perception of how easy a therapy is to use in their work setting (i.e., feasibility) can impact whether the provider uses the therapy in their setting. Implementation researchers have recommended finding practices and constructs that lead to important indicators that a therapy will be used. However, limited research to our knowledge has searched and found practices and constructs that might determine feasibility of a therapy. This article uses existing data from a large trial looking at the continued use of a trauma-focused therapy to find practices and constructs that lead to moderate and high levels of feasibility. We found that in settings with a strong organizational structure that organization and leadership support for the therapy led to teachers in Kenya to perceive the therapy as easy to use. On the other hand, in settings with a weaker organizational structure, outside support from a clinical supervisor led to community health volunteers in Kenya perceiving the therapy as easy to use. The findings from this article can guide context-specific recommendations for increasing perceived therapy feasibility at the provider-, organization-, and policy levels.

Findings from an Organizational Context Survey to Inform the Implementation of a Collaborative Care Study for Co-occurring Disorders

Primary care is an opportune setting to deliver treatments for co-occurring substance use and mental health disorders; however, treatment delivery can be challenging due multi-level implementation barriers. Documenting organizational context can provide insight into implementation barriers and the adaptation of new processes into usual care workflows. This study surveyed primary care and behavioral health staff from 13 clinics implementing a collaborative care intervention for opioid use disorders co-occurring with PTSD and/or depression as part of a multisite randomized controlled trial. A total of 323 completed an online survey for a 60% response rate. The Consolidated Framework for Implementation Research guided this assessment of multi-level factors that influence implementation. Most areas for improvement focused on inner setting (organizational level) constructs whereas individual-level constructs tended to be strengths. This work addresses a research gap regarding how organizational analyses can be used prior to implementation and provides practical implications for researchers and clinic leaders.

Addressing COVID-19 vaccine hesitancy in rural community pharmacies: a protocol for a stepped wedge randomized clinical trial

BACKGROUND

Uptake of COVID-19 vaccines remains problematically low in the USA, especially in rural areas. COVID-19 vaccine hesitancy is associated with lower uptake, which translates to higher susceptibility to SARS-CoV-2 variants in communities where vaccination coverage is low. Because community pharmacists are among the most accessible and trusted health professionals in rural areas, this randomized clinical trial will examine implementation strategies to support rural pharmacists in delivering an adapted evidence-based intervention to reduce COVID-19 vaccine hesitancy.

METHODS

We will use an incomplete stepped wedge trial design in which we will randomize 30 rural pharmacies (unit of analysis) to determine the effectiveness and incremental cost-effectiveness of a standard implementation approach (consisting of online training that describes the vaccine hesitancy intervention, live webinar, and resource website) compared to adding on a virtual facilitation approach (provided by a trained facilitator in support of the delivery of the vaccine hesitancy counseling intervention by pharmacists). The intervention (ASORT) has been adapted from an evidence-based vaccine communication intervention for HPV vaccines through a partnership with rural pharmacies in a practice-based research network in seven southern US states. ASORT teaches pharmacists how to identify persons eligible for COVID-19 vaccination (including a booster), solicit and address vaccine concerns in a non-confrontational way, recommend the vaccine, and repeat the steps later if needed. The primary trial outcome is fidelity to the ASORT intervention, which will be determined through ratings of recordings of pharmacists delivering the intervention. The secondary outcome is the effectiveness of the intervention, determined by rates of patients who agree to be vaccinated after receiving the intervention. Other secondary outcomes include feasibility, acceptability, adoption, reach, and cost. Cost-effectiveness and budget impact analyses will be conducted to maximize the potential for future dissemination and sustainability. Mixed methods will provide triangulation, expansion, and explanation of quantitative findings.

DISCUSSION

This trial contributes to a growing evidence base on vaccine hesitancy interventions and virtual-only facilitation of evidenced-based practices in community health settings. The trial will provide the first estimate of the relative value of different implementation strategies in pharmacy settings.

TRIAL REGISTRATION

NCT05926544 (clinicaltrials.gov); 07/03/2023.

Tailored implementation of the FICUS multicomponent family support intervention in adult intensive care units: findings from a mixed methods contextual analysis

BACKGROUND

The Family in Intensive Care UnitS (FICUS) trial investigates the clinical effectiveness of a multicomponent, nurse-led interprofessional family support intervention (FSI) and explores its implementation in intensive care units (ICUs). The local context of each ICU strongly influences intervention performance in practice. To promote FSI uptake and to reduce variation in intervention delivery, we aimed to develop tailored implementation strategies.

METHODS

A mixed method contextual analysis guided by the Consolidated Framework for Implementation Research (CFIR) was performed from March to June 2022 on eight ICUs assigned to the intervention group. ICU key clinical partners were asked to complete a questionnaire on CFIR inner setting measures (i.e., organizational culture, resources, learning climate and leadership engagement) and the Organizational Readiness for Implementing Change (ORIC) scale prior to group interviews, which were held to discuss barriers and facilitators to FSI implementation. Descriptive analysis and pragmatic rapid thematic analysis were used. Then, tailored implementation strategies were developed for each ICU.

RESULTS

In total, 33 key clinical partners returned the questionnaire and 40 attended eight group interviews. Results showed a supportive environment, with CFIR inner setting and ORIC measures each rated above 3 (scale: 1 low-5 high value), with leadership engagement scoring highest (median 4.00, IQR 0.38). Interview data showed that the ICU teams were highly motivated and committed to implementing the FSI. They reported limited resources, new interprofessional information exchange, and role adoption of nurses as challenging.

CONCLUSION

We found that important pre-conditions for FSI implementation, such as leadership support, a supportive team culture, and a good learning climate were present. Some aspects, such as available resources, interprofessional collaboration and family nurses' role adoption were of concern and needed attention. An initial set of implementation strategies were relevant to all ICUs, but some additions and adaptation to local needs were required. Multi-component interventions are challenging to implement within complex systems, such as ICUs. This pragmatic, theory-guided, mixed methods contextual analysis demonstrated high readiness and commitment to FSI implementation in the context of a clinical trial and enabled the specification of a tailored, multifaceted implementation strategy.

How Societal Forces of Change Are Transforming Youth Physical Activity Promotion in North America

BACKGROUND

Climate change, increasing recognition of institutionalized discrimination, and the COVID-19 pandemic are large-scale, societal events (ie, forces of change) that affect the timing, settings, and modes of youth physical activity. Despite the impact that forces of change have on youth physical activity and physical activity environments, few studies consider how they affect physical activity promotion.

METHODS

The authors use 2 established frameworks, the ecological model of physical activity and the youth physical activity timing, how, and setting framework, to highlight changes in physical activity patterns of youth in North America that have resulted from contemporary forces of change.

RESULTS

North American countries-Canada, Mexico, and the United States-have faced similar but contextually different challenges for promoting physical activity in response to climate change, increasing recognition of institutionalized discrimination, and the COVID-19 pandemic. Innovative applications of implementation science, digital health technologies, and community-based participatory research methodologies may be practical for increasing and sustaining youth physical activity in response to these forces of change.

CONCLUSIONS

Thoughtful synthesis of existing physical activity frameworks can help to guide the design and evaluation of new and existing physical activity initiatives. Researchers, practitioners, and policymakers are encouraged to carefully consider the intended and unintended consequences of actions designed to respond to forces of change.

Anthropogenic effects on global soil nitrogen pools

The amount of nitrogen stored in terrestrial soils, its "nitrogen pool", moderates biogeochemical cycling affecting primary productivity, nitrogen pollution and even carbon budgets. The soil nitrogen pools and the transformation of nitrogen forms within them are heavily influenced by environmental factors including anthropogenic activities. However, our understanding of the global distribution of soil nitrogen with respect to anthropogenic activity and human land use remains unclear. We constructed a meta-analysis from a global sampling, in which we compare soil total nitrogen pools and the driving mechanisms affecting each pool across three major classifications of human land use: natural, agricultural, and urban. Although the size of the nitrogen pool can be similar across natural, agricultural and urban soils, the ecological and human associated drivers vary. Specifically, the drivers within agricultural and urban soils as opposed to natural soils are more complex and often decoupled from climatic and soil factors. This suggests that the nitrogen pools of those soils may be co-moderated by other factors not included in our analyses, like human activities. Our analysis supports the notion that agricultural soils act as a nitrogen source while urban soils as a nitrogen sink and informs a modern understanding of the fates and distributions of anthropogenic nitrogen in natural, agricultural, and urban soils.

A structural equation model of CFIR inner and outer setting constructs, organization characteristics, and national DPP enrollment

BACKGROUND

The National Diabetes Prevention Program (DPP) has made great strides in increasing accessibility to its year-long, evidence-based lifestyle change program, with around 3000 organizations having delivered the program. This large dissemination effort offers a unique opportunity to identify organization-level factors associated with program implementation and reach (enrollment) across diverse settings. The purpose of this study was to quantitatively examine the relationships among Consolidated Framework for Implementation Research (CFIR) Inner Setting and Outer Setting constructs and the implementation outcome of reach.

METHODS

This study analyzed data from a 2021 cross-sectional online survey with 586 National DPP Staff (lifestyle coaches, master trainers, program coordinators) with information about their organization, implementation outcomes, and responses to quantitative CFIR Inner Setting and Outer Setting construct items. Structural equation modeling was used to test a hypothesized path model with Inner and Outer Setting variables to explore direct and indirect pathways to enrollment.

RESULTS

The CFIR items had good internal consistency and indicated areas of implementation strength and weakness. Eight variables included as part of the CFIR structural characteristics and one organization characteristic variable had significant direct relationships with enrollment. The length of delivery, number of lifestyle coaches, number of full-time staff, large organization size, and organizations delivering in rural, suburban, and/or urban settings all had positive significant direct relationships with enrollment, while academic organizations and organizations with only non-White participants enrolled in their National DPP lifestyle change programs had a negative association with enrollment.

CONCLUSIONS

Participant reach is an important implementation outcome for the National DPP and vital to making population-level decreases in diabetes incidence in the USA. Our findings suggest that to facilitate enrollment, program implementers should focus on organizational structural characteristics such as staffing. Strengths of this study include the use of adapted and newly developed quantitative CFIR measures and structural equation modeling. Health prevention programs can use the methods and findings from this study to further understand and inform the impact of organization factors on implementation outcomes.

Implementation measurement in global mental health: Results from a modified Delphi panel and investigator survey

Limited guidance exists to support investigators in the choice, adaptation, validation and use of implementation measures for global mental health implementation research. Our objectives were to develop consensus on best practices for implementation measurement and identify strengths and opportunities in current practice. We convened seven expert panelists. Participants rated approaches to measure adaptation and validation according to appropriateness and feasibility. Follow-up interviews were conducted and a group discussion was held. We then surveyed investigators who have used quantitative implementation measures in global mental health implementation research. Participants described their use of implementation measures, including approaches to adaptation and validation, alongside challenges and opportunities. Panelists agreed that investigators could rely on evidence of a measure's validity, reliability and dimensionality from similar contexts. Panelists did not reach consensus on whether to establish the pragmatic qualities of measures in novel settings. Survey respondents (n = 28) most commonly reported using the Consolidated Framework for Implementation Research Inner Setting Measures (n = 9) and the Program Assessment Sustainability Tool (n = 5). All reported adapting measures to their settings; only two reported validating their measures. These results will support guidance for implementation measurement in support of mental health services in diverse global settings.

Increasing the adoption of evidence-based communication practices for HPV vaccination in primary care clinics: The HPV ECHO study protocol for a cluster randomized controlled trial

BACKGROUND

The safe, highly-effective human papillomavirus (HPV) vaccine remains underused in the US. The Announcement Approach Training (AAT) has been shown to effectively increase HPV vaccine uptake by training providers to make strong vaccine recommendations and answer parents' common questions. Systems communications, like recall notices, can further improve HPV vaccination by reducing missed clinical opportunities for vaccination. Never tested in supporting HPV vaccination, the ECHO (Extension for Community Healthcare Outcomes) model is a proven implementation strategy to increase best practices among healthcare providers. This trial uses a hybrid effectiveness-implementation design (type II) to evaluate two ECHO-delivered interventions intended to increase HPV vaccination rates.

METHODS

This 3-arm cluster randomized controlled trial will be conducted in 36 primary care clinics in Pennsylvania. Aim 1 evaluates the impact of HPV ECHO (AAT to providers) and HPV ECHO+ (AAT to providers plus recall notices to vaccine-declining parents) versus control on HPV vaccination (≥1 dose) among adolescents, ages 11-14, between baseline and 12-month follow-up (primary outcome). Using a convergent mixed-methods approach, Aim 2 evaluates the implementation of the HPV ECHO and HPV ECHO+ interventions. Aim 3 explores exposure to and impact of vaccine information from providers and other sources (e.g., social media) on secondary acceptance among 200 HPV vaccine-declining parents within 12 months.

DISCUSSION

We expect to demonstrate the effectiveness and evaluate the implementation of two highly scalable interventions to increase HPV vaccination in primary care clinics. Our study seeks to address the communication needs of both providers and parents, increase HPV vaccination, and, eventually, prevent HPV-related cancers.

TRIAL REGISTRATION

ClinicalTrials.govNCT04587167. Registered on October 14, 2020.

Initial insights into the impact and implementation of Creating Active Schools in Bradford, UK

BACKGROUND

Few whole-school physical activity programmes integrate implementation science frameworks within the design, delivery, and evaluation. As a result, knowledge of the key factors that support implementation at scale is lacking. The Creating Active Schools (CAS) programme was co-designed and is underpinned by the Capability, Opportunity, Motivation and Behaviour (COM-B) model and the Consolidated Framework for Implementation Research (CFIR). The study aims to understand the initial impact and implementation of CAS in Bradford over 9 months using McKay's et al.'s (2019) implementation evaluation roadmap.

METHODS

Focus groups and interviews were conducted with school staff (n = 30, schools = 25), CAS Champions (n = 9), and the CAS strategic lead (n = 1). Qualitative data were analysed both inductively and deductively. The deductive analysis involved coding data into a priori themes based on McKay et al's implementation evaluation roadmap, using a codebook approach to thematic analysis. The inductive analysis included producing initial codes and reviewing themes before finalising.

RESULTS

Identified themes aligned into three categories: (i) key ingredients for successful adoption and implementation of CAS, (ii) CAS implementation: challenges and solutions, and (iv) the perceived effectiveness of CAS at the school level. This included the willingness of schools to adopt and implement whole-school approaches when they are perceived as high quality and aligned with current school values. The programme implementation processes were seen as supportive; schools identified and valued the step-change approach to implementing CAS long-term. Formal and informal communities of practice provided "safe spaces" for cross-school support. Conversely, challenges persisted with gaining broader reach within schools, school staff's self-competence and shifting school culture around physical activity. This resulted in varied uptake between and within schools.

CONCLUSIONS

This study provides novel insights into the implementation of CAS, with outcomes aligning to the adoption, reach, and sustainability. Successful implementation of CAS was underpinned by determinants including acceptability, intervention complexity, school culture and school stakeholders' perceived self-efficacy. The combination of McKay's evaluation roadmap and CFIR establishes a rigorous approach for evaluating activity promotion programmes underpinned by behavioural and implementation science. Resultantly this study offers originality and progression in understanding the implementation and effectiveness of whole-school approaches to physical activity.

Experience and Hospital Context Influence Fall Prevention Practice by Physical Therapists: A Survey Study

BACKGROUND

Falls in and following hospitalization are common and problematic. Little is understood about the factors that impede or promote effective implementation of fall prevention practices.

PURPOSE AND RELEVANCE

Physical therapists are commonly consulted for acute care patients at risk for falling. The purpose of this study is to understand therapist perceptions of their effectiveness in fall prevention and to explore the impact of contextual factors on practice patterns to prevent falls surrounding hospitalization.

METHODS

Survey questions were tailored to the constructs of hospital culture, structural characteristics, networks and communications, and implementation climate, in addition to inquiries regarding practice patterns and attitudes/beliefs.

RESULTS

Overall, 179 surveys were analyzed. Most therapists (n = 135, 75.4%) affirmed their hospital prioritizes best practices for fall prevention, although fewer agreed that therapists other than themselves provide optimal fall prevention intervention (n = 105, 58.7%). Less practice experience was associated with greater odds of affirming that contextual factors influence fall prevention practice (odds ratio 3.90, p < .001). Respondents who agreed that their hospital system prioritizes best practices for fall prevention had 14 times the odds of believing that their system prioritizes making improvements ( p = .002).

CONCLUSIONS/IMPLICATIONS

As experience influences fall prevention practice, quality assurance and improvement initiatives should be used to ensure minimum specifications of practice.

Models, frameworks and theories in the implementation of programs targeted to reduce formal coercion in mental health settings: a systematic review

Introduction

Implementation models, frameworks and theories (hereafter tools) provide researchers and clinicians with an approach to understand the processes and mechanisms for the successful implementation of healthcare innovations. Previous research in mental health settings has revealed, that the implementation of coercion reduction programs presents a number of challenges. However, there is a lack of systematized knowledge of whether the advantages of implementation science have been utilized in this field of research. This systematic review aims to gain a better understanding of which tools have been used by studies when implementing programs aiming to reduce formal coercion in mental health settings, and what implementation outcomes they have reported.

Methods

A systematic search was conducted using PubMed, CINAHL, PsycINFO, Cochrane, Scopus, and Web of Science. A manual search was used to supplement database searches. Quality appraisal of included studies was undertaken using MMAT-Mixed Methods Appraisal Tool. A descriptive and narrative synthesis was formed based on extracted data. Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) guidelines were followed in this review.

Results

We identified 5,295 references after duplicates were removed. Four additional references were found with a manual search. In total eight studies reported in nine papers were included in the review. Coercion reduction programs that were implemented included those that were holistic, and/or used professional judgement, staff training and sensory modulation interventions. Eight different implementation tools were identified from the included studies. None of them reported all eight implementation outcomes sought from the papers. The most frequently reported outcomes were acceptability (4/8 studies) and adaptation (3/8). With regards to implementation costs, no data were provided by any of the studies. The quality of the studies was assessed to be overall quite low.

Discussion

Systematic implementation tools are seldom used when efforts are being made to embed interventions to reduce coercive measures in routine mental health care. More high-quality studies are needed in the research area that also involves perspectives of service users and carers. In addition, based on our review, it is unclear what the costs and resources are needed to implement complex interventions with the guidance of an implementation tool.

Systematic review registration

[Prospero], identifier [CRD42021284959].

Retrospective analysis of factors influencing the implementation of a program to address unprofessional behaviour and improve culture in Australian hospitals

BACKGROUND

Unprofessional behaviour among hospital staff is common. Such behaviour negatively impacts on staff wellbeing and patient outcomes. Professional accountability programs collect information about unprofessional staff behaviour from colleagues or patients, providing this as informal feedback to raise awareness, promote reflection, and change behaviour. Despite increased adoption, studies have not assessed the implementation of these programs utilising implementation theory. This study aims to (1) identify factors influencing the implementation of a whole-of-hospital professional accountability and culture change program, Ethos, implemented in eight hospitals within a large healthcare provider group, and (2) examine whether expert recommended implementation strategies were intuitively used during implementation, and the degree to which they were operationalised to address identified barriers.

METHOD

Data relating to implementation of Ethos from organisational documents, interviews with senior and middle management, and surveys of hospital staff and peer messengers were obtained and coded in NVivo using the Consolidated Framework for Implementation Research (CFIR). Implementation strategies to address identified barriers were generated using Expert Recommendations for Implementing Change (ERIC) strategies and used in a second round of targeted coding, then assessed for degree of alignment to contextual barriers.

RESULTS

Four enablers, seven barriers, and three mixed factors were found, including perceived limitations in the confidential nature of the online messaging tool ('Design quality and packaging'), which had downstream challenges for the capacity to provide feedback about utilisation of Ethos ('Goals and Feedback', 'Access to Knowledge and Information'). Fourteen recommended implementation strategies were used, however, only four of these were operationalised to completely address contextual barriers.

CONCLUSION

Aspects of the inner setting (e.g., 'Leadership Engagement', 'Tension for Change') had the greatest influence on implementation and should be considered prior to the implementation of future professional accountability programs. Theory can improve understanding of factors affecting implementation, and support strategies to address them.

Team-focused implementation strategies to improve implementation of mental health screening and referral in rural Children's Advocacy Centers: study protocol for a pilot cluster randomized hybrid type 2 trial

BACKGROUND

Children's Advocacy Centers (CACs) use multidisciplinary teams to investigate and respond to maltreatment allegations. CACs play a critical role in connecting children with mental health needs to evidence-based mental health treatment, especially in low-resourced rural areas. Standardized mental health screening and referral protocols can improve CACs' capacity to identify children with mental health needs and encourage treatment engagement. In the team-based context of CACs, teamwork quality is likely to influence implementation processes and outcomes. Implementation strategies that target teams and apply the science of team effectiveness may enhance implementation outcomes in team-based settings.

METHODS

We will use Implementation Mapping to develop team-focused implementation strategies to support the implementation of the Care Process Model for Pediatric Traumatic Stress (CPM-PTS), a standardized screening and referral protocol. Team-focused strategies will integrate activities from effective team development interventions. We will pilot team-focused implementation in a cluster-randomized hybrid type 2 effectiveness-implementation trial. Four rural CACs will implement the CPM-PTS after being randomized to either team-focused implementation (n = 2 CACs) or standard implementation (n = 2 CACs). We will assess the feasibility of team-focused implementation and explore between-group differences in hypothesized team-level mechanisms of change and implementation outcomes (implementation aim). We will use a within-group pre-post design to test the effectiveness of the CPM-PTS in increasing caregivers' understanding of their child's mental health needs and caregivers' intentions to initiate mental health services (effectiveness aim).

CONCLUSIONS

Targeting multidisciplinary teams is an innovative approach to improving implementation outcomes. This study will be one of the first to test team-focused implementation strategies that integrate effective team development interventions. Results will inform efforts to implement evidence-based practices in team-based service settings.

TRIAL REGISTRATION

Clinicaltrials.gov, NCT05679154 . Registered on January 10, 2023.

Application of implementation mapping to develop strategies for integrating the National Diabetes Prevention Program into primary care clinics

Background

Diabetes is considered one of the most prevalent and preventable chronic health conditions in the United States. Research has shown that evidence-based prevention measures and lifestyle changes can help lower the risk of developing diabetes. The National Diabetes Prevention Program (National DPP) is an evidence-based program recognized by the Centers for Disease Control and Prevention; it is designed to reduce diabetes risk through intensive group counseling in nutrition, physical activity, and behavioral management. Factors known to influence this program's implementation, especially in primary care settings, have included limited awareness of the program, lack of standard clinical processes to facilitate referrals, and limited reimbursement incentives to support program delivery. A framework or approach that can address these and other barriers of practice is needed.

Objective

We used Implementation Mapping, a systematic planning framework, to plan for the adoption, implementation, and maintenance of the National DPP in primary care clinics in the Greater Houston area. We followed the framework's five iterative tasks to develop strategies that helped to increase awareness and adoption of the National DPP and facilitate program implementation.

Methods

We conducted a needs assessment survey and interviews with participating clinics. We identified clinic personnel who were responsible for program use, including adopters, implementers, maintainers, and potential facilitators and barriers to program implementation. The performance objectives, or sub-behaviors necessary to achieve each clinic's goals, were identified for each stage of implementation. We used classic behavioral science theory and dissemination and implementation models and frameworks to identify the determinants of program adoption, implementation, and maintenance. Evidence- and theory-based methods were selected and operationalized into tailored strategies that were executed in the four participating clinic sites. Implementation outcomes are being measured by several different approaches. Electronic Health Records (EHR) will measure referral rates to the National DPP. Surveys will be used to assess the level of the clinic providers and staff's acceptability, appropriateness of use, feasibility, and usefulness of the National DPP, and aggregate biometric data will measure the level of the clinic's disease management of prediabetes and diabetes.

Results

Participating clinics included a Federally Qualified Health Center, a rural health center, and two private practices. Most personnel, including the leadership at the four clinic sites, were not aware of the National DPP. Steps for planning implementation strategies included the development of performance objectives (implementation actions) and identifying psychosocial and contextual implementation determinants. Implementation strategies included provider-to-provider education, electronic health record optimization, and the development of implementation protocols and materials (e.g., clinic project plan, policies).

Conclusion

The National DPP has been shown to help prevent or delay the development of diabetes among at-risk patients. Yet, there remain many challenges to program implementation. The Implementation Mapping framework helped to systematically identify implementation barriers and facilitators and to design strategies to address them. To further advance diabetes prevention, future program, and research efforts should examine and promote other strategies such as increased reimbursement or use of incentives and a better billing infrastructure to assist in the scale and spread of the National DPP across the U.S.

Symptom management care pathway adaptation process and specific adaptation decisions

BACKGROUND

There is substantial heterogeneity in symptom management provided to pediatric patients with cancer. The primary objective was to describe the adaptation process and specific adaptation decisions related to symptom management care pathways based on clinical practice guidelines. The secondary objective evaluated if institutional factors were associated with adaptation decisions.

METHODS

Fourteen previously developed symptom management care pathway templates were reviewed by an institutional adaptation team composed of two clinicians at each of 10 institutions. They worked through each statement for all care pathway templates sequentially. The institutional adaptation team made the decision to adopt, adapt or reject each statement, resulting in institution-specific symptom management care pathway drafts. Institutional adaption teams distributed the 14 care pathway drafts to their respective teams; their feedback led to care pathway modifications.

RESULTS

Initial care pathway adaptation decision making was completed over a median of 4.2 (interquartile range 2.0-5.3) weeks per institution. Across all institutions and among 1350 statements, 551 (40.8%) were adopted, 657 (48.7%) were adapted, 86 (6.4%) were rejected and 56 (4.1%) were no longer applicable because of a previous decision. Most commonly, the reason for rejection was not agreeing with the statement (70/86, 81.4%). Institutional-level factors were not significantly associated with statement rejection.

CONCLUSIONS

Acceptability of the 14 care pathways was evident by most statements being adopted or adapted. The adaptation process was accomplished over a relatively short timeframe. Future work should focus on evaluation of care pathway compliance and determination of the impact of care pathway-consistent care on patient outcomes.

TRIAL REGISTRATION

clinicaltrials.gov, NCT04614662. Registered 04/11/2020, https://clinicaltrials.gov/ct2/show/NCT04614662?term=NCT04614662&draw=2&rank=1 .

Facilitators and barriers to collaboration between drug courts and community-based medication for opioid use disorder providers

INTRODUCTION

Access to medications for opioid use disorder (MOUD) is limited for individuals in drug courts - programs that leverage sanctions for mandatory substance use treatment. Drug courts rely on community agencies to provide MOUD. However, relationships with MOUD agencies, which impact access to treatment, are understudied. We examined barriers and facilitators from drug court staffs' perspectives to understand how to enhance collaborations with MOUD providers.

METHODS

Drug court staff (n = 21) from seven courts participated in semi-structured interviews about their experience in collaborating with MOUD providers. Interviews were informed by the Consolidated Framework for Implementation Research. Inductive (theory-based) and deductive (ground-up) approaches were used for analyses.

RESULTS

Facilitator and barrier themes centered around the needs and resources of drug court participants, external policies such MOUD access in jails, networking with external agencies, and beliefs about MOUD providers. Drug court staff preferred working with agencies that offered MOUD alongside comprehensive services. Drug courts benefited when jails offered MOUD in-house and facilitated community referrals. Existing relationships with providers and responsive communication eased referrals and served to educate the courts about MOUD. Barriers included logistical limitations (limited hours, few methadone providers) and inadequate communication patterns between providers and drug court staff. A lack of confidence in providers' prescribing practices and concerns around perceived overmedication of participants impacted referrals, interagency collaboration, and further burdened the participants.

CONCLUSIONS

Collaboration between drug courts and MOUD providers was driven by patient needs, external policies, communication patterns, and perceptions. Interventions to increase access MOUD for drug court participants will need to incorporate collaboration strategies while considering the unique features of drug courts.

Diabetes Remote Monitoring Program Implementation: A Mixed Methods Analysis of Delivery Strategies, Barriers and Facilitators

BACKGROUND

Remote patient monitoring (RPM) is being increasingly utilized as a type of telemedicine modality to improve access to quality health care, although there are documented challenges with this type of innovation. The goals of this study were to characterize clinic delivery strategies for an RPM program and to examine barriers and facilitators to program implementation in a variety of community clinic settings.

METHODS

Primary data were collected via individual and small group interviews and surveys of clinical staff from South Carolina primary care clinics participating in an RPM program for patients with diabetes mellitus type 2 in 2019. We used a parallel convergent mixed methods study design with six South Carolina primary care outpatient clinics currently participating in a diabetes remote monitoring program. Clinic staff participants completed surveys to define delivery strategies and experiences with the program in a variety of clinical settings. Interviews of clinic staff examined barriers and facilitators to program implementation guided by the Consolidated Framework for Implementation Research (CFIR). Quantitative survey data were summarized via descriptive statistics. Qualitative data from interviews were analyzed in a template analysis approach with primary themes identified and organized by two independent coders and guided by the CFIR. Quantitative and qualitative findings were then synthesized in a final step.

RESULTS

RPM program delivery strategies varied across clinic, patient population, and program domains, largely affected by staffing, leadership buy-in, resources, patient needs, and inter-site communication. Barriers and facilitators to implementation were linked to similar factors that influenced delivery strategy.

DISCUSSION

RPM programs were implemented in a variety of different clinic settings with program delivery tailored to fit within each clinic's workflow and meet patients' needs. By addressing the barriers identified in this study with focused training and support strategies, delivery processes can improve implementation of RPM programs and thus benefit patient outcomes in rural and community settings.

Participation, barriers, and facilitators of cancer screening among LGBTQ+ populations: A review of the literature

The LGBTQ+ community is at higher risk of certain cancers but is less likely to participate in screening programs or engage with preventive healthcare. Despite this, the barriers and facilitators to cancer screening are not well understood in this population. We conducted a literature review of research related to LGBTQ+ participation in cancer screening, as well as barriers and facilitators to participation. Following abstract and full-text screening, 50 studies were included in the final synthesis. Compared to their heterosexual counterparts, lesbian and bisexual women were less likely to participate in cervical cancer screening and mammography, but gay and bisexual men were more likely to participate in anal and colorectal cancer screening. Transgender individuals had lower rates of screening than cisgender individuals for all cancer types. Barriers to participation were found at the individual-, provider-, and administrator-level, and good communication with a healthcare provider was the strongest facilitator. These results provide reasonable first steps toward improving participation rates for LGBTQ+ populations in cancer screening. Patient-centered approaches should draw on core guiding principles to inform the provision of care, including anticipating LGBTQ+ patients, improving knowledge about care for these patients, and confronting individually-held biases that may affect care, in order to improve care experiences and participation rates in preventive services.

Participating in a parenting intervention in prison, perceptions from incarcerated fathers and mothers-A convergent mixed-methods study

BACKGROUND

Children of incarcerated parents run a high risk of ill-health and future delinquency, whereas positive parenting can support children's healthy development. The For Our Children's Sake (FOCS) parenting intervention for parents in prison was evaluated as a controlled trial during 2019-2021 within The Swedish Prison and Probation Service (SPPS). This study reports on the process evaluation and aimed to describe how parents perceived their participation and aspects that influenced implementation of the FOCS intervention.

METHODS

This convergent mixed-methods study (QUAL + quan) included qualitative interview data after participation in the FOCS intervention group (12 parents), and quantitative questionnaire data from intervention and control groups (46 parents). Qualitative data were analysed using inductive qualitative content analysis and quantitative data using descriptive and non-parametric statistics.

RESULTS

An integrated synthesis of the qualitative and quantitative results showed three joint concepts that provided an extended understanding of the importance of a child and parent focused intervention available to parents in prison, where FOCS was perceived as the only place where inmates could openly reflect, and express sensitive feelings and thoughts related to the children and being a parent. Also, that the SPPS as an organisation entails partly unsupportive organisational norms with irregular individual staff engagement, which made FOCS invisible in prisons, and the importance of engagement and motivation from all participants and group leaders in the group was essential for a successful FOCS group.

CONCLUSION

This study showed that availability of a child and parent focused intervention in prison is perceived as very important, and at the same time dependent on a trustful relationship in the group to be rewarding to the participants, where organisational norms within the SPSS need amendments for successful implementation of FOCS. These findings can guide further implementation of similar interventions in prison.

Barriers to Implementation of Breast Cancer Risk Assessment: The Health Care Team Perspective

PURPOSE

To assess health care professionals' perceptions of barriers to the utilization of breast cancer risk assessment tools in the public health setting through a series of one-on-one interviews with health care team members.

METHODS

We conducted a cross-sectional qualitative study consisting of one-on-one semistructured telephone interviews with health care team members in the public health setting in the state of Tennessee between May 2020 and October 2020. An iterative inductive-deductive approach was used for qualitative analysis of interview data, resulting in the development of a conceptual framework to depict influences of provider behavior in the utilization of breast cancer risk assessment.

RESULTS

A total of 24 interviews were completed, and a framework of influences of provider behavior in the utilization of breast cancer risk assessment was developed. Participants identified barriers to the utilization of breast cancer risk assessment (knowledge and understanding of risk assessment tools, workflow challenges, and availability of personnel); patient-level barriers as perceived by health care team members (psychological, economic, educational, and environmental); and strategies to increase the utilization of breast cancer risk assessment at the provider level (leadership buy-in, training, supportive policies, and incentives) and patient level (improved communication and better understanding of patients' perceived cancer risk and severity of cancer).

CONCLUSIONS

Understanding barriers to implementation of breast cancer risk assessment and strategies to overcome these barriers as perceived by health care team members offers an opportunity to improve implementation of risk assessment and to identify a racially, geographically, and socioeconomically diverse population of young women at high risk for breast cancer.

Translating knowledge into action for child obesity treatment in partnership with Parks and Recreation: study protocol for a hybrid type II trial

BACKGROUND

Safe and effective treatment exists for childhood obesity, but treatment recommendations have largely not been translated into practice, particularly among racial and ethnic minorities and low-wealth populations. A key gap is meeting the recommended treatment of ≥26 h of lifestyle modification over 6-12 months. Fit Together is an effective treatment model that meets these recommendations by integrating healthcare and community resources. Pediatric providers screen children for obesity, deliver counseling, and treat co-morbidities, while Parks and Recreation partners provide recreation space for a community nutrition and physical activity program.

METHODS

This study will use a hybrid type II implementation-effectiveness design to evaluate the effectiveness of an online implementation platform (the Playbook) for delivering Fit Together. Clinical and community partners in two North Carolina communities will implement Fit Together, using the Playbook, an implementation package designed to facilitate new partnerships, guide training activities, and provide curricular materials needed to implement Fit Together. An interrupted time series design anchored in the Process Redesign Framework will be used to evaluate implementation and effectiveness outcomes in intervention sites. Implementation measures include semi-structured interviews with partners, before and after the implementation of Fit Together, and quantitative measures assessing several constructs within the Process Redesign Framework. The participants will be children 6-11 years old with obesity and their families (n=400). Effectiveness outcomes include a change in child body mass index and physical activity from baseline to 6 and 12 months, as compared with children receiving usual care. Findings will be used to inform the design of a dissemination strategy guided by the PCORI Dissemination Framework.

DISCUSSION

This project addresses the knowledge-to-action gap by developing evidence-based implementation tools that allow clinicians and communities to deliver effective pediatric obesity treatment recommendations. Future dissemination of these tools will allow more children who have obesity and their families to have access to effective, evidence-based care in diverse communities.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT05455190 . Registered on 13 July 2022.

Associations between teamwork and implementation outcomes in multidisciplinary cross-sector teams implementing a mental health screening and referral protocol

PURPOSE

Teams play a central role in the implementation of new practices in settings providing team-based care. However, the implementation science literature has paid little attention to potentially important team-level constructs. Aspects of teamwork, including team interdependence, team functioning, and team performance, may affect implementation processes and outcomes. This cross-sectional study tests associations between teamwork and implementation antecedents and outcomes in a statewide initiative to implement a standardized mental health screening/referral protocol in Child Advocacy Centers (CACs).

METHODS

Multidisciplinary team members (N = 433) from 21 CACs completed measures of team interdependence; affective, behavioral, and cognitive team functioning; and team performance. Team members also rated the acceptability, appropriateness, and feasibility of the screening/referral protocol and implementation climate. The implementation outcomes of days to adoption and reach were independently assessed with administrative data. Associations between team constructs and implementation antecedents and outcomes were tested with linear mixed models and regression analyses.

RESULTS

Team task interdependence was positively associated with implementation climate and reach, and outcome interdependence was negatively correlated with days to adoption. Task and outcome interdependence were not associated with acceptability, appropriateness, or feasibility of the screening/referral protocol. Affective team functioning (i.e., greater liking, trust, and respect) was associated with greater acceptability, appropriateness, and feasibility. Behavioral and cognitive team functioning were not associated with any implementation outcomes in multivariable models. Team performance was positively associated with acceptability, appropriateness, feasibility, and implementation climate; performance was not associated with days to adoption or reach.

CONCLUSIONS

We found associations of team interdependence, functioning, and performance with both individual- and center-level implementation outcomes. Implementation strategies targeting teamwork, especially task interdependence, affective functioning, and performance, may contribute to improving implementation outcomes in team-based service settings.

Understanding tailoring to support the implementation of evidence-based interventions in healthcare: The CUSTOMISE research programme protocol

Although there are effective evidence-based interventions (EBIs) to prevent, treat and coordinate care for chronic conditions they may not be adopted widely and when adopted, implementation challenges can limit their impact.  Implementation strategies are "methods or techniques used to enhance the adoption, implementation, and sustainment of a clinical program or practice". There is some evidence to suggest that to be more effective,  strategies should be tailored; that is, selected and designed to address specific determinants which may influence implementation in a given context. Despite the growing popularity of tailoring the concept is ill-defined, and the way in which tailoring is applied can vary across studies or lack detail when reported. There has been less focus on the part of tailoring where stakeholders prioritise determinants and select strategies, and the way in which theory, evidence and stakeholders' perspectives should be combined to make decisions during the process. Typically, tailoring is evaluated based on the effectiveness of the tailored strategy, we do not have a clear sense of the mechanisms through which tailoring works, or how to measure the "success" of the tailoring process. We lack an understanding of how stakeholders can be involved effectively in tailoring and the influence of different approaches on the outcome of tailoring. Our research programme, CUSTOMISE (Comparing and Understanding Tailoring Methods for Implementation Strategies in healthcare) will address some of these outstanding questions and generate evidence on  the feasibility, acceptability, and efficiency of different tailoring approaches, and build capacity in implementation science in Ireland, developing and delivering training and supports for, and network of, researchers and implementation practitioners. The evidence generated across the studies conducted as part of CUSTOMISE will bring greater clarity, consistency, coherence, and transparency to tailoring, a key process in implementation science.

Using the Consolidated Framework for Implementation Research to evaluate a nationwide depression prevention project (ImplementIT) from the perspective of health care workers and implementers: Results on the implementation of digital interventions for farmers

Introduction

Depression has a significant impact on individuals and society, which is why preventive measures are important. Farmers represent an occupational group exposed to many risk factors for depression. The potential of guided, tailored internet-based interventions and a personalized telephone coaching is evaluated in a German project of the Social Insurance for Agriculture, Forestry and Horticulture (SVLFG). While user outcomes are promising, not much is known about actual routine care use and implementation of the two digital health interventions. This study evaluates the implementation from the perspective of social insurance employees to understand determinants influencing the uptake and implementation of digital interventions to prevent depression in farmers.

Methods

The data collection and analysis are based on the Consolidated Framework for Implementation Research (CFIR). Health care workers (n = 86) and implementers (n = 7) completed online surveys and/or participated in focus groups. The surveys consisted of validated questionnaires used in implementation research, adapted items from the CFIR guide or from other CFIR studies. In addition, we used reporting data to map implementation based on selected CFIR constructs.

Results

Within the five CFIR dimensions, many facilitating factors emerged in relation to intervention characteristics (e.g., relative advantage compared to existing services, evidence and quality) and the inner setting of the SVLFG (e.g., tension for change, compatibility with values and existing working processes). In addition, barriers to implementation were identified in relation to the outer setting (patient needs and resources), inner setting (e.g., available resources, access to knowledge and information) and characteristics of individuals (e.g., self-efficacy). With regard to the implementation process, facilitating factors (formal implementation leaders) as well as hindering factors (reflecting and evaluating) were identified.

Discussion

The findings shed light on the implementation of two digital prevention services in an agricultural setting. While both offerings seem to be widely accepted by health care workers, the results also point to revealed barriers and contribute to recommendations for further service implementation. For instance, special attention should be given to "patient needs and resources" by raising awareness of mental health issues among the target population as well as barriers regarding the inner setting.

Clinical Trial Registration

German Clinical Trial Registration: [DRKS00017078]. Registered on 18.04.2019.

Assessing the use of constructs from the consolidated framework for implementation research in U.S. rural cancer screening promotion programs: a systematic search and scoping review

BACKGROUND

Cancer screening is suboptimal in rural areas, and interventions are needed to improve uptake. The Consolidated Framework for Implementation Research (CFIR) is a widely-used implementation science framework to optimize planning and delivery of evidence-based interventions, which may be particularly useful for screening promotion in rural areas. We examined the discussion of CFIR-defined domains and constructs in programs to improve cancer screening in rural areas.

METHODS

We conducted a systematic search of research databases (e.g., Medline, CINAHL) to identify studies (published through November 2022) of cancer screening promotion programs delivered in rural areas in the United States. We identified 166 records, and 15 studies were included. Next, two reviewers used a standardized abstraction tool to conduct a critical scoping review of CFIR constructs in rural cancer screening promotion programs.

RESULTS

Each study reported at least some CFIR domains and constructs, but studies varied in how they were reported. Broadly, constructs from the domains of Process, Intervention, and Outer setting were commonly reported, but constructs from the domains of Inner setting and Individuals were less commonly reported. The most common constructs were planning (100% of studies reporting), followed by adaptability, cosmopolitanism, and reflecting and evaluating (86.7% for each). No studies reported tension for change, self-efficacy, or opinion leader.

CONCLUSIONS

Leveraging CFIR in the planning and delivery of cancer screening promotion programs in rural areas can improve program implementation. Additional studies are needed to evaluate the impact of underutilized CFIR domains, i.e., Inner setting and Individuals, on cancer screening programs.

Implementation, uptake and use of a digital COVID-19 symptom tracker in English care homes in the coronavirus pandemic: a mixed-methods, multi-locality case study

BACKGROUND

COVID-19 spread rapidly in UK care homes for older people in the early pandemic. National infection control recommendations included remote resident assessment. A region in North-West England introduced a digital COVID-19 symptom tracker for homes to identify early signs of resident deterioration to facilitate care responses. We examined the implementation, uptake and use of the tracker in care homes across four geographical case study localities in the first year of the pandemic.

METHODS

This was a rapid, mixed-methods, multi-locality case study. Tracker uptake was calculated using the number of care homes taking up the tracker as a proportion of the total number of care homes in a locality. Mean tracker use was summarised at locality level and compared. Semi-structured interviews were conducted with professionals involved in tracker implementation and used to explore implementation factors across localities. Template Analysis with the Consolidated Framework for Implementation Research (CFIR) guided the interpretation of qualitative data.

RESULTS

Uptake varied across the four case study localities ranging between 13.8 and 77.8%. Tracker use decreased in all localities over time at different rates, with average use ranging between 18 and 58%. The implementation context differed between localities and the process of implementation deviated over time from the initially planned strategy, for stakeholder engagement and care homes' training. Four interpretative themes reflected the most influential factors appearing to affect tracker uptake and use: (1) the process of implementation, (2) implementation readiness, (3) clarity of purpose/perceived value and (4) relative priority in the context of wider system pressures.

CONCLUSIONS

Our study findings resonate with the digital solutions evidence base prior to the COVID-19 pandemic, suggesting three key factors that can inform future development and implementation of rapid digital responses in care home settings even in times of crisis: an incremental approach to implementation with testing of organisational readiness and attention to implementation climate, particularly the innovation's fit with local contexts (i.e. systems, infrastructure, work processes and practices); involvement of end-users in innovation design and development; and enabling users' easy access to sustained, high-quality, appropriate training and support to enable staff to adapt to digital solutions.

Adaptation of a Personalized Electronic Care Planning Tool for Cancer Follow-up Care: Formative Study

BACKGROUND

Most patients diagnosed with colorectal cancer will survive for at least 5 years; thus, engaging patients to optimize their health will likely improve outcomes. Clinical guidelines recommend patients receive a comprehensive care plan (CP) when transitioning from active treatment to survivorship, which includes support for ongoing symptoms and recommended healthy behaviors. Yet, cancer care providers find this guideline difficult to implement. Future directions for survivorship care planning include enhancing information technology support for developing personalized CPs, using CPs to facilitate self-management, and assessing CPs in clinical settings.

OBJECTIVE

We aimed to develop an electronic tool for colorectal cancer follow-up care (CFC) planning.

METHODS

Incorporating inputs from health care professionals and patient stakeholders is fundamental to the successful integration of any tool into the clinical workflow. Thus, we followed the Integrate, Design, Assess, and Share (IDEAS) framework to adapt an existing application for stroke care planning (COMPASS-CP) to meet the needs of colorectal cancer survivors (COMPASS-CP CFC). Constructs from the Consolidated Framework for Implementation Research (CFIR) guided our approach. We completed this work in 3 phases: (1) gathering qualitative feedback from stakeholders about the follow-up CP generation design and workflow; (2) adapting algorithms and resource data sources needed to generate a follow-up CP; and (3) optimizing the usability of the adapted prototype of COMPASS-CP CFC. We also quantitatively measured usability (target average score ≥70; range 0-100), acceptability, appropriateness, and feasibility.

RESULTS

In the first phase, health care professionals (n=7), and patients and caregivers (n=7) provided qualitative feedback on COMPASS-CP CFC that informed design elements such as selection, interpretation, and clinical usefulness of patient-reported measures. In phase 2, we built a minimal viable product of COMPASS-CP CFC. This tool generated CPs based on the needs identified by patient-completed measures (including validated patient-reported outcomes) and electronic health record data, which were then matched with resources by zip code and preference to support patients' self-management. Elements of the CFIR assessed revealed that most health care professionals believed the tool would serve patients' needs and had advantages. In phase 3, the average System Usability Scale score was above our target score for health care professionals (n=5; mean 71.0, SD 15.2) and patients (n=5; mean 95.5, SD 2.1). Participants also reported high levels of acceptability, appropriateness, and feasibility. Additional CFIR-informed feedback, such as desired format for training, will inform future studies.

CONCLUSIONS

The data collected in this study support the initial usability of COMPASS-CP CFC and will inform the next steps for implementation in clinical care. COMPASS-CP CFC has the potential to streamline the implementation of personalized CFC planning to enable systematic access to resources that will support self-management. Future research is needed to test the impact of COMPASS-CP CFC on patient health outcomes.

Pilot implementation of the PharmNet naloxone program in an independent pharmacy

BACKGROUND

The U.S. overdose epidemic has continued to escalate with more than 100,000 deaths per year in the past several years, most of which involve opioids. Widespread availability of naloxone is part of a national solution to the crisis, and community pharmacies are well-poised to facilitate such distribution and provide additional harm reduction services.

OBJECTIVES

The primary objectives of this study were to (a) examine the usability of each of the separate intervention components prepared for PharmNet, (b) observe intervention fidelity through regularly scheduled site visits, and (c) explore the association between PharmNet implementation and the volume of naloxone sales and distribution in the pilot site.

PRACTICE DESCRIPTION

Here, we describe a carefully designed and tailored pharmacy harm reduction intervention called PharmNet that is designed to maximize harm reduction impact while minimizing utilization of pharmacist resources. It is a pragmatic awareness, service provision, and referral program that was developed through careful, iterative feasibility studies with pharmacists.

PRACTICE INNOVATION

PharmNet procedures include tools and steps to create awareness (e.g., yard signs and messaging for patients, reminder tools for pharmacists), facilitation of naloxone delivery from nonprofits, and provision of referral cards featuring local resources.

EVALUATION METHODS

Evaluation included direct data collection and randomly scheduled fidelity site visits.

RESULTS

The intervention was associated with an increase of 3.33 naloxone doses/mo being dispensed at cost (34.4% relative increase) and an overall increase of 9.33 naloxone doses/mo being dispensed via any mechanism (96.48% relative increase). Around 2.85 referral cards were issued to patients daily. Intervention fidelity was moderate, and the study provides valuable information for how to modify the study prior to a randomized trial.

CONCLUSION

With modifications informed by this pilot study, the PharmNet intervention merits a randomized trial to determine whether it causes increased naloxone dispensing in independent community pharmacies.

The MOHMQuit (Midwives and Obstetricians Helping Mothers to Quit Smoking) Trial: protocol for a stepped-wedge implementation trial to improve best practice smoking cessation support in public antenatal care services

BACKGROUND

Smoking during pregnancy is the most important preventable cause of adverse pregnancy outcomes, yet smoking cessation support (SCS) is inconsistently provided. The MOMHQUIT intervention was developed to address this evidence-practice gap, using the Behaviour Change Wheel method by mapping barriers to intervention strategies. MOHMQuit includes systems, leadership and clinician elements. This implementation trial will determine the effectiveness and cost-effectiveness of MOHMQuit in improving smoking cessation rates in pregnant women in public maternity care services in Australia; test the mechanisms of action of the intervention strategies; and examine implementation outcomes.

METHODS

A stepped-wedge cluster-randomised design will be used. Implementation of MOHMQuit will include reinforcing leadership investment in SCS as a clinical priority, strengthening maternity care clinicians' knowledge, skills, confidence and attitudes towards the provision of SCS, and clinicians' documentation of guideline-recommended SCS provided during antenatal care. Approximately, 4000 women who report smoking during pregnancy will be recruited across nine sites. The intervention and its implementation will be evaluated using a mixed methods approach. The primary outcome will be 7-day point prevalence abstinence at the end of pregnancy, among pregnant smokers, verified by salivary cotinine testing. Continuous data collection from electronic medical records and telephone interviews with postpartum women will occur throughout 32 months of the trial to assess changes in cessation rates reported by women, and SCS documented by clinicians and reported by women. Data collection to assess changes in clinicians' knowledge, skills, confidence and attitudes will occur prior to and immediately after the intervention at each site, and again 6 months later. Questionnaires at 3 months following the intervention, and semi-structured interviews at 6 months with maternity service leaders will explore leaders' perceptions of acceptability, adoption, appropriateness, feasibility, adaptations and fidelity of delivery of the MOHMQuit intervention. Structural equation modelling will examine causal linkages between the strategies, mediators and outcomes. Cost-effectiveness analyses will also be undertaken.

DISCUSSION

This study will provide evidence of the effectiveness of a multi-level implementation intervention to support policy decisions; and evidence regarding mechanisms of action of the intervention strategies (how the strategies effected outcomes) to support further theoretical developments in implementation science.

TRIAL REGISTRATION

ACTRN12622000167763, registered February 2nd 2022.

Use of the consolidated framework for implementation research in a mixed methods evaluation of the EQUIPPED medication safety program in four academic health system emergency departments

Background

Enhancing Quality of Prescribing Practices for Older Adults Discharged from the Emergency Department (EQUIPPED) is an effective quality improvement program initially designed in the Veterans Administration (VA) health care system to reduce potentially inappropriate medication prescribing for adults aged 65 years and older. This study examined factors that influence implementation of EQUIPPED in EDs from four distinct, non-VA academic health systems using a convergent mixed methods design that operationalized the Consolidated Framework for Implementation Research (CFIR). Fidelity of delivery served as the primary implementation outcome.

Materials and methods

Four EDs implemented EQUIPPED sequentially from 2017 to 2021. Using program records, we scored each ED on a 12-point fidelity index calculated by adding the scores (1-3) for each of four components of the EQUIPPED program: provider receipt of didactic education, one-on-one academic detailing, monthly provider feedback reports, and use of order sets. We comparatively analyzed qualitative data from focus groups with each of the four implementation teams (n = 22) and data from CFIR-based surveys of ED providers (108/234, response rate of 46.2%) to identify CFIR constructs that distinguished EDs with higher vs. lower levels of implementation.

Results

Overall, three sites demonstrated higher levels of implementation (scoring 8-9 of 12) and one ED exhibited a lower level (scoring 5 of 12). Two constructs distinguished between levels of implementation as measured through both quantitative and qualitative approaches: patient needs and resources, and organizational culture. Implementation climate distinguished level of implementation in the qualitative analysis only. Networks and communication, and leadership engagement distinguished level of implementation in the quantitative analysis only.

Discussion

Using CFIR, we demonstrate how a range of factors influence a critical implementation outcome and build an evidence-based approach on how to prime an organizational setting, such as an academic health system ED, for successful implementation.

Conclusion

This study provides insights into implementation of evidence-informed programs targeting medication safety in ED settings and serves as a potential model for how to integrate theory-based qualitative and quantitative methods in implementation studies.

Prenatal oral health guidelines: a theory- and practice-informed approach to survey development using a modified-Delphi technique and cognitive interviews

BACKGROUND

Pregnancy presents an opportune time for oral health promotion and intervention; however, implementation of the prenatal oral health guidelines remains a challenge among prenatal and oral health providers. The purpose of this study was twofold: To employ a theory-based approach to identify high-priority Consolidated Framework for Implementation Research (CFIR) constructs with the greatest potential to impact prenatal oral health guideline implementation, and to operationalize and pre-test survey items based on the prioritized CFIR constructs. Identifying barriers and facilitators to guideline implementation will inform the development of targeted interventions that address gaps in adherence which can positively impact oral-systemic health.

METHODS

The online survey development process employed three rounds of a modified-Delphi technique with prenatal (i.e., MD/DO, CNM) and oral health (i.e., DMD) Practice Advisory Board Members, cognitive interviews with prenatal and oral health providers, and deliberations among the research team and a Scientific Advisory Board (OBGYN, pediatric dentist, and researchers). High-impact CFIR constructs were identified and translated into survey items that were subsequently piloted and finalized.

RESULTS

During three modified-Delphi rounds, a total of 39 CFIR constructs were evaluated with final input and deliberations with the Practice Advisory Board, Scientific Advisory Board, and the research team achieving consensus on 19 constructs. The instrument was pre-tested with four prenatal and two oral health providers. Overall, participants reported that the survey items were feasible to respond to, took an appropriate length of time to complete, and were well-organized. Participants identified specific areas of improvement to clarify CFIR items. The final survey instrument included 21 CFIR items across four domains, with five constructs included from the intervention characteristics domain, two from the process domain, two from the outer setting domain, and 12 from the inner setting domain.

CONCLUSIONS

Lessons learned from the survey development process include the importance of soliciting diverse scientific and practice-based input, distinguishing between importance/impact and direction of impact (barrier/facilitator), and the need for additional qualitative methods during interdisciplinary collaborations. Overall, this study illustrated an iterative approach to identifying high-priority CFIR constructs that may influence the implementation of the prenatal oral health guidelines into practice settings.

Implementation of Coach McLungsSM into primary care using a cluster randomized stepped wedge trial design

Background

Asthma is a prevalent chronic disease that is difficult to manage and associated with marked disparities in outcomes. One promising approach to addressing disparities is shared decision making (SDM), a method by which the patient and provider cooperatively make a decision about asthma care. SDM is associated with improved outcomes for patients; however, time constraints and staff availability are noted implementation barriers. Use of health information technology (IT) solutions may facilitate the utilization of SDM. Coach McLungs^SM is a collaborative web-based application that involves pediatric patients, their caregivers, and providers in a personalized experience while gathering patient-reported data. Background logic provides decision support so both audiences can develop a well-informed treatment plan together. The goal of this study is to evaluate the implementation of the Coach McLungs^SM intervention into primary care.

Methods

Implementation will be evaluated using a stepped wedge randomized control study design at 21 pediatric and family medicine practices within a large, integrated, nonprofit healthcare system. We will measure changes in emergency department visits, hospitalizations, and oral steroid use, which serve as surrogate measures for patient-centered asthma outcomes. We will use a generalized linear mixed models with logit link to test the hypothesis for the reduction in exacerbation rates specifying the fixed effects of intervention and time and random effects for practice and practice*time. This design achieves 84% power to detect the hypothesized effect size difference of 10% in overall exacerbation between control (40%) and intervention (30%) periods (two-sided, p = 0.05). Implementation will be guided using the Expert Recommendations for Implementing Change (ERIC), a compilation of implementation strategies, and evaluated using the CFIR (Consolidated Framework for Implementation Research) and RE-AIM (Reach Effectiveness, Adoption, Implementation, Maintenance).

Discussion

We anticipate that a tailored implementation of Coach McLungs^SM across diverse primary care practices will lead to a decrease in emergency department visits, hospitalizations, and oral steroid use for patients in the intervention group as compared to the control condition.

Trial Registration: Clincaltrials.gov, NCT05059210. Registered 28 September 2021, https://www.clinicaltrials.gov/ct2/show/NCT05059210

Supplementary Information

The online version contains supplementary material available at 10.1186/s12911-022-02030-1.

Inner and outer setting factors that influence the implementation of the National Diabetes Prevention Program (National DPP) using the Consolidated Framework for Implementation Research (CFIR): a qualitative study

BACKGROUND

Scaling evidence-based interventions are key to impacting population health. The National DPP lifestyle change program is one such intervention that has been scaled across the USA over the past 20 years; however, enrollment is an ongoing challenge. Furthermore, little is known about which organizations are most successful with program delivery, enrollment, and scaling. This study aims to understand more about the internal and external organization factors that impact program implementation and reach.

METHODS

Between August 2020 and January 2021, data were collected through semi-structured key informant interviews with 30 National DPP delivery organization implementers. This study uses a qualitative cross-case construct rating methodology to assess which Consolidated Framework for Implementation Research (CFIR) inner and outer setting constructs contributed (both in valence and magnitude) to the organization's current level of implementation reach (measured by average participant enrollment per year). A construct by case matrix was created with ratings for each CFIR construct by interviewee and grouped by implementation reach level.

RESULTS

Across the 16 inner and outer setting constructs and subconstructs, the interviewees with greater enrollment per year provided stronger and more positive examples related to implementation and enrollment of the program, while the lower reach groups reported stronger and more negative examples across rated constructs. Four inner setting constructs/subconstructs (structural characteristics, compatibility, goals and feedback, and leadership engagement) were identified as "distinguishing" between enrollment reach levels based on the difference between groups by average rating, the examination of the number of extreme ratings within levels, and the thematic analysis of the content discussed. Within these constructs, factors such as organization size and administrative processes; program fit with existing organization services and programs; the presence of enrollment goals; and active leadership involvement in implementation were identified as influencing program reach.

CONCLUSIONS

Our study identified a number of influential CFIR constructs and their impact on National DPP implementation reach. These findings can be leveraged to improve efforts in recruiting and assisting delivery organizations to increase the reach and scale of the National DPP as well as other evidence-based interventions.

Unraveling implementation context: the Basel Approach for coNtextual ANAlysis (BANANA) in implementation science and its application in the SMILe project

BACKGROUND

Designing intervention and implementation strategies with careful consideration of context is essential for successful implementation science projects. Although the importance of context has been emphasized and methodology for its analysis is emerging, researchers have little guidance on how to plan, perform, and report contextual analysis. Therefore, our aim was to describe the Basel Approach for coNtextual ANAlysis (BANANA) and to demonstrate its application on an ongoing multi-site, multiphase implementation science project to develop/adapt, implement, and evaluate an integrated care model in allogeneic SteM cell transplantatIon facILitated by eHealth (the SMILe project).

METHODS

BANANA builds on guidance for assessing context by Stange and Glasgow (Contextual factors: the importance of considering and reporting on context in research on the patient-centered medical home, 2013). Based on a literature review, BANANA was developed in ten discussion sessions with implementation science experts and a medical anthropologist to guide the SMILe project's contextual analysis. BANANA's theoretical basis is the Context and Implementation of Complex Interventions (CICI) framework. Working from an ecological perspective, CICI acknowledges contextual dynamics and distinguishes between context and setting (the implementation's physical location).

RESULTS

BANANA entails six components: (1) choose a theory, model, or framework (TMF) to guide the contextual analysis; (2) use empirical evidence derived from primary and/or secondary data to identify relevant contextual factors; (3) involve stakeholders throughout contextual analysis; (4) choose a study design to assess context; (5) determine contextual factors' relevance to implementation strategies/outcomes and intervention co-design; and (6) report findings of contextual analysis following appropriate reporting guidelines. Partly run simultaneously, the first three components form a basis both for the identification of relevant contextual factors and for the next components of the BANANA approach.

DISCUSSION

Understanding of context is indispensable for a successful implementation science project. BANANA provides much-needed methodological guidance for contextual analysis. In subsequent phases, it helps researchers apply the results to intervention development/adaption and choices of contextually tailored implementation strategies. For future implementation science projects, BANANA's principles will guide researchers first to gather relevant information on their target context, then to inform all subsequent phases of their implementation science project to strengthen every part of their work and fulfill their implementation goals.

Strengthening Care for Children (SC4C): protocol for a stepped wedge cluster randomised controlled trial of an integrated general practitioner-paediatrician model of primary care

INTRODUCTION

Australia's current healthcare system for children is neither sustainable nor equitable. As children (0-4 years) comprise the largest proportion of all primary care-type emergency department presentations, general practitioners (GPs) report feeling undervalued as an integral member of a child's care, and lacking in opportunities for support and training in paediatric conditions. This Strengthening Care for Children (SC4C) randomised trial aims to evaluate a novel, integrated GP-paediatrician model of care, that, if effective, will improve GP quality of care, reduce burden to hospital services and ensure children receive the right care, at the right time, closer to home.

METHODS AND ANALYSIS

SC4C is a stepped wedge cluster randomised controlled trial (RCT) of 22 general practice clinics in Victoria and New South Wales, Australia. General practice clinics will provide control period data before being exposed to the 12-month intervention which will be rolled out sequentially each month (one clinic per state) until all 22 clinics receive the intervention. The intervention comprises weekly GP-paediatrician co-consultation sessions; monthly case discussions; and phone and email paediatrician support, focusing on common paediatric conditions. The primary outcome of the trial is to assess the impact of the intervention as measured by the proportion of children's (0-<18 years) GP appointments that result in a hospital referral, compared with the control period. Secondary outcomes include GP quality of care; GP experience and confidence in providing paediatric care; family trust in and preference for GP care; and the sustainability of the intervention. An implementation evaluation will assess the model to inform acceptability, adaptability, scalability and sustainability, while a health economic evaluation will measure the cost-effectiveness of the intervention.

ETHICS AND DISSEMINATION

Human research ethics committee (HREC) approval was granted by The Royal Children's Hospital Ethics Committee in August 2020 (Project ID: 65955) and site-specific HRECs. The investigators (including Primary Health Network partners) will communicate trial results to stakeholders and participating GPs and general practice clinics via presentations and publications.

TRIAL REGISTRATION NUMBER

Australia New Zealand Clinical Trials Registry 12620001299998.

Role of Local Evidence in Transferring Evidence-Based Interventions to Low- and Middle-Income Country Settings: Application to Global Cancer Prevention and Control

PURPOSE

Although the global burden of cancer falls increasingly on low- and middle-income countries (LMICs), much of the evidence for cancer prevention and control comes from high-income countries and may not be directly applicable to LMIC settings. In this paper, we focus on the following question: When the majority of the evidence supporting an evidence-based intervention or implementation strategy comes from high-income countries, what local, contextual evidence is needed when transferring and adapting an intervention or strategy to a specific LMIC setting?

METHODS

We draw on an existing framework (the Population, Intervention, Environment, Transfer-T process model) for assessing transferability of interventions between distinct settings and apply the model to two case studies as learning examples involving implementation of tobacco use treatment guidelines and self sampling for human papillomavirus DNA in cervical cancer screening.

RESULTS

These two case studies illustrate how researchers, policymakers, practitioners, and consumers may approach the need for local evidence from different perspectives and with different priorities. As uses and expectations around local evidence may be different for different groups, aligning these priorities through multistakeholder engagement in which all parties participate in defining the questions and cocreating the solutions is critical, along with promoting standardized reporting of contextual factors.

CONCLUSION

Local, contextual evidence can be important for both researchers and practitioners, and its absence may hinder translation of research and implementation efforts across different settings. However, it is essential for researchers, practitioners, and other stakeholders to be able to clearly articulate the type of data needed and why it is important. In particular, where resources are limited, evidence generation should be prioritized to address real needs and gaps in knowledge.

Providing "a beam of light to see the gaps": determinants of implementation of the Systems Analysis and Improvement Approach applied to the pediatric and adolescent HIV cascade in Kenya

Background

Children and adolescents living with HIV have poorer rates of HIV testing, treatment, and virologic suppression than adults. Strategies that use a systems approach to optimize these multiple, linked steps simultaneously are critical to close these gaps.

Methods

The Systems Analysis and Improvement Approach (SAIA) was adapted and piloted for the pediatric and adolescent HIV care and treatment cascade (SAIA-PEDS) at 6 facilities in Kenya. SAIA-PEDS includes three tools: continuous quality improvement (CQI), flow mapping, and pediatric cascade analysis (PedCAT). A predominately qualitative evaluation utilizing focus group discussions (N = 6) and in-depth interviews (N = 19) was conducted with healthcare workers after implementation to identify determinants of implementation. Data collection and analysis were grounded in the Consolidated Framework for Implementation Research (CFIR).

Results

Overall, the adapted SAIA-PEDS strategy was acceptable, and the three tools complemented one another and provided a relative advantage over existing processes. The flow mapping and CQI tools were compatible with existing workflows and resonated with team priorities and goals while providing a structure for group problem solving that transcended a single department’s focus. The PedCAT was overly complex, making it difficult to use. Leadership and hierarchy were complex determinants. All teams reported supportive leadership, with some describing in detail how their leadership was engaged and enthusiastic about the SAIA-PEDS process, by providing recognition, time, and resources. Hierarchy was similarly complex: in some facilities, leadership stifled rapid innovation by insisting on approving each change, while at other facilities, leadership had strong and supportive oversight of processes, checking on the progress frequently and empowering teams to test innovative ideas.

Conclusion

CQI and flow mapping were core components of SAIA-PEDS, with high acceptability and consistent use, but the PedCAT was too complex. Leadership and hierarchy had a nuanced role in implementation. Future SAIA-PEDS testing should address PedCAT complexity and further explore the modifiability of leadership engagement to maximize implementation.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00304-3.

Development of an Implementation Facilitation Strategy to Link Mental Health Screening and eHealth Intervention for Clients in Ryan White-Funded Clinics in Chicago

BACKGROUND

To reduce the impact of depression on people living with HIV, we are implementing a clinic-based behavioral health screener and referral to Optimizing Resilience and Coping with HIV through Internet Delivery, an evidenced-based intervention. We used the Consolidated Framework for Implementation Research to identify contextual barriers and facilitators in advance of implementation.

SETTING

Sixteen Chicagoland area Ryan White Medical Case Management sites.

METHODS

We conducted a sequential mixed-methods study with medical case managers and supervisors. Participants completed an online survey assessing Consolidated Framework for Implementation Research domains, scored on a 1 (strongly disagree) to 5 (strongly agree) scale. Survey results informed a purposive sampling frame and interview protocol. Interviews were analyzed by rapid qualitative analysis.

RESULTS

On average, survey respondents (n = 58) slightly agreed with positive views of team culture, learning climate, and implementation readiness (mean = 3.80-3.87). Potential barriers included intervention complexity (mean = 3.47), needed human resources (mean = 2.71-3.33), and only slight agreement with relative advantage over existing screening/referral systems (mean = 3.09-3.71). Qualitative results (n = 15) identified low advantage for clinics with robust behavioral health systems but strong advantage in clinics without these services. Respondents identified system-wide training and monitoring strategies to facilitate implementation.

CONCLUSIONS

Ryan White Medical Case Management sites are a generally favorable context for the implementation of the interventions. As illustrated in an implementation research logic model, barriers will be addressed through deploying strategies proposed to impact clinic- and individual-level outcomes, including electronic prompts (reduce complexity), training on Optimizing Resilience and Coping with HIV through Internet Delivery as a complement to other behavioral health services (increase relative advantage), and feedback during implementation (strengthen rewards/incentives).

Exploring perceptions of implementation practice capacity in community-based behavioral health organizations

Community-based organizations (CBOs) must have the capacity to adopt, implement, and sustain evidence-based practices (EBPs). However, limited research exists examining CBOs' ability/capacity to implement EBPs. The purpose of this preliminary study was to investigate how staff of CBOs perceive implementation practice capacity, determine factors needed for adequate capacity for implementing EBPs, and examine which perspectives of capacity are shared across organizational levels. Ninety-seven administrators and practitioners of CBOs were surveyed using the Implementation Capacity Survey, which examines perceived importance, presence, and organizational capacity of the CBO in nine implementation practice areas (IPAs) (e.g., leadership). Results revealed participants rated IPAs on the importance scale higher than IPAs on the present scale. Presence and organizational capacity scales were strongly correlated, and results showed significant differences between administrators and practitioners on ratings of presence and organizational capacity. Implications for future research aimed at examining/building implementation practice capacity in community settings will be discussed.