What is the extent and quality of documentation and reporting of fidelity to implementation strategies: a scoping review

Fidelity and acceptability of implementation strategies developed for adherence to a clinical pathway for screening, assessment and management of anxiety and depression in adults with cancer

BACKGROUND

Implementation strategies are crucial to facilitate implementation success. To prepare and support implementation of a clinical pathway for screening, assessment and management of anxiety and depression in cancer patients (the ADAPT CP), six broad categories of implementation strategies; (1) Awareness campaigns, (2) Champions, (3) Education, (4) Academic Detailing and Support, (5) Reporting, (6) Technological Support, were developed. The aim of this paper is to describe the fidelity and acceptability of six categories of implementation strategies and any subsequent changes/adaptations made to those strategies.

METHODS

The ADAPT CP was implemented in twelve cancer services in NSW, Australia, as part of a cluster randomised controlled trial of core versus enhanced implementation strategies. Fidelity to and any subsequent changes to the delivery of the planned six categories of implementation strategies were captured using the ADAPT contact log, which recorded the contacts made between the ADAPT research team and services, engagement meetings and monthly meetings. To explore acceptability and awareness/engagement with the implementation strategies, interviews with a purposively selected staff sample across both study arms were held prior to implementation (T0), six months into implementation (T1) and at the end of the 12-month implementation period (T2). Interviews were thematically analysed across the six categories of strategies.

RESULTS

Delivery of all six categories of implementation strategies as planned was moderated by service context and resources and staff engagement. As such, for some implementation strategies, subsequent changes or adaptations to the content, mode of delivery, frequency and duration such as abbreviated training sessions, were made to optimise fidelity to and engagement with the strategies. Most strategies were perceived to be acceptable by service staff. Use of strategies prior to implementation of the ADAPT CP such as the engagement meetings and training sessions, positively impacted on ownership and preparedness to implement the ADAPT CP. Furthermore, ongoing support such as provision of additional training or monthly meetings facilitated increased awareness and engagement with the ADAPT program.

CONCLUSION

Flexibility in delivering implementation strategies, and ensuring staff engagement with, and acceptability of those strategies, can support implementation of interventions within healthcare settings.

TRIAL REGISTRATION

The ADAPT CRCT was registered prospectively with the ANZCTR on 22/3/2017. Trial ID ACTRN12617000411347.  https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=372486&isReview=true.

Using the i-PARIHS theoretical framework to develop evidence implementation strategies for central venous catheter maintenance: a multi-site quality improvement project

INTRODUCTION

Evidence-based nursing practice can reduce complications associated with central venous catheters (CVCs). In this project, the Integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) framework was considered an ideal theoretical instrument to identify facilitators and barriers to implementing evidence-based practice.

METHODS

The project was conducted in pediatric intensive care units in six Chinese tertiary children's hospitals. Twenty-two audit criteria were obtained from best practice recommendations, and a baseline audit was conducted to assess current practice against best practice. Next, the i-PARIHS framework was used to identify facilitators and barriers to best practice and develop improvement strategies. A follow-up audit was then conducted to measure changes in compliance with best practices.

RESULTS

Facilitators and barriers were identified at the innovation, recipient, and context levels. A comprehensive CVC maintenance strategy was then developed to apply the best evidence to nurses' clinical work. Of the 22 audit criteria, 17 showed significant improvement compared with the baseline audit.

CONCLUSIONS

The i-PARIHS framework is an effective tool for developing targeted, evidence-based improvement strategies and applying these to the clinical setting. The quality of the nurses' clinical practice improved during CVC maintenance. However, there is no certainty that these positive results can be maintained, and long-term data are needed to verify this.

SPANISH ABSTRACT

http://links.lww.com/IJEBH/A185.

Building CapaCITY/É for sustainable transportation: protocol for an implementation science research program in healthy cities

INTRODUCTION

Improving sustainable transportation options will help cities tackle growing challenges related to population health, congestion, climate change and inequity. Interventions supporting active transportation face many practical and political hurdles. Implementation science aims to understand how interventions or policies arise, how they can be translated to new contexts or scales and who benefits. Sustainable transportation interventions are complex, and existing implementation science frameworks may not be suitable. To apply and adapt implementation science for healthy cities, we have launched our mixed-methods research programme, CapaCITY/É. We aim to understand how, why and for whom sustainable transportation interventions are successful and when they are not.

METHODS AND ANALYSIS

Across nine Canadian municipalities and the State of Victoria (Australia), our research will focus on two types of sustainable transportation interventions: all ages and abilities bicycle networks and motor vehicle speed management interventions. We will (1) document the implementation process and outcomes of both types of sustainable transportation interventions; (2) examine equity, health and mobility impacts of these interventions; (3) advance implementation science by developing a novel sustainable transportation implementation science framework and (4) develop tools for scaling up and scaling out sustainable transportation interventions. Training activities will develop interdisciplinary scholars and practitioners able to work at the nexus of academia and sustainable cities.

ETHICS AND DISSEMINATION

This study received approval from the Simon Fraser University Office of Ethics Research (H22-03469). A Knowledge Mobilization Hub will coordinate dissemination of findings via a website; presentations to academic, community organisations and practitioner audiences; and through peer-reviewed articles.

Champion and audit and feedback strategy fidelity and their relationship to depression intervention fidelity: A mixed method study

Background

Globally, mental health disorders rank as the greatest cause of disability. Low and middle-income countries (LMICs) hold a disproportionate share of the mental health burden, especially as it pertains to depression. Depression is highly prevalent among those with non-communicable diseases (NCDs), creating a barrier to successful treatment. While some treatments have proven efficacy in LMIC settings, wide dissemination is challenged by multiple factors, leading researchers to call for implementation strategies to overcome barriers to care provision. However, implementation strategies are often not well defined or documented, challenging the interpretation of study results and the uptake and replication of strategies in practice settings. Assessing implementation strategy fidelity (ISF), or the extent to which a strategy was implemented as designed, overcomes these challenges. This study assessed fidelity of two implementation strategies (a 'basic' champion strategy and an 'enhanced' champion + audit and feedback strategy) to improve the integration of a depression intervention, measurement based care (MBC), at 10 NCD clinics in Malawi. The primary goal of this study was to assess the relationship between the implementation strategies and MBC fidelity using a mixed methods approach.

Methods

We developed a theory-informed mixed methods fidelity assessment that first combined an implementation strategy specification technique with a fidelity framework. We then created corresponding fidelity indicators to strategy components. Clinical process data and one-on-one in-depth interviews with 45 staff members at 6 clinics were utilized as data sources. Our final analysis used descriptive statistics, reflexive-thematic analysis (RTA), data merging, and triangulation to examine the relationship between ISF and MBC intervention fidelity.

Results

Our mixed methods analysis revealed how ISF may moderate the relationship between the strategies and MBC fidelity. Leadership engagement and implementation climate were critical for clinics to overcome implementation barriers and preserve implementation strategy and MBC fidelity. Descriptive statistics determined champion strategy fidelity to range from 61 to 93% across the 10 clinics. Fidelity to the audit and feedback strategy ranged from 82 to 91% across the 5 clinics assigned to that condition. MBC fidelity ranged from 54 to 95% across all clinics. Although correlations between ISF and MBC fidelity were not statistically significant due to the sample of 10 clinics, associations were in the expected direction and of moderate effect size. A coefficient for shared depression screening among clinicians had greater face validity compared to depression screening coverage and functioned as a proximal indicator of implementation strategy success.

Conclusion

Fidelity to the basic and enhanced strategies varied by site and were influenced by leadership engagement and implementation climate. Champion strategies may benefit from the addition of leadership strategies to help address implementation barriers outside the purview of champions. ISF may moderate the relationship between strategies and implementation outcomes.

Assessing the fidelity of a behavioural intervention involving academic detailing in general practice: a sub-study of the 'Implementing work-related Mental health guidelines in general PRacticE' (IMPRovE) trial

BACKGROUND

Assessing the fidelity of intervention components enables researchers to make informed judgements about the influence of those components on the observed outcome. The 'Implementing work-related Mental health guidelines in general PRacticE' (IMPRovE) trial is a hybrid III trial aiming to increase adherence to the 'Clinical Guidelines for the diagnosis and management of work-related mental health conditions in general practice'. IMPRovE is a multifaceted intervention, with one of the central components being academic detailing (AD). This study describes the fidelity to the protocol for the AD component of the IMPRovE intervention.

METHOD

All AD sessions for the trial were audio-recorded and a sample of 22% were randomly selected for fidelity assessment. Fidelity was assessed using a tailored proforma based on the Modified Conceptual Framework for fidelity assessment, measuring duration, coverage, frequency and content. A descriptive analysis was used to quantify fidelity to the protocol and a content analysis was used to elucidate qualitative aspects of fidelity.

RESULTS

A total of eight AD sessions were included in the fidelity assessment. The average fidelity score was 89.2%, ranging from 80 to 100% across the eight sessions. The sessions were on average 47 min long and addressed all of the ten chapters in the guideline. Of the guideline chapters, 9 were frequently discussed. The least frequently discussed chapter related to management of comorbid conditions. Most general practitioner (GP) participants used the AD sessions to discuss challenges with managing secondary mental conditions. In line with the protocol, opinion leaders who delivered the AD sessions largely offered evidence-based strategies aligning with the clinical guideline recommendations.

CONCLUSIONS/IMPLICATIONS

The IMPRovE AD intervention component was delivered to high fidelity. The sessions adhered to the intended duration, coverage, frequency, and content allowing participating GPs to comprehend the implementation of the guideline in their own practice. This study also demonstrates that the Modified Conceptual Fidelity Framework with a mixed methods approach can support the assessment of implementation fidelity of a behavioural intervention in general practice. The findings enhance the trustworthiness of reported outcomes from IMPRovE and show that assessing fidelity is amenable for AD and should be incorporated in other studies using AD.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry ACTRN 12620001163998, November 2020.

Longitudinal Evaluation of the Neurosequential Model of Therapeutics with Adoptive Families in Tennessee

PURPOSE

This study evaluated effectiveness of the Neurosequential Model of Therapeutics (NMT) with adoptive families who received post adoption services in Tennessee.

METHODS

Researchers obtained a sample of 552 families who received post adoption services in the U.S. state of Tennessee. Most families (77%) had adopted children through public child welfare services. A quasi-experimental design examined wellbeing outcomes for an NMT group (n = 319) versus a services-as-usual (SAU) group (n = 233) in intent-to-treat analyses. Then, the SAU group was contrasted to an NMT subgroup that had high adherence to the NMT model (n = 109) in an analysis of treatment-on-the-treated.

RESULTS

Intent-to-treat models indicated no differences on outcomes between the NMT and SAU groups. However, the results of treatment-on-the-treated analyses showed slightly greater reduction on the Behavior Problems Index over time for the NMT with high adherence group as compared to SAU.

DISCUSSION AND CONCLUSION

Adoptive families may face challenges that could be addressed through developmentally sensitive, trauma-informed services, such as NMT. The results of this study suggest that the NMT might benefit adoptive families if greater attention is paid to implementation adherence, or fidelity.

The GLA:D BACK self-management adherence and competence checklist (SMAC Checklist)-Development, content validity and feasibility

OBJECTIVES

To unpack the complexity and impact of self-management interventions targeting musculoskeletal health conditions, we need to learn more about treatment delivery in clinical settings. Fidelity evaluation can illuminate how complex treatments are delivered and help understand the elements that lead to the effect. The objective of this study was to develop a checklist for the evaluation of the clinicians' delivery of structured patient education and exercise intervention for people with persistent back pain, the GLA:D Back intervention. The intent was to provide a checklist adaptable for the general delivery of self-management interventions for musculoskeletal pain.

METHODS

We derived items for the treatment delivery fidelity checklist from behaviour change techniques and theory about communication style. We applied a three-step developmental process covering developing a preliminary fidelity intervention framework, validating checklist content and piloting and refining the checklist.

RESULTS

We developed the adaptable fidelity checklist, The GLA:D BACK Self-management Adherence and Competence Checklist (SMAC Checklist). Evaluation of clinical practice using the checklist was feasible and acceptable by clinicians. Preliminary results indicate satisfactory observer agreement during pilot testing of the checklist.

CONCLUSION

The GLA:D BACK Self-management Adherence and Competence Checklist is a fidelity measurement tool for the assessment of the delivery of a self-management supportive intervention for people with persistent back pain. The intention is that it can be useful as an adaptable tool for use across self-management interventions for musculoskeletal pain.

Fidelity of implementation of Reptes, an alcohol and cannabis selective prevention program for youngsters

OBJECTIVE

Implementation fidelity is a key dimension in process evaluation but has been scarcely studied. Reptes is a selective alcohol and cannabis use prevention program performed in vulnerable young people (16-21 years) from different educational and leisure settings. The study aimed to describe the components of this program, its implementation fidelity, and satisfaction among participants and facilitators.

METHOD

A descriptive cross-sectional study was conducted. Implementation fidelity was assessed in terms of adherence, dose, participant responsiveness, and quality of the intervention through self-reports completed by 15 facilitators and self-administered questionnaires by 99 youth from the 15 groups completing the program.

RESULTS

70.7% of the groups performed 30 of the 43 planned activities with high use of various teaching methods, except for Information and Communication Technology resources. Fidelity implementation was above 70%. 2/3 groups completed an acceptable intervention and 1/3 completed a qualified intervention. Satisfaction was higher than 7.

CONCLUSIONS

Our results show high implementation fidelity and satisfaction compared with those from similar studies.

Systems analysis and improvement approach to improve naloxone distribution within syringe service programs: study protocol of a randomized controlled trial

BACKGROUND

More than half a million Americans died of an opioid-related overdose between 1999 and 2020, the majority occurring between 2015 and 2020. The opioid overdose mortality epidemic disproportionately impacts Black, Indigenous, and people of color (BIPOC): since 2015, overdose mortality rates have increased substantially more among Black (114%) and Latinx (97%) populations compared with White populations (32%). This is in part due to disparities in access to naloxone, an opioid antagonist that can effectively reverse opioid overdose to prevent death. Our recent pilot work determined that many barriers to naloxone access can be identified and addressed by syringe service programs (SSPs) using the Systems Analysis and Improvement Approach to Naloxone distribution (SAIA-Naloxone). This randomized controlled trial will test SAIA-Naloxone's ability to improve naloxone distribution in general and among BIPOC specifically.

METHODS

We will conduct a trial with 32 SSPs across California, randomly assigning 16 to the SAIA-Naloxone arm and 16 to receive implementation as usual. SAIA-Naloxone is a multifaceted, multilevel implementation strategy through which trained facilitators work closely with SSPs to (1) assess organization-level barriers, (2) prioritize barriers for improvement, and (3) test solutions through iterative change cycles until achieving and sustaining improvements. SSPs receiving SAIA-Naloxone will work with a trained facilitator for a period of 12 months. We will test SAIA-Naloxone's ability to improve SSPs' naloxone distribution using an interrupted time series approach. Data collection will take place during a 3-month lead-in period, the 12-month active period, and for an additional 6 months afterward to determine whether impacts are sustained. We will use a structured approach to specify SAIA-Naloxone to ensure strategy activities are clearly defined and to assess SAIA-Naloxone fidelity to aid in interpreting study results. We will also assess the costs associated with SAIA-Naloxone and its cost-effectiveness.

DISCUSSION

This trial takes a novel approach to improving equitable distribution of naloxone amid the ongoing epidemic and associated racial disparities. If successful, SAIA-Naloxone represents an important organizational-level solution to the multifaceted and multilevel barriers to equitable naloxone distribution.

Fidelity to the ACT SMART Toolkit: an instrumental case study of implementation strategy fidelity

BACKGROUND

Evidence-based practices (EBPs) are shown to improve a variety of outcomes for autistic children. However, EBPs often are mis-implemented or not implemented in community-based settings where many autistic children receive usual care services. A blended implementation process and capacity-building implementation strategy, developed to facilitate the adoption and implementation of EBPs for autism spectrum disorder (ASD) in community-based settings, is the Autism Community Toolkit: Systems to Measure and Adopt Research-based Treatments (ACT SMART Toolkit). Based on an adapted Exploration, Adoption decision, Preparation, Implementation, Sustainment (EPIS) Framework, the multi-phased ACT SMART Toolkit is comprised of (a) implementation facilitation, (b) agency-based implementation teams, and (c) a web-based interface. In this instrumental case study, we developed and utilized a method to evaluate fidelity to the ACT SMART Toolkit. This study responds to the need for implementation strategy fidelity evaluation methods and may provide evidence supporting the use of the ACT SMART Toolkit.

METHODS

We used an instrumental case study approach to assess fidelity to the ACT SMART Toolkit during its pilot study with six ASD community agencies located in southern California. We assessed adherence, dose, and implementation team responsiveness for each phase and activity of the toolkit at both an aggregate and individual agency level.

RESULTS

Overall, we found that adherence, dose, and implementation team responsiveness to the ACT SMART Toolkit were high, with some variability by EPIS phase and specific activity as well as by ASD community agency. At the aggregate level, adherence and dose were rated notably lowest during the preparation phase of the toolkit, which is a more activity-intensive phase of the toolkit.

CONCLUSIONS

This evaluation of fidelity to the ACT SMART Toolkit, utilizing an instrumental case study design, demonstrated the potential for the strategy to be used with fidelity in ASD community-based agencies. Findings related to the variability of implementation strategy fidelity in the present study may also inform future adaptations to the toolkit and point to broader trends of how implementation strategy fidelity may vary by content and context.

Assessing the Fidelity of an Affirmative Cognitive Behavioral Group Intervention

PURPOSE

Support implementation fidelity in intervention research with lesbian, gay, bisexual, transgender, queer, and sexual and gender diverse (LGBTQ+) populations, this study explores the systematic development of a fidelity process for AFFIRM, an evidence-based, affirmative cognitive behavioral therapy group intervention for LGBTQ+ youth and adults.

METHOD

As part of a clinical trial, the AFFIRM fidelity checklist was designed to assess clinician adherence. A total of 151 audio-recorded group sessions were coded by four trained raters.

RESULTS

Adherence was high with a mean fidelity score of 84.13 (SD = 12.50). Inter-rater reliability was 81%, suggesting substantial agreement. Qualitative thematic analysis of low-rated sessions identified deviations from the manual and difficulties in group facilitation, while high-rated sessions specified affirmative and effective clinical responses.

DISCUSSION

Findings were integrated into clinical training and coaching. The fidelity process provides insights into the challenges of implementing social work interventions effectively with LGBTQ+ populations in community settings.

The Canadian Healthy Life Trajectories Initiative (HeLTI) Trial: a study protocol for monitoring fidelity of a preconception-lifestyle behaviour intervention

BACKGROUND

In evaluating technology-based behaviour change interventions, it is increasingly important to have a monitoring plan for intervention fidelity. It is important to maintain intervention fidelity to ensure that the theory-based intervention that is being tested is what causes the observed changes, particularly for eHealth behaviour change interventions. In this protocol, we outline the intervention fidelity and monitoring protocol for Healthy Life Trajectory Initiative (HeLTI) Canada, a randomized controlled trial evaluating the effect of a preconception-early childhood technology-based intervention delivered by public health nurses among pregnancy-planning women and their partners to optimize child growth and development.

METHODS

The HeLTI Canada fidelity protocol is based on the National Institutes of Health Behaviour Change Consortium (NIH BCC) Treatment Fidelity Framework, outlining the following components of intervention fidelity: study design, provider training, intervention delivery, intervention receipt, and intervention enactment. The intervention fidelity components and associated monitoring strategies were developed to align with the HeLTI Canada approach. Strategies for intervention fidelity monitoring include a pre-post written evaluation of training, standardization of provider training, use and monitoring of activity logs, and intervention session checklists. Possible challenges to intervention fidelity include provider turnover due to the length of the trial and lack of ability to directly monitor participant behaviour change in real-life settings. Details about intervention fidelity monitoring are provided in detail. The study launched in January 2021 and is currently recruiting.

DISCUSSION

Using the NIH BCC Treatment Fidelity Framework, HeLTI Canada has a robust framework for monitoring and reporting intervention fidelity to improve intervention validity, ability to assess intervention effectiveness, and transparency.

TRIAL REGISTRATION

ISRCN ISRCTN13308752 . Registered on February 29, 2019.

Exploring the Association between Individual-Level Attributes and Fidelity to a Vocational Rehabilitation Intervention within a Randomised Controlled Trial

Understanding what attributes or characteristics of those delivering interventions affect intervention fidelity and patient outcomes is important for contextualising intervention effectiveness. It may also inform implementation of interventions in future research and clinical practice. This study aimed to explore the relationships between attributes of Occupational Therapists (OTs), their faithful delivery of an early stroke specialist vocational rehabilitation intervention (ESSVR), and stroke survivor return-to-work (RTW) outcomes. Thirty-nine OTs were surveyed about their experience and knowledge of stroke and vocational rehabilitation and were trained to deliver ESSVR. ESSVR was delivered across 16 sites in England and Wales between February 2018 and November 2021. OTs received monthly mentoring to support ESSVR delivery. The amount of mentoring each OT received was recorded in OT mentoring records. Fidelity was assessed using an intervention component checklist completed using retrospective case review of one randomly selected participant per OT. Linear and logistic regression analyses explored relationships between OT attributes, fidelity, and stroke survivor RTW outcome. Fidelity scores ranged from 30.8 to 100% (Mean: 78.8%, SD: 19.2%). Only OT engagement in mentoring was significantly associated with fidelity (b = 0.29, 95% CI = 0.05-0.53, p < 0.05). Increased fidelity (OR = 1.06, 95% CI = 1.01-1.1, p = 0.01) and increasing years of stroke rehabilitation experience (OR = 1.17, 95% CI = 1.02-1.35) was significantly associated with positive stroke survivor RTW outcomes. Findings of this study suggest that mentoring OTs may increase fidelity of delivery of ESSVR, which may also be associated with positive stroke survivor return-to-work outcomes. The results also suggest that OTs with more experience of stroke rehabilitation may be able to support stroke survivors to RTW more effectively. Upskilling OTs to deliver complex interventions, such as ESSVR, in clinical trials may require mentoring support in addition to training to ensure fidelity.

Dancing for Parkinson's Disease Online: Clinical Trial Process Evaluation

Background: Dancing is an engaging physical activity for people living with Parkinson's disease (PD). We conducted a process evaluation for a PD trial on online dancing. Methods: "ParkinDANCE Online" was co-produced by people with PD, healthcare professionals, dance instructors, and a PD organisation. The evaluation mapped the following inputs: (i) stakeholder steering group to oversee program design, processes, and outcomes; (ii) co-design of online classes, based on a research evidence synthesis, expert advice, and stakeholder recommendations; (iii) trial fidelity. The key activities were (i) the co-design of classes and instruction manuals, (ii) the education of dance teachers, (iii) fidelity checking, (iv) online surveys, (v) and post-trial focus groups and interviews with participants. The outputs pertained to: (i) recruitment, (ii) retention, (iii) adverse events, (iv) fidelity, (v) protocol variations, and (vi) participant feedback. Results: Twelve people with PD, four dance instructors and two physiotherapists, participated in a 6-week online dance program. There was no attrition, nor were there any adverse events. Program fidelity was strong with few protocol variations. Classes were delivered as planned, with 100% attendance. Dancers valued skills mastery. Dance teachers found digital delivery to be engaging and practical. The safety of online testing was facilitated by careful screening and a home safety checklist. Conclusions: It is feasible to deliver online dancing to people with early PD.

Implementation Strategy Fidelity and Organizational Outcomes in a Randomized Trial: Implications for Reentry from Corrections to Community Treatment

Background: This study examined fidelity of implementation strategies used in an organizational process improvement intervention (OPII) designed to improve evidence-based practices related to assessments for drug-involved clients exiting incarceration. Leadership was studied as a moderating factor between fidelity and outcomes. Methods: A mixed-method cluster randomized design was used to randomize 21 sites to early- or delayed-start within 9 research centers. Parent study protocol was reviewed to develop fidelity constructs (i.e., responsiveness, dose, quality, adherence). Outcomes were site-level success in achieving goals and objectives completed during the OPII (e.g., percent goals achieved). Correlations, analyses of covariance, regressions and moderation analyses were performed. Qualitative interviews assessed facilitators/barriers to implementation. Results: Fidelity constructs related to outcomes. No differences were found in fidelity by early or delayed condition. At low levels of leadership, high staff responsiveness (i.e., engagement in the OPII) related to poorer outcome. Conclusions: It is important to consider contextual factors (e.g., leadership) that may influence implementation strategy fidelity when deploying evidence-based practices. Findings are relevant to researchers, clinicians, administrators and policy makers, and suggest that goal completion during implementation of evidence-based practices requires monitoring of leadership competence, fidelity to implementation strategies (i.e., staff responsiveness to strategies) and attendance to goal importance.

Barriers and facilitators influencing parental adherence to prevention strategies for deformational plagiocephaly: Results from a scoping review

BACKGROUND

Deformational plagiocephaly can be prevented in many healthy infants if strategies are implemented early after birth. However, despite efforts to disseminate accurate information, parental adherence to evidence-based prevention strategies is a challenge. To date, factors - barriers and facilitators - influencing parental adherence to strategies have yet to be identified in a comprehensive manner.

OBJECTIVES

This scoping review aims to identify and synthesize current evidence on barriers and facilitators impacting adherence of parents of newborns to deformational plagiocephaly prevention strategies.

METHODS

This review followed the Joanna Briggs Institute (JBI) process guidelines. Seven electronic (Cumulative Index to Nursing and Allied Health Literature (CINAHL), MEDLINE, SPORTDiscus, Academic Search Complete, AMED, PsychINFO and Scopus) and two grey literature (Health Systems Evidence and Grey Literature Report) databases were searched. Studies published between 2001 and 2022 were included. The deductive thematic data analysis used was guided by the Capability, Opportunity, Motivation Behavioral Model (COM-B) of health behaviour change.

RESULTS

From a total of 1172 articles, 15 met the eligibility criteria. All components of the COM-B framework were identified. Capability-psychological and opportunity-environmental factors dominated the literature, whereas capability-physical, motivation and, in particular, opportunity-social factors were understudied. The most often reported barriers were a lack of knowledge of deformational plagiocephaly and the associated prevention strategies, ambiguous or inconsistent messaging, intolerance of babies to prone positioning and a lack of time. The most frequently reported facilitators were an awareness of deformational plagiocephaly, postural asymmetry and prevention strategies, skill acquisition with practice, accurate convincing information, scheduled time and environmental organization to position the baby at home.

DISCUSSION

Recommendations focused on diffusing accurate and detailed information for parents. Our review also suggests a gap regarding the comprehensive identification of factors influencing parental adherence to deformational plagiocephaly prevention strategies. Further studies exploring comprehensive opportunity-social and motivation factors influencing parental adherence to deformational plagiocephaly prevention strategies are warranted to inform prevention programmes and foster better infant outcomes.

"We start where we are": a qualitative study of barriers and pragmatic solutions to the assessment and reporting of implementation strategy fidelity

BACKGROUND

Fidelity measurement of implementation strategies is underdeveloped and underreported, and the level of reporting is decreasing over time. Failing to properly measure the factors that affect the delivery of an implementation strategy may obscure the link between a strategy and its outcomes. Barriers to assessing and reporting implementation strategy fidelity among researchers are not well understood. The aims of this qualitative study were to identify barriers to fidelity measurement and pragmatic pathways towards improvement.

METHODS

We conducted in-depth interviews among researchers conducting implementation trials. We utilized a theory-informed interview approach to elicit the barriers and possible solutions to implementation strategy fidelity assessment and reporting. Reflexive-thematic analysis guided coding and memo-writing to determine key themes regarding barriers and solutions.

RESULTS

Twenty-two implementation researchers were interviewed. Participants agreed that implementation strategy fidelity was an essential element of implementation trials and that its assessment and reporting should improve. Key thematic barriers focused on (1) a current lack of validated fidelity tools with the need to assess fidelity in the short term, (2) the complex nature of some implementation strategies, (3) conceptual complications when assessing fidelity within mechanisms-focused implementation research, and (4) structural issues related to funding and publishing. Researchers also suggested pragmatic solutions to overcome each barrier. Respondents reported using specification and tracking data in the short term until validated tools become available. Participants suggested that researchers with strategy-specific content expertise lead the way in identifying core components and setting fidelity requirements for them. Addressing the third barrier, participants provided examples of what pragmatic prospective and retrospective fidelity assessments might look like along a mechanistic pathway. Finally, researchers described approaches to minimize costs of data collection, as well as more structural accountability like adopting and enforcing reporting guidelines or changing the structure of funding opportunities.

DISCUSSION

We propose short- and long-term priorities for improving the assessment and reporting of implementation strategy fidelity and the quality of implementation research.

CONCLUSIONS

A better understanding of the barriers to implementation strategy fidelity assessment may pave the way towards pragmatic solutions.

Implementation fidelity in parent-implemented interventions for stuttering

Knowledge of the fidelity with which interventions are delivered in research studies is crucial to meaningful examination of intervention impact. This paper presents a review of fidelity implementation (FOI) measurements in interventions jointly delivered by speech-language pathologists (SLP) and parents in research for preschool-aged children who stutter (CWS). Four key FOI components were examined: dosage, adherence, quality, responsiveness. Thirty-six studies met the inclusion criteria for this study. Articles were published between 1990 and 2020 described nine different interventions and examined CWS aged 2-6 years. No study reported all FOI components in both the clinical and the home setting and five did not report on any FOI component in either setting. The number of FOI components reported ranged from 0 to 4 in both clinical (M = 1.5) and home (M = 1.0) settings. Across studies, dosage was most often reported (n = 27, 75.0%) and responsiveness was least often reported (n = 16, 44.4%). The number of FOI components reported in articles did not increase over time, although a trend towards greater reporting in recent years was observed. Poor reporting of FOI in intervention research presents a serious methodological concern that impacts the ability of clinicians and researchers to interpret the findings of these studies. Rigorous measurement and reporting of FOI in future intervention studies is required in order to better inform evidence-based practices for interventions with CWS.

Comparing two implementation strategies for implementing and sustaining a case management practice serving homeless-experienced veterans: a protocol for a type 3 hybrid cluster-randomized trial

Background

The Veterans Health Administration (VA) Grant and Per Diem case management “aftercare” program provides 6 months of case management for homeless-experienced veterans (HEVs) undergoing housing transitions. To standardize and improve aftercare services, we will implement critical time intervention (CTI), an evidence-based, structured, and time-limited case management practice. We will use two strategies to support the implementation and sustainment of CTI at 32 aftercare sites, conduct a mixed-methods evaluation of this implementation initiative, and generate a business case analysis and implementation playbook to support the continued spread and sustainment of CTI in aftercare.

Methods

We will use the Replicating Effective Programs (REP) implementation strategy to support CTI implementation at 32 sites selected by our partners. Half (n=16) of these sites will also receive 9 months of external facilitation (EF, enhanced REP). We will conduct a type 3 hybrid cluster-randomized trial to compare the impacts of REP versus enhanced REP. We will cluster potential sites into three implementation cohorts staggered in 9-month intervals. Within each cohort, we will use permuted block randomization to balance key site characteristics among sites receiving REP versus enhanced REP; sites will not be blinded to their assigned strategy. We will use mixed methods to assess the impacts of the implementation strategies. As fidelity to CTI influences its effectiveness, fidelity to CTI is our primary outcome, followed by sustainment, quality metrics, and costs. We hypothesize that enhanced REP will have higher costs than REP alone, but will result in stronger CTI fidelity, sustainment, and quality metrics, leading to a business case for enhanced REP. This work will lead to products that will support our partners in spreading and sustaining CTI in aftercare.

Discussion

Implementing CTI within aftercare holds the potential to enhance HEVs’ housing and health outcomes. Understanding effective strategies to support CTI implementation could assist with a larger CTI roll-out within aftercare and support the implementation of other case management practices within and outside VA.

Trial registration

This project was registered with ClinicalTrials.gov as “Implementing and sustaining Critical Time Intervention in case management programs for homeless-experienced Veterans.” Trial registration NCT05312229, registered April 4, 2022.

The implementation of a culturally tailored parenting support programme for Somali immigrant parents living in Sweden—A process evaluation

Background

Parental support programmes aim to strengthen family functioning and the parent–child relationship and to promote the mental health of children and parents. However, there is a lack of knowledge on how parenting support programmes can be implemented for newly arrived immigrant parents. This process evaluation describes the implementation of a successful parenting programme for immigrant parents from Somalia and identifies key components of the implementation process with a focus on Reach, Adaptation, and Fidelity of Ladnaan intervention.

Method

This process evaluation considered context, implementation and mechanism of impact, in accordance with the Medical Research Council’s guidance. Data were collected through focus group discussions, a questionnaire, attendance lists, field and reflection notes and observations of the sessions. The data were then analysed using content analysis and descriptive statistics.

Results

Of the 60 parents invited to the parenting programme, 58 participated in the sessions. The study showed that involving key individuals in the early stage of the parenting programme’s implementation facilitated reaching Somali-born parents. To retain the programme participants, parents were offered free transportation. The programme was implemented and delivered as intended. A majority of the parents were satisfied with the programme and reported increased knowledge about children’s rights and the support they could seek from social services.

Conclusions

This study illustrates how a parenting support programme can be implemented for Somali-born parents and provides guidance on how to attract immigrant parents to and engage them in participating in parenting support programmes.

A process evaluation of 'We Can Quit': a community-based smoking cessation intervention targeting women from areas of socio-disadvantage in Ireland

Background

Smoking poses a serious risk of early preventable death and disease especially for women living with socio-economic disadvantage (SED). A smoking cessation programme, ‘We Can Quit’, was developed in Ireland tailored to SED women. This includes group-based support delivered by trained lay local community facilitators (CFs) and free nicotine replacement therapy (NRT). The intervention was pilot tested in a cluster randomised controlled trial, ‘We Can Quit 2’. This paper reports on the WCQ2 process evaluation which assessed feasibility and acceptability of the programme and trial processes.

Methods

Embedded qualitative design using the UK Medical Research Council’s process evaluation framework. Semi-structured interviews with trial participants (N = 21) and CFs (N = 8). Thematic analysis was utilised.

Results

Peer-modelling, a non-judgemental environment, CFs facilitation of group support were viewed as acceptable programme related factors. Some participants expressed concerns about NRT side effects. Provision of free NRT was welcomed and accepted by participants, although structural barriers made access challenging. Pharmacists took on a role that became larger than originally envisaged – and the majority provided additional support to women in their quit attempts between group meetings which augmented and supplemented the intervention sessions provided by the CFs. Participants reported good acceptance of repeated measures for data collection, but mixed acceptability of provision of saliva samples. Low literacy affected the feasibility of some women to fully engage with programme and trial-related materials. This was despite efforts made by intervention developers and the trial team to make materials (e.g., participant intervention booklet; consent forms and participant information leaflets) accessible while also meeting requirements under 2018 European General Data Protection Regulation legislation. Hypothetical scenarios of direct (e.g., researcher present during programme delivery) and indirect (e.g., audio recordings of programme sessions) observational fidelity assessments for a future definitive trial (DT) were acceptable.

Conclusions

Intervention and trial-related processes were generally feasible and acceptable to participants and CFs. Any future DT will need to take further steps to mitigate structural barriers to accessing free NRT; and the established problem of low literacy and low educational attainment in SED areas, while continuing to comply within the contemporary legislative research environment.

Trial registration

WCQ2 pilot trial (ISRCTN74721694).

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-022-13957-5.

Study protocol for a cluster-randomized trial of a bundle of implementation support strategies to improve the fidelity of implementation of schoolwide Positive Behavioral Interventions and Supports in rural schools

Background

Improving the implementation of evidence-based interventions is important for population-level impacts. Positive Behavioral Interventions and Supports (PBIS) is effective for improving school climate and students’ behavioral outcomes, but rural schools often lag behind urban and suburban schools in implementing such initiatives.

Methods/Design

This paper describes a Type 3 hybrid implementation-effectiveness trial of Rural School Support Strategies (RS3), a bundle of implementation support strategies selected to improve implementation outcomes in rural schools. In this two-arm parallel group trial, 40 rural public schools are randomized to receive: 1) a series of trainings about PBIS; or 2) an enhanced condition with training plus RS3. The trial was planned for two years, but due to the pandemic has been extended another year. RS3 draws from the Interactive Systems Framework, with a university-based team (support system) that works with a team at each school (school-based delivery system), increasing engagement through strategies such as: providing technical assistance, facilitating school team functioning, and educating implementers. The primary organizational-level outcome is fidelity of implementation, with additional implementation outcomes of feasibility, acceptability, appropriateness, and cost. Staff-level outcomes include perceived climate and self-reported adoption of PBIS core components. Student-level outcomes include disciplinary referrals, academic achievement, and perceived climate. Mediators being evaluated include organizational readiness, school team functioning, and psychological safety.

Discussion

The study tests implementation strategies, with strengths including a theory-based design, mixed methods data collection, and consideration of mediational mechanisms. Results will yield knowledge about how to improve implementation of universal prevention initiatives in rural schools.

Protocol for the process evaluation of a counselling intervention designed to educate cancer patients on complementary and integrative health care and promote interprofessional collaboration in this area (the CCC-Integrativ study)

Background

Conducting a process evaluation is essential to understand how health interventions work in different healthcare settings. Particularly in the case of complex interventions, it is important to find out whether the intervention could be carried out as planned and which factors had a beneficial or hindering effect on its implementation. The aim of this study is to present the detailed protocol of the process evaluation embedded in the controlled implementation study CCC-Integrativ aiming to implement an interprofessional counselling program for cancer patients on complementary and integrative health care (CIH).

Methods

This mixed methods study will draw upon the “Consolidated Framework for Implementation Research” (CFIR) combined with the concept of “intervention fidelity” to evaluate the quality of the interprofessional counselling sessions, to explore the perspective of the directly and indirectly involved healthcare staff, as well as to analyze the perceptions and experiences of the patients. The qualitative evaluation phase consists of analyzing audio-recorded counselling sessions, as well as individual and group interviews with the involved persons. The quantitative evaluation phase applies questionnaires which are distributed before (T0), at the beginning (T1), in the middle (T2) and at the end (T3) of the intervention delivery.

Discussion

This protocol provides an example of how a process evaluation can be conducted parallel to a main study investigating and implementing a complex intervention. The results of this mixed methods research will make it possible to identify strengths and weaknesses of the team-based intervention, and to target more specifically the key factors and structures required to implement healthcare structures to meet patients’ unmet needs in the context of CIH. To our knowledge, this study is the first applying the CFIR framework in the context of interprofessional CIH counselling, and its results are expected to provide comprehensive and multidisciplinary management of cancer patients with complex supportive healthcare needs.

The case for prioritizing implementation strategy fidelity measurement: benefits and challenges

Implementation strategies are systematic approaches to improve the uptake and sustainability of evidence-based interventions. They frequently focus on changing provider behavior through the provision of interventions such as training, coaching, and audit-and-feedback. Implementation strategies often impact intermediate behavioral outcomes like provider guideline adherence, in turn improving patient outcomes. Fidelity of implementation strategy delivery is defined as the extent to which an implementation strategy is carried out as it was designed. Implementation strategy fidelity measurement is under-developed and under-reported, with the quality of reporting decreasing over time. Benefits of fidelity measurement include the exploration of the extent to which observed effects are moderated by fidelity, and critical information about Type-III research errors, or the likelihood that null findings result from implementation strategy fidelity failure. Reviews of implementation strategy efficacy often report wide variation across studies, commonly calling for increased implementation strategy fidelity measurement to help explain variations. Despite the methodological benefits of rigorous fidelity measurement, implementation researchers face multi-level challenges and complexities. Challenges include the measurement of a complex variable, multiple data collection modalities with varying precision and costs, and the need for fidelity measurement to change in-step with adaptations. In this position paper, we weigh these costs and benefits and ultimately contend that implementation strategy fidelity measurement and reporting should be improved in trials of implementation strategies. We offer pragmatic solutions for researchers to make immediate improvements like the use of mixed methods or innovative data collection and analysis techniques, the inclusion of implementation strategy fidelity assessment in reporting guidelines, and the staged development of fidelity tools across the evolution of an implementation strategy. We also call for additional research into the barriers and facilitators of implementation strategy fidelity measurement to further clarify the best path forward.

Mapping the road to elimination: a 5-year evaluation of implementation strategies associated with hepatitis C treatment in the veterans health administration

BACKGROUND

While few countries and healthcare systems are on track to meet the World Health Organization's hepatitis C virus (HCV) elimination goals, the US Veterans Health Administration (VHA) has been a leader in these efforts. We aimed to determine which implementation strategies were associated with successful national viral elimination implementation within the VHA.

METHODS

We conducted a five-year, longitudinal cohort study of the VHA Hepatic Innovation Team (HIT) Collaborative between October 2015 and September 2019. Participants from 130 VHA medical centers treating HCV were sent annual electronic surveys about their use of 73 implementation strategies, organized into nine clusters as described by the Expert Recommendations for Implementing Change taxonomy. Descriptive and nonparametric analyses assessed strategy use over time, strategy attribution to the HIT, and strategy associations with site HCV treatment volume and rate of adoption, following the Theory of Diffusion of Innovations.

RESULTS

Between 58 and 109 medical centers provided responses in each year, including 127 (98%) responding at least once, and 54 (42%) responding in all four implementation years. A median of 13-27 strategies were endorsed per year, and 8-36 individual strategies were significantly associated with treatment volume per year. Data warehousing, tailoring, and patient-facing strategies were most commonly endorsed. One strategy-"identify early adopters to learn from their experiences"-was significantly associated with HCV treatment volume in each year. Peak implementation year was associated with revising professional roles, providing local technical assistance, using data warehousing (i.e., dashboard population management), and identifying and preparing champions. Many of the strategies were driven by a national learning collaborative, which was instrumental in successful HCV elimination.

CONCLUSIONS

VHA's tremendous success in rapidly treating nearly all Veterans with HCV can provide a roadmap for other HCV elimination initiatives.

Community-based implementation strategy use and satisfaction: A mixed-methods approach to using the ERIC compilation for organizations serving children on the autism spectrum

Background

Despite efforts to use standardized taxonomy and research reporting, documenting implementation strategies utilized in community settings remains challenging. This case study demonstrates a practical approach to gather use of and satisfaction with implementation strategies utilized within community-based sites to understand community providers’ perspectives of implementing an early intensive behavioral intervention (EIBI) for children on the autism spectrum across different settings.

Methods

Using a sequential explanatory mixed-methods design, survey and interview data were collected from directors/supervisors and direct providers ( n = 26) across three sites (one university and two community-based replication sites). The Implementation Strategies and Satisfaction Survey (ISSS) was administered to identify staff-reported implementation strategy use and satisfaction. Informed by quantitative results, follow-up semi-structured interviews were conducted with a subsample ( n = 13) to further understand staff experiences with endorsed implementation strategies and elicit recommendations for future efforts.

Results

Survey results were used to demonstrate frequencies of implementation strategies endorsed by site and role. Overall, staff felt satisfied with implementation strategies used within their agencies. Content analysis of qualitative data revealed three salient themes related to implementation strategy use—context, communication, and successes and challenges—providing in-depth detail on how strategies were utilized, and strategy effectiveness based on community providers’ experiences. Recommendations were also elicited to improve strategy use within “broader” community settings.

Conclusions

The project demonstrated a practical approach to identifying and evaluating implementation strategies used within sites delivering autism services. Reporting implementation strategies using the ISSS can provide insight into community providers’ perspectives and satisfaction with agency implementation strategy use that can generate more relevant and responsive strategies to address barriers in community settings. Plain language abstract Examining community providers’ preferences and experiences with implementation strategies used to facilitate evidence-based practice uptake can broaden our understanding of what, how, and why implementation strategies work in community-based settings ( Chaudoir et al., 2013 ; Leeman et al., 2017 ; Proctor et al., 2013 ). Such efforts have great potential to tailor implementation strategies to address barriers/facilitators typically found in community-based settings. This case study demonstrates a practical approach using mixed methodology to: (a) gather self-reported use of and satisfaction with implementation strategies to understand community providers’ perspectives of implementation strategy success. Using a new survey, the Implementation Strategies and Satisfaction Survey (ISSS) conjoined with interviews, the study demonstrated a practical approach using standardized language to report strategies used in one university-based site and two community-based replication sites that deliver an early intensive behavioral intervention (EIBI) for children on the autism spectrum. This paper contributes to one of the five priorities to enhance public health impact—improve tracking and reporting of implementation strategies utilized when translating research into practice ( Dingfelder & Mandell, 2011 ; Powell et al., 2019 ; Stahmer et al., 2019 ). This approach emphasizes the importance of understanding context (e.g., community organizations providing services to children on the autism spectrum) to develop strategies that work better for EIBI implementation and scale-up. Understanding community provider's preferences and experiences with implementation strategies can support use of implementation strategies that better fit usual care contexts, with the ultimate goal of improving implementation practice in community-based settings.

Experiences with tailoring of primary diabetes care in well-organised general practices: a mixed-methods study

Background

Dutch standard diabetes care is generally protocol-driven. However, considering that general practices wish to tailor diabetes care to individual patients and encourage self-management, particularly in light of current COVID-19 related constraints, protocols and other barriers may hinder implementation. The impact of dispensing with protocol and implementation of self-management interventions on patient monitoring and experiences are not known. This study aims to evaluate tailoring of care by understanding experiences of well-organised practices 1) when dispensing with protocol; 2) determining the key conditions for successful implementation of self-management interventions; and furthermore exploring patients’ experiences regarding dispensing with protocol and self-management interventions.

Methods

in this mixed-methods prospective study, practices (n = 49) were invited to participate if they met protocol-related quality targets, and their adult patients with well-controlled type 2 diabetes were invited if they had received protocol-based diabetes care for a minimum of 1 year. For practices, study participation consisted of the opportunity to deliver protocol-free diabetes care, with selection and implementation of self-management interventions. For patients, study participation provided exposure to protocol-free diabetes care and self-management interventions.

Qualitative outcomes (practices: 5 focus groups, 2 individual interviews) included experiences of dispensing with protocol and the implementation process of self-management interventions, operationalised as implementation fidelity. Quantitative outcomes (patients: routine registry data, surveys) consisted of diabetes monitoring completeness, satisfaction, wellbeing and health status at baseline and follow-up (24 months).

Results

Qualitative:

In participating practices (n = 4), dispensing with protocol encouraged reflection on tailored care and selection of various self-management interventions

A focus on patient preferences, team collaboration and intervention feasibility was associated with high implementation fidelity

Quantitative:

In patients (n = 126), likelihood of complete monitoring decreased significantly after two years (OR 0.2 (95% CI 0.1–0.5), p < 0.001)

Satisfaction decreased slightly (− 1.6 (95% CI -2.6;-0.6), p = 0.001)

Non-significant declines were found in wellbeing (− 1.3 (95% CI -5.4; 2.9), p = 0.55) and health status (− 3.0 (95% CI -7.1; 1.2), p = 0.16).

Conclusions

To tailor diabetes care to individual patients within well-organised practices, we recommend dispensing with protocol while maintaining one structural annual monitoring consultation, combined with the well-supported implementation of feasible self-management interventions. Interventions should be selected and delivered with the involvement of patients and should involve population preferences and solid team collaborations.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-07198-2.

Assessing Fidelity to and Satisfaction with the “Adolescent Coping with Depression Course” (ACDC) Intervention in a Randomized Controlled Trial

This paper aims at describing the process for assessing the intervention fidelity of a randomized controlled trial (RCT) of an “Adolescent Coping with Depression Course” (ACDC) and to assess the participants’ satisfaction with the intervention. We applied the comprehensive fidelity model developed by the National Institutes of Health’s Behavior Change Consortium to examine how our intervention met the fidelity requirements under five categories. Data came from a two-arm parallel cluster RCT. Both qualitative and quantitative analyses of the ACDC intervention using the comprehensive fidelity model indicated that the level of fidelity in this study did not reach 100%. However, it was approaching a high level of treatment fidelity. Participants also expressed high levels of satisfaction (M = 3.65, SD = .95). This analysis is important to show how appropriately the intervention was implemented, areas for improvement to increase its fidelity, and to ensure the internal and external validity of the findings. Trial Registration: ISRCTN registry ISRCTN19700389. Registered 6 October 2015. https://doi.org/10.1186/ISRCTN19700389. Full Protocol: 10.1186/s12888-016-0954-y

Combining Improvement and Implementation Sciences and Practices for the Post COVID-19 Era

Health services made many changes quickly in response to the SARS-CoV-2 pandemic. Many more are being made. Some changes were already evaluated, and there are rigorous research methods and frameworks for evaluating their local implementation and effectiveness. But how useful are these methods for evaluating changes where evidence of effectiveness is uncertain, or which need adaptation in a rapidly changing situation? Has implementation science provided implementers with tools for effective implementation of changes that need to be made quickly in response to the demands of the pandemic? This perspectives article describes how parts of the research and practitioner communities can use and develop a combination of implementation and improvement to enable faster and more effective change in the future, especially where evidence of local effectiveness is limited. We draw on previous reviews about the advantages and disadvantages of combining these two domains of knowledge and practice. We describe a generic digitally assisted rapid cycle testing (DA-RCT) approach that combines elements of each in order to better describe a change, monitor outcomes, and make adjustments to the change when implemented in a dynamic environment.

Telehealth Behavioral Intervention for Diabetes Management in Adults With Physical Disabilities: Intervention Fidelity Protocol for a Randomized Controlled Trial

BACKGROUND

Diabetes mellitus is a major health problem among people with physical disabilities. Health coaching has been proven to be an effective approach in terms of behavioral changes, patient self-efficacy, adherence to treatment, health service use, and health outcomes. Telehealth systems combined with health coaching have the potential to improve the quality of health care by increasing access to services. Treatment fidelity is particularly important for behavior change studies; however, fidelity protocols are inadequately administered and reported in the literature.

OBJECTIVE

The aim of this study is to outline all the intervention fidelity strategies and procedures of a telecoaching intervention-artificial intelligence for diabetes management (AI4DM)-which is a randomized controlled trial to evaluate the feasibility, acceptability, and preliminary efficacy of a telehealth platform in adults with type 2 diabetes and permanent impaired mobility. AI4DM aims to create a web-based disability-inclusive diabetes self-management program. We selected the National Institutes of Health Behavior Change Consortium (NIH BCC) fidelity framework to describe strategies to ensure intervention fidelity in our research.

METHODS

We have developed fidelity strategies based on the five fidelity domains outlined by the NIH BCC-focusing on study design, provider training, treatment delivery, treatment receipt, and enactment of treatment skills. The design of the study is grounded in the social cognitive theory and is intended to ensure that both arms would receive the same amount of attention from the intervention. All providers will receive standardized training to deliver consistent health coaching to the participants. The intervention will be delivered through various controlling and monitoring strategies to reduce differences within and between treatment groups. The content and structure of the study are delivered to ensure comprehension and participation among individuals with low health literacy. By constantly reviewing and monitoring participant progress and protocol adherence, we intend to ensure that participants use cognitive and behavioral skills in real-world settings to engage in health behavior.

RESULTS

Enrollment for AI4DM will begin in October 2021 and end in October 2022. The results of this study will be reported in late 2022.

CONCLUSIONS

Developing and using fidelity protocols in behavior change studies is essential to ensure the internal and external validity of interventions. This study incorporates NIH BCC recommendations into an artificial intelligence embedded telecoaching platform for diabetes management designed for people with physical disabilities. The developed fidelity protocol can provide guidance for other researchers conducting telehealth interventions within behavioral health settings to present more consistent and reproducible research.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04927377; http://clinicaltrials.gov/ct2/show/NCT04927377.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/31695.

IMplementation and evaluation of the school-based family support PRogram a Healthy School Start to promote child health and prevent OVErweight and obesity (IMPROVE) - study protocol for a cluster-randomized trial

Background

IMPROVE aims to conduct a hybrid type 3 evaluation design to test the effectiveness of bundled implementation strategies on intervention fidelity of the Healthy School Start (HSS) program, while simultaneously monitoring effects on health outcomes of children and parents. The HSS is a 4-component family support program for children starting school (5–7 years of age) promoting healthy dietary habits and physical activity in the home environment to prevent childhood obesity and parents’ risk of developing type 2 diabetes.

Methods

IMPROVE is a cluster-randomized controlled trial with two arms to evaluate and compare the effects of two different bundles of implementation strategies on intervention fidelity expressed as adherence and responsiveness at 12 and 24 months (primary outcomes). Thirty schools in two municipalities will participate in the study reaching about 1400 families per school year. In stakeholder workshops, key implementation determinants were identified according to the domains of the Consolidated Framework for Implementation Research. Through a consensus process with stakeholders, two bundles of implementation strategies were tailored to address context-specific determinants. Schools randomly assigned to group 1 will receive bundle 1 (Basic) and group 2 will receive bundle 1 + 2 (Enhanced). Bundle 2 consists of external facilitation, fidelity monitoring and feedback strategies. Secondary outcomes will include change in acceptability, appropriateness, feasibility, and organisational readiness as perceived by school staff. In addition, child weight status and diet, and parents’ feeding practices and risk of type 2 diabetes will be monitored. Linear and ordinal regression analysis will be used to test the effect on the primary and secondary outcomes, taking clustering and covariates into consideration where needed. Process evaluation will be conducted through key stakeholder interviews to investigate experiences of the program and perceptions on sustainability.

Discussion

This systematic approach to investigating the effectiveness of two different bundles of implementation strategies tailored to context-specific determinants on the fidelity of the HSS intervention will provide new insight into feasible implementation strategies and external support needed for the HSS to be effective and sustainable. Results will help inform how to bridge the gap between the research on school-based health programs and routine practice in schools.

Trial registration

Registered prospectively at ClinicalTrials.gov ID: NCT04984421, registered July 30, 2021

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-021-11663-2.

Implementation strategy fidelity evaluation for a multidisciplinary Chest Injury Protocol (ChIP)

Background

Blunt chest wall injuries can lead to complications, especially without early intervention. A blunt Chest Injury Protocol (ChIP) was developed to help improve the consistency of evidence-based care following admission to the emergency department. Implementation strategy fidelity is the extent to which the strategies of implementation are delivered in line with the intended plan. The aim of this study was to assess fidelity to the strategies of the implementation plan developed for ChIP.

Methods

A retrospective evaluation of strategies used for implementation was performed, specifically the behaviour change techniques (BCTs). BCTs were used as part of an implementation plan derived based on the Behaviour Change Wheel from results from a staff survey at two hospitals.

Levels of implementation or adaptation for BCTs were scored by implementers as follows: ‘Were the behaviour change interventions implemented?’ (0 = ‘not implemented’, 1 = partially implemented, and 2 = fully implemented); ‘Were adaptations made to the implementation plan?’, scored 1 (many changes from plan) to 4 (just as planned). Free text explanation to their responses was also collected with supporting evidence and documentation (such as emails, implementation checklists, audit reports, and incident reports).

Results

There was high overall fidelity of 97.6% for BCTs partially or fully implemented. More than three quarters (32/42, 76.2%) of the BCTs were fully implemented with an additional 9/42 (21.4%) partially implemented. BCTs that were not fully implemented were social support, feedback on behaviour, feedback on outcomes of behaviour, adding objects to the environment, and restructuring the environment. The modes of delivery with poorer implementation or increased adaptations were clinical champions and audit/feedback.

Conclusions

This study describes the evaluation of implementation strategy fidelity in the acute care context. The systematic use and application of the behaviour change wheel was used to develop an implementation plan and was associated with high implementation strategy fidelity. A fidelity checklist developed during the implementation process may help implementers assess fidelity.

Trial registration

Trial registered on ANZCTR. Registration number ACTRN12618001548224, date approved 17/09/2018

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-021-00189-8.

Strengthening methods for tracking adaptations and modifications to implementation strategies

BACKGROUND

Developing effective implementation strategies requires adequate tracking and reporting on their application. Guidelines exist for defining and reporting on implementation strategy characteristics, but not for describing how strategies are adapted and modified in practice. We built on existing implementation science methods to provide novel methods for tracking strategy modifications.

METHODS

These methods were developed within a stepped-wedge trial of an implementation strategy package designed to help community clinics adopt social determinants of health-related activities: in brief, an 'Implementation Support Team' supports clinics through a multi-step process. These methods involve five components: 1) describe planned strategy; 2) track its use; 3) monitor barriers; 4) describe modifications; and 5) identify / describe new strategies. We used the Expert Recommendations for Implementing Change taxonomy to categorize strategies, Proctor et al.'s reporting framework to describe them, the Consolidated Framework for Implementation Research to code barriers / contextual factors necessitating modifications, and elements of the Framework for Reporting Adaptations and Modifications-Enhanced to describe strategy modifications.

RESULTS

We present three examples of the use of these methods: 1) modifications made to a facilitation-focused strategy (clinics reported that certain meetings were too frequent, so their frequency was reduced in subsequent wedges); 2) a clinic-level strategy addition which involved connecting one study clinic seeking help with community health worker-related workflows to another that already had such a workflow in place; 3) a study-level strategy addition which involved providing assistance in overcoming previously encountered (rather than de novo) challenges.

CONCLUSIONS

These methods for tracking modifications made to implementation strategies build on existing methods, frameworks, and guidelines; however, as none of these were a perfect fit, we made additions to several frameworks as indicated, and used certain frameworks' components selectively. While these methods are time-intensive, and more work is needed to streamline them, they are among the first such methods presented to implementation science. As such, they may be used in research on assessing effective strategy modifications and for replication and scale-up of effective strategies. We present these methods to guide others seeking to document implementation strategies and modifications to their studies.

TRIAL REGISTRATION

clinicaltrials.gov ID: NCT03607617 (first posted 31/07/2018).

Strengthening methods for tracking adaptations and modifications to implementation strategies

BACKGROUND

Developing effective implementation strategies requires adequate tracking and reporting on their application. Guidelines exist for defining and reporting on implementation strategy characteristics, but not for describing how strategies are adapted and modified in practice. We built on existing implementation science methods to provide novel methods for tracking strategy modifications.

METHODS

These methods were developed within a stepped-wedge trial of an implementation strategy package designed to help community clinics adopt social determinants of health-related activities: in brief, an 'Implementation Support Team' supports clinics through a multi-step process. These methods involve five components: 1) describe planned strategy; 2) track its use; 3) monitor barriers; 4) describe modifications; and 5) identify / describe new strategies. We used the Expert Recommendations for Implementing Change taxonomy to categorize strategies, Proctor et al.'s reporting framework to describe them, the Consolidated Framework for Implementation Research to code barriers / contextual factors necessitating modifications, and elements of the Framework for Reporting Adaptations and Modifications-Enhanced to describe strategy modifications.

RESULTS

We present three examples of the use of these methods: 1) modifications made to a facilitation-focused strategy (clinics reported that certain meetings were too frequent, so their frequency was reduced in subsequent wedges); 2) a clinic-level strategy addition which involved connecting one study clinic seeking help with community health worker-related workflows to another that already had such a workflow in place; 3) a study-level strategy addition which involved providing assistance in overcoming previously encountered (rather than de novo) challenges.

CONCLUSIONS

These methods for tracking modifications made to implementation strategies build on existing methods, frameworks, and guidelines; however, as none of these were a perfect fit, we made additions to several frameworks as indicated, and used certain frameworks' components selectively. While these methods are time-intensive, and more work is needed to streamline them, they are among the first such methods presented to implementation science. As such, they may be used in research on assessing effective strategy modifications and for replication and scale-up of effective strategies. We present these methods to guide others seeking to document implementation strategies and modifications to their studies.

TRIAL REGISTRATION

clinicaltrials.gov ID: NCT03607617 (first posted 31/07/2018).

Implementation of a hospital-wide multidisciplinary blunt chest injury care bundle (ChIP): Fidelity of delivery evaluation

BACKGROUND

Ineffective intervention for patients with blunt chest wall injury results in high rates of morbidity and mortality. To address this, a blunt chest injury care bundle protocol (ChIP) was developed, and a multifaceted plan was implemented using the Behaviour Change Wheel.

OBJECTIVE

The purpose of this study was to evaluate the reach, fidelity, and dose of the ChIP intervention to discern if it was activated and delivered to patients as intended at two regional Australian hospitals.

METHODS

This is a pretest and post-test implementation evaluation study. The proportion of ChIP activations and adherence to ChIP components received by eligible patients were compared before and after intervention over a 4-year period. Sample medians were compared using the nonparametric median test, with 95% confidence intervals. Differences in proportions for categorical data were compared using the two-sample z-test.

RESULTS/FINDINGS

Over the 19-month postimplementation period, 97.1% (n = 440) of eligible patients received ChIP (reach). The median activation time was 134 min; there was no difference in time to activation between business hours and after-hours; time to activation was not associated with comorbidities and injury severity score. Compared with the preimplementation group, the postimplementation group were more likely to receive evidence-based treatments (dose), including high-flow nasal cannula use (odds ratio [OR] = 6.8 [95% confidence interval {CI} = 4.8-9.6]), incentive spirometry in the emergency department (OR = 7.5, [95% CI = 3.2-17.6]), regular analgesia (OR = 2.4 [95% CI = 1.5-3.8]), regional analgesia (OR = 2.8 [95% CI = 1.5-5.3]), patient-controlled analgesia (OR = 1.8 [95% CI = 1.3-2.4]), and multiple specialist team reviews, e.g., surgical review (OR = 9.9 [95% CI = 6.1-16.1]).

CONCLUSIONS

High fidelity of delivery was achieved and sustained over 19 months for implementation of a complex intervention in the acute context through a robust implementation plan based on theoretical frameworks. There were significant and sustained improvements in care practices known to result in better patient outcomes. Findings from this evaluation can inform future implementation programs such as ChIP and other multidisciplinary interventions in an emergency or acute care context.

Mapping Clinical Barriers and Evidence-Based Implementation Strategies in Low-to-Middle Income Countries (LMICs)

Background

Low‐to‐middle income countries (LMICs) experience a high burden of disease from both non‐communicable and communicable diseases. Addressing these public health concerns requires effective implementation strategies and localization of translation of knowledge into practice.

Aim

To identify and categorize barriers and strategies to evidence implementation in LMICs from published evidence implementation studies.

Methods

A descriptive analysis of key characteristics of evidence implementation projects completed as part of a 6‐month, multi‐phase, intensive evidence‐based clinical fellowship program, conducted in LMICs and published in the JBI Database of Systematic Reviews and Implementation Reports was undertaken. Barriers were identified and categorized to the Donabedian dimensions of care (structure, process, and outcome), and strategies were mapped to the Cochrane effective practice and organization of care taxonomy.

Results

A total of 60 implementation projects reporting 58 evidence‐based clinical audit topics from LMICs were published between 2010 and 2018. The projects included diverse populations and were predominantly conducted in tertiary care settings. A total of 279 barriers to implementation were identified. The most frequently identified groupings of barriers were process‐related and associated predominantly with staff knowledge. A total of 565 strategies were used across all projects, with every project incorporating more than one strategy to address barriers to implementation of evidence‐based practice; most strategies were categorized as educational meetings for healthcare workers.

Linking Evidence to Action

Context‐specific strategies are required for successful evidence implementation in LMICs, and a number of common barriers can be addressed using locally available, low‐cost resources. Education for healthcare workers in LMICs is an effective awareness‐raising, workplace culture, and practice‐transforming strategy for evidence implementation.

An Internet-Based Intervention for Cardiovascular Disease Management Integrated With Primary Care Electronic Health Records: Mixed Methods Evaluation of Implementation Fidelity and User Engagement

Background

Growing evidence supports the benefits of eHealth interventions to increase patient engagement and improve outcomes for a range of conditions. However, ineffective program delivery and usage attrition limit exposure to these interventions and may reduce their effectiveness.

Objective

This study aims to evaluate the delivery fidelity of an eHealth intervention, describe use patterns, compare outcomes between low and high users, and identify mediating factors on intervention delivery and receipt.

Methods

This is a mixed methods study of an internet-based intervention being evaluated for effectiveness in a randomized controlled trial (RCT). The intervention comprised medication and cardiovascular disease (CVD) risk data uploaded from the primary care electronic health record (EHR); interactive, personalized CVD risk score estimation; goal setting and self-monitoring; an interactive social forum; and optional receipt of heart health messages. Fidelity was assessed over 12 months. Trial outcomes were compared between low and high users. Data sources included program delivery records, web log data, trial data, and thematic analysis of communication records.

Results

Most participants in the intervention group (451/486, 93%) had an initial training session conducted by telephone (413/447, 92.4% of participants trained), with a mean duration of 44 minutes (range 10-90 minutes). Staff conducted 98.45% (1776/1804) of the expected follow-ups, mostly by telephone or email. Of the 451 participants who commenced log-ins, 46.8% (211) were categorized as low users (defined as at least one log-in in 3 or fewer months of follow-up), 40.4% (182) were categorized as high users (at least one log-in in more than 3 months of follow-up), and 12.8% (58) were nonadopters (no log-ins after their training session). The mean log-in frequency was 3-4 per month in ongoing users. There was no significant difference between the groups in the primary trial outcome of adherence to guideline-recommended medications (P=.44). In unadjusted analyses, high users had significantly greater eHealth literacy scores (P=.003) and were more likely to meet recommended weekly targets for fruit (P=.03) and fish (P=.004) servings; however, the adjusted findings were not significant. Interactive screen use was highest for goal tracking and lowest for the chat forum. Screens with EHR-derived data held only an early interest for most users. Fidelity measures (reach, content, dose delivered, and dose received) were influenced by the facilitation strategies used by staff, invisible qualities of staff-participant communication, and participants’ responsiveness to intervention attributes.

Conclusions

A multifeature internet-based intervention was delivered with high fidelity to the RCT protocol and was regularly used by 40.4% (182/451) of users over 12 months. Higher log-in frequency as an indicator of greater intervention exposure was not associated with statistically significant improvements in eHealth literacy scores, lifestyle changes, or clinical outcomes. Attributes of the intervention and individualized support influenced initial and ongoing use.

Fidelity evaluation of the compared procedures for conducting the PVS-PREDIAPS implementation strategy to optimize diabetes prevention in primary care

Background

Assessing the fidelity of an implementation strategy is important to understand why and how the strategy influences the uptake of evidence-based interventions. The present study aims to assess the fidelity of the two procedures for engaging primary care (PC) professionals and for the deployment of an implementation strategy for optimizing type 2 diabetes prevention in routine PC within the PREDIAPS randomized cluster implementation trial.

Method

We conducted a mixed-method fidelity evaluation study of the PVS-PREDIAPS implementation strategy. Nine PC centers from the Basque Health Service (Osakidetza) were allocated to two different procedures to engage physicians and nurses and deploy a implementation strategy to model and adapt the clinical intervention and its implementation to their specific contexts: a Global procedure, promoting the cooperation of all healthcare professionals from the beginning; or a Sequential procedure, centered first on nurses who then pursued the pragmatic cooperation of physicians. Process indicators of the delivery and receipt of implementation strategy actions, documented modifications to the planned implementation strategy, and a structured group interview with centers’ leaders were all used to assess the following components of fidelity: adherence, dose, quality of delivery, professionals’ responsiveness and program differentiation.

Results

Generally, the procedures compared for professionals engagement and deployment of the implementation strategy were carried out with the planned differentiation. Nonetheless, some unexpected between-group differences were observed, the initial rate of collaboration of nurses being higher in the Sequential (93%) than in the Global (67%) groups. Exposure rate to the programed implementation actions (% of hours received out of those delivered) were similar in both groups by professional category, with nurses (86%) having a higher rate of exposure than physicians (75%). Professionals identified half of the planned discrete strategies and their rating of strategies’ perceived usefulness was overwhelmingly positive, with few differences between Sequential and Global centers.

Conclusions

The PVS-PREDIAPS implementation strategy has been implemented with high fidelity and minor unplanned reactive modifications. Professionals’ exposure to the implementation strategy was high in both groups. The centers’ organizational context (i.e., work overload) led to small mismatches between groups in participation and exposure of professionals to implementation actions.

Trial registration

Clinicaltrials.gov identifier: NCT03254979. Registered 16 August 2017.

Completeness of Intervention Reporting of Clinical Trials Published in Highly Ranked Obesity Journals

OBJECTIVE

Randomized controlled trials (RCTs) play a crucial role in the research and advancement of medical treatment. A cross-sectional study design was utilized to analyze the completeness of intervention reporting using the Template for Intervention Description and Replication (TIDieR) checklist and to evaluate factors associated with intervention reporting. A comparison of the completeness of intervention reporting before and after the publication of TIDieR was sought.

METHODS

PubMed was searched for RCTs in the top 10 obesity journals per the Google h5-index. After excluding non-RCTs, 300 articles were randomly sampled. After assessing each publication for eligibility, two authors (SLR and DT) extracted data related to intervention reporting from records in an independent, masked fashion. Data were then verified and analyzed.

RESULTS

The analysis revealed that the quality of intervention reporting is quite variable. Overall, no statistically significant difference in the quality of intervention reporting before and after the release of TIDieR guidelines was found. In general, obesity research has good intervention reporting in areas such as the mode of delivery, material lists for intervention, and procedure lists. However, four main areas in which obesity researchers can improve reporting quality were determined. These include providing the expertise and background of intervention providers and providing statements regarding the assessment of fidelity of the intervention.

CONCLUSIONS

Urgent intervention is warranted to improve the quality of research reporting in obesity research, which is a fundamental component of obesity management. This will likely require a unified approach from researchers, journals, and funding sources.

Assessing Implementation Strategy Reporting in the Mental Health Literature: A Narrative Review

Inadequate implementation strategy reporting restricts research synthesis and replicability. We explored the implementation strategy reporting quality of a sample of mental health articles using Proctor et al.'s (Implement Sci 8:139, 2013) reporting recommendations. We conducted a narrative review to generate the sample of articles and assigned a reporting quality score to each article. The mean article reporting score was 54% (range 17-100%). The most reported domains were: name (100%), action (82%), target (80%), and actor (67%). The least reported domains included definition (6%), temporality (26%), justification (34%), and outcome (37%). We discuss limitations and provide recommendations to improve reporting.

Development and Optimization of Clinical Informatics Infrastructure to Support Bioinformatics at an Oncology Center

Translational bioinformatics for therapeutic discovery requires the infrastructure of clinical informatics. In this chapter, we describe the clinical informatics components needed for successful implementation of translational research at a cancer center. This chapter is meant to be an introduction to those clinical informatics concepts that are needed for translational research. For a detailed account of clinical informatics, the authors will guide the reader to comprehensive resources. We provide examples of workflows from Moffitt Cancer Center led by Drs. Perkins and Markowitz. This perspective represents an interesting collaboration as Dr. Perkins is the Chief Medical Information Officer and Dr. Markowitz is a translational researcher in Melanoma with an active informatics component to his laboratory to study the mechanisms of resistance to checkpoint blockade and an active member of the clinical informatics team.

Implementation of a national mental health intervention in educational communities: What do successful teams do differently?

This study aimed to identify the elements that characterize local teams which implement a nationwide preventive mental health intervention in schools and achieve better results. A mixed-methods sequential explanatory design was conducted in two phases: (a) teams were characterized according to their level of achievement in the preventive intervention through latent class analysis; and (b) case studies of three teams with different implementation results were conducted by performing content analysis on interviews, observations, and documents. It was established that the more effective teams have better planning, the more they are familiar with the intervention, and more aware of their strengths and weaknesses. This team also implement culturally pertinent actions aimed at increasing knowledge about the intervention, which causes schools to experience it as part of their community, since they include the intervention in their regular dynamics. Lastly, the importance and relevance of these elements when working in educational communities is discussed.

A systematic review of the implementation of obesity prevention interventions in early childcare and education settings using the RE-AIM framework

Previous systematic reviews have examined the efficacy of obesity prevention interventions within early childcare/education settings. Often lacking in these reviews is reporting on external validity, which continues to be underemphasized compared to internal validity. More attention to external validity would help better translate evidence-based interventions to real-world settings. This systematic review aimed to determine the availability of data on both internal and external validity across dimensions of the Reach, Efficacy/Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework in studies reporting on obesity prevention interventions in early childcare/education settings. Inclusion criteria included: randomized controlled trials, early childcare/education setting, targeted children 2-6 years old, addressed both diet and physical activity, collected measures of weight status and diet and/or physical activity, and published within the last 10 years. Searches were conducted in ERIC, PsychInfo, and PubMed; 23 studies met inclusion criteria. A validated RE-AIM abstraction tool was used to code studies. Most commonly reported dimensions were Reach (62.3%), Implementation (53.5%), and Efficacy/Effectiveness (48.7%). Adoption (21.7%) and Maintenance (11.6%) were less often reported. All studies reported on primary outcomes, but few reported on RE-AIM indicators of characteristics of participation and adoption, quality of life, methods used to identify staff, staff inclusion/exclusion criteria and adoption rates, implementation fidelity, measures of cost to start-up and deliver the intervention, and indicators of maintenance. This systematic review underscores the need for more focus on external validity to inform replication, dissemination, and implementation so that evidence-based early childcare/education obesity interventions can be generalized to real-world settings.

The Implementation Research Logic Model: a method for planning, executing, reporting, and synthesizing implementation projects

BACKGROUND

Numerous models, frameworks, and theories exist for specific aspects of implementation research, including for determinants, strategies, and outcomes. However, implementation research projects often fail to provide a coherent rationale or justification for how these aspects are selected and tested in relation to one another. Despite this need to better specify the conceptual linkages between the core elements involved in projects, few tools or methods have been developed to aid in this task. The Implementation Research Logic Model (IRLM) was created for this purpose and to enhance the rigor and transparency of describing the often-complex processes of improving the adoption of evidence-based interventions in healthcare delivery systems.

METHODS

The IRLM structure and guiding principles were developed through a series of preliminary activities with multiple investigators representing diverse implementation research projects in terms of contexts, research designs, and implementation strategies being evaluated. The utility of the IRLM was evaluated in the course of a 2-day training to over 130 implementation researchers and healthcare delivery system partners.

RESULTS

Preliminary work with the IRLM produced a core structure and multiple variations for common implementation research designs and situations, as well as guiding principles and suggestions for use. Results of the survey indicated a high utility of the IRLM for multiple purposes, such as improving rigor and reproducibility of projects; serving as a "roadmap" for how the project is to be carried out; clearly reporting and specifying how the project is to be conducted; and understanding the connections between determinants, strategies, mechanisms, and outcomes for their project.

CONCLUSIONS

The IRLM is a semi-structured, principle-guided tool designed to improve the specification, rigor, reproducibility, and testable causal pathways involved in implementation research projects. The IRLM can also aid implementation researchers and implementation partners in the planning and execution of practice change initiatives. Adaptation and refinement of the IRLM are ongoing, as is the development of resources for use and applications to diverse projects, to address the challenges of this complex scientific field.

Measuring Implementation Strategy Fidelity in HealthyHearts NYC: A Complex Intervention Using Practice Facilitation in Primary Care

Few studies have assessed the fidelity of practice facilitation (PF) as an implementation strategy, and none have used an a priori definition or conceptual framework of fidelity to guide fidelity assessment. The authors adapted the Conceptual Framework for Implementation Fidelity to guide fidelity assessment in HealthyHearts NYC, an intervention that used PF to improve adoption of cardiovascular disease evidence-based guidelines in primary care practices. Data from a web-based tracking system of 257 practices measured fidelity using 4 categories: frequency, duration, content, and coverage. Almost all (94.2%) practices received at least the required 13 PF visits. Facilitators spent on average 26.3 hours at each site. Most practices (95.7%) completed all Task List items, and 71.2% were educated on all Chronic Care Model strategies. The majority (65.8%) received full coverage. This study provides a model that practice managers and implementers can use to evaluate fidelity of PF, and potentially other implementation strategies.

Design of a cluster-randomized trial of the effectiveness and cost-effectiveness of metformin on prevention of type 2 diabetes among prediabetic Mexican adults (the PRuDENTE initiative of Mexico City)

INTRODUCTION

Type 2 diabetes (T2D) is a global epidemic, and nations are struggling to implement effective healthcare strategies to reduce the burden. While efficacy studies demonstrate that metformin can reduce incident T2D by half among younger, obese adults with prediabetes, its real-world effectiveness are understudied, and its use for T2D prevention in primary care is low. We describe the design of a pragmatic trial to evaluate the incremental effectiveness of metformin, as an adjunct to a simple lifestyle counseling.

METHODS

The "Prevención de la Diabetes con Ejercicio, Nutrición y Tratamiento" [Diabetes Prevention with Exercise, Nutrition and Treatment; PRuDENTE, (Spanish acronym)] is a cluster-randomized trial in Mexico City's public primary healthcare system. The study randomly assigns 51 clinics to deliver one of two interventions for 36 months: 1) lifestyle only; 2) lifestyle plus metformin, to 3060 patients ages 30-65 with impaired fasting glucose and obesity. The primary endpoint is incident T2D (fasting glucose ≥126 mg/dL, or HbA1c ≥6.5%). We will also measure a range of implementation-related process outcomes at the clinic-, clinician- and patient-levels to inform interpretations of effectiveness and enable efforts to refine, adapt, adopt and disseminate the model. We will also estimate the cost-effectiveness of metformin as an adjunct to lifestyle counseling in Mexico.

DISCUSSION

Findings from this pragmatic trial will generate new translational knowledge in Mexico and beyond, both with respect to metformin's real-world effectiveness among an 'at-risk' population, and uncovering facilitators and barriers to the reach, adoption and implementation of metformin preventive therapy in public primary care settings.

TRIAL REGISTRATION

This trial is registered at Clinicaltrials.gov (NCT03194009).

Effectiveness of reminders to sustain practice change among direct care providers in residential care facilities: a cluster randomized controlled trial

BACKGROUND

The study purpose was to compare the effectiveness of monthly or quarterly peer reminder knowledge translation interventions, with monthly or quarterly paper-based reminders, to sustain a mobility innovation, the sit-to-stand activity.

METHOD

A cluster RCT using a stratified 2 × 2 factorial design was conducted in 24 Canadian residential care facilities with 416 residents and 54 peer reminder care aides. The 1-year intervention included two intensities of reminders (high: socially based peer reminders delivered by volunteer care aides to other care aides; low: paper-based reminders posted in residents' rooms), at two frequencies (monthly; every 3 months). Intervention fidelity was assessed using questionnaires and observations. Monthly sustainability rate of the sit-to-stand activity was calculated as the percentage of opportunities that residents successfully completed the activity in 30 days. Residents' sustainability rates were analyzed using a linear mixed model that mirrored the clustered repeated-measures factorial trial design. The model included a random intercept to account for clustering within sites. An unstructured covariance structure characterized the interdependence of repeated measures over time.

RESULTS

Twenty-four sites were randomized. One site was excluded because of falsifying data, leaving 23 sites and 349 residents for intention-to-treat analysis. Paper reminders were implemented with high fidelity across all arms (91.5% per protocol), while the peer reminders were implemented with moderate fidelity in the monthly group (81.0% per protocol) and poor fidelity in the quarterly group (51.7% per protocol). At month 1, mean sustainability ranged from 40.7 to 47.2 per 100 opportunities, across the four intervention arms (p = 0.43). Mean rate of sustainability in the high intensity, high frequency group diverged after randomization, yielding statistically significant differences among the groups at 4 months which persisted for the remainder of the trial. After 12 months, the mean sustainability in the high intensity, high frequency group was approximately twice that of the other three groups combined (64.1 versus 37.8 per 100 opportunities, p < 0.001).

CONCLUSIONS

A monthly peer reminder intervention was more effective than a quarterly peer reminder intervention, a monthly paper-based reminder intervention, and a quarterly paper-based reminder intervention, in supporting care aides to sustain a mobility innovation in residential care facilities over 1 year.

TRIAL REGISTRATION

ClinicalTrials.gov , NCT01746459. Registered 11 December 2012: https://clinicaltrials.gov/ct2/show/NCT01746459 .

Stakeholder Engagement in Practice Change: Enabling Person-Centred Mealtime Experiences in Residential Care Homes

Person-centred care is recognized as best practice in dementia care. The purpose of this study was to evaluate the effectiveness of a stakeholder engagement practice change initiative aimed at increasing the provision of person-centred mealtimes in a residential care home (RCH). A single-group, time series design was used to assess the impact of the practice change initiative on mealtime environment across four time periods (pre-intervention, 1-month, 3-month, and 6-month follow-up). Statistically significant improvements were noted in all mealtime environment scales by 6 months, including the physical environment (z = -3.06, p = 0.013), social environment (z = -3.69, p = 0.001), relationship and person-centred scale (z = -3.51, p = 0.003), and overall environment scale (z = -3.60, p = 0.002). This practice change initiative, which focused on enhancing stakeholder engagement, provided a feasible method for increasing the practice of person-centred care during mealtimes in an RCH through the application of supportive leadership, collaborative decision making, and staff engagement.