[Analysis of the results of a palliative care quality program for the last days of life. Ten years of experience]

The integrated care pathways for the last days of life propose quality standards optimizing the care of patients and families. The Pallium Multidisciplinary Assistance Program (PAMPA ©) was implemented based on standards of the International Collaborative for Best Care for the Dying Person in 4 phases: induction, implementation, dissemination and sustainability, in five health centres in Argentina, between 2008 and 2018. A total of 1237 adult patients in the last days of life were included and cared for by palliative care teams trained in PAMPA©. An audit was conducted before and after the implementation of the Program, which is still going on. The median range of follow up into five centres from the beginning of the pathway until death varied from 16 to 178 hours. Care goals were compared: symptom control, communication, multidimensional needs, hydration and nutrition, documentation of interventions and post-mortem care. The overall analysis showed an improvement in the number of records (p = 0.001). The goal of communication on care plan to the patient showed no difference (p = 0.173). Continuous training, support and permanent teams supervision were carried out and perceptions and impact of the implementation were registered. The main emerging items of the qualitative analysis were: attitudes towards the program, fundamental contributions, strengths, weaknesses and subjective definition of the program, recognition of institutional cultural singularities and its influence on care. PAMPA© demonstrated its feasibility as a model of end of life care for patients and families, based on international quality standards.

Opportunities and barriers to implementing antibiotic stewardship in low and middle-income countries: Lessons from a mixed-methods study in a tertiary care hospital in Ethiopia

Background

Global action plans to tackle antimicrobial resistance (AMR) include implementation of antimicrobial stewardship (AMS), but few studies have directly addressed the challenges faced by low and middle-income countries (LMICs). Our aim was to explore healthcare providers’ knowledge and perceptions on AMR, and barriers/facilitators to successful implementation of a pharmacist-led AMS intervention in a referral hospital in Ethiopia.

Methods

Tikur Anbessa Specialized Hospital (TASH) is an 800-bed tertiary center in Addis Ababa, and the site of an ongoing 4-year study on AMR. Between May and July 2017, using a mixed approach of quantitative and qualitative methods, we performed a cross-sectional survey of pharmacists and physicians using a pre-tested questionnaire and semi-structured interviews of purposively selected respondents until thematic saturation. We analyzed differences in proportions of agreement between physicians and pharmacists using χ² and fisher exact tests. Qualitative data was analyzed thematically.

Findings

A total of 406 survey respondents (358 physicians, 48 pharmacists), and 35 key informants (21 physicians and 14 pharmacists) were enrolled. The majority of survey respondents (>90%) strongly agreed with statements regarding the global scope of AMR, the need for stewardship, surveillance and education, but their perceptions on factors contributing to AMR and their knowledge of institutional resistance profiles for common bacteria were less uniform. Close to 60% stated that a significant proportion of S. aureus infections were caused by methicillin-resistant strains (an incorrect statement), while only 48% thought a large proportion of gram-negative infections were caused by cephalosporin-resistant strains (a true statement). Differences were noted between physicians and pharmacists: more pharmacists agreed with statements on links between use of broad-spectrum antibiotics and AMR (p<0.022), but physicians were more aware that lack of diagnostic tests led to antibiotic overuse (p<0.01). More than cost, fear of treatment failure and of retribution from senior physicians were major drivers of antibiotic prescription behavior particularly among junior physicians. All respondents identified high turnover of pharmacists, poor communication between the laboratory, pharmacists and clinicians as potential challenges; but the existing hierarchical culture and academic setting were touted as opportunities to implement AMS in Ethiopia.

Conclusions

This knowledge and perceptions survey identified specific educational priorities and implementation strategies for AMS in our setting. This is likely also true in other LMICs, where expertise and infrastructure may be lacking.

Mixed-methods evaluation of the Perioperative Medicine Service for High-Risk Patients Implementation Pilot (POMSHIP): a study protocol

INTRODUCTION

Perioperative complications have a lasting effect on health-related quality of life and long-term survival. The Royal College of Anaesthetists has proposed the development of perioperative medicine (POM) services as an intervention aimed at improving postoperative outcome, by providing better coordinated care for high-risk patients. The Perioperative Medicine Service for High-risk Patients Implementation Pilot was developed to determine if a specialist POM service is able to reduce postoperative morbidity, failure to rescue, mortality and cost associated with hospital admission. The service involves individualised objective risk assessment, admission to a postoperative critical care unit and follow-up on the surgical ward by the POM team. This paper introduces the service and how it will be evaluated.

METHODS AND ANALYSIS OF THE EVALUATION

A mixed-methods evaluation is exploring the impact of the service. Clinical effectiveness of the service is being analysed using a 'before and after' comparison of the primary outcome (the PostOperative Morbidity Score). Secondary outcomes will include length of stay, validated surveys to explore quality of life (EQ-5D) and quality of recovery (Quality of Recovery-15 Score). The impact on costs is being analysed using 'before and after' data from the Patient-Level Information and Costing System and the National Schedule of Reference Costs. The perceptions and experiences of staff and patients with the service, and how it is being implemented, are being explored by a qualitative process evaluation.

ETHICS AND DISSEMINATION

The study was classified as a service evaluation. Participant information sheets and consent forms have been developed for the interviews and approvals required for the use of the validated surveys were obtained. The findings of the evaluation are being used formatively, to make changes in the service throughout implementation. The findings will also be used to inform the potential roll-out of the service to other sites.

Actions required to implement integrated care for older people in the community using the World Health Organization's ICOPE approach: A global Delphi consensus study

Background

Integrated care is recognised as an important enabler to healthy ageing, yet few countries have managed to sustainably deliver integrated care for older people. We aimed to gather global consensus on the key actions required to realign health and long-term systems and integrate services to implement the World Health Organization (WHO) Integrated Care for Older People (ICOPE) approach.

Methods

A two-round eDelphi study, including a global consultation meeting, was undertaken to identify, refine and generate consensus on the actions required across high-, middle- and low-income countries to implement the WHO ICOPE approach. In round 1, a framework of 31 actions, empirically derived from previous WHO evidence reviews was presented to panellists to judge the relative importance of each action (numeric rating scale; range:1–9) and provide free-text comments concerning the scope of the actions. These outcomes were discussed and debated at the global consultation meeting. In round 2, a revised framework of 19 actions was presented to panellists to measure their extent of agreement and identify ‘essential’ actions (five-point Likert scale; range: strongly agree to strongly disagree). A threshold of ≥80% for agree/strongly agree was set a priori for consensus.

Results

After round 1 (n = 80 panellists), median scores across 31 actions ranged from 6 to 9. Based on pre-defined category thresholds for median scores, panellists considered 28 actions (90·3%) as ‘important’ and three (9·7%) as ‘uncertain’. Fifteen additional actions were suggested for inclusion based on free-text comments, creating 46 for consideration at the global consultation meeting. In round 2 (n = 84 panellists), agreement (agree or strongly agree) ranged from 84·6–97·6%, suggesting consensus. Fourteen (73·7%) actions were rated as essential.

Conclusion

Fourteen essential actions and five important actions are necessary at system (macro; n = 10) and service (meso; n = 9) levels to implement community-based integrated care for older people.

Evaluation of the COPDnet integrated care model in patients with COPD: the study protocol

Background

Projections on the future suggest a further rise in the prevalence of patients with COPD, and in COPD related morbidity, mortality, and health care costs worldwide. Given the substantial impact on the individual and on society, it is important to establish a care process that maximizes outcomes in relation to the costs and efforts made. In an attempt to bridge this gap, we set out to develop an evidence-based model of integrated care for patients with COPD, named the COPDnet integrated care model.

Purpose

The current study protocol sets out to 1) evaluate the feasibility of employing the COPDnet model in present real-life care within the context of the Dutch health care system, 2) explore the potential health status benefits, and 3) analyze the costs of care of this model.

Patients and methods

In this prospective study, feasibility and health status changes will be evaluated with an experimental before and after study design. The costs of the diagnostic trajectory will be calculated according to a standard economic health care evaluation approach. Furthermore, the feasibility and cost of care studies will comprise both quantitative and qualitative data collection. For the studies on the feasibility and change in health status, all new patients qualifying for shared care by primary and secondary care professionals according to the Dutch Standard of Care for COPD, and patients referred by their general practitioners to one of the COPDnet hospitals will be included. To evaluate the feasibility and costs of care, semi-structured interviews will be held with patients, hospital personnel, health care professionals in the affiliated primary care region, and hospital and primary care group managers.

Conclusions

The COPDnet integrated care model for COPD patients has been designed according to the current insights regarding effective care for patients with a chronic condition in general, and for patients with COPD in particular. It will be evaluated for its feasibility, potential health status benefits, and the costs of care of the diagnostic trajectory in secondary care.

Leveraging routine clinical materials and mobile technology to assess CBT fidelity: the Innovative Methods to Assess Psychotherapy Practices (imAPP) study

BACKGROUND

Identifying scalable strategies for assessing fidelity is a key challenge in implementation science. However, for psychosocial interventions, the existing, reliable ways to test treatment fidelity quality are often labor intensive, and less burdensome strategies may not reflect actual clinical practice. Cognitive behavioral therapies (CBTs) provide clinicians with a set of effective core elements to help treat a multitude of disorders, which, evidence suggests, need to be delivered with fidelity to maximize potential client impact. The current "gold standard" for rating CBTs is rating recordings of therapy sessions, which is extremely time-consuming and requires a substantial amount of initial training. Although CBTs can vary based on the target disorder, one common element employed in most CBTs is the use of worksheets to identify specific behaviors and thoughts that affect a client's ability to recover. The present study will develop and evaluate an innovative new approach to rate CBT fidelity, by developing a universal CBT scoring system based on worksheets completed in therapy sessions.

METHODS

To develop a scoring system for CBT worksheets, we will compile common CBT elements from a variety of CBT worksheets for a range of psychiatric disorders and create adherence and competence measures. We will collect archival worksheets from past studies to test the scoring system and assess test-retest reliability. To evaluate whether CBT worksheet scoring accurately reflects clinician fidelity, we will recruit clinicians who are engaged in a CBT for depression, anxiety, and/or posttraumatic stress disorder. Clinicians and clients will transmit routine therapy materials produced in session (e.g., worksheets, clinical notes, session recordings) to the study team after each session. We will compare observer-rated fidelity, clinical notes, and fidelity-rated worksheets to identify the most effective and efficient method to assess clinician fidelity. Clients will also be randomly assigned to either complete the CBT worksheets on paper forms or on a mobile application (app) to learn if worksheet format influences clinician and client experience or differs in terms of reflecting fidelity.

DISCUSSION

Scoring fidelity using CBT worksheets may allow clinics to test fidelity in a short and effective manner, enhancing continuous quality improvement in the workplace. Clinicians and clinics can use such data to improve clinician fidelity in real time, leading to improved patient outcomes.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03479398 . Retrospectively registered March 20, 2018.

Opportunities and Challenges in Implementation of Multiparameter Single Cell Analysis Platforms for Clinical Translation

The high-content interrogation of single cells with platforms optimized for the multiparameter characterization of cells in liquid and solid biopsy samples can enable characterization of heterogeneous populations of cells ex vivo. Doing so will advance the diagnosis, prognosis, and treatment of cancer and other diseases. However, it is important to understand the unique issues in resolving heterogeneity and variability at the single cell level before navigating the validation and regulatory requirements in order for these technologies to impact patient care. Since 2013, leading experts representing industry, academia, and government have been brought together as part of the Foundation for the National Institutes of Health (FNIH) Biomarkers Consortium to foster the potential of high-content data integration for clinical translation.

An updated protocol for a systematic review of implementation-related measures

BACKGROUND

Implementation science is the study of strategies used to integrate evidence-based practices into real-world settings (Eccles and Mittman, Implement Sci. 1(1):1, 2006). Central to the identification of replicable, feasible, and effective implementation strategies is the ability to assess the impact of contextual constructs and intervention characteristics that may influence implementation, but several measurement issues make this work quite difficult. For instance, it is unclear which constructs have no measures and which measures have any evidence of psychometric properties like reliability and validity. As part of a larger set of studies to advance implementation science measurement (Lewis et al., Implement Sci. 10:102, 2015), we will complete systematic reviews of measures that map onto the Consolidated Framework for Implementation Research (Damschroder et al., Implement Sci. 4:50, 2009) and the Implementation Outcomes Framework (Proctor et al., Adm Policy Ment Health. 38(2):65-76, 2011), the protocol for which is described in this manuscript.

METHODS

Our primary databases will be PubMed and Embase. Our search strings will be comprised of five levels: (1) the outcome or construct term; (2) terms for measure; (3) terms for evidence-based practice; (4) terms for implementation; and (5) terms for mental health. Two trained research specialists will independently review all titles and abstracts followed by full-text review for inclusion. The research specialists will then conduct measure-forward searches using the "cited by" function to identify all published empirical studies using each measure. The measure and associated publications will be compiled in a packet for data extraction. Data relevant to our Psychometric and Pragmatic Evidence Rating Scale (PAPERS) will be independently extracted and then rated using a worst score counts methodology reflecting "poor" to "excellent" evidence.

DISCUSSION

We will build a centralized, accessible, searchable repository through which researchers, practitioners, and other stakeholders can identify psychometrically and pragmatically strong measures of implementation contexts, processes, and outcomes. By facilitating the employment of psychometrically and pragmatically strong measures identified through this systematic review, the repository would enhance the cumulativeness, reproducibility, and applicability of research findings in the rapidly growing field of implementation science.

Process evaluation of a participatory organizational change program to reduce musculoskeletal and slip, trip and fall injuries

BACKGROUND

Long-term care (LTC) workers are at significant risk for occupational-related injuries. Our objective was to evaluate the implementation process of a participatory change program to reduce risk.

METHODS

A process evaluation was conducted in three LTC sites using a qualitative approach employing structured interviews, consultant logs and a focus group.

RESULTS

Findings revealed recruitment/reach themes of being "voluntold", using established methods, and challenges related to work schedules. Additional themes about dose were related to communication, iterative solution development, participation and engagement. For program fidelity and satisfaction, themes emerged around engagement, capacity building and time demands.

CONCLUSION

Process evaluation revealed idiosyncratic approaches to recruitment and related challenges of reaching staff. Solutions to prioritized hazards were developed and implemented, despite time challenges. The iterative solution development approach was embraced. Program fidelity was considered good despite early program time demands. Post implementation reports revealed sustained hazard identification and solution development.

Use of Simulation-Based Training to Aid in Implementing Complex Health Technology

Clinicians are adult learners in a complex environment that historically does not invest in training in a way that is conducive to these types of learners. Adult learners are independent, self-directed, and goal oriented. In today's fast-paced clinical setting, a practical need exists for nurses and clinicians to master the technology they use on a daily basis, especially as medical devices have become more interconnected and complex. As hospitals look to embrace new technologies, medical device companies must provide clinical end-user training. This should be a required part of the selection process when considering the purchase of any complex medical technology. However, training busy clinicians in a traditional classroom setting can be difficult and costly. A simple, less expensive solution is online simulation training. This interactive training provides a virtual, "hands-on" end-user experience in advance of implementing new equipment. Online simulation training ensures knowledge retention and comprehension and, most importantly, that the training leads to end-user satisfaction and the ability to confidently operate new equipment. A review of the literature revealed that online simulation, coupled with the use of adult learning principles and experiential learning, may enhance the experience of clinical end users.

Strategies for successful trauma registry implementation in low- and middle-income countries-protocol for a systematic review

BACKGROUND

The benefits of trauma registries have been well described. The crucial data they provide may guide injury prevention strategies, inform resource allocation, and support advocacy and policy. This has been shown to reduce trauma-related mortality in various settings. Trauma remains a leading cause of mortality in low- and middle-income countries (LMICs). However, the implementation of trauma registries in LMICs can be challenging due to lack of funding, specialized personnel, and infrastructure. This study explores strategies for successful trauma registry implementation in LMICs.

METHODS

The protocol was registered a priori (CRD42017058586). A peer-reviewed search strategy of multiple databases will be developed with a senior librarian. As per PRISMA guidelines, first screen of references based on abstract and title and subsequent full-text review will be conducted by two independent reviewers. Disagreements that cannot be resolved by discussion between reviewers shall be arbitrated by the principal investigator. Data extraction will be performed using a pre-defined data extraction sheet. Finally, bibliographies of included articles will be hand-searched. Studies of any design will be included if they describe or review development and implementation of a trauma registry in LMICs. No language or period restrictions will be applied. Summary statistics and qualitative meta-narrative analyses will be performed.

DISCUSSION

The significant burden of trauma in LMIC environments presents unique challenges and limitations. Adapted strategies for deployment and maintenance of sustainable trauma registries are needed. Our methodology will systematically identify recommendations and strategies for successful trauma registry implementation in LMICs and describe threats and barriers to this endeavor.

SYSTEMATIC REVIEW REGISTRATION

The protocol was registered on the PROSPERO international prospective register of systematic reviews ( CRD42017058586 ).

Implementation of an electronic routine outcome monitoring at an inpatient unit for psychosomatic medicine

BACKGROUND

Patient-reported outcomes (PROs) can be part of an electronic routine outcome monitoring (eROM). eROM can improve patient involvement, treatment outcomes and simplify scientific data assessment. Available studies on eROM focus on its evaluation only and lack a detailed description of the prior implementation procedure.

OBJECTIVE

The aim was to implement an eROM assessment at a division of Psychosomatic Medicine and provide a detailed description of the implementation procedure.

METHODS

According to the Replicating Effective Program concept the project consisted of 4 phases: pre-condition (1), pre-implementation (2), implementation (3) and maintenance and evolution (4) mainly focusing the description of the implementation procedure and a short evaluation.

RESULTS

We describe the actions taken during the implementation procedure and steps which were taken to overcome identified barriers. All decisions were carried out based on the Participatory Action Research process. A core set consisting of sociodemographic and clinical data and a comprehensive questionnaire battery covering symptoms, functioning parameters and psychological constructs was implemented. In total 164 patients, took part in the eROM assessment from June 2015 to December 2016. The evaluation showed that eROM was appreciated by health-care professionals (85.2%) and patients (70.2%) alike. The majority of patients (89.4%) and health-care professionals (85.7%) experienced no delays in daily clinical routine due to eROM.

CONCLUSION

The detailed description of the implementation process can guide institutions planning to implement eROM into their daily clinical routine. Focusing scientific efforts on the implementation process is essential since this influences all further steps such as evaluation and acceptance.

Identifying a practice-based implementation framework for sustainable interventions for improving the evolving working environment: Hitting the Moving Target Framework

Our aim was to identify implementation components for sustainable working environment interventions in the nursing assistant sector to generate a framework to optimize the implementation of workplace improvement initiatives. The implementation framework was informed by: 1) an industry advisory group, 2) interviews with key stakeholder, 3) concept mapping workshops, and 4) an e-mail survey. Thirty five stakeholders were interviewed and contributed in the concept mapping workshops. Eleven implementation components were derived across four domains: 1) A supportive organizational platform, 2) An engaged workplace with mutual goals, 3) The intervention is sustainably fitted to the workplace, and 4) the intervention is an attractive choice. The highest rated component was "Engaged and Active Management" (mean 4.1) and the lowest rated was "Delivered in an Attractive Form" (mean 2.8). The framework provides new insights into implementation in an evolving working environment and is aiming to assist with addressing gaps in effectiveness of workplace interventions and implementation success.

Putting public health infrastructures to the test: introducing HPV vaccination in Austria and the Netherlands

This article presents two cases of policymaking concerning the vaccine against Human Papilloma Virus (HPV), which is sexually transmitted and carcinogenic. Our analysis focuses on its introduction in Austria and the Netherlands. In both contexts, we find prevention and screening to be at once complementary and competing public health logics and we draw on the concept of 'infrastructure' to understand their roles in shaping the reception of the vaccine. We reveal how the HPV vaccine had to be made 'good enough', much like the Pap smear (Casper and Clarke ), by means of diverse tinkering practices that transformed both the technology and the infrastructures in which they emerged. At the same time, it was important that the vaccine would not come to problematise Pap smear-based screening. The article points to the contextually contingent nature of policymaking around new medical technologies, and the skillful care with which public health infrastructures such as immunisation and screening programmes are handled and tinkered with.

The dichotomy of the application of a systems approach in UK healthcare the challenges and priorities for implementation

There is increasing demand for a systems approach within national healthcare guidelines to provide a systematic and sustainable framework for improvements in patient safety. Supported by this is the growing body of evidence within Human Factors/Ergonomics (HFE) healthcare literature for the inclusion of this approach in health service design, provision and evaluation. This paper considers the current interpretation of this within UK healthcare systems and the dichotomy which exists in the challenge to implement a systems approach. Three case studies, from primary and secondary care, present a systems approach, offering a novel perspective of primary care and blood sampling. These provide practical illustrations of how HFE methods have been used in collaboration with healthcare staff to understand the system for the purpose of professional education, design and safety of clinical activities. The paper concludes with the challenge for implementation and proposes five roles for systems HFE to support patient safety. Practitioner Summary: healthcare is classified as a complex and dynamic system within this paper and as such HFE system methods are presented as desirable to understand the system, to develop HFE tools, to deliver education and integrate HFE within healthcare systems.

Implementation fidelity trajectories of a health promotion program in multidisciplinary settings: managing tensions in rehabilitation care

BACKGROUND

Although the importance of evaluating implementation fidelity is acknowledged, little is known about heterogeneity in fidelity over time. This study aims to generate insight into the heterogeneity in implementation fidelity trajectories of a health promotion program in multidisciplinary settings and the relationship with changes in patients' health behavior.

METHODS

This study used longitudinal data from the nationwide implementation of an evidence-informed physical activity promotion program in Dutch rehabilitation care. Fidelity scores were calculated based on annual surveys filled in by involved professionals (n = ± 70). Higher fidelity scores indicate a more complete implementation of the program's core components. A hierarchical cluster analysis was conducted on the implementation fidelity scores of 17 organizations at three different time points. Quantitative and qualitative data were used to explore organizational and professional differences between identified trajectories. Regression analyses were conducted to determine differences in patient outcomes.

RESULTS

Three trajectories were identified as the following: 'stable high fidelity' (n = 9), 'moderate and improving fidelity' (n = 6), and 'unstable fidelity' (n = 2). The stable high fidelity organizations were generally smaller, started earlier, and implemented the program in a more structured way compared to moderate and improving fidelity organizations. At the implementation period's start and end, support from physicians and physiotherapists, professionals' appreciation, and program compatibility were rated more positively by professionals working in stable high fidelity organizations as compared to the moderate and improving fidelity organizations (p < .05). Qualitative data showed that the stable high fidelity organizations had often an explicit vision and strategy about the implementation of the program. Intriguingly, the trajectories were not associated with patients' self-reported physical activity outcomes (adjusted model β = - 651.6, t(613) = - 1032, p = .303).

CONCLUSIONS

Differences in organizational-level implementation fidelity trajectories did not result in outcome differences at patient-level. This suggests that an effective implementation fidelity trajectory is contingent on the local organization's conditions. More specifically, achieving stable high implementation fidelity required the management of tensions: realizing a localized change vision, while safeguarding the program's standardized core components and engaging the scarce physicians throughout the process. When scaling up evidence-informed health promotion programs, we propose to tailor the management of implementation tensions to local organizations' starting position, size, and circumstances.

TRIAL REGISTRATION

The Netherlands National Trial Register NTR3961 . Registered 18 April 2013.

Chronic disease outcomes from primary care population health program implementation

OBJECTIVES

We implemented a health information technology-enabled population health management program for chronic disease management in academic hospital-affiliated primary care practices, then compared quality-of-care outcome measures among practices assigned a central population health coordinator (PHC) and those not assigned a PHC.

STUDY DESIGN

Quasi-experimental.

METHODS

Central PHCs were nonrandomly assigned to 8 of 18 practices. They met with physicians, managed lists of patients not at goal in chronic disease registries, and performed administrative tasks. In non-PHC practices, existing staff remained responsible for these tasks. The primary outcome was difference-in-differences over the 6-month follow-up period between PHC and non-PHC practices for outcome measures for diabetes (low-density lipoprotein cholesterol [LDL-C], glycated hemoglobin [A1C], and blood pressure [BP] goal attainment), cardiovascular disease (LDL-C goal attainment), and hypertension (BP goal attainment). Secondary outcomes included process measures only (obtaining LDL-C, A1C, and BP readings) and cancer screening test completion.

RESULTS

The difference in the percentage point (PP) increase in outcome measures over follow-up was greater in PHC practices than non-PHC practices for all measures among patients with diabetes (LDL-C, 4.6 PP; A1C, 4.8 PP; BP, 4.7 PP), cardiovascular disease (LDL-C, 3.3 PP), and hypertension (BP, 2.3 PP) (adjusted P all <.001). Changes in cancer screening outcomes, which were not a focus of PHC efforts, were similar between PHC and non-PHC practices.

CONCLUSIONS

Use of central PHCs led to greater improvement in short-term chronic disease outcome measures compared with patients in practices not assigned a central PHC.

Considering health equity when moving from evidence-based guideline recommendations to implementation: a case study from an upper-middle income country on the GRADE approach

The availability of evidence-based guidelines does not ensure their implementation and use in clinical practice or policy making. Inequities in health have been defined as those inequalities within or between populations that are avoidable, unnecessary and also unjust and unfair. Evidence-based clinical practice and public health guidelines ('guidelines') can be used to target health inequities experienced by disadvantaged populations, although guidelines may unintentionally increase health inequities. For this reason, there is a need for evidence-based clinical practice and public health guidelines to intentionally target health inequities experienced by disadvantaged populations. Current guideline development processes do not include steps for planned implementation of equity-focused guidelines. This article describes nine steps that provide guidance for consideration of equity during guideline implementation. A critical appraisal of the literature followed by a process to build expert consensus was undertaken to define how to include consideration of equity issues during the specific GRADE guideline development process. Using a case study from Colombia we describe nine steps that were used to implement equity-focused GRADE recommendations: (1) identification of disadvantaged groups, (2) quantification of current health inequities, (3) development of equity-sensitive recommendations, (4) identification of key actors for implementation of equity-focused recommendations, (5) identification of barriers and facilitators to the implementation of equity-focused recommendations, (6) development of an equity strategy to be included in the implementation plan, (7) assessment of resources and incentives, (8) development of a communication strategy to support an equity focus and (9) development of monitoring and evaluation strategies. This case study can be used as model for implementing clinical practice guidelines, taking into account equity issues during guideline development and implementation.

Strategies for enhancing the implementation of school-based policies or practices targeting risk factors for chronic disease

BACKGROUND

A number of school-based policies or practices have been found to be effective in improving child diet and physical activity, and preventing excessive weight gain, tobacco or harmful alcohol use. Schools, however, frequently fail to implement such evidence-based interventions.

OBJECTIVES

The primary aims of the review are to examine the effectiveness of strategies aiming to improve the implementation of school-based policies, programs or practices to address child diet, physical activity, obesity, tobacco or alcohol use.Secondary objectives of the review are to: Examine the effectiveness of implementation strategies on health behaviour (e.g. fruit and vegetable consumption) and anthropometric outcomes (e.g. BMI, weight); describe the impact of such strategies on the knowledge, skills or attitudes of school staff involved in implementing health-promoting policies, programs or practices; describe the cost or cost-effectiveness of such strategies; and describe any unintended adverse effects of strategies on schools, school staff or children.

SEARCH METHODS

All electronic databases were searched on 16 July 2017 for studies published up to 31 August 2016. We searched the following electronic databases: Cochrane Library including the Cochrane Central Register of Controlled Trials (CENTRAL); MEDLINE; MEDLINE In-Process & Other Non-Indexed Citations; Embase Classic and Embase; PsycINFO; Education Resource Information Center (ERIC); Cumulative Index to Nursing and Allied Health Literature (CINAHL); Dissertations and Theses; and SCOPUS. We screened reference lists of all included trials for citations of other potentially relevant trials. We handsearched all publications between 2011 and 2016 in two specialty journals (Implementation Science and Journal of Translational Behavioral Medicine) and conducted searches of the WHO International Clinical Trials Registry Platform (ICTRP) (http://apps.who.int/trialsearch/) as well as the US National Institutes of Health registry (https://clinicaltrials.gov). We consulted with experts in the field to identify other relevant research.

SELECTION CRITERIA

'Implementation' was defined as the use of strategies to adopt and integrate evidence-based health interventions and to change practice patterns within specific settings. We included any trial (randomised or non-randomised) conducted at any scale, with a parallel control group that compared a strategy to implement policies or practices to address diet, physical activity, overweight or obesity, tobacco or alcohol use by school staff to 'no intervention', 'usual' practice or a different implementation strategy.

DATA COLLECTION AND ANALYSIS

Citation screening, data extraction and assessment of risk of bias was performed by review authors in pairs. Disagreements between review authors were resolved via consensus, or if required, by a third author. Considerable trial heterogeneity precluded meta-analysis. We narratively synthesised trial findings by describing the effect size of the primary outcome measure for policy or practice implementation (or the median of such measures where a single primary outcome was not stated).

MAIN RESULTS

We included 27 trials, 18 of which were conducted in the USA. Nineteen studies employed randomised controlled trial (RCT) designs. Fifteen trials tested strategies to implement healthy eating policies, practice or programs; six trials tested strategies targeting physical activity policies or practices; and three trials targeted tobacco policies or practices. Three trials targeted a combination of risk factors. None of the included trials sought to increase the implementation of interventions to delay initiation or reduce the consumption of alcohol. All trials examined multi-strategic implementation strategies and no two trials examined the same combinations of implementation strategies. The most common implementation strategies included educational materials, educational outreach and educational meetings. For all outcomes, the overall quality of evidence was very low and the risk of bias was high for the majority of trials for detection and performance bias.Among 13 trials reporting dichotomous implementation outcomes-the proportion of schools or school staff (e.g. classes) implementing a targeted policy or practice-the median unadjusted (improvement) effect sizes ranged from 8.5% to 66.6%. Of seven trials reporting the percentage of a practice, program or policy that had been implemented, the median unadjusted effect (improvement), relative to the control ranged from -8% to 43%. The effect, relative to control, reported in two trials assessing the impact of implementation strategies on the time per week teachers spent delivering targeted policies or practices ranged from 26.6 to 54.9 minutes per week. Among trials reporting other continuous implementation outcomes, findings were mixed. Four trials were conducted of strategies that sought to achieve implementation 'at scale', that is, across samples of at least 50 schools, of which improvements in implementation were reported in three trials.The impact of interventions on student health behaviour or weight status were mixed. Three of the eight trials with physical activity outcomes reported no significant improvements. Two trials reported reductions in tobacco use among intervention relative to control. Seven of nine trials reported no between-group differences on student overweight, obesity or adiposity. Positive improvements in child dietary intake were generally reported among trials reporting these outcomes. Three trials assessed the impact of implementation strategies on the attitudes of school staff and found mixed effects. Two trials specified in the study methods an assessment of potential unintended adverse effects, of which, they reported none. One trial reported implementation support did not significantly increase school revenue or expenses and another, conducted a formal economic evaluation, reporting the intervention to be cost-effective. Trial heterogeneity, and the lack of consistent terminology describing implementation strategies, were important limitations of the review.

AUTHORS' CONCLUSIONS

Given the very low quality of the available evidence, it is uncertain whether the strategies tested improve implementation of the targeted school-based policies or practices, student health behaviours, or the knowledge or attitudes of school staff. It is also uncertain if strategies to improve implementation are cost-effective or if they result in unintended adverse consequences. Further research is required to guide efforts to facilitate the translation of evidence into practice in this setting.

Toward criteria for pragmatic measurement in implementation research and practice: a stakeholder-driven approach using concept mapping

BACKGROUND

Advancing implementation research and practice requires valid and reliable measures of implementation determinants, mechanisms, processes, strategies, and outcomes. However, researchers and implementation stakeholders are unlikely to use measures if they are not also pragmatic. The purpose of this study was to establish a stakeholder-driven conceptualization of the domains that comprise the pragmatic measure construct. It built upon a systematic review of the literature and semi-structured stakeholder interviews that generated 47 criteria for pragmatic measures, and aimed to further refine that set of criteria by identifying conceptually distinct categories of the pragmatic measure construct and providing quantitative ratings of the criteria's clarity and importance.

METHODS

Twenty-four stakeholders with expertise in implementation practice completed a concept mapping activity wherein they organized the initial list of 47 criteria into conceptually distinct categories and rated their clarity and importance. Multidimensional scaling, hierarchical cluster analysis, and descriptive statistics were used to analyze the data.

FINDINGS

The 47 criteria were meaningfully grouped into four distinct categories: (1) acceptable, (2) compatible, (3) easy, and (4) useful. Average ratings of clarity and importance at the category and individual criteria level will be presented.

CONCLUSIONS

This study advances the field of implementation science and practice by providing clear and conceptually distinct domains of the pragmatic measure construct. Next steps will include a Delphi process to develop consensus on the most important criteria and the development of quantifiable pragmatic rating criteria that can be used to assess measures.

What hinders the uptake of computerized decision support systems in hospitals? A qualitative study and framework for implementation

BACKGROUND

Advanced Computerized Decision Support Systems (CDSSs) assist clinicians in their decision-making process, generating recommendations based on up-to-date scientific evidence. Although this technology has the potential to improve the quality of patient care, its mere provision does not guarantee uptake: even where CDSSs are available, clinicians often fail to adopt their recommendations. This study examines the barriers and facilitators to the uptake of an evidence-based CDSS as perceived by diverse health professionals in hospitals at different stages of CDSS adoption.

METHODS

Qualitative study conducted as part of a series of randomized controlled trials of CDSSs. The sample includes two hospitals using a CDSS and two hospitals that aim to adopt a CDSS in the future. We interviewed physicians, nurses, information technology staff, and members of the boards of directors (n = 30). We used a constant comparative approach to develop a framework for guiding implementation.

RESULTS

We identified six clusters of experiences of, and attitudes towards CDSSs, which we label as "positions." The six positions represent a gradient of acquisition of control over CDSSs (from low to high) and are characterized by different types of barriers to CDSS uptake. The most severe barriers (prevalent in the first positions) include clinicians' perception that the CDSSs may reduce their professional autonomy or may be used against them in the event of medical-legal controversies. Moving towards the last positions, these barriers are substituted by technical and usability problems related to the technology interface. When all barriers are overcome, CDSSs are perceived as a working tool at the service of its users, integrating clinicians' reasoning and fostering organizational learning.

CONCLUSIONS

Barriers and facilitators to the use of CDSSs are dynamic and may exist prior to their introduction in clinical contexts; providing a static list of obstacles and facilitators, irrespective of the specific implementation phase and context, may not be sufficient or useful to facilitate uptake. Factors such as clinicians' attitudes towards scientific evidences and guidelines, the quality of inter-disciplinary relationships, and an organizational ethos of transparency and accountability need to be considered when exploring the readiness of a hospital to adopt CDSSs.

Designing an implementation intervention with the Behaviour Change Wheel for health provider smoking cessation care for Australian Indigenous pregnant women

BACKGROUND

Indigenous smoking rates are up to 80% among pregnant women: prevalence among pregnant Australian Indigenous women was 45% in 2014, contributing significantly to the health gap for Indigenous Australians. We aimed to develop an implementation intervention to improve smoking cessation care (SCC) for pregnant Indigenous smokers, an outcome to be achieved by training health providers at Aboriginal Medical Services (AMS) in a culturally competent approach, developed collaboratively with AMS.

METHOD

The Behaviour Change Wheel (BCW), incorporating the COM-B model (capability, opportunity and motivation for behavioural interventions), provided a framework for the development of the Indigenous Counselling and Nicotine (ICAN) QUIT in Pregnancy implementation intervention at provider and patient levels. We identified evidence-practice gaps through (i) systematic literature reviews, (ii) a national survey of clinicians and (iii) a qualitative study of smoking and quitting with Aboriginal mothers. We followed the three stages recommended in Michie et al.'s "Behaviour Change Wheel" guide.

RESULTS

Targets identified for health provider behaviour change included the following: capability (psychological capability, knowledge and skills) by training clinicians in pharmacotherapy to assist women to quit; motivation (optimism) by presenting evidence of effectiveness, and positive testimonials from patients and clinicians; and opportunity (environmental context and resources) by promoting a whole-of-service approach and structuring consultations using a flipchart and prompts. Education and training were selected as the main intervention functions. For health providers, the delivery mode was webinar, to accommodate time and location constraints, bringing the training to the services; for patients, face-to-face consultations were supported by a booklet embedded with videos to improve patients' capability, opportunity and motivation.

CONCLUSIONS

The ICAN QUIT in Pregnancy was an intervention to train health providers at Aboriginal Medical Services in how to implement culturally competent evidence-based practice including counselling and nicotine replacement therapy for pregnant patients who smoke. The BCW aided in scientifically and systematically informing this targeted implementation intervention based on the identified gaps in SCC by health providers. Multiple factors impact at systemic, provider, community and individual levels. This process was therefore important for defining the design and intervention components, prior to a conducting a pilot feasibility trial, then leading on to a full clinical trial.

Implementation strategies for health systems in low-income countries: an overview of systematic reviews

BACKGROUND

A key function of health systems is implementing interventions to improve health, but coverage of essential health interventions remains low in low-income countries. Implementing interventions can be challenging, particularly if it entails complex changes in clinical routines; in collaborative patterns among different healthcare providers and disciplines; in the behaviour of providers, patients or other stakeholders; or in the organisation of care. Decision-makers may use a range of strategies to implement health interventions, and these choices should be based on evidence of the strategies' effectiveness.

OBJECTIVES

To provide an overview of the available evidence from up-to-date systematic reviews about the effects of implementation strategies for health systems in low-income countries. Secondary objectives include identifying needs and priorities for future evaluations and systematic reviews on alternative implementation strategies and informing refinements of the framework for implementation strategies presented in the overview.

METHODS

We searched Health Systems Evidence in November 2010 and PDQ-Evidence up to December 2016 for systematic reviews. We did not apply any date, language or publication status limitations in the searches. We included well-conducted systematic reviews of studies that assessed the effects of implementation strategies on professional practice and patient outcomes and that were published after April 2005. We excluded reviews with limitations important enough to compromise the reliability of the review findings. Two overview authors independently screened reviews, extracted data and assessed the certainty of evidence using GRADE. We prepared SUPPORT Summaries for eligible reviews, including key messages, 'Summary of findings' tables (using GRADE to assess the certainty of the evidence) and assessments of the relevance of findings to low-income countries.

MAIN RESULTS

We identified 7272 systematic reviews and included 39 of them in this overview. An additional four reviews provided supplementary information. Of the 39 reviews, 32 had only minor limitations and 7 had important methodological limitations. Most studies in the reviews were from high-income countries. There were no studies from low-income countries in eight reviews.Implementation strategies addressed in the reviews were grouped into four categories - strategies targeting:1. healthcare organisations (e.g. strategies to change organisational culture; 1 review);2. healthcare workers by type of intervention (e.g. printed educational materials; 14 reviews);3. healthcare workers to address a specific problem (e.g. unnecessary antibiotic prescription; 9 reviews);4. healthcare recipients (e.g. medication adherence; 15 reviews).Overall, we found the following interventions to have desirable effects on at least one outcome with moderate- or high-certainty evidence and no moderate- or high-certainty evidence of undesirable effects.1.Strategies targeted at healthcare workers: educational meetings, nutrition training of health workers, educational outreach, practice facilitation, local opinion leaders, audit and feedback, and tailored interventions.2.Strategies targeted at healthcare workers for specific types of problems: training healthcare workers to be more patient-centred in clinical consultations, use of birth kits, strategies such as clinician education and patient education to reduce antibiotic prescribing in ambulatory care settings, and in-service neonatal emergency care training.3. Strategies targeted at healthcare recipients: mass media interventions to increase uptake of HIV testing; intensive self-management and adherence, intensive disease management programmes to improve health literacy; behavioural interventions and mobile phone text messages for adherence to antiretroviral therapy; a one time incentive to start or continue tuberculosis prophylaxis; default reminders for patients being treated for active tuberculosis; use of sectioned polythene bags for adherence to malaria medication; community-based health education, and reminders and recall strategies to increase vaccination uptake; interventions to increase uptake of cervical screening (invitations, education, counselling, access to health promotion nurse and intensive recruitment); health insurance information and application support.

AUTHORS' CONCLUSIONS

Reliable systematic reviews have evaluated a wide range of strategies for implementing evidence-based interventions in low-income countries. Most of the available evidence is focused on strategies targeted at healthcare workers and healthcare recipients and relates to process-based outcomes. Evidence of the effects of strategies targeting healthcare organisations is scarce.

Executive summary for the Micronutrient Powders Consultation: Lessons Learned for Operational Guidance

Iron deficiency anaemia is estimated to be the leading cause of years lived with disability among children. Young children's diets are often inadequate in iron and other micronutrients, and provision of essential vitamin and minerals has long been recommended. With the limited programmatic success of iron drop/syrup interventions, interest in micronutrient powders (MNP) has increased. MNP are a mixture of vitamins and minerals, enclosed in single-dose sachets, which are stirred into a child's portion of food immediately before consumption. MNP are an efficacious intervention for reducing iron deficiency anaemia and filling important nutrient gaps in children 6-23 months of age. As of 2014, 50 countries have implemented MNP programmes including 9 at a national level. This paper provides an overview of a 3-paper series, based on findings from the "Micronutrient Powders Consultation: Lessons Learned for Operational Guidance" held by the USAID-funded Strengthening Partnerships, Results, and Innovations in Nutrition Globally (SPRING) Project. The objectives of the Consultation were to identify and summarize the most recent MNP programme experiences and lessons learned for operationalizing MNP for young children and prioritize an implementation research agenda. The Consultation was composed of 3 working groups that used the following methods: deliberations among 49 MNP programme implementers and experts, a review of published and grey literature, questionnaires, and key informant interviews, described in this overview. The following articles summarize findings in 3 broad programme areas: planning, implementation, and continual programme improvement. The papers also outline priorities for implementation research to inform improved operationalization of MNP.

Active involved community partnerships: co-creating implementation infrastructure for getting to and sustaining social impact

Active involved community partnerships (AICPs) are essential to co-create implementation infrastructure and translate evidence into real-world practice. Across varied forms, AICPs cultivate community and tribal members as agents of change, blending research and organizational knowledge with relationships, context, culture, and local wisdom. Unlike selective engagement, AICPs enable active involvement of partners in the ongoing process of implementation and sustainability. This includes defining the problem, developing solutions, detecting practice changes, aligning organizational supports, and nurturing shared responsibility, accountability, and ownership for implementation. This paper builds on previously established active implementation and scaling functions by outlining key AICP functions to close the research-practice gap. Part of a federal initiative, California Partners for Permanency (CAPP) integrated AICP functions for implementation and system change to reduce disproportionality and disparities in long-term foster care. This paper outlines their experience defining and embedding five AICP functions: (1) relationship-building; (2) addressing system barriers; (3) establishing culturally relevant supports and services; (4) meaningful involvement in implementation; and (5) ongoing communication and feedback for continuous improvement. Planning for social impact requires the integration of AICP with other active implementation and scaling functions. Through concrete examples, authors bring multilevel AICP roles to life and discuss implications for implementation research and practice.

Demand-side financing for maternal and newborn health: what do we know about factors that affect implementation of cash transfers and voucher programmes?

BACKGROUND

Demand-side financing (DSF) interventions, including cash transfers and vouchers, have been introduced to promote maternal and newborn health in a range of low- and middle-income countries. These interventions vary in design but have typically been used to increase health service utilisation by offsetting some financial costs for users, or increasing household income and incentivising 'healthy behaviours'. This article documents experiences and implementation factors associated with use of DSF in maternal and newborn health.

METHODS

A secondary analysis (using an adapted Supporting the Use of Research Evidence framework - SURE) was performed on studies that had previously been identified in a systematic review of evidence on DSF interventions in maternal and newborn health.

RESULTS

The article draws on findings from 49 quantitative and 49 qualitative studies. The studies give insights on difficulties with exclusion of migrants, young and multiparous women, with demands for informal fees at facilities, and with challenges maintaining quality of care under increasing demand. Schemes experienced difficulties if communities faced long distances to reach participating facilities and poor access to transport, and where there was inadequate health infrastructure and human resources, shortages of medicines and problems with corruption. Studies that documented improved care-seeking indicated the importance of adequate programme scope (in terms of programme eligibility, size and timing of payments and voucher entitlements) to address the issue of concern, concurrent investments in supply-side capacity to sustain and/or improve quality of care, and awareness generation using community-based workers, leaders and women's groups.

CONCLUSIONS

Evaluations spanning more than 15 years of implementation of DSF programmes reveal a complex picture of experiences that reflect the importance of financial and other social, geographical and health systems factors as barriers to accessing care. Careful design of DSF programmes as part of broader maternal and newborn health initiatives would need to take into account these barriers, the behaviours of staff and the quality of care in health facilities. Research is still needed on the policy context for DSF schemes in order to understand how they become sustainable and where they fit, or do not fit, with plans to achieve equitable universal health coverage.

Psychometric assessment of three newly developed implementation outcome measures

BACKGROUND

Implementation outcome measures are essential for monitoring and evaluating the success of implementation efforts. Yet, currently available measures lack conceptual clarity and have largely unknown reliability and validity. This study developed and psychometrically assessed three new measures: the Acceptability of Intervention Measure (AIM), Intervention Appropriateness Measure (IAM), and Feasibility of Intervention Measure (FIM).

METHODS

Thirty-six implementation scientists and 27 mental health professionals assigned 31 items to the constructs and rated their confidence in their assignments. The Wilcoxon one-sample signed rank test was used to assess substantive and discriminant content validity. Exploratory and confirmatory factor analysis (EFA and CFA) and Cronbach alphas were used to assess the validity of the conceptual model. Three hundred twenty-six mental health counselors read one of six randomly assigned vignettes depicting a therapist contemplating adopting an evidence-based practice (EBP). Participants used 15 items to rate the therapist's perceptions of the acceptability, appropriateness, and feasibility of adopting the EBP. CFA and Cronbach alphas were used to refine the scales, assess structural validity, and assess reliability. Analysis of variance (ANOVA) was used to assess known-groups validity. Finally, half of the counselors were randomly assigned to receive the same vignette and the other half the opposite vignette; and all were asked to re-rate acceptability, appropriateness, and feasibility. Pearson correlation coefficients were used to assess test-retest reliability and linear regression to assess sensitivity to change.

RESULTS

All but five items exhibited substantive and discriminant content validity. A trimmed CFA with five items per construct exhibited acceptable model fit (CFI = 0.98, RMSEA = 0.08) and high factor loadings (0.79 to 0.94). The alphas for 5-item scales were between 0.87 and 0.89. Scale refinement based on measure-specific CFAs and Cronbach alphas using vignette data produced 4-item scales (α's from 0.85 to 0.91). A three-factor CFA exhibited acceptable fit (CFI = 0.96, RMSEA = 0.08) and high factor loadings (0.75 to 0.89), indicating structural validity. ANOVA showed significant main effects, indicating known-groups validity. Test-retest reliability coefficients ranged from 0.73 to 0.88. Regression analysis indicated each measure was sensitive to change in both directions.

CONCLUSIONS

The AIM, IAM, and FIM demonstrate promising psychometric properties. Predictive validity assessment is planned.

Implementing the WHO integrated tool to assess quality of care for mothers, newborns and children: results and lessons learnt from five districts in Malawi

BACKGROUND

In 2014 the World Health Organization (WHO) developed a new tool to be used to assess the quality of care for mothers, newborns and children provided at healthcare facility level. This paper reports on the feasibility of using the tool, its limitations and strengths.

METHODS

Across 5 districts in Malawi, 35 healthcare facilities were assessed. The WHO tool includes checklists, interviews and observation of case management by which care is assessed against agreed standards using a Likert scale (1 lowest: not meeting standard, 5 highest: compliant with standard). Descriptive statistics were used to provide summary scores for each standard. A 'dashboard' system was developed to display the results.

RESULTS

For maternal care three areas met standards; 1) supportive care for admitted patients (71% of healthcare facilities scored 4 or 5); 2) prevention and management of infections during pregnancy (71% scored 4 or 5); and 3) management of unsatisfactory progress of labour (84% scored 4 or 5). Availability of essential equipment and supplies was noted to be a critical barrier to achieving satisfactory standards of paediatric care (mean score; standard deviation: 2.9; SD 0.95) and child care (2.7; SD 1.1). Infection control is inadequate across all districts for maternal, newborn and paediatric care. Quality of care varies across districts with a mean (SD) score for all standards combined of 3 (SD 0.19) for the worst performing district and 4 (SD 0.27) for the best. The best performing district has an average score of 4 (SD 0.27). Hospitals had good scores for overall infrastructure, essential drugs, organisation of care and management of preterm labour. However, health centres were better at case management of HIV/AIDS patients and follow-up of sick children.

CONCLUSIONS

There is a need to develop an expanded framework of standards which is inclusive of all areas of care. In addition, it is important to ensure structure, process and outcomes of health care are reflected.

Five-year plan will revamp neonatal services in Scotland

The Scottish Government is considering recommendations for a revamp of neonatal services - including creating three specialist neonatal intensive care units in the next five years.

NATIVE-It's Your Game: Adapting a Technology-Based Sexual Health Curriculum for American Indian and Alaska Native youth

Sexually transmitted infection (STI) and birth rates among American Indian/Alaska Native (AI/AN) youth indicate a need for effective middle school HIV/STI and pregnancy prevention curricula to delay, or mitigate, the consequences of early sexual activity. While effective curricula exist, there is a dearth of curricula with content salient to AI/AN youth. Further, there is a lack of sexual health curricula that take advantage of the motivational appeal, reach, and fidelity of communication technology for this population, who are sophisticated technology users. We describe the adaptation process used to develop Native It's Your Game, a stand-alone 13-lesson Internet-based sexual health life-skills curriculum adapted from an existing promising sexual health curriculum, It's Your Game-Tech (IYG-Tech). The adaptation included three phases: (1) pre-adaptation needs assessment and IYG-Tech usability testing; (2) adaptation, including design document development, prototype programming, and alpha testing; and (3) post-adaption usability testing. Laboratory- and school-based tests with AI/AN middle school youth demonstrated high ratings on usability parameters. Youth rated the Native IYG lessons favorably in meeting the needs of AI/AN youth (54-86 % agreement across lessons) and in comparison to other learning channels (57-100 %) and rated the lessons as helpful in making better health choices (73-100 %). Tribal stakeholders rated Native IYG favorably, and suggested it was culturally appropriate for AI/AN youth and suitable for implementation in tribal settings. Further efficacy testing is indicated for Native IYG, as a potential strategy to deliver HIV/STI and pregnancy prevention to traditionally underserved AI/AN middle school youth.

The Science of Salt: A regularly updated systematic review of the implementation of salt reduction interventions (March-August 2016)

This review aims to identify, summarize, and appraise studies reporting on the implementation of salt reduction interventions that were published between March and August 2016. Overall, 40 studies were included: four studies evaluated the impact of salt reduction interventions, while 36 studies were identified as relevant to the design, assessment, and implementation of salt reduction strategies. Detailed appraisal and commentary were undertaken on the four studies that measured the impact of the interventions. Among them, different evaluation approaches were adopted; however, all demonstrated positive health outcomes relating to dietary salt reduction. Three of the four studies measured sodium in breads and provided consistent evidence that sodium reduction in breads is feasible and different intervention options are available. None of the studies were conducted in low- or lower middle-income countries, which stresses the need for more resources and research support for the implementation of salt reduction interventions in these countries.

Using Getting To Outcomes to facilitate the use of an evidence-based practice in VA homeless programs: a cluster-randomized trial of an implementation support strategy

BACKGROUND

Incorporating evidence-based integrated treatment for dual disorders into typical care settings has been challenging, especially among those serving Veterans who are homeless. This paper presents an evaluation of an effort to incorporate an evidence-based, dual disorder treatment called Maintaining Independence and Sobriety Through Systems Integration, Outreach, and Networking-Veterans Edition (MISSION-Vet) into case management teams serving Veterans who are homeless, using an implementation strategy called Getting To Outcomes (GTO).

METHODS

This Hybrid Type III, cluster-randomized controlled trial assessed the impact of GTO over and above MISSION-Vet Implementation as Usual (IU). Both conditions received standard MISSION-Vet training and manuals. The GTO group received an implementation manual, training, technical assistance, and data feedback. The study occurred in teams at three large VA Medical Centers over 2 years. Within each team, existing sub-teams (case managers and Veterans they serve) were the clusters randomly assigned. The trial assessed MISSION-Vet services delivered and collected via administrative data and implementation barriers and facilitators, via semi-structured interview.

RESULTS

No case managers in the IU group initiated MISSION-Vet while 68% in the GTO group did. Seven percent of Veterans with case managers in the GTO group received at least one MISSION-Vet session. Most case managers appreciated the MISSION-Vet materials and felt the GTO planning meetings supported using MISSION-Vet. Case manager interviews also showed that MISSION-Vet could be confusing; there was little involvement from leadership after their initial agreement to participate; the data feedback system had a number of difficulties; and case managers did not have the resources to implement all aspects of MISSION-Vet.

CONCLUSIONS

This project shows that GTO-like support can help launch new practices but that multiple implementation facilitators are needed for successful execution of a complex evidence-based program like MISSION-Vet.

TRIAL REGISTRATION

ClinicalTrials.gov NCT01430741.

Improving and sustaining delivery of CPT for PTSD in mental health systems: a cluster randomized trial

BACKGROUND

Large-scale implementation of evidence-based psychotherapies (EBPs) such as cognitive processing therapy (CPT) for posttraumatic stress disorder can have a tremendous impact on mental and physical health, healthcare utilization, and quality of life. While many mental health systems (MHS) have invested heavily in programs to implement EBPs, few eligible patients receive EBPs in routine care settings, and clinicians do not appear to deliver the full treatment protocol to many of their patients. Emerging evidence suggests that when CPT and other EBPs are delivered at low levels of fidelity, clinical outcomes are negatively impacted. Thus, identifying strategies to improve and sustain the delivery of CPT and other EBPs is critical. Existing literature has suggested two competing strategies to promote sustainability. One emphasizes fidelity to the treatment protocol through ongoing consultation and fidelity monitoring. The other focuses on improving the fit and effectiveness of these treatments through appropriate adaptations to the treatment or the clinical setting through a process of data-driven, continuous quality improvement. Neither has been evaluated in terms of impact on sustained implementation.

METHODS

To compare these approaches on the key sustainability outcomes and provide initial guidance on sustainability strategies, we propose a cluster randomized trial with mental health clinics (n = 32) in three diverse MHSs that have implemented CPT. Cohorts of clinicians and clinical managers will participate in 1 year of a fidelity oriented learning collaborative or 1 year of a continuous quality improvement-oriented learning collaborative. Patient-level PTSD symptom change, CPT fidelity and adaptation, penetration, and clinics' capacity to deliver EBP will be examined. Survey and interview data will also be collected to investigate multilevel influences on the success of the two learning collaborative strategies. This research will be conducted by a team of investigators with expertise in CPT implementation, mixed method research strategies, quality improvement, and implementation science, with input from stakeholders in each participating MHS.

DISCUSSION

It will have broad implications for supporting ongoing delivery of EBPs in mental health and healthcare systems and settings. The resulting products have the potential to significantly improve efforts to ensure ongoing high quality implementation and consumer access to EBPs.

TRIAL REGISTRATION

NCT02449421 . Registered 02/09/2015.

An Operational Framework for Insecticide Resistance Management Planning

Arthropod vectors transmit organisms that cause many emerging and reemerging diseases, and their control is reliant mainly on the use of chemical insecticides. Only a few classes of insecticides are available for public health use, and the increased spread of insecticide resistance is a major threat to sustainable disease control. The primary strategy for mitigating the detrimental effects of insecticide resistance is the development of an insecticide resistance management plan. However, few examples exist to show how to implement such plans programmatically. We describe the formulation and implementation of a resistance management plan for mosquito vectors of human disease in Zambia. We also discuss challenges, steps taken to address the challenges, and directions for the future.

Essential conditions for the implementation of comprehensive school health to achieve changes in school culture and improvements in health behaviours of students

BACKGROUND

Comprehensive School Health (CSH) is an internationally recognized framework that holistically addresses school health by transforming the school culture. It has been shown to be effective in enhancing health behaviours among students while also improving educational outcomes. Despite this effectiveness, there is a need to focus on how CSH is implemented. Previous studies have attempted to uncover the conditions necessary for successful operationalization, but none have described them in relation to a proven best practice model of implementation that has demonstrated positive changes to school culture and improvements in health behaviours.

METHODS

The purpose of this research was to identify the essential conditions of CSH implementation utilizing secondary analysis of qualitative interview data, incorporating a multitude of stakeholder perspectives. This included inductive content analysis of teacher (n = 45), principal (n = 46), and school health facilitator (n = 34) viewpoints, all of whom were employed within successful CSH project schools in Alberta, Canada between 2008 and 2013.

RESULTS

Many themes were identified, here called conditions, that were divided into two categories: 'core conditions' (students as change agents, school-specific autonomy, demonstrated administrative leadership, dedicated champion to engage school staff, community support, evidence, professional development) and 'contextual conditions' (time, funding and project supports, readiness and prior community connectivity). Core conditions were defined as those conditions necessary for CSH to be successfully implemented, whereas contextual conditions had a great degree of influence on the ability for the core conditions to be obtained. Together, and in consideration of already established 'process conditions' developed by APPLE Schools (assess, vision, prioritize; develop and implement an action plan; monitor, evaluate, celebrate), these represent the essential conditions of successful CSH implementation.

CONCLUSIONS

Overall, the present research contributes to the evidence-base of CSH implementation, ultimately helping to shape its optimization by providing school communities with a set of understandable essential conditions for CSH implementation. Such research is important as it helps to support and bolster the CSH framework that has been shown to improve the education, health, and well-being of school-aged children.

[Let’s move our health! The experience of 40 physical activity motivational workshops]

Aims: To set up physical activity promotion workshops in health centres to help people with a sedentary lifestyle achieve an adequate level of physical activity. Methods: This health programme, called ‘Bougeons Notre Santé’ (Let’s move our health) has been implemented since 2006 by four health centres in the Pays de la Loire region, in France. This article describes implementation of the programme, its feasibility, how it can be integrated into a global preventive approach and its outcomes on promoting more physical activity. The “Let’s move our health!” programme comprises four group meetings with participants over a period of several months. At these meetings, participants discuss, exchange and monitor their qualitative and quantitative level of physical activity. Realistic and achievable goals are set in consultation with each participant in relation to their personal circumstances and are monitored with a pedometer and a follow-up diary. Support on healthy eating is also provided. This programme is an opportunity to promote health and refer participants to existing local resources. Results: Forty groups, comprising a total of 275 people, have participated in the programme since 2006. After the four meetings, participants had increased their physical activity level by an average of 723 steps per day and 85% reported that they had changed their eating habits. Conclusion: This health promotion programme is feasible and effective: an increase in the physical activity of participants was observed, together with a favourable impact on perceived health, well-being and social links. These workshops are integrated into a network of associations and institutional partners and could be implemented by similar social or health organisations.

Development of a Web Site for Transplant Patient Education

The Internet is a global communication network used by more than 17.6 million adults as a major source of current health information. Both the number of health-related Web sites and the number of Web users are increasing exponentially as well as reports indicating a growth in the number of persons who access the Internet specifically to retrieve information about organ transplantation. However, few are using this medium for posttransplant educational or psychosocial purposes. Armed with this information, as well as a commitment from the transplant team, we chose to develop a Web-based educational program to facilitate posttransplant care for our transplant recipients. The purpose of this article is to describe the planning, development, and implementation of a Web-based education program for transplant recipients.

Reporting on the Strategies Needed to Implement Proven Interventions: An Example From a "Real-World" Cross-Setting Implementation Study

The objective of this study was to empirically demonstrate the use of a new framework for describing the strategies used to implement quality improvement interventions and provide an example that others may follow. Implementation strategies are the specific approaches, methods, structures, and resources used to introduce and encourage uptake of a given intervention's components. Such strategies have not been regularly reported in descriptions of interventions' effectiveness, or in assessments of how proven interventions are implemented in new settings. This lack of reporting may hinder efforts to successfully translate effective interventions into "real-world" practice. A recently published framework was designed to standardize reporting on implementation strategies in the implementation science literature. We applied this framework to describe the strategies used to implement a single intervention in its original commercial care setting, and when implemented in community health centers from September 2010 through May 2015. Per this framework, the target (clinic staff) and outcome (prescribing rates) remained the same across settings; the actor, action, temporality, and dose were adapted to fit local context. The framework proved helpful in articulating which of the implementation strategies were kept constant and which were tailored to fit diverse settings, and simplified our reporting of their effects. Researchers should consider consistently reporting this information, which could be crucial to the success or failure of implementing proven interventions effectively across diverse care settings.

TRIAL REGISTRATION

clinicaltrials.gov Identifier: NCT02299791.

Systematic dissemination of a preschool physical activity intervention to the control preschools

For public health interventions to have a meaningful impact on public health, they must be disseminated to the wider population. Systematic planning and evaluation of dissemination efforts can aid translation from experimental trials to larger dissemination programs. The Study of Health and Activity in Preschool Environments (SHAPES) was a group-randomized intervention trial conducted in 16 preschools that successfully increased the physical activity of preschool age children. Following the completion of the research study protocol, the intervention was abbreviated, modified and implemented in four preschools that participated as control preschools in the original research study. The purposes of the current study were to describe the process of refining the intervention for dissemination to the control preschools, and to assess the acceptability of the resulting abbreviated intervention delivery. Five overarching behavioral objectives, informed by process evaluation, data from the original trial and collaboration with intervention teachers, were used to guide the implementation. Teachers in the dissemination classrooms reported high levels of acceptability, potential for sustainability of the program, and positive results in knowledge, skills, and child outcomes. Researchers can include a systematic approach to dissemination of effective intervention elements to the control participants in experimental studies to inform future dissemination efforts and begin to bridge the dissemination gap.

An evaluation of factors which can affect the implementation of a health promotion programme under the Schools for Health in Europe framework

The Health Promoting Schools concept helps schools to promote health in a sustainable and long-term fashion. However, developing the capacity to promote health in this way can be challenging when a busy teaching curriculum must be fulfilled. This study aimed to identify factors which affect the acceptability of health promotion programmes to the everyday school environment. Semi-structured qualitative interviews were audio-taped with primary school teachers in one Irish county and transcribed verbatim. The resulting transcripts were analysed using content analysis. Thirty-one teachers were interviewed. The factors which may adversely affect the acceptability of health promotion programmes include the: attitude of teachers towards an additional extra-curricular workload; lack of confidence amongst teachers to lead health promotion; and different organisational cultures between schools. When health promotion programmes under the Health Promoting Schools concept are being implemented, it's important to consider: the readiness for change amongst teachers; the resources available to increase staff capacity to promote health; and the ability of a programme to adapt to the different organisational cultures between schools.

Evaluating the implementation of a national clinical programme for diabetes to standardise and improve services: a realist evaluation protocol

BACKGROUND

Over the last three decades in response to the growing burden of diabetes, countries worldwide have developed national and regional multifaceted programmes to improve the monitoring and management of diabetes and to enhance the coordination of care within and across settings. In Ireland in 2010, against a backdrop of limited dedicated strategic planning and engrained variation in the type and level of diabetes care, a national programme was established to standardise and improve care for people with diabetes in Ireland, known as the National Diabetes Programme (NDP). The NDP comprises a range of organisational and service delivery changes to support evidence-based practices and policies. This realist evaluation protocol sets out the approach that will be used to identify and explain which aspects of the programme are working, for whom and in what circumstances to produce the outcomes intended.

METHODS/DESIGN

This mixed method realist evaluation will develop theories about the relationship between the context, mechanisms and outcomes of the diabetes programme. In stage 1, to identify the official programme theories, documentary analysis and qualitative interviews were conducted with national stakeholders involved in the design, development and management of the programme. In stage 2, as part of a multiple case study design with one case per administrative region in the health system, qualitative interviews are being conducted with frontline staff and service users to explore their responses to, and reasoning about, the programme's resources (mechanisms). Finally, administrative data will be used to examine intermediate implementation outcomes such as service uptake, acceptability, and fidelity to models of care.

DISCUSSION

This evaluation is using the principles of realist evaluation to examine the implementation of a national programme to standardise and improve services for people with diabetes in Ireland. The concurrence of implementation and evaluation has enabled us to produce formative feedback for the NDP while also supporting the refinement and revision of initial theories about how the programme is being implemented in the dynamic and unstable context of the Irish healthcare system.

Adverse inpatient outcomes during the transition to a new electronic health record system: observational study

OBJECTIVE

 To assess the short term association of inpatient implementation of electronic health records (EHRs) with patient outcomes of mortality, readmissions, and adverse safety events.

DESIGN

 Observational study with difference-in-differences analysis.

SETTING

 Medicare, 2011-12.

PARTICIPANTS

 Patients admitted to 17 study hospitals with a verifiable "go live" date for implementation of inpatient EHRs during 2011-12, and 399 control hospitals in the same hospital referral region.

MAIN OUTCOME MEASURES

 All cause readmission within 30 days of discharge, all cause mortality within 30 days of admission, and adverse safety events as defined by the patient safety for selected indicators (PSI)-90 composite measure among Medicare beneficiaries admitted to one of these hospitals 90 days before and 90 days after implementation of the EHRs (n=28 235 and 26 453 admissions), compared with the control group of all contemporaneous admissions to hospitals in the same hospital referral region (n=284 632 and 276 513 admissions). Analyses were adjusted for beneficiaries' sociodemographic and clinical characteristics.

RESULTS

 Before and after implementation, characteristics of admissions were similar in both study and control hospitals. Among study hospitals, unadjusted 30 day mortality (6.74% to 7.15%, P=0.06) and adverse safety event rates (10.5 to 11.4 events per 1000 admissions, P=0.34) did not significantly change after implementation of EHRs. There was an unadjusted decrease in 30 day readmission rates, from 19.9% to 19.0% post-implementation (P=0.02). In difference-in-differences analysis, however, there was no significant change in any outcome between pre-implementation and post-implementation periods (all P≥0.13).

CONCLUSIONS

 Despite concerns that implementation of EHRs might adversely impact patient care during the acute transition period, we found no overall negative association of such implementation on short term inpatient mortality, adverse safety events, or readmissions in the Medicare population across 17 US hospitals.