Meausures of organizational characteristics associated with adoption and/or implementation of innovations: A systematic review

Predicting Therapists' Intentions to Use Innovations: Comparing the Role of Individual, Organizational, and Innovation Characteristics

Theories emphasize the role of individual and organizational characteristics in implementation outcomes, yet research indicates that these characteristics account for only a small amount of variance in those outcomes. Innovation characteristics might be important proximal determinants of implementation outcomes but are infrequently examined in mental health services research. This study examined the relative variance explained by individual, organizational, and innovation characteristics on behavioral intentions, a central implementation outcome in implementation theories. Data were collected from 95 therapists and 28 supervisors who participated in a cluster randomized trial that tested the effectiveness of two clinical decision-making innovations. Multilevel models compared individual, organizational, and innovation characteristics as predictors of therapists' intentions to use the innovations. Subsequent mediational path analyses tested whether innovation characteristics mediated the effect of innovation type on intentions. Individual and organizational characteristics explained 29% of the variability in therapists' intentions. Approximately 75% of the variability in therapists' intentions was accounted for by innovation characteristics. Individual and organizational characteristics were not statistically significant predictors of intentions after controlling for innovation characteristics. The indirect effect of innovation type on intentions through therapists' beliefs was statistically significant (B = 0.410, 95% Bootstrapped CI = [0.071, 0.780]), but the direct effect of innovation type was not (B = 0.174, p = .365). Innovation characteristics are related to therapist intentions and might explain why some innovations are received more favorably than others. Future studies should explore the complex interrelationships between these beliefs alongside other individual or organizational characteristics.

Ready, set, go! The role of organizational readiness to predict adoption of a family caregiver training program using the Rogers' diffusion of innovation theory

BACKGROUND

Caregivers FIRST is an evidence-based program addressing gaps in caregivers' skills. In 2020, the Veterans Health Administration Caregiver Support Program (CSP) nationally endorsed Caregivers FIRST, offering credit in leadership performance plans to encourage all VA medical centers (VAMCs) to implement locally. This study examines the association of organizational readiness with VAMC adoption of Caregivers FIRST.

METHODS

In a cohort observational study, we surveyed CSP managers about their facilities' readiness to implement using the Organizational Readiness for Implementing Change (ORIC) instrument and compared change commitment and change efficacy domains among VAMCs "adopters" defined as delivering Caregivers FIRST within 1 year of the national announcement to those that did not ("non-adopters"). Within "adopters," we categorized time to adoption based on Rogers' diffusion of innovation theory including "innovators," "early adopters," "early majority," "late adopters," and "laggards." Organizational readiness and site characteristics (facility complexity, staffing levels, volume of applications for caregiver assistance services) were compared between "adopters," "non-adopters," and between time to adoption subcategories. Separate logistic regression models were used to assess whether ORIC and site characteristics were associated with early adoption among "adopters."

RESULTS

Fifty-one of 63 (81%) VAMCs with CSP manager survey respondents adopted Caregivers FIRST during the first year. ORIC change commitment and efficacy were similar for "adopters" and "non-adopters." However, sites that adopted earlier (innovators and early adopters) had higher ORIC change commitment and efficacy scores than the rest of the "adopters." Logistic regression results indicated that higher ORIC change commitment (odds ratio [OR] = 2.57; 95% confidence interval [CI], 1.11-5.95) and ORIC change efficacy (OR = 2.60; 95% CI, 1.12-6.03) scores were associated with increased odds that a VAMC was an early adopter (categorized as an "innovator," "early adopter", or "early majority"). Site-level characteristics were not associated with Caregivers FIRST early adoption.

CONCLUSIONS

To our knowledge, this study is the first to prospectively assess organizational readiness and the timing of subsequent program adoption. Early adoption was associated with higher ORIC change commitment and change efficacy and not site-level characteristics. These findings yield insights into the role of organizational readiness to accelerate program adoption.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT03474380. Registered on March 22, 2018.

How does facilitation in healthcare work? Using mechanism mapping to illuminate the black box of a meta-implementation strategy

BACKGROUND

Healthcare facilitation, an implementation strategy designed to improve the uptake of effective clinical innovations in routine practice, has produced promising yet mixed results in randomized implementation trials and has not been fully researched across different contexts.

OBJECTIVE

Using mechanism mapping, which applies directed acyclic graphs that decompose an effect of interest into hypothesized causal steps and mechanisms, we propose a more concrete description of how healthcare facilitation works to inform its further study as a meta-implementation strategy.

METHODS

Using a modified Delphi consensus process, co-authors developed the mechanistic map based on a three-step process. First, they developed an initial logic model by collectively reviewing the literature and identifying the most relevant studies of healthcare facilitation components and mechanisms to date. Second, they applied the logic model to write vignettes describing how facilitation worked (or did not) based on recent empirical trials that were selected via consensus for inclusion and diversity in contextual settings (US, international sites). Finally, the mechanistic map was created based on the collective findings from the vignettes.

FINDINGS

Theory-based healthcare facilitation components informing the mechanistic map included staff engagement, role clarification, coalition-building through peer experiences and identifying champions, capacity-building through problem solving barriers, and organizational ownership of the implementation process. Across the vignettes, engagement of leaders and practitioners led to increased socialization of the facilitator's role in the organization. This in turn led to clarifying of roles and responsibilities among practitioners and identifying peer experiences led to increased coherence and sense-making of the value of adopting effective innovations. Increased trust develops across leadership and practitioners through expanded capacity in adoption of the effective innovation by identifying opportunities that mitigated barriers to practice change. Finally, these mechanisms led to eventual normalization and ownership of the effective innovation and healthcare facilitation process.

IMPACT

Mapping methodology provides a novel perspective of mechanisms of healthcare facilitation, notably how sensemaking, trust, and normalization contribute to quality improvement. This method may also enable more efficient and impactful hypothesis-testing and application of complex implementation strategies, with high relevance for lower-resourced settings, to inform effective innovation uptake.

Factors associated with the adoption of evidence-based innovations by substance use disorder treatment organizations: A study of HIV testing

INTRODUCTION

Though prior research shows that a range of important regulatory, market, community, and organizational factors influence the adoption of evidence-based practices (EBPs) among health care organizations, we have little understanding of how these factors relate to each other. To address this gap, we test a conceptual model that emphasizes indirect, mediated effects among key factors related to HIV testing in substance use disorder treatment organizations (SUTs), a critical EBP during the US opioid epidemic.

METHODS

We draw on nationally representative data from the 2014 (n = 697) and 2017 (n = 657) National Drug Abuse Treatment System Survey (NDATSS) to measure the adoption of HIV testing among the nation's SUTs and their key organizational characteristics; we also draw on data from the US Census Bureau; Centers for Disease Control; and legislative sources to measure regulatory and community environments. We estimate cross-sectional and longitudinal structural equation models (SEM) to test the proposed model.

RESULTS

Our longitudinal model of the adoption of HIV testing by SUTs in the United States identifies a pathway by which community and market characteristics (rurality and the number of other SUTs in the area) are related to key sociotechnical characteristics of these organizations (alignment of clients, staff, and harm-reduction culture) that, in turn, are related to the adoption of this EBP.

CONCLUSIONS

Results also show the importance of developing conceptual models that include indirect effects to account for organizational adoption of EBPs.

Healthcare Organizations Management: Analyzing Characteristics, Features and Factors, to Identify Gaps "Scoping Review"

Background

Studying the organizational characteristics, factors and features in healthcare organizations will have its prompt in achieving the desired outcomes of the provided services. Addressing these variables, the subsequent study conducts a scoping review methodology to systematically evaluate existing information while focusing on conclusions and gaps representing organizational variables that have been shown to influence the management of healthcare organizations.

Methods

A scoping review was performed to shed the light on the healthcare organizations' characteristics, features and factors.

Results

Fifteen articles were included in the final analysis of this study. Among the relevant studies, 12 were research articles and 8 were quantitative studies. Continuity of care, organizational culture, patient trust, strategic factors and operational factors are among the explored features that have an impact in the management of healthcare organizations.

Conclusion

This review shows the gaps in the management practice and in the management studies that address healthcare organizations.

Repeated measures of implementation variables

It is commonly acknowledged that implementation work is long-term and contextual in nature and often takes years to accomplish. Repeated measures are needed to study the trajectory of implementation variables over time. To be useful in typical practice settings, measures that are relevant, sensitive, consequential, and practical are needed to inform planning and action. If implementation independent variables and implementation dependent variables are to contribute to a science of implementation, then measures that meet these criteria must be established. This exploratory review was undertaken to "see what is being done" to evaluate implementation variables and processes repeatedly in situations where achieving outcomes was the goal (i.e., more likely to be consequential). No judgement was made about the adequacy of the measure (e.g., psychometric properties) in the review. The search process resulted in 32 articles that met the criteria for a repeated measure of an implementation variable. 23 different implementation variables were the subject of repeated measures. The broad spectrum of implementation variables identified in the review included innovation fidelity, sustainability, organization change, and scaling along with training, implementation teams, and implementation fidelity. Given the long-term complexities involved in providing implementation supports to achieve the full and effective use of innovations, repeated measurements of relevant variables are needed to promote a more complete understanding of implementation processes and outcomes. Longitudinal studies employing repeated measures that are relevant, sensitive, consequential, and practical should become common if the complexities involved in implementation are to be understood.

Using implementation strategies in community settings: an introduction to the Expert Recommendations for Implementing Change (ERIC) compilation and future directions

In this commentary, we introduce public health practitioners and researchers to implementation science through an established compilation of implementation strategies. We provide terminology and examples for community settings so public health practitioners and researchers can use implementation strategies and document efforts using standard terminology. We also discuss the need for future work to determine the extent to which these implementation strategies work and are most useful in community settings, and ultimately, how health behaviors are impacted. We intend this commentary to serve as a dissemination strategy for implementation strategies and to contribute to knowledge in the growing field of implementation science in community settings.

Quantitative Measurements for Factors Influencing Implementation in School Settings: Protocol for A Systematic Review and A Psychometric and Pragmatic Analysis

INTRODUCTION

In order to address the effectiveness and sustainability of school-based interventions, there is a need to consider the factors affecting implementation success. The rapidly growing field of implementation-focused research is struggling to determine how to assess and measure implementation-relevant constructs. Earlier research has identified the need for strong psychometric and pragmatic measures. The aims of this review are therefore to (i) systematically review the literature to identify measurements of the factors influencing implementations which have been developed or adapted in school settings, (ii) describe each measurement's psychometric and pragmatic properties, (iii) describe the alignment between each measurement and the corresponding domain and/or construct of the Consolidated Framework for Implementation Research (CFIR).

METHODS

Six databases (Medline, ERIC, PsycInfo, Cinahl, Embase, and Web of Science) will be searched for peer-reviewed articles reporting on school settings, published from the year 2000. The identified measurements will be mapped against the CFIR, and analyzed for their psychometric and pragmatic properties.

DISCUSSION

By identifying measurements that are psychometrically and pragmatically impactful in the field, this review will contribute to the identification of feasible, effective, and sustainable implementation strategies for future research in school settings.

Unraveling implementation context: the Basel Approach for coNtextual ANAlysis (BANANA) in implementation science and its application in the SMILe project

BACKGROUND

Designing intervention and implementation strategies with careful consideration of context is essential for successful implementation science projects. Although the importance of context has been emphasized and methodology for its analysis is emerging, researchers have little guidance on how to plan, perform, and report contextual analysis. Therefore, our aim was to describe the Basel Approach for coNtextual ANAlysis (BANANA) and to demonstrate its application on an ongoing multi-site, multiphase implementation science project to develop/adapt, implement, and evaluate an integrated care model in allogeneic SteM cell transplantatIon facILitated by eHealth (the SMILe project).

METHODS

BANANA builds on guidance for assessing context by Stange and Glasgow (Contextual factors: the importance of considering and reporting on context in research on the patient-centered medical home, 2013). Based on a literature review, BANANA was developed in ten discussion sessions with implementation science experts and a medical anthropologist to guide the SMILe project's contextual analysis. BANANA's theoretical basis is the Context and Implementation of Complex Interventions (CICI) framework. Working from an ecological perspective, CICI acknowledges contextual dynamics and distinguishes between context and setting (the implementation's physical location).

RESULTS

BANANA entails six components: (1) choose a theory, model, or framework (TMF) to guide the contextual analysis; (2) use empirical evidence derived from primary and/or secondary data to identify relevant contextual factors; (3) involve stakeholders throughout contextual analysis; (4) choose a study design to assess context; (5) determine contextual factors' relevance to implementation strategies/outcomes and intervention co-design; and (6) report findings of contextual analysis following appropriate reporting guidelines. Partly run simultaneously, the first three components form a basis both for the identification of relevant contextual factors and for the next components of the BANANA approach.

DISCUSSION

Understanding of context is indispensable for a successful implementation science project. BANANA provides much-needed methodological guidance for contextual analysis. In subsequent phases, it helps researchers apply the results to intervention development/adaption and choices of contextually tailored implementation strategies. For future implementation science projects, BANANA's principles will guide researchers first to gather relevant information on their target context, then to inform all subsequent phases of their implementation science project to strengthen every part of their work and fulfill their implementation goals.

The Setting-Intervention Fit of Nine Evidence-Based Interventions for Substance Use Disorders Within HIV Service Organizations Across the United States: Results of a National Stakeholder-Engaged Real-Time Delphi Study

BACKGROUND

Given substance use disorders (SUDs) among people with HIV are highly prevalent, integrating SUD services within HIV service settings is needed to help end the HIV epidemic. In this study, we assessed the setting-intervention fit (SIF) of 9 evidence-based SUD interventions: acamprosate, disulfiram, oral naltrexone, injectable naltrexone, oral buprenorphine, injectable buprenorphine, contingency management, motivational interviewing, and cognitive behavioral therapy (CBT).

SETTING

Clinical and nonclinical HIV service organizations (HSOs) in the United States.

METHODS

In May 2020, a stakeholder-engaged real-time Delphi was completed with 202 HSOs. HSO respondents rated the extent to which each SUD intervention was fundable, implementable, retainable, sustainable, scalable, and timely for their HSO, and these 6 items were summed into an SIF score (possible range of 0-18).

RESULTS

Motivational interviewing had the highest average SIF score (11.42), with SIF scores above the midpoint (9.5) for clinical (11.51) and nonclinical HSOs (11.36). For nonclinical HSOs, none of the other interventions were above the midpoint. For clinical HSOs, the average SIF scores were above the midpoint for CBT (10.97) and oral buprenorphine (9.51). Multivariate regression analyses, which controlled for characteristics of the HSO respondent, revealed geographic region of the United States and whether the HSO currently offered any substance use services as 2 of the best predictors of SIF scores.

CONCLUSIONS

Notwithstanding the need to improve the SIF for the other evidence-based SUD interventions, motivational interviewing, CBT, and oral buprenorphine are currently the evidence-based SUD interventions with greatest perceived fit for integration within HSOs in the United States.

Iowa Implementation for Sustainability Framework

Background

An application-oriented implementation framework designed for clinicians and based on the Diffusion of Innovations theory included 81 implementation strategies with suggested timing for use within four implementation phases. The purpose of this research was to evaluate and strengthen the framework for clinician use and propose its usefulness in implementation research.

Methods

A multi-step, iterative approach guided framework revisions. Individuals requesting the use of the framework over the previous 7 years were sent an electronic questionnaire. Evaluation captured framework usability, generalizability, accuracy, and implementation phases for each strategy. Next, nurse leaders who use the framework pile sorted strategies for cultural domain analysis. Last, a panel of five EBP/implementation experts used these data and built consensus to strengthen the framework.

Results

Participants (n = 127/1578; 8% response) were predominately nurses (94%), highly educated (94% Master’s or higher), and from across healthcare (52% hospital/system, 31% academia, and 7% community) in the USA (84%). Most (96%) reported at least some experience using the framework and 88% would use the framework again. A 4-point scale (1 = not/disagree to 4 = very/agree) was used. The framework was deemed useful (92%, rating 3–4), easy to use (72%), intuitive (67%), generalizable (100%), flexible and adaptive (100%), with accurate phases (96%), and accurate targets (100%). Participants (n = 51) identified implementation strategy timing within four phases (Cochran’s Q); 54 of 81 strategies (66.7%, p < 0.05) were significantly linked to a specific phase; of these, 30 (55.6%) matched the original framework. Next, nurse leaders (n = 23) completed a pile sorting activity. Anthropac software was used to analyze the data and visualize it as a domain map and hierarchical clusters with 10 domains. Lastly, experts used these data and implementation science to refine and specify each of the 75 strategies, identifying phase, domain, actors, and function. Strategy usability, timing, and groupings were used to refine the framework.

Conclusion

The Iowa Implementation for Sustainability Framework offers a typology to guide implementation for evidence-based healthcare. This study specifies 75 implementation strategies within four phases and 10 domains and begins to validate the framework. Standard use of strategy names is foundational to compare and understand when implementation strategies are effective, in what dose, for which topics, by whom, and in what context.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01157-5.

Integrating organizational impacts into health technology assessment (HTA): an analysis of the content and use of existing evaluation frameworks

Objective

The French health technology assessment (HTA) agency initiated a research between 2018 and 2019 with the aim of determining whether other HTA organizations (agencies, bodies, institutes, and expert networks) and researchers had developed an evaluation framework of organizational impacts (OIs).

Methods

Three types of investigation were carried out: (i) an analysis of documents published by selected HTA organizations, (ii) a rapid review on the OI issues, (iii) a questionnaire survey to experts of the International Network of Agencies for Health Technology Assessment.

Results

The analyses highlight six key points: (i) there is no explicit conceptual definition of OIs; (ii) OIs are often not included in a specific dimension of the evaluation or in the same dimensions; (iii) three recurring categories emerge from the assessment of OIs: processes, structure, and culture; (iv) despite its limitations, the European Network for Health Technology Assessment framework (Core Model) is the most mature assessment model to date; (v) the question of the scope of OIs to be considered is unresolved (micro-meso-macro); and (vi) the delineation between OI assessment and economic assessment must be addressed.

Conclusions

Although the issue of considering OI in HTA has been raised for many years, it remains largely unresolved. Defining the concept of OI is a prerequisite for taking the next step toward an evaluation framework. As the question of the impact of innovation goes beyond the health sector, extensive research on how to define and take into account these OIs may be relevant.

Examining the external validity of the CRUZA study, a randomized trial to promote implementation of evidence-based cancer control programs by faith-based organizations

The CRUZA trial tested the efficacy of an organizational-level intervention to increase capacity among Catholic parishes to implement evidence-based interventions (EBIs) for cancer control. This paper examines the external generalizability of the CRUZA study findings by comparing characteristics of parishes that agreed to participate in the intervention trial versus those that declined participation. Sixty-five Roman Catholic parishes that offered Spanish-language mass in Massachusetts were invited to complete a four-part survey assessing organization-level characteristics that, based on the Consolidated Framework for Implementation Research (CFIR), may be associated with EBI implementation. Forty-nine parishes (75%) completed the survey and were invited to participate in the CRUZA trial, which randomized parishes to either a "capacity enhancement intervention" or a "standard dissemination" group. Of these 49 parishes, 31 (63%) agreed to participate in the trial, whereas 18 parishes (37%) declined participation. Parishes that participated in the CRUZA intervention trial were similar to those that did not participate with respect to "inner organizational setting" characteristics of the CFIR, including innovation and values fit, implementation climate, and organizational culture. Change commitment, a submeasure of organizational readiness that reflects the shared resolve of organizational members to implement an innovation, was significantly higher among the participating parishes (mean = 3.93, SD = 1.08) as compared to nonparticipating parishes (mean = 3.27, SD = 1.08) (Z = -2.16, p = .03). Parishes that agreed to participate in the CRUZA intervention trial were similar to those that declined participation with regard to organizational characteristics that may predict implementation of EBIs. Pragmatic tools to assess external generalizability in community-based implementation trials and to promote readiness among faith-based organizations to implement EBIs are needed to enhance the reach and impact of public health research. Clinical Trial information: The CRUZA trial identifier number with clinicaltrials.gov is NCT01740219.

Barriers and facilitators to knowledge translation activities within academic institutions in low- and middle-income countries

The barriers and facilitators of conducting knowledge translation (KT) activities are well-established but less is known about the institutional forces that drive these barriers, particularly in low resource settings. Understanding organizational readiness has been used to assess and address such barriers but the employment of readiness assessments has largely been done in high-income countries. We conducted a qualitative study to describe the institutional needs and barriers in KT specific to academic institutions in low- and middle-income countries. We conducted a review of the grey and published literature to identify country health priorities and established barriers and facilitators for KT. Key-informant interviews (KII) were conducted to elicit perceptions of institutional readiness to conduct KT, including experiences with KT, and views on motivation and capacity building. Participants included representatives from academic institutions and Ministries of Health in six countries (Bangladesh, Democratic Republic of the Congo, Ethiopia, India, Indonesia, Nigeria). We conducted 18 KIIs, 11 with members of academic institutions and 7 with policymakers. KIIs were analysed using a deductive and inductive coding approach. Our findings support many well-documented barriers including lack of time, skills and institutional support to conduct KT. Three additional institutional drivers emerged around soft skills and the complexity of the policy process, alignment of incentives and institutional missions, and the role of networks. Participants reflected on often-lacking soft-skills needed by researchers to engage policy makers. Continuous engagement was viewed as a challenge given competing demands for time (both researchers and policy makers) and lack of institutional incentives to conduct KT. Strong networks, both within the institution and between institutions, were described as important for conducting KT but difficult to establish and maintain. Attention to the cross-cutting themes representing barriers and facilitators for both individuals and institutions can inform the development of capacity building strategies that meet readiness needs.

Team functioning and implementation of innovations in healthcare and human service settings: a systematic review protocol

BACKGROUND

Healthcare and human services increasingly rely on teams of individuals to deliver services. Implementation of evidence-based practices and other innovations in these settings requires teams to work together to change processes and behaviors. Accordingly, team functioning may be a key determinant of implementation outcomes. This systematic review will identify and summarize empirical research examining associations between team functioning and implementation outcomes in healthcare and human service settings.

METHODS

We will conduct a comprehensive search of bibliographic databases (e.g., MEDLINE, PsycINFO, CINAHL, ERIC) for articles published from January 2000 or later. We will include peer-reviewed empirical articles and conference abstracts using quantitative, qualitative, or mixed methods. We will include experimental or observational studies that report on the implementation of an innovation in a healthcare or human service setting and examine associations between team functioning and implementation outcomes. Implementation outcomes of interest are acceptability, adoption, appropriateness, cost, feasibility, fidelity, penetration, and sustainability. Two reviewers will independently screen all titles/abstracts, review full-text articles, and extract data from included articles. We will use the Mixed Methods Appraisal Tool to assess methodological quality/bias and conduct a narrative synthesis without meta-analysis.

DISCUSSION

Understanding how team functioning influences implementation outcomes will contribute to our understanding of team-level barriers and facilitators of change. The results of this systematic review will inform efforts to implement evidence-based practices in team-based service settings.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42020220168.

Enhancing organizational readiness for implementation: constructing a typology of readiness-development strategies using a modified Delphi process

BACKGROUND

Knowledge about the development of organizational readiness for implementation (ORI) is limited. ORI, referred to as the willingness and capacity of all relevant stakeholders to change practice, is critical for increasing the adoption rate of evidence-based practices and improving implementation outcomes. However, no methodology currently guides ORI's enhancement or addresses differences in readiness needs across an organization. This study used the transtheoretical model (TTM) as a framework for classifying a well-established compilation of implementation strategies into three readiness stages: pre-contemplation, contemplation, and preparation.

METHODS

A modified Delphi method was used to establish consensus among a panel of purposefully selected research and field implementation experts. The Delphi process involved three rounds of online questionnaires. The third round also included a live video discussion to clarify definitions in an effort to increase consensus among experts.

RESULTS

Of the 73 strategies reviewed, the experts identified 75% (n = 55) as relevant for pre-implementation and reached a high-level agreement on the assignment of 7% (n = 5) of the strategies to the pre-contemplation stage (ORI-1), 25% (n = 18) to the contemplation stage (ORI-2), and 52% (n = 38) to the preparation stage (ORI-3). Several strategies were identified as relevant to more than one stage.

CONCLUSIONS

Participating experts were able to reach high-level agreement on the relevance of specific sets of implementation strategies to each of the three ORI stages. The lowest number of strategies was assigned to ORI-1 and the highest number to ORI-3. Given the overlap of strategies across ORI stages, there is a need to better understand the specific utilization of such strategies at different stages. Future studies are needed to empirically evaluate the relevance and applicability of this expert-informed typology based on implementers' experiences in the field.

The psychological burden of waiting for procedures and patient-centred strategies that could support the mental health of wait-listed patients and caregivers during the COVID-19 pandemic: A scoping review

BACKGROUND

Waiting for procedures delayed by COVID-19 may cause anxiety and related adverse consequences.

OBJECTIVE

To synthesize research on the mental health impact of waiting and patient-centred mitigation strategies that could be applied in the COVID-19 context.

METHODS

Using a scoping review approach, we searched 9 databases for studies on waiting lists and mental health and reported study characteristics, impacts and intervention attributes and outcomes.

RESULTS

We included 51 studies that focussed on organ transplant (60.8%), surgery (21.6%) or cancer management (13.7%). Most patients and caregivers reported anxiety, depression and poor quality of life, which deteriorated with increasing wait time. The impact of waiting on mental health was greater among women and new immigrants, and those of younger age, lower socio-economic status, or with less-positive coping ability. Six studies evaluated educational strategies to develop coping skills: 2 reduced depression (2 did not), 1 reduced anxiety (2 did not) and 2 improved quality of life (2 did not). In contrast, patients desired acknowledgement of concerns, peer support, and periodic communication about wait-list position, prioritization criteria and anticipated procedure date.

CONCLUSIONS

Findings revealed patient-centred strategies to alleviate the mental health impact of waiting for procedures. Ongoing research should explore how to optimize the impact of those strategies for diverse patients and caregivers, particularly in the COVID-19 context.

PATIENT OR PUBLIC CONTRIBUTION

Six patients and four caregivers waiting for COVID-19-delayed procedures helped to establish eligibility criteria, plan data extraction and review a draft and final report.

Social network influences on integrated reporting adoption and implementation – a UK perspective

Purpose

This paper aims to investigate social influences on the UK integrated reporting (<IR>) adoption and implementation.

Design/methodology/approach

The study was based on in-depth semi-structured interviews with 36 senior executives actively involved in <IR> within 17 organisations.

Findings

Main social influences on adoption externally were reported design consultants and to a lesser extent, external auditors, primarily to legitimise <IR>. Internal influences were board support for <IR>, with the main driver being the mind-set of the CFO/Chairman to drive sustainability throughout the organisation or to regain trust in society. Social influences aiding further diffusion at the implementation stage came from three external sources: business networks; report design consultants; and external auditors. Internal influences in driving <IR> diffusion within organisations were identified in five functional areas, with finance, sustainability and communications functions exerting the greatest external influence on the diffusion of <IR>.

Research limitations/implications

This research study was limited by the small sample of organisations that participated, although significant efforts were made to ensure that the sample incorporated the majority of early adopter UK organisations who demonstrated best practice in <IR>. Therefore, the findings are specific to the research context and do not represent statistical generalisations.

Practical implications

Empirical evidence identifying social influences from a practitioner perspective provides recommendations as to how <IR> may be further diffused in the future.

Social implications

<IR> creates the potential to significantly improve the long-term health of corporations and the external environment they impact through consideration of the three indivisible and integrated dimensions of sustainable development, the economy, society and the environment and can contribute to a sustainable society by providing the opportunity for organisations to respond to the UN Sustainable Development Goals. This highlights the significance of the research, which aims to gain insights into <IR> social influences which can assist in the adoption and implementation of <IR>.

Originality/value

This is the first comprehensive study of social influences on the <IR> adoption and implementation practices in the UK. It incorporates recommendations to improve the likelihood of subsequent adoption and diffusion of <IR> based on the findings.

Development and validation of the Readiness to Train Assessment Tool (RTAT)

BACKGROUND

In recent years, health centers in the United States have embraced the opportunity to train the next generation of health professionals. The uniqueness of the health centers as teaching settings emphasizes the need to determine if health professions training programs align with health center priorities and the nature of any adjustments that would be needed to successfully implement a training program. We sought to address this need by developing and validating a new survey that measures organizational readiness constructs important for the implementation of health professions training programs at health centers where the primary role of the organizations and individuals is healthcare delivery.

METHODS

The study incorporated several methodological steps for developing and validating a measure for assessing health center readiness to engage with health professions programs. A conceptual framework was developed based on literature review and later validated by 20 experts in two focus groups. A survey-item pool was generated and mapped to the conceptual framework and further refined and validated by 13 experts in three modified Delphi rounds. The survey items were pilot-tested with 212 health center employees. The final survey structure was derived through exploratory factor analysis. The internal consistency reliability of the scale and subscales was evaluated using Chronbach's alpha.

RESULTS

The exploratory factor analysis revealed a 41-item, 7-subscale solution for the survey structure, with 72% of total variance explained. Cronbach's alphas (.79-.97) indicated high internal consistency reliability. The survey measures: readiness to engage, evidence strength and quality of the health professions training program, relative advantage of the program, financial resources, additional resources, implementation team, and implementation plan.

CONCLUSIONS

The final survey, the Readiness to Train Assessment Tool (RTAT), is theoretically-based, valid and reliable. It provides an opportunity to evaluate health centers' readiness to implement health professions programs. When followed with appropriate change strategies, the readiness evaluations could make the implementation of health professions training programs, and their spread across the United States, more efficient and cost-effective. While developed specifically for health centers, the survey may be useful to other healthcare organizations willing to assess their readiness to implement education and training programs.

School Coordinators' Perceptions of Organizational Readiness Is Associated with Implementation Fidelity in a Smoking Prevention Program: Findings from the X:IT II Study

School organizational readiness to implement interventions may play an important role for the actual obtained implementation level, and knowledge about organizational readiness prior to intervention start can help pinpoint how to optimize support to the schools. In this study, we applied a novel heuristic, R = MC2 to assess school organizational readiness prior to implementation of a multicomponent smoking prevention program. Furthermore, we examined the association to actual implementation after the first year of study. We used questionnaire data from school coordinators at 40 schools in Denmark who had accepted to implement the multi-component smoking prevention intervention-X:IT II-in the school year 2017-2018 including three main components: (1) Rules on smoke-free school time, (2) A smoke-free curriculum, and (3) Parental involvement. On behalf of the school, a school coordinator answered a baseline questionnaire about the organizational readiness and a follow-up questionnaire about implementation of the three components after first year of study. Readiness was measured by summing aspects of motivation (relative advantage, compatibility, complexity, and priority), general capacity (culture, climate, and staff capacity), and innovation-specific capacity (knowledge, skills, and abilities). Based on school coordinators' perceptions, almost all schools had good general capacity while the other two areas of readiness varied across schools; overall, 56.8% of schools (N = 25) had good motivation for implementing the X:IT II intervention and 61.3% (N = 27) had high innovation-specific capacity. Half of the schools had high overall readiness defined as high motivation and high innovation-specific capacity. Schools with high overall readiness implemented the rules on smoke-free school time, smoke-free curriculum, and parental involvement to a higher degree than schools with low overall readiness. All participating schools possessed sufficient levels of general capacity, e.g., a well-functioning organizational culture and sufficient staff capacity. High levels of motivation and innovation-specific capacity were positively associated with the schools' actual implementation of the main intervention components. This way of conceptualizing and measuring organizational readiness may be useful in future studies, i.e., in studies where enhancing readiness is a main objective.

The Effect of Innovation Capabilities of Health Care Organizations on the Quality of Health Information Technology: Model Development With Cross-sectional Data

Background

Large health organizations often struggle to build complex health information technology (HIT) solutions and are faced with ever-growing pressure to continuously innovate their information systems. Limited research has been conducted that explores the relationship between organizations’ innovative capabilities and HIT quality in the sense of achieving high-quality support for patient care processes.

Objective

The aim of this study is to explain how core constructs of organizational innovation capabilities are linked to HIT quality based on a conceptual sociotechnical model on innovation and quality of HIT, called the IQ_HIT model, to help determine how better information provision in health organizations can be achieved.

Methods

We designed a survey to assess various domains of HIT quality, innovation capabilities of health organizations, and context variables and administered it to hospital chief information officers across Austria, Germany, and Switzerland. Data from 232 hospitals were used to empirically fit the model using partial least squares structural equation modeling to reveal associations and mediating and moderating effects.

Results

The resulting empirical IQ_HIT model reveals several associations between the analyzed constructs, which can be summarized in 2 main insights. First, it illustrates the linkage between the constructs measuring HIT quality by showing that the professionalism of information management explains the degree of HIT workflow support (R²=0.56), which in turn explains the perceived HIT quality (R²=0.53). Second, the model shows that HIT quality was positively influenced by innovation capabilities related to the top management team, the information technology department, and the organization at large. The assessment of the model’s statistical quality criteria indicated valid model specifications, including sufficient convergent and discriminant validity for measuring the latent constructs that underlie the measures of HIT quality and innovation capabilities.

Conclusions

The proposed sociotechnical IQ_HIT model points to the key role of professional information management for HIT workflow support in patient care and perceived HIT quality from the viewpoint of hospital chief information officers. Furthermore, it highlights that organizational innovation capabilities, particularly with respect to the top management team, facilitate HIT quality and suggests that health organizations establish this link by applying professional information management practices. The model may serve to stimulate further scientific work in the field of HIT adoption and diffusion and to provide practical guidance to managers, policy makers, and educators on how to achieve better patient care using HIT.

Implementing a complex psychosocial intervention for unstably housed Veterans: A realist-informed evaluation case study

Background

Only 7% of individuals with co-occurring mental health and substance use disorder (COD) receive services for both conditions. We implemented and evaluated maintaining independence and sobriety through systems integration, outreach and networking-Veteran's edition (MISSION-Vet), an evidence-based manualized psychosocial intervention for Veterans with CODs. This paper identifies the generative mechanisms that explain "how, for whom, and under what conditions" MISSION-Vet adoption, implementation, and fidelity work when applied in a complex adaptive system with facilitation support.

Methods

Within two VA healthcare systems (Sites A and B), a hybrid III trial tested facilitation to implement MISSION-Vet. We conducted a two-site case study based on 42 semi-structured consolidated framework for implementation research (CFIR) guided interviews with site leadership, implementers (social workers, peer specialists), and team members (facilitators, site leads). Interviews were coded and CFIR constructs used to generate "Context  +  Mechanism  =  Outcome" configurations to understand the conditions of MISSION-Vet adoption, implementation, and fidelity.

Results

Site A was low, and Site B was high in adoption, implementation, and fidelity. Adoption hesitancy/eagerness (outcome) resulted from the interaction of "external policy" (context) dampening/encouraging a "tension for change" (mechanism). Implementation intensity (outcome) was based on how "peer pressure" or practice culture (context) activated staff "self-efficacy" (mechanism) to engage with MISSION-Vet and appraise its "relative advantage" over current practices (mechanism). Fidelity relied on how "staffing structure and availability" (context) activated/muted "facilitation" (mechanism) to result in strategy and intervention adaptation (outcome).

Conclusions

We delineated how specific contexts activated certain mechanisms to drive the different stages of implementation of a multi-faceted COD treatment intervention.

Trial registration

ClinicalTrials.gov, NCT02942979.

Plain language abstract

Implementation is inherently dynamic and influenced by interdependent factors operating at the individual, organizational, and system levels. This is especially true for complex interventions addressing co-occurring mental health and substance use disorders because such interventions involve multiple treatment modalities delivered simultaneously, in busy practice settings, with challenging populations. This paper pairs consolidated framework for implementation research (CFIR) constructs with a realist evaluation approached to generate configurations important to the adoption, implementation, and adaptation stages of a highly complex intervention addressing the behavioural health and housing needs of a vulnerable population. Each configuration describes how contextual factors trigger mechanisms to generate implementation outcomes and answers "what works for whom, in what circumstances and in what respects, and how?" These findings further our understanding of possible mechanisms of change and push us to be more precise about identifying causal relationships among constructs that contribute to the success of implementing complex interventions. This work also moves us to think theoretically and methodologically in a more dynamic fashion, thereby leading to more responsive implementation practice.

Factors that Influenced Adoption of a School-Based Trauma-Informed Universal Mental Health Intervention

We know little about why school administrators choose to adopt preventive mental health interventions within the context of school-based prevention trials. This study used a qualitative multiple-case study design to identify factors that influenced the adoption of a trauma-informed universal intervention by urban public school administrators during an efficacy trial. Semi-structured interviews were conducted with 15 school administrators who adopted a trauma-informed mindfulness intervention called RAP (Relax, be Aware, and do a Personal Rating) Club as part of their participation in a school-based trial with eighth graders. Findings indicated that administrators adopted RAP Club to provide support for students affected by trauma and prevent students from engaging in unhealthy coping behaviors. Examples of contextual factors that contributed to adoption included a lack of trauma-informed mental health programs within schools, inadequate district funding for preventive school mental health services, and the perceived benefits of engaging in a university-community partnership. The study's findings suggest strategies to increase school program adoption in the context of research and, more broadly, for implementation science.

Organizational characteristics conducive to the implementation of health programs among Latino churches

Background

Faith-based organizations (FBOs) can be effective partners in the implementation of health interventions to reach underserved audiences. However, little is known about the capacity they have or need to engage in these efforts. We examined inner-setting organizational characteristics hypothesized to be important for program implementation by the Consolidated Framework for Implementation Research (CFIR).

Methods

This cross-sectional study involved 34 churches with predominantly Latino congregations in Massachusetts. FBO leaders completed a survey assessing inner-setting CFIR organizational characteristics, including organizational readiness, implementation climate, organizational culture, and innovation “fit” with organizational mission.

Results

There was limited variability in CFIR organizational characteristics, with scores on a scale from 1 to 5 skewed toward higher values, ranging from 3.27 (SD 0.94) for implementation climate to 4.58 (SD 0.54). Twenty-one percent of the FBOs had offered health programs in the prior year.

Conclusions

FBOs had high scores on most of the organizational factors hypothesized to be important for the implementation of health programs, although relatively few FBOs offered them. While this suggests that FBOs have favorable characteristics for health programming, prospective studies are needed to understand relative salience of inner-setting organizational characteristics versus factors external to the organization (e.g., policies, incentives), as well as the potential direction of relationships between internal organizational characteristics and health program offerings.

Trial registration

Clinical trials identifier number NCT01740219 (clinicaltrials.gov)

Understanding Evidence-Based Practice (EBP) Implementation in HCOs Through the Lens of Organizational Theory

Despite the increasing use of theory in the field of implementation science over the past decade, the literature has largely focused on using deterministic frameworks to retrospectively understand "what" factors are essential for the effective implementation of evidence-based practices (EBPs). On the other hand, gaps remain in using organizational theory to prospectively understand "how" successful EBP implementation occurs in health-care organizations (HCOs). This article discusses the theoretical and empirical contributions of two selected recent exploratory research works, which provide a starting point for addressing the identified gaps in the literature, with the purpose of deriving implications for theory, practice, and future research in implementation science. The selected works used the theory of "effective knowledge sharing network structures in professional complex systems (PCS)," developed through an integration of organizational theories, to design prospective interventions for enabling EBP implementation in HCOs. In doing so, these studies have helped explain "how" inter-professional knowledge exchange and collective learning occurred, to enable successful EBP implementation in HCOs. Correspondingly, the selected works have served a dual purpose in: 1) identifying evidence-based management (EBM) practice strategies for successful EBP implementation; while 2) further developing the theoretical literature on "effective knowledge sharing networks in PCS." Importantly, by addressing the identified gaps in the literature, the selected works serve to either complement or supplement existing theoretical approaches in implementation science. To this effect, they provide unique insights for theory, practice, and research in implementation science, including insights into a potential "dual-role" for the future implementation researcher-one of advancing implementation science, while working to strengthen implementation practice. Based on these contributions, it could be argued that the selected works provide a starting point for a new research stream that has the potential to occupy a distinct position in the taxonomy of theoretical approaches used in implementation science.

Unknown makes unloved-A case study on improving integrated health and social care in the Netherlands using a participatory approach

Many initiatives integrating health and social care have been implemented in order to provide adequate care and support to older people living at home. Further development of existing initiatives requires iterative processes of developing, implementing and evaluating improvements to current practice. This case study provides insight into the process of improving an existing integrated care initiative in the Netherlands. Using a participatory approach, researchers and local stakeholders collaborated to develop and implement activities to further improve collaboration between health and social care professionals. Improvement activities included interprofessional meetings focussing on reflection and mutual learning and workplace visits. Researchers evaluated the improvement process, using data triangulation of multiple qualitative and quantitative data sources. According to participating professionals, the improvement activities improved their communication and collaboration by establishing mutual understanding and trust. Enabling factors included the safe and informal setting in which the meetings took place and the personal relationships they developed during the project. Different organisational cultures and interests and a lack of ownership and accountability among managers hindered the improvement process, whereas issues such as staff shortages, time constraints and privacy regulations made it difficult to implement improvements on a larger scale. Still, the participatory approach encouraged the development of partnerships and shared goals on the level of both managers and professionals. This case study highlights that improving communication between professionals is an important first step in improving integrated care. In addition, it shows that a participatory approach, in which improvements are co-created and tailored to local priorities and needs, can help in the development of shared goals and trust between stakeholders with different perspectives. However, stakeholders' willingness and ability to participate in such an improvement process is challenged by many factors.

On Innovation

Innovation has become an increasingly common topic in healthcare. Private companies, developers, payers, and regulators are devoting attention toward innovative products and processes as a crucial component of their interests in and occupation with healthcare services. Even when there is no consensus as to its definition, "innovation" -as opposed to "invention"- is broadly understood to refer turning a good idea into a practical solution. Adoption and applicability are key components of implementation that are sustained not only on innovation's attributes themselves but also in the characteristics of providers, users, and implementing organizations, as well as the external environment. Regulatory agencies often face the need to make decisions about proposed innovations with obsolete or inadequate normative frameworks and with a high degree of uncertainty about its eventual performance or its risks. Early interaction between developers and dedicated multidisciplinary teams at regulatory agencies may prove instrumental for speeding up the time required for proper evaluation and product registration, as well as the establishment of quality validation mechanisms. Community involvement both in the adoption and vigilance on innovative products and processes is crucial for completing the process of defining their roles and uses.

Using the Consolidated Framework for Implementation Research (CFIR) to evaluate implementation effectiveness of a facilitated approach to an asthma shared decision making intervention

OBJECTIVE

To describe the evaluation of implementation effectiveness of an asthma shared decision making (SDM) intervention at the 10 individual facilitator-led primary care practices in the ADAPT-NC Study using the Consolidated Framework for Implementation Research (CFIR).

METHODS

Practices were scored across 40 CFIR constructs within 5 domains using a previously published scoring system of -2 to +2. Based on overall construct scores, practices were then classified as high, medium, or low adopters. To evaluate clinical outcomes, changes in asthma exacerbations were assessed for emergency department (ED) visits, hospitalizations, and oral steroid prescription orders. Using regression analysis, the absolute change in percent for each outcome relative to the CFIR score for each practice was analyzed. (Trial registration #NCT02047929).

RESULTS

Implementation effectiveness was reflected in CFIR score differences with 7 high, 1 medium, and 2 low adopter practices. High adopters mostly scored well across all domains. Weaknesses were consistent amongst the 2 low adopters with lower scores in the Inner Setting, Characteristics of Individuals, and Process domains. While no significant correlations were seen between the practices' CFIR scores and the absolute change in ED visits, hospitalizations, or oral steroid prescription orders, practices with higher percentages of children had greater improvements in clinical outcomes.

CONCLUSIONS

The CFIR was used to evaluate the asthma SDM intervention implementation at 10 facilitator-led practices. While there was no significant correlation between higher implementation effectiveness and greater improvement in clinical outcomes, practices with a higher proportion of pediatric patients did experience a significant reduction in overall exacerbations post-implementation.

Tobacco-related knowledge following a comprehensive tobacco-free workplace program within behavioral health facilities: Identifying organizational moderators

OBJECTIVE

Although smoking prevalence rates among behavioral health consumers is nearly five times that of the general population, evidence-based policies and practices to address tobacco use are uncommon within behavioral health settings. This study assessed changes in non-clinical, general staff and clinician tobacco-related knowledge following brief education provided as part of a comprehensive tobacco-free workplace program implementation and explored organizational moderators of pre- to post-education knowledge change.

METHODS

Fifteen behavioral health facilities, comprising hundreds of individual clinics in Texas, participated in a one (for general staff) or two (for clinicians) hour educational session.

RESULTS

There were large effect sizes in general staff knowledge gain within each consortium, and large effect sizes in clinician knowledge gain in all but one consortium. Knowledge of the requirements for change, perceived availability of resources, and total number of client contacts moderated general staff knowledge gain. Value in the change and total number of client contacts moderated training effectiveness among clinicians.

CONCLUSIONS

We conclude that a brief tobacco-related education for behavioral health employees was effective in increase attendee knowledge.

PRACTICE IMPLICATIONS

Attention to organization-level factors moderating knowledge gain has the potential to guide and improve program implementation.

Feasibility and acceptability of a proposed pharmacy-based harm reduction intervention to reduce opioid overdose, HIV and hepatitis C

BACKGROUND

Evidence-based harm reduction intervention components which might benefit pharmacy patients have not been integrated and studied.

OBJECTIVE

To investigate the feasibility and acceptability of a proposed pharmacy-based harm reduction intervention to reduce opioid overdose, HIV and hepatitis C called PharmNet.

METHODS

Indiana managing pharmacists were surveyed in 2018 to assess the feasibility and acceptability of an intervention for opioid misuse screening, brief intervention, syringe and naloxone dispensing, and referrals provision. The Consolidated Framework for Implementation Research informed the survey development and analysis.

RESULTS

The sample included 303 (30.8%) pharmacists; 215 (70.9%) provided detailed written comments. Intervention Characteristics: 83.3% believed PharmNet would benefit patients, and that staff could deliver the intervention with adequate training (70.0%). Inner Setting: While 77.2% believed their pharmacy culture supported practice change, 57.5% of chain pharmacists believed their pharmacies would not have time for PharmNet. Outer Setting: 73.3% believed additional addiction and overdose screening is needed in their community, and pharmacies should offer new services to help reduce opioid overdose and addiction among their patients (79.5%). A vast majority (97.7%) were asked by patients in the past 2 years about syringe related issues; 67.7% were asked about syringes for non-prescription injection drug use. Individuals Involved: While 62.4% believed PharmNet was within pharmacy scope of practice and 90.1% were comfortable consulting about syringe use, pharmacists reported that they had limited control over the implementation environment.

PROCESS

38.0% of pharmacists indicated interest in advising the development of PharmNet.

CONCLUSIONS

An implementation trial of a modified version of PharmNet is likely feasible; yet will be challenged by structural pressures particularly in chain pharmacies. Successful implementation will involve the development of resources and policy components to manage outer and inner setting characteristics and align the intervention to the implementation environment.

Organizational readiness for wellness promotion - a survey of 100 African American church leaders in South Los Angeles

BACKGROUND

Churches are an important asset and a trusted resource in the African American community. We needed a better understanding of their readiness to engage in health promotion before launching a large-scale health promotion effort in partnership with South Los Angeles churches.

METHODS

In 2017, we conducted surveys with leaders of 100 churches. Surveys were conducted face-to-face (32%) or by telephone (68%) with senior pastors (one per church) and lasted on average 48 min. We compared small (less than 50 active members), medium (50-99 active members) and large churches (at least 100 active members), and assessed which church characteristics were associated with the implementation of wellness activities.

RESULTS

Medium and large churches conducted significantly more wellness activities than small churches and were more likely to have wellness champions and health policies. Regardless of church size, insufficient budget was the most commonly cited barrier to implement wellness activities (85%). A substantial proportion of churches was not sure how to implement wellness activities (61%) and lacked volunteers (58%). Forty-five percent of the variation in the number of wellness activities in the last 12 months was explained by church characteristics, such as size of congregation, number of paid staff, leadership engagement, having a wellness ministry and barriers.

CONCLUSIONS

Many churches in South Los Angeles are actively engaged in health promotion activities, despite a general lack of resources. We recommend a comprehensive assessment of church characteristics in intervention studies to enable the use of strategies (e.g., stratification by size) that reduce imbalances that could mask or magnify study outcomes. Our data provide empirical support for the inner settings construct of the Consolidated Framework for Implementation Research in the context of health promotion in African American churches.

Annual Research Review: The state of implementation science in child psychology and psychiatry: a review and suggestions to advance the field

BACKGROUND

Scientists have developed evidence-based interventions that improve the symptoms and functioning of youth with psychiatric disorders; however, these interventions are rarely used in community settings. Eliminating this research-to-practice gap is the purview of implementation science, the discipline devoted to the study of methods to promote the use of evidence-based practices in routine care.

METHODS

We review studies that have tested factors associated with implementation in child psychology and psychiatry, explore applications of social science theories to implementation, and conclude with recommendations to advance implementation science through the development and testing of novel, multilevel, causal theories.

RESULTS

During its brief history, implementation science in child psychology and psychiatry has documented the implementation gap in routine care, tested training approaches and found them to be insufficient for behavior change, explored the relationships between variables and implementation outcomes, and initiated randomized controlled trials to test implementation strategies. This research has identified targets related to implementation (e.g., clinician motivation, organizational culture) and demonstrated the feasibility of activating these targets through implementation strategies. However, the dominant methodological approach has been atheoretical and predictive, relying heavily on a set of variables from heuristic frameworks.

CONCLUSIONS

Optimizing the implementation of effective treatments in community care for youth with psychiatric disorders is a defining challenge of our time. This review proposes a new direction focused on developing and testing integrated causal theories. We recommend implementation scientists: (a) move from observational studies of implementation barriers and facilitators to trials that include causal theory; (b) identify a core set of implementation determinants; (c) conduct trials of implementation strategies with clear targets, mechanisms, and outcomes; (d) ensure that behaviors that are core to EBPs are clearly defined; and (e) agree upon standard measures. This agenda will help fulfill the promise of evidence-based practice for improving youth behavioral health.

Data-Driven Diffusion Of Innovations: Successes And Challenges In 3 Large-Scale Innovative Delivery Models

Failed diffusion of innovations may be linked to an inability to use and apply data, information, and knowledge to change perceptions of current practice and motivate change. Using qualitative and quantitative data from three large-scale health care delivery innovations-accountable care organizations, advanced primary care practice, and EvidenceNOW-we assessed where data-driven innovation is occurring and where challenges lie. We found that implementation of some technological components of innovation (for example, electronic health records) has occurred among health care organizations, but core functions needed to use data to drive innovation are lacking. Deficits include the inability to extract and aggregate data from the records; gaps in sharing data; and challenges in adopting advanced data functions, particularly those related to timely reporting of performance data. The unexpectedly high costs and burden incurred during implementation of the innovations have limited organizations' ability to address these and other deficits. Solutions that could help speed progress in data-driven innovation include facilitating peer-to-peer technical assistance, providing tailored feedback reports to providers from data aggregators, and using practice facilitators skilled in using data technology for quality improvement to help practices transform. Policy efforts that promote these solutions may enable more rapid uptake of and successful participation in innovative delivery system reforms.

German language questionnaires for assessing implementation constructs and outcomes of psychosocial and health-related interventions: a systematic review

Background

Over the past years, implementation science has gained more and more importance in German-speaking countries. Reliable and valid questionnaires are needed for evaluating the implementation of evidence-based practices. On an international level, several initiatives focused on the identification of questionnaires used in English-speaking countries but limited their search processes to mental health and public health settings. Our aim was to identify questionnaires used in German-speaking countries measuring the implementation of interventions in public health and health care settings in general and to assess their psychometric properties.

Methods

We searched five different bibliographic databases (from 1985 to August 2017) and used several other search strategies (e.g., reference lists, forward citation) to obtain our data. We assessed the instruments, which were identified in an independent dual review process, using 12 psychometric rating criteria. Finally, we mapped the instruments’ scales and subscales in regard to the constructs of the Consolidated Framework for Implementation Research (CFIR) and the Implementation Outcome Framework (IOF).

Results

We identified 31 unique instruments available for the assessment of implementation science constructs. Hospitals and other health care settings were the ones most often investigated (23 instruments), while education and childcare settings, workplace settings, and community settings lacked published instruments. Internal consistency, face and content validity, usability, and structural validity were the aspects most often described. However, most studies did not report on test-retest reliability, known-groups validity, predictive criterion validity, or responsiveness. Overall, the majority of studies did not reveal high-quality instruments, especially regarding the psychometric criteria internal consistency, structural validity, and criterion validity. In addition, we seldom detected instruments operationalizing the CFIR domains intervention characteristics, outer setting, and process, and the IOF constructs adoption, fidelity, penetration, and sustainability.

Conclusions

Overall, a sustained and continuous effort is needed to improve the reliability and validity of existing instruments to new ones. Instruments applicable to the assessment of implementation constructs in public health and community settings are urgently needed.

Trial registration

The systematic review protocol was registered in PROSPERO on October 19, 2017, under the following number: CRD42017075208.

Electronic supplementary material

The online version of this article (10.1186/s13012-018-0837-3) contains supplementary material, which is available to authorized users.

Is innovative workforce planning software the solution to NHS staffing and cost crisis? An exploration of the locum industry

BACKGROUND

Workforce planning in the British healthcare system (NHS) is associated with significant costs of agency staff employment. The introduction of a novel software (ABG) as a 'people to people economy' (P2PE) platform for temporary staff recruitment offers a potential solution to this problem. Consequently, the focus of this study was twofold - primarily to explore the locum doctor landscape, and secondarily to evaluate the implementation of P2PE in the healthcare industry.

METHODS

Documentary analysis was conducted alongside thirteen semi structured interviews across five informant groups: two industry experts, two healthcare consultants, an executive director, two speciality managers and six doctors.

RESULTS

We found that locum doctors are indispensable to covering workforce shortages, yet existing planning and recruitment practices were found to be inefficient, inconsistent and lacking transparency. Contrarily, mobile-first solutions such as ABG seem to secure higher convenience, better transparency, cost and time efficiency. We also identified factors facilitating the successful diffusion of ABG; these were in line with classically cited characteristics of innovation such as trialability, observability, and scope for local reinvention. Drawing upon the concept of value-based healthcare coupled with the analysis of our findings led to the development of Information Exchange System (IES) model, a comprehensive framework allowing a thorough comparison of recruitment practices in healthcare.

CONCLUSION

IES was used to evaluate ABG and its diffusion against other recruitment methods and ABG was found to outperform its alternatives, thus suggesting its potential to solve the staffing and cost crisis at the chosen hospital.

Innovation Implementation in the Context of Hospital QI: Lessons Learned and Strategies for Success

In 1999, the Institute of Medicine reported that 98,000 people die each year due to medical errors. In the following years, the focus on hospital quality was intensified nationally, with policymakers providing evidence-based practice guidelines for improving health care quality. However, these innovations (evidence-based guidelines) that were being produced at policy levels were not translating to clinical practice at the hospital organizational level easily, and stark variations continued to persist, in the quality of health care. Circa 2009, nearly a decade after the release of the IOM report, the health care organizational literature began referring to this challenge as "innovation implementation failure" in health care organizations (HCOs), ie, failure to implement an evidence-based practice that is new to a HCO. This stream of literature drew upon management research to explain why innovation implementation failure occurs in HCOs and what could be done to prevent it. This paper conducts an integrative review of the literature on "innovation implementation" in hospitals and health systems over the last decade, since the spotlight was cast on "innovation implementation failure" in HCOs. The review reveals that while some studies have retrospectively sought to identify the key drivers of innovation implementation, through surveys and interviews of practitioners (the "what"), other studies have prospectively sought to understand how innovation implementation occurs in hospitals and health systems (the "how"). Both make distinctive contributions to identifying strategies for success in innovation implementation. While retrospective studies have helped identify the key drivers of innovation implementation, prospective studies have shed light on how these drivers could be attained, thereby helping to develop context-sensitive management strategies for success. The literature has called for more prospective research on the implementation and sustainability of health care innovations. This paper summarizes the lessons learned from the literature, discusses the relevance of management research on innovation implementation in HCOs, and identifies future research avenues.