The role of organizational research in implementing evidence-based practice: QUERI Series

Audit and feedback: effects on professional practice

BACKGROUND

Audit and feedback (A&F) is a widely used strategy to improve professional practice. This is supported by prior Cochrane reviews and behavioural theories describing how healthcare professionals are prompted to modify their practice when given data showing that their clinical practice is inconsistent with a desirable target. Yet there remains uncertainty regarding the effects of A&F on improving healthcare practice and the characteristics of A&F that lead to a greater impact.

OBJECTIVES

To assess the effects of A&F on the practice of healthcare professionals and to examine factors that may explain variation in the effectiveness of A&F.

SEARCH METHODS

With the Cochrane Effective Practice and Organisation of Care (EPOC) group information scientist, we updated our search strategy to include studies published from 2010 to June 2020. Search updates were performed on 28 February 2019 and 11 June 2020. We searched MEDLINE (Ovid), Embase (Ovid), CINAHL (EBSCO), the Cochrane Library, clinicaltrials.gov (all dates to June 2020), WHO ICTRP (all dates to February Week 3 2019, no information available in 2020 due to COVID-19 pandemic). An updated search and duplicate screen was completed on February 14, 2022; studies that met inclusion criteria are included in the 'Studies awaiting classification' section.

SELECTION CRITERIA

Randomised trials, including cluster-trials and cross-over and factorial designs, featuring A&F (defined as measurement of clinical performance over a specified period of time (audit) and provision of the resulting data to clinicians or clinical teams (feedback)) in any trial arm that reported objectively measured health professional practice outcomes.

DATA COLLECTION AND ANALYSIS

For this updated review, we re-extracted data for each study arm, including theory-informed variables regarding how the A&F was conducted and behaviour change techniques for each intervention, as well as study-level characteristics including risk of bias. For each study, we extracted outcome data for every healthcare professional practice targeted by A&F. All data were extracted by a minimum of two independent review authors. For studies with dichotomous outcomes that included arms with and without A&F, we calculated risk differences (RDs) (absolute difference between arms in proportion of desired practice completed) and also odds ratios (ORs). We synthesised the median RDs and interquartile ranges (IQRs) across all trials. We then conducted meta-analyses, accounting for multiple outcomes from a given study and weighted by effective sample size, using reported (or imputed, when necessary) intra-cluster correlation coefficients. Next, we explored the role of baseline performance, co-interventions, targeted behaviour, and study design factors on the estimated effects of A&F. Finally, we conducted exploratory meta-regressions to test preselected variables that might be associated with A&F effect size: characteristics of the audit (number of indicators, aggregation of data); delivery of the feedback (multi-modal format, local champion, nature of comparator, repeated delivery); and components supporting action (facilitation, provision of specific plans for improvement, co-development of action plans).

MAIN RESULTS

We included 292 studies with 678 arms; 133 (46%) had a low risk of bias, 41 (14%) unclear, and 113 (39%) had a high risk of bias. There were 26 (9%) studies conducted in low- or middle-income countries. In most studies (237, 81%), the recipients of A&F were physicians. Professional practices most commonly targeted in the studies were prescribing (138 studies, 47%) and test-ordering (103 studies, 35%). Most studies featured multifaceted interventions: the most common co-interventions were clinician education (377 study arms, 56%) and reminders (100 study arms, 15%). Forty-eight unique behaviour change techniques were identified within the study arms (mean 5.2, standard deviation 2.8, range 1 to 29). Synthesis of 558 dichotomous outcomes measuring professional practices from 177 studies testing A&F versus control revealed a median absolute improvement in desired practice of 2.7%, with an IQR of 0.0 to 8.6. Meta-analyses of these studies, accounting for multiple outcomes from the same study and weighting by effective sample size accounting for clustering, found a mean absolute increase in desired practice of 6.2% (95% confidence interval (CI) 4.1 to 8.2; moderate-certainty evidence) and an OR of 1.47 (95% CI 1.31 to 1.64; moderate-certainty evidence). Effects were similar for pre-planned subgroup analyses focused on prescribing and test-ordering outcomes. Lower baseline performance and increased number of co-interventions were both associated with larger intervention effects. Meta-regressions comparing the presence versus absence of specific A&F components to explore heterogeneity, accounting for baseline performance and number of co-interventions, suggested that A&F effects were greater with individual-recipient-level data rather than team-level data, comparing performance to top-peers or a benchmark, involving a local champion with whom the recipient had a relationship, using interactive modalities rather than just didactic or just written format, and with facilitation to support engagement, and action plans to improve performance. The meta-regressions did not find significant effects with the number of indicators in the audit, comparison to average performance of all peers, or co-development of action plans. Contrary to expectations, repeated delivery was associated with lower effect size. Direct comparisons from head-to-head trials support the use of peer-comparisons versus no comparison at all and the use of design elements in feedback that facilitate the identification and action of high-priority clinical items.

AUTHORS' CONCLUSIONS

A&F can be effective in improving professional practice, but effects vary in size. A&F is most often delivered along with co-interventions which can contribute additive effects. A&F may be most effective when designed to help recipients prioritise and take action on high-priority clinical issues and with the following characteristics: 1. targets important performance metrics where health professionals have substantial room for improvement (audit); 2. measures the individual recipient's practice, rather than their team or organisation (audit); 3. involves a local champion with an existing relationship with the recipient (feedback); 4. includes multiple, interactive modalities such as verbal and written (feedback); 5. compares performance to top peers or a benchmark (feedback); 6. facilitates engagement with the feedback (action); 7. features an actionable plan with specific advice for improvement (action). These conclusions require further confirmatory research; future research should focus on discerning ways to optimise the effectiveness of A&F interventions.

Adaptability, Scalability and Sustainability (ASaS) of complex health interventions: a systematic review of theories, models and frameworks

BACKGROUND

Complex health interventions (CHIs) are increasingly used in public health, clinical research and education to reduce the burden of disease worldwide. Numerous theories, models and frameworks (TMFs) have been developed to support implementation of CHIs. This systematic review aims to identify and critique theoretical frameworks concerned with three features of implementation; adaptability, scalability and sustainability (ASaS). By dismantling the constituent theories, analysing their component concepts and then exploring factors that influence each theory the review team hopes to offer an enhanced understanding of considerations when implementing CHIs.

METHODS

This review searched PubMed MEDLINE, CINAHL, Web of Science, and Google Scholar for research investigating the TMFs of complex health interventions. Narrative synthesis was employed to examine factors that may influence the adaptability, scalability and sustainability of complex health interventions.

RESULTS

A total of 9763 studies were retrieved from the five databases (PubMed, MEDLINE, CINAHL, Web of Science, and Google Scholar). Following removal of duplicates and application of the eligibility criteria, 35 papers were eligible for inclusion. Influencing factors can be grouped within outer context (socio-political context; leadership funding, inter-organisational networks), inner context; (client advocacy; organisational characteristics), intervention characteristics (supervision, monitoring and evaluation), and bridging factors (individual adopter or provider characteristics).

CONCLUSION

This review confirms that identified TMFS do not typically include the three components of adaptability, scalability, and sustainability. Current approaches focus on high income countries or generic "whole world" approaches with few frameworks specific to low- and middle-income countries. The review offers a starting point for further exploration of adaptability, scalability and sustainability, within a low- and middle-income context.

TRIAL REGISTRATION

Not registered.

Key factors for effective implementation of healthcare workers support interventions after patient safety incidents in health organisations: a scoping review

OBJECTIVES

This study aims to map and frame the main factors present in support interventions successfully implemented in health organisations in order to provide timely and adequate response to healthcare workers (HCWs) after patient safety incidents (PSIs).

DESIGN

Scoping review guided by the six-stage approach proposed by Arksey and O'Malley and by PRISMA-ScR.

DATA SOURCES

CINAHL, Cochrane Library, Embase, Epistemonikos, PsycINFO, PubMed, SciELO Citation Index, Scopus, Web of Science Core Collection, reference lists of the eligible articles, websites and a consultation group.

ELIGIBILITY CRITERIA FOR SELECTING STUDIES

Empirical studies (original articles) were prioritised. We used the Mixed Methods Appraisal Tool Version 2018 to conduct a quality assessment of the eligible studies.

DATA EXTRACTION AND SYNTHESIS

A total of 9766 records were retrieved (last update in November 2022). We assessed 156 articles for eligibility in the full-text screening. Of these, 29 earticles met the eligibility criteria. The articles were independently screened by two authors. In the case of disagreement, a third author was involved. The collected data were organised according to the Organisational factors, People, Environment, Recommendations from other Audies, Attributes of the support interventions. We used EndNote to import articles from the databases and Rayyan to support the screening of titles and abstracts.

RESULTS

The existence of an organisational culture based on principles of trust and non-judgement, multidisciplinary action, leadership engagement and strong dissemination of the support programmes' were crucial factors for their effective implementation. Training should be provided for peer supporters and leaders to facilitate the response to HCWs' needs. Regular communication among the implementation team, allocation of protected time, funding and continuous monitoring are useful elements to the sustainability of the programmes.

CONCLUSION

HCWs' well-being depends on an adequate implementation of a complex group of interrelated factors to support them after PSIs.

Evaluating the Effectiveness of a Modified Colorectal Cancer Screening Program in Almaty, Kazakhstan

OBJECTIVE

This study aimed to evaluate the effectiveness of a modified colorectal cancer (CRC) screening program, incorporating culturally tailored strategies to increase screening uptake and compliance, in Almaty, Kazakhstan.

METHODS

A cross-sectional study was conducted in Almaty between 2019-2022, involving 5370 participants aged 50-70 from diverse settings. Participants were assigned to the main (modified method) and comparison (standard method) groups based on the parity of their ID number digits. Variables of interest included demographics, somatic comorbidities, disability degree, and CRC screening results. The modified screening emphasized healthcare prioritization, optimized nursing resources, enhanced accessibility, and preparedness for the second screening stage.

RESULTS

In the study 2702 patients in the main group (modified method), and 2668 patients in the comparison group (standard method). Comorbidity data showed that the majority of participants in both groups had between 1-10 comorbidities, with an average of 8.2 in the main group and 8.1 in the comparison group. Screening response rates at stage I were higher in the main group, with 82.6% of subjects undergoing screening, compared to 78.9% in the comparison group (χ2=12.12, p=0.001). The response rates were higher among females in both groups, and no significant differences were found across age groups. At stage II, the response rate was again higher in the main group (56.2%) than in the comparison group (47.2%) (χ2=4.217, p=0.040), with no significant differences noted in relation to sex or age. However, the main group showed a higher response rate at stage I among respondents with 6-10 comorbidities (87.1% vs 82.5%, χ2 =7.820, p=0.009).

CONCLUSION

The study demonstrates that the modified program significantly outperformed the traditional one, achieving higher response rates at both the initial and subsequent stages of screening. These findings emphasize the value of revisiting and refining current CRC screening methods to maximize early detection rates.

An Examination of Practices and Barriers of Procedures Performed by Physicians in Rural Hawai'i

There is an estimated shortage of 46 000 to 90 000 physicians in the US, especially in rural areas. Physicians working in rural areas often maintain a larger scope of practice compared to their urban counterparts. This scope may include performing procedures which may require additional training, and lack of that training may limit rural physicians' capability to perform procedures. Physicians practicing in rural areas of Hawai'i were surveyed about their scope of practice regarding procedures and the perceived hindrances in performing procedures. Physicians identified as rural practitioners and rural physicians attending local conferences were asked to participate. Forty-seven (out of 301) rural Hawai'i physicians participated in the survey, of which 89% reported performing procedures. The most common procedures performed included suture removal, incision and drainage, wound care, and suturing. Of the 47 respondents, a total of 28 physicians or 60% reported wishing to perform procedures but not doing so. The procedures physicians would like to perform included gynecological (36%), casting (21%) and wound care (14%). Barriers to performing procedures included lack of time (51%), inadequate training (37%), out of practice (22%), and poor reimbursement (17%). While most rural physicians in this study perform procedures, many would like to perform more. Lack of training and support are significant barriers to increasing scope of procedures performed. Medical schools, residencies, and continuing education programs should consider expanding training in these areas, especially for those planning to practice or currently practicing in rural areas.

Innovation in healthcare: leadership perceptions about the innovation characteristics of artificial intelligence-a qualitative interview study with healthcare leaders in Sweden

BACKGROUND

Despite the extensive hopes and expectations for value creation resulting from the implementation of artificial intelligence (AI) applications in healthcare, research has predominantly been technology-centric rather than focused on the many changes that are required in clinical practice for the technology to be successfully implemented. The importance of leaders in the successful implementation of innovations in healthcare is well recognised, yet their perspectives on the specific innovation characteristics of AI are still unknown. The aim of this study was therefore to explore the perceptions of leaders in healthcare concerning the innovation characteristics of AI intended to be implemented into their organisation.

METHODS

The study had a deductive qualitative design, using constructs from the innovation domain in the Consolidated Framework for Implementation Research (CFIR). Interviews were conducted with 26 leaders in healthcare.

RESULTS

Participants perceived that AI could provide relative advantages when it came to care management, supporting clinical decisions, and the early detection of disease and risk of disease. The development of AI in the organisation itself was perceived as the main current innovation source. The evidence base behind AI technology was questioned, in relation to its transparency, potential quality improvement, and safety risks. Although the participants acknowledged AI to be superior to human action in terms of effectiveness and precision in some situations, they also expressed uncertainty about the adaptability and trialability of AI. Complexities such as the characteristics of the technology, the lack of conceptual consensus about AI, and the need for a variety of implementation strategies to accomplish transformative change in practice were identified, as were uncertainties about the costs involved in AI implementation.

CONCLUSION

Healthcare leaders not only saw potential in the technology and its use in practice, but also felt that AI's opacity limits its evidence strength and that complexities in relation to AI itself and its implementation influence its current use in healthcare practice. More research is needed based on actual experiences using AI applications in real-world situations and their impact on clinical practice. New theories, models, and frameworks may need to be developed to meet challenges related to the implementation of AI in healthcare.

(Re)situating expertise in community-based overdose response: Insights from an ethnographic study of overdose prevention sites (OPS) in Vancouver, Canada

Overdose Prevention Sites (OPS) are low-barrier services where people may use illicit drugs under the monitoring of staff trained to provide life-saving care in the event of an overdose. In British Columbia (BC), Canada, OPS have been rapidly scaled-up as a community-based response to the overdose crisis and are staffed primarily by community members who are also people who use drugs (PWUD). While it is known that PWUD perform vital roles in OPS and other community-based overdose interventions, the expertise and expert knowledge of PWUD in this work remains under-theorised. This study draws on 20 months of ethnographic fieldwork in Vancouver, BC (July 2018 to March 2020), to explore how OPS responders who are PWUD developed and enacted expertise in overdose response. Ethnographic fieldwork focused on four OPS located in Vancouver's Downtown Eastside (DTES) and Downtown South neighbourhoods. Methods included 100 hours of observation in the sites and surrounding areas, three site-specific focus groups with OPS responders (n=20), and semi-structured interviews with OPS responders (n=14) and service users (n=23). Data was analysed with the aim of characterizing the knowledge underpinning responders' expertise, and the arrangements which allow for the formation and enactment of expertise. We found that OPS responders' expertise was grounded in experiential knowledge acquired through their positionality as PWUD and members of a broader community of activists engaged in mutual aid. Responders became skilled in overdose response through frequent practice and drew on their experiential and embodied knowledge of overdose to provide care that was both technically proficient and responsive to the broader needs of PWUD (e.g. protection from criminalization and stigmatizing treatment). Responders emphasized that the spatial arrangements of OPS supported the development of expertise by facilitating more specialized and comprehensive overdose care. OPS became sites of collective expertise around overdose management as responder teams developed shared understandings of overdose management, including processes for managing uncertainty, delegating team responsibilities, and sharing decision-making. This research re-situates theoretical understandings of expertise in community-based overdose response with implications for overdose prevention interventions. Findings underscore the experiential and embodied expertise of PWUD as community-based responders; the importance of supportive environments and team-based approaches for overdose response; and the benefits of community-driven training that extends beyond technical skills of overdose identification and naloxone administration.

A qualitative study of organisational resilience in care homes in Scotland

Providing care for the dependent older person is complex and there have been persistent concerns about care quality as well as a growing recognition of the need for systems approaches to improvement. The I-SCOPE (Improving Systems of Care for the Older person) project employed Resilient Healthcare (RHC) theory and the CARE (Concepts for Applying Resilience) Model to study how care organisations adapt to complexity in everyday work, with the aim of exploring how to support resilient performance. The project was an in-depth qualitative study across multiple sites over 24 months. There were: 68 hours of non-participant observation, shadowing care staff at work and starting broad before narrowing to observe care domains of interest; n = 33 recorded one-to-one interviews (32 care staff and one senior inspector); three focus groups (n = 19; two with inspectors and one multi-disciplinary group); and five round table discussions on emergent results at a final project workshop (n = 31). All interviews and discussion groups were recorded and transcribed verbatim. Resident and family interviews (n = 8) were facilitated through use of emotional touchpoints. Analysis using QSR NVivo 12.0 focused on a) capturing everyday work in terms of the interplay between demand and capacity, adaptations and intended and unintended outcomes and b) a higher-level thematic description (care planning and use of information; coordination of everyday care activity; providing person-centred care) which gives an overview of resilient performance and how it might be enhanced. This gives important new insight for improvement. Conclusions are that resilience can be supported through more efficient use of information, supporting flexible adaptation, coordination across care domains, design of the physical environment, and family involvement based on realistic conversations about quality of life.

Description of organizational and clinician characteristics of primary dementia care in Canada: a multi-method study

Background

Organizational and clinician characteristics are important considerations for the implementation of evidence-based recommendations into primary care practice. The introduction of Canadian dementia practice guidelines and Alzheimer strategies offers a unique context to study which of the organizational and clinician characteristics align with good quality care in primary care practices.

Methods

To evaluate the quality of dementia care, we carried out a retrospective chart review in randomly selected patients with a diagnosis of dementia and who had a visit during a 9-month period in 33 primary care practices. We collected data on indicators that were based on existing Canadian evidence-based recommendations to measure a quality of dementia care score. In addition, four questionnaires were administered: two questionnaires to evaluate the organizational characteristics of the practices (dementia-specific and general organization) and two to evaluate the clinician characteristics (one for family physicians and one for nurses). Primary care practices were stratified into tertiles based on their average quality of dementia care score (low, moderate, high). The differences between the groups organizational and clinician questionnaires scores were analyzed descriptively and visually.

Results

The mean overall scores for each questionnaire were higher in the high quality of dementia care group. When looking at the breakdown of the overall score into each characteristic, the high-quality group had a higher average score for the dementia-specific organizational characteristics of “access to and coordination with home and community services”, “financial support”, “training”, “coordination and continuity within the practice”, and “caregiver support and involvement”. The characteristic “Leadership” showed a higher average score for the moderate and high-quality groups than the low-quality group. In both clinician questionnaires, the high group scored better in “attitudes towards the Alzheimer’s plan” than the other two groups.

Conclusions

These results suggest that investing in organizational characteristics specifically aimed at dementia care is a promising avenue to improve quality of dementia care in primary care. These results may be useful to enhance the implementation of evidence-based practices and improve the quality of dementia care.

Team-Based Care for Cancer Survivors With Comorbidities: A Systematic Review

Coordination of quality care for the growing population of cancer survivors with comorbidities remains poorly understood, especially among health disparity populations who are more likely to have comorbidities at the time of cancer diagnosis. This systematic review synthesized the literature from 2000 to 2022 on team-based care for cancer survivors with comorbidities and assessed team-based care conceptualization, teamwork processes, and outcomes. Six databases were searched for original articles on adults with cancer and comorbidity, which defined care team composition and comparison group, and assessed clinical or teamwork processes or outcomes. We identified 1,821 articles of which 13 met the inclusion criteria. Most studies occurred during active cancer treatment and nine focused on depression management. Four studies focused on Hispanic or Black cancer survivors and one recruited rural residents. The conceptualization of team-based care varied across articles. Teamwork processes were not explicitly measured, but teamwork concepts such as communication and mental models were mentioned. Despite team-based care being a cornerstone of quality cancer care, studies that simultaneously assessed care delivery and outcomes for cancer and comorbidities were largely absent. Improving care coordination will be key to addressing disparities and promoting health equity for cancer survivors with comorbidities.

Key factors for effective implementation of healthcare worker support interventions after patient safety incidents in health organisations: a protocol for a scoping review

INTRODUCTION

Health organisations should support healthcare workers who are physically and psychologically affected by patient safety incidents (second victims). There is a growing body of evidence which focuses on second victim support interventions. However, there is still limited research on the elements necessary to effectively implement and ensure the sustainability of these types of interventions. In this study, we propose to map and frame the key factors which underlie an effective implementation of healthcare worker support interventions in healthcare organisations when healthcare workers are physically and/or emotionally affected by patient safety incidents.

METHODS AND ANALYSIS

This scoping review will be guided by the established methodological Arksey and O'Malley framework, Levac and Joanna Briggs Institute (JBI) recommendations. We will follow the JBI three-step process: (1) a preliminary search conducted on two databases; (2) the definition of clear inclusion criteria and the creation of a list of search terms to be used in the subsequent running of the search on a larger number of databases; and (3) additional searches (cross-checking/cross-referencing of reference lists of eligible studies, hand-searching in target journals relevant to the topic, conference proceedings, institutional/organisational websites and networks repositories). We will undertake a comprehensive search strategy in relevant bibliographic databases (PubMed/MEDLINE, Embase, CINHAL, Web of Science, Scopus, PsycInfo, Epistemonikos, Scielo, Cochrane Library and Open Grey). We will use the Mixed Methods Appraisal Tool V.2018 for quality assessment of the eligible studies. Our scoping review will be guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Extension for Scoping Reviews.

ETHICS AND DISSEMINATION

This study will not require ethical approval. Results of the scoping review will be published in a peer-review journal, and findings will be presented in scientific conferences as well as in international forums and other relevant dissemination channels.

TRIAL REGISTRATION NUMBER

10.17605/OSF.IO/RQAT6.Preprint from medRxiv available: doi: https://doi.org/10.1101/2022.01.25.22269846.

Support for COVID-19-Related Substance Use Services Policy Changes: a New York State-Wide Survey

This study aims to describe which substance use service (SUS) organizations and who within these organizations support the maintenance of policies targeted at improving substance use treatment services. An online survey assessing respondent, organizational and program demographics, and knowledge and support regarding policy changes was distributed to all certified SUS and harm reduction programs in NYS. Bivariate and latent class analyses were used to identify patterns and associations to policy choices. Across the 227 respondents, there was a support for maintaining expansion of insurance coverage, virtual behavioral health/counseling and medication initiation/maintenance visits, reductions in prior authorizations, and access to prevention/harm reduction services. Three classes of support for policies were derived: (1) high-supporters (n = 49; 21%), (2) low-supporters (n = 66; 29%), and (3) selective-supporters. Having knowledge of policy changes was associated with membership in the high-supporters class. Implications regarding the role of knowledge in behavioral health policies dissemination structures, decision-making, and long-term expansion of SUS are discussed.

Cancer prevention, risk reduction, and control: opportunities for the next decade of health care delivery research

In this commentary, we discuss opportunities to optimize cancer care delivery in the next decade building from evidence and advancements in the conceptualization and implementation of multi-level translational behavioral interventions. We summarize critical issues and discoveries describing new directions for translational behavioral research in the coming decade based on the promise of the accelerated application of this evidence within learning health systems. To illustrate these advances, we discuss cancer prevention, risk reduction (particularly precision prevention and early detection), and cancer treatment and survivorship (particularly risk- and need-stratified comprehensive care) and propose opportunities to equitably improve outcomes while addressing clinician shortages and cross-system coordination. We also discuss the impacts of COVID-19 and potential advances of scientific knowledge in the context of existing evidence, the need for adaptation, and potential areas of innovation to meet the needs of converging crises (e.g., fragmented care, workforce shortages, ongoing pandemic) in cancer health care delivery. Finally, we discuss new areas for exploration by applying key lessons gleaned from implementation efforts guided by advances in behavioral health.

Organizational knowledge translation strategies for allied health professionals in traumatology settings: realist review protocol

BACKGROUND

Knowledge translation (KT) is an important means of improving the health service quality. Most research on the effectiveness of KT strategies has focused on individual strategies, i.e., those directly targeting the modification of allied health professionals' knowledge, attitudes, and behaviors, for example. In general, these strategies are moderately effective in changing practices (maximum 10% change). Effecting change in organizational contexts (e.g., change readiness, general and specific organizational capacity, organizational routines) is part of a promising new avenue to service quality improvement through the implementation of evidence-based practices. The objective of this study will be to identify why, how, and under what conditions organizational KT strategies have been shown to be effective or ineffective in changing the (a) knowledge, (b) attitudes, and (c) clinical behaviors of allied health professionals in traumatology settings.

METHODS

This is a realist review protocol involving four iterative steps: (1) Initial theory formulation, (2) search for Evidence search, (3) knowledge extraction and synthesis, and (4) recommendations. We will search electronic databases such as PubMed, Embase, CINHAL, Cochrane Library, and Conference Proceedings Citation Index - Science. The studies included will be those relating to the use of organizational KT strategies in trauma settings, regardless of study designs, published between January 1990 and October 2020, and presenting objective measures that demonstrate change in allied health professionals' knowledge, attitudes, and clinical behaviors. Two independent reviewers will select, screen, and extract the data related to all relevant sources in order to refine or refute the context-mechanism-outcome (CMO) configurations developed in the initial theory and identify new CMO configurations.

DISCUSSION

Using a systematic and rigorous method, this review will help guide decision-makers and researchers in choosing the best organizational strategies to optimize the implementation of evidence-based practices.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42020216105.

Fragmentation of Care Among Black Women With Breast Cancer and Comorbidities: The Role of Health Systems

PURPOSE

Black women are disproportionately burdened by comorbidities and breast cancer. The complexities of coordinating care for multiple health conditions can lead to adverse consequences. Care coordination may be exacerbated when care is received outside the same health system, defined as care fragmentation. We examine types of practice setting for primary and breast cancer care to assess care fragmentation.

MATERIALS AND METHODS

We analyzed data from a prospective cohort of Black women diagnosed with breast cancer in New Jersey who also had a prior diagnosis of diabetes and/or hypertension (N = 228). Following breast cancer diagnosis, we examined types of practice setting for first primary care visit and primary breast surgery, through medical chart abstraction, and identified whether care was used within or outside the same health system. We used multivariable logistic regression to explore sociodemographic and clinical factors associated with care fragmentation.

RESULTS

Diverse primary care settings were used: medical groups (32.0%), health systems (29.4%), solo practices (23.7%), Federally Qualified Health Centers (8.3%), and independent hospitals (6.1%). Surgical care predominately occurred in health systems (79.8%), with most hospitals being Commission on Cancer-accredited. Care fragmentation was experienced by 78.5% of Black women, and individual-level factors (age, health insurance, cancer stage, and comorbidity count) were not associated with care fragmentation (P > .05).

CONCLUSION

The majority of Black breast cancer survivors with comorbidities received primary care and surgical care in different health systems, illustrating care fragmentation. Strategies for care coordination and health care delivery across health systems and practice settings are needed for health equity.

Organizational Readiness for Lung Cancer Screening: A Cross-Sectional Evaluation at a Veterans Affairs Medical Center

OBJECTIVES

Lung cancer has the highest cancer-related mortality in the United States and among Veterans. Screening of high-risk individuals with low-dose CT (LDCT) can improve survival through detection of early-stage lung cancer. Organizational factors that aid or impede implementation of this evidence-based practice in diverse populations are not well described. We evaluated organizational readiness for change and change valence (belief that change is beneficial and valuable) for implementation of LDCT screening.

METHODS

We performed a cross-sectional survey of providers, staff, and administrators in radiology and primary care at a single Veterans Affairs Medical Center. Survey measures included Shea's validated Organizational Readiness for Implementing Change (ORIC) scale and Shea's 10 items to assess change valence. ORIC and change valence were scored on a scale from 1 to 7 (higher scores representing higher readiness for change or valence). Multivariable linear regressions were conducted to determine predictors of ORIC and change valence.

RESULTS

Of 523 employees contacted, 282 completed survey items (53.9% overall response rate). Higher ORIC scores were associated with radiology versus primary care (mean 5.48, SD 1.42 versus 5.07, SD 1.22, β = 0.37, P = .039). Self-identified leaders in lung cancer screening had both higher ORIC (5.56, SD 1.39 versus 5.11, SD 1.26, β = 0.43, P = .050) and change valence scores (5.89, SD 1.21 versus 5.36, SD 1.19, β = 0.51, P = .012).

DISCUSSION

Radiology health professionals have higher levels of readiness for change for implementation of LDCT screening than those in primary care. Understanding health professionals' behavioral determinants for change can inform future lung cancer screening implementation strategies.

Implementing Improvements: Opportunities to Integrate Quality Improvement and Implementation Science

In hospitals, improvers and implementers use quality improvement science (QIS) and less frequently implementation research (IR) to improve health care and health outcomes. Narrowly defined quality improvement (QI) guided by QIS focuses on transforming systems of care to improve health care quality and delivery and IR focuses on developing approaches to close the gap between what is known (research findings) and what is practiced (by clinicians). However, QI regularly involves implementing evidence and IR consistently addresses organizational and setting-level factors. The disciplines share a common end goal, namely, to improve health outcomes, and work to understand and change the same actors in the same settings often encountering and addressing the same challenges. QIS has its origins in industry and IR in behavioral science and health services research. Despite overlap in purpose, the 2 sciences have evolved separately. Thought leaders in QIS and IR have argued the need for improved collaboration between the disciplines. The Veterans Health Administration's Quality Enhancement Research Initiative has successfully employed QIS methods to implement evidence-based practices more rapidly into clinical practice, but similar formal collaborations between QIS and IR are not widespread in other health care systems. Acute care teams are well positioned to improve care delivery and implement the latest evidence. We provide an overview of QIS and IR; examine the key characteristics of QIS and IR, including strengths and limitations of each discipline; and present specific recommendations for integration and collaboration between the 2 approaches to improve the impact of QI and implementation efforts in the hospital setting.

Current status and future directions of U.S. genomic nursing health care policy

BACKGROUND

As genomic science moves beyond government-academic collaborations into routine healthcare operations, nursing's holistic philosophy and evidence-based practice approach positions nurses as leaders to advance genomics and precision health care in routine patient care.

PURPOSE

To examine the status of and identify gaps for U.S. genomic nursing health care policy and precision health clinical practice implementation.

METHODS

We conducted a scoping review and policy priorities analysis to clarify key genomic policy concepts and definitions, and to examine trends and utilization of health care quality benchmarking used in precision health.

FINDINGS

Genomic nursing health care policy is an emerging area. Educating and training the nursing workforce to achieve full dissemination and integration of precision health into clinical practice remains an ongoing challenge. Use of health care quality measurement principles and federal benchmarking performance evaluation criteria for precision health implementation are not developed.

DISCUSSION

Nine recommendations were formed with calls to action across nursing practice workforce and education, nursing research, and health care policy arenas.

CONCLUSIONS

To advance genomic nursing health care policy, it is imperative to develop genomic performance measurement tools for clinicians, purchasers, regulators and policymakers and to adequately prepare the nursing workforce.

Identifying barriers, facilitators, and implementation strategies for a faith-based physical activity program

Background

Community engagement is critical to the acceleration of evidence-based interventions into community settings. Harnessing the knowledge and opinions of community leaders increases the likelihood of successful implementation, scale-up, and sustainment of evidence-based interventions. Faith in Action (Fe en Acción) is an evidence-based promotora-led physical activity program designed to increase moderate-to-vigorous physical activity among churchgoing Latina women.

Methods

We conducted in-depth interviews using a semi-structured interview guide based on the Consolidated Framework for Implementation Research (CFIR) at various Catholic and Protestant churches with large Latino membership in San Diego County, California to explore barriers and facilitators to implementation of Faith in Action and identify promising implementation strategies for program scale-up and dissemination. We interviewed 22 pastors and church staff and analyzed transcripts using an iterative-deductive team approach.

Results

Pastors and church staff described barriers and facilitators to implementation within three domains of CFIR: characteristics of individuals (lack of self-efficacy for and knowledge of physical activity; influence on churchgoers' behaviors), inner setting (church culture and norms, alignment with mission and values, competing priorities, lack of resources), and outer setting (need for buy-in from senior leadership). From the interviews, we identified four promising implementation strategies for the scale-up of faith-based health promotion programs: (1) health behavior change training for pastors and staff, (2) tailored messaging, (3) developing community collaborations, and (4) gaining denominational support.

Conclusions

While churches can serve as valuable partners in health promotion, specific barriers and facilitators to implementation must be recognized and understood. Addressing these barriers through targeted implementation strategies at the adopter and organizational level can facilitate improved program implementation and lead the way for scale-up and dissemination.

Planning for Implementation Success Using RE-AIM and CFIR Frameworks: A Qualitative Study

Background: RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) and CFIR (Consolidated Framework for Implementation Research) dissemination and implementation frameworks define theory-based domains associated with the adoption, implementation and maintenance of evidence-based interventions. Used together, the two frameworks identify metrics for evaluating implementation success, i.e., high reach and effectiveness resulting in sustained practice change (RE-AIM), and modifiable factors that explain and enhance implementation outcomes (CFIR). We applied both frameworks to study the implementation planning process for a technology-delivered asthma care intervention called Breathewell within an integrated care organization. The goal of the Breathewell intervention is to increase the efficiency of delivering resource-intensive asthma care services. Methods: We reviewed historical documents (i.e., meeting agendas; minutes) from 14 months of planning to evaluate alignment of implementation team priorities with RE-AIM domains. Key content was extracted and analyzed on topics, frequency and amount of discussion within each RE-AIM domain. Implementation team members were interviewed using questions adapted from the CFIR Interview Guide Tool to focus their reflection on the process and contextual factors considered during pre-implementation planning. Documents and transcripts were initially coded using RE-AIM domain definitions, and recoded using CFIR constructs, with intent to help explain how team decisions and actions can contribute to adoption, implementation and maintenance outcomes. Results: Qualitative analysis of team documents and interviews demonstrated strong alignment with the RE-AIM domains: Reach, Effectiveness, and Implementation; and with the CFIR constructs: formal inclusion of provider and staff stakeholders in implementation planning, compatibility of the intervention with workflows and systems, and alignment of the intervention with organizational culture. Focus on these factors likely contributed to RE-AIM outcomes of high implementation fidelity. However, team members expressed low confidence that Breathewell would be adopted and maintained post-trial. A potential explanation was weak alignment with several CFIR constructs, including tension for change, relative priority, and leadership engagement that contribute to organizational receptivity and motivation to sustain change. Conclusions: While RE-AIM provides a practical framework for planning and evaluating practice change interventions to assure their external validity, CFIR explains why implementation succeeded or failed, and when used proactively, identifies relevant modifiable factors that can promote or undermine adoption, implementation, and maintenance.

Building a Group-Based Opioid Treatment (GBOT) blueprint: a qualitative study delineating GBOT implementation

BACKGROUND

Group-Based Opioid Treatment (GBOT) has recently emerged as a mechanism for treating patients with opioid use disorder (OUD) in the outpatient setting. However, the more practical "how to" components of successfully delivering GBOT has received little attention in the medical literature, potentially limiting its widespread implementation and utilization. Building on a previous case series, this paper delineates the key components to implementing GBOT by asking: (a) What are the core components to GBOT implementation, and how are they defined? (b) What are the malleable components to GBOT implementation, and what conceptual framework should providers use in determining how to apply these components for effective delivery in their unique clinical environment?

METHODS

To create a blueprint delineating GBOT implementation, we integrated findings from a previously conducted and separately published systematic review of existing GBOT studies, conducted additional literature review, reviewed best practice recommendations and policies related to GBOT and organizational frameworks for implementing health systems change. We triangulated this data with a qualitative thematic analysis from 5 individual interviews and 2 focus groups representing leaders from 5 different GBOT programs across our institution to identify the key components to GBOT implementation, distinguish "core" and "malleable" components, and provide a conceptual framework for considering various options for implementing the malleable components.

RESULTS

We identified 6 core components to GBOT implementation that optimize clinical outcomes, comply with mandatory policies and regulations, ensure patient and staff safety, and promote sustainability in delivery. These included consistent group expectations, team-based approach to care, safe and confidential space, billing compliance, regular monitoring, and regular patient participation. We identified 14 malleable components and developed a novel conceptual framework that providers can apply when deciding how to employ each malleable component that considers empirical, theoretical and practical dimensions.

CONCLUSION

While further research on the effectiveness of GBOT and its individual implementation components is needed, the blueprint outlined here provides an initial framework to help office-based opioid treatment sites implement a successful GBOT approach and hence potentially serve as future study sites to establish efficacy of the model. This blueprint can also be used to continuously monitor how components of GBOT influence treatment outcomes, providing an empirical framework for the ongoing process of refining implementation strategies.

Specifying an implementation framework for Veterans Affairs antimicrobial stewardship programmes: using a factor analysis approach

Objectives

Inappropriate antibiotic use poses a serious threat to patient safety. Antimicrobial stewardship programmes (ASPs) may optimize antimicrobial use and improve patient outcomes, but their implementation remains an organizational challenge. Using the Promoting Action on Research Implementation in Health Services (PARiHS) framework, this study aimed to identify organizational factors that may facilitate ASP design, development and implementation.

Methods

Among 130 Veterans Affairs facilities that offered acute care, we classified organizational variables supporting antimicrobial stewardship activities into three PARiHS domains: evidence to encompass sources of knowledge; contexts to translate evidence into practice; and facilitation to enhance the implementation process. We conducted a series of exploratory factor analyses to identify conceptually linked factor scales. Cronbach's alphas were calculated. Variables with large uniqueness values were left as single factors.

Results

We identified 32 factors, including six constructs derived from factor analyses under the three PARiHS domains. In the evidence domain, four factors described guidelines and clinical pathways. The context domain was broken into three main categories: (i) receptive context (15 factors describing resources, affiliations/networks, formalized policies/practices, decision-making, receptiveness to change); (ii) team functioning (1 factor); and (iii) evaluation/feedback (5 factors). Within facilitation, two factors described facilitator roles and tasks and five captured skills and training.

Conclusions

We mapped survey data onto PARiHS domains to identify factors that may be adapted to facilitate ASP uptake. Our model encompasses mostly mutable factors whose relationships with performance outcomes may be explored to optimize antimicrobial use. Our framework also provides an analytical model for determining whether leveraging existing organizational processes can potentially optimize ASP performance.

Is Variation in Resident-Centered Care and Quality Performance Related to Health System Factors in Veterans Health Administration Nursing Homes?

The purpose of this research was to explore and compare common health system factors for 5 Community Living Centers (ie Veterans Health Administration nursing homes) with high performance on both resident-centered care and clinical quality and for 5 Community Living Centers (CLC) with low performance on both resident-centered care and quality. In particular, we were interested in “how” and “why” some Community Living Centers were able to deliver high levels of resident-centered care and high quality of care, whereas others did not demonstrate this ability. Sites were identified based on their rankings on a composite quality measure calculated from 28 Minimum Data Set version 2.0 quality indicators and a resident-centered care summary score calculated from 6 domains of the Artifacts of Culture Change Tool. Data were from fiscal years 2009-2012. We selected high- and low-performing sites on quality and resident-centered care and conducted 12 in-person site visits in 2014-2015. We used systematic content analysis to code interview transcripts for a priori and emergent health system factor domains. We then assessed variations in these domains across high and low performers using cross-site summaries and matrixes. Our final sample included 108 staff members at 10 Veterans Health Administration CLCs. Staff members included senior leaders, middle managers, and frontline employees. Of the health system factors identified, high and low performers varied in 5 domains, including leadership support, organizational culture, teamwork and communication, resident-centered care recognition and awards, and resident-centered care training. Organizations must recognize that making improvements in the factors identified in this article will require dedicated resources from leaders and support from staff throughout the organization.

A systems approach using the functional resonance analysis method to support fluoride varnish application for children attending general dental practice

BACKGROUND

All children attending General Dental Practice in Scotland are recommended to receive twice-yearly applications of sodium fluoride varnish to prevent childhood caries, yet application is variable. Development of complex interventions requires theorizing and modelling to understand context. This study applies the Functional Resonance Analysis Method (FRAM) to produce a sociotechnical systems model and identify opportunities for intervention to support application.

METHODS

The FRAM was used to synthesise data which were: routine monitoring of fluoride varnish application in 2015/16; a longitudinal survey with practitioners (n = 1090); in-depth practitioner and key informant interviews (n = 43); and a 'world café' workshop (n = 56).

RESULTS

We describe a detailed model of functions linked to application, and use this to make recommendations for system-wide intervention.

CONCLUSIONS

Rigorous research is required to produce accessible models of complex systems in healthcare. This novel paper shows how careful articulation of the functions associated with fluoride varnish application can support future improvement efforts.

Implementation of an evidence-based biobehavioral treatment for cancer patients

One aim of dissemination and implementation (DI) research is to study the translation of evidence-based treatments (EBTs) from the research environments of their development and testing to broader communities where they are needed. There are few behavioral medicine DI studies and none in cancer survivorship. A determinant model (Setting, Therapist, Education, imPlementation, and Sustainability (STEPS)) was used to conceptualize DI of mental health treatment and frame a longitudinal study of implementation of a behavioral medicine EBT-a biobehavioral intervention (BBI) for cancer patients. Using effective dissemination strategies, therapists were trained in the BBI and followed to determine if implementation occurred. Participants (N = 108) were psychologists, social workers, and other oncology mental health providers from diverse settings to whom the BBI had been disseminated. BBI trainers then provided 6 months of support for implementation (e.g., monthly conference calls). Therapists reported number of patients treated, with or without the BBI, at 2, 4, and 6 months; use of support strategies was tracked. Generalized linear mixed models show that the proportion of patients treated with BBI ranged from 58 to 68%, with a 2% increase across follow-ups. Therapist and setting characteristics did not predict usage. Implementation of a behavioral medicine EBT provides a "real-world" demonstration of a BBI moved from the research setting to diverse communities. As the first study in cancer, it is an encouraging example of training and supporting mental health providers to deliver evidence-based psychological treatment and finding their success in doing so.

Organizational theory for dissemination and implementation research

Background

Even under optimal internal organizational conditions, implementation can be undermined by changes in organizations’ external environments, such as fluctuations in funding, adjustments in contracting practices, new technology, new legislation, changes in clinical practice guidelines and recommendations, or other environmental shifts. Internal organizational conditions are increasingly reflected in implementation frameworks, but nuanced explanations of how organizations’ external environments influence implementation success are lacking in implementation research. Organizational theories offer implementation researchers a host of existing, highly relevant, and heretofore largely untapped explanations of the complex interaction between organizations and their environment. In this paper, we demonstrate the utility of organizational theories for implementation research.

Discussion

We applied four well-known organizational theories (institutional theory, transaction cost economics, contingency theories, and resource dependency theory) to published descriptions of efforts to implement SafeCare, an evidence-based practice for preventing child abuse and neglect. Transaction cost economics theory explained how frequent, uncertain processes for contracting for SafeCare may have generated inefficiencies and thus compromised implementation among private child welfare organizations. Institutional theory explained how child welfare systems may have been motivated to implement SafeCare because doing so aligned with expectations of key stakeholders within child welfare systems’ professional communities. Contingency theories explained how efforts such as interagency collaborative teams promoted SafeCare implementation by facilitating adaptation to child welfare agencies’ internal and external contexts. Resource dependency theory (RDT) explained how interagency relationships, supported by contracts, memoranda of understanding, and negotiations, facilitated SafeCare implementation by balancing autonomy and dependence on funding agencies and SafeCare developers.

Summary

In addition to the retrospective application of organizational theories demonstrated above, we advocate for the proactive use of organizational theories to design implementation research. For example, implementation strategies should be selected to minimize transaction costs, promote and maintain congruence between organizations’ dynamic internal and external contexts over time, and simultaneously attend to organizations’ financial needs while preserving their autonomy. We describe implications of applying organizational theory in implementation research for implementation strategies, the evaluation of implementation efforts, measurement, research design, theory, and practice. We also offer guidance to implementation researchers for applying organizational theory.

A structural model of treatment program and individual counselor leadership in innovation transfer

BACKGROUND

A number of program-level and counselor-level factors are known to impact the adoption of treatment innovations. While program leadership is considered a primary factor, the importance of leadership among clinical staff to innovation transfer is less known. Objectives included explore (1) the influence of two leadership roles, program director and individual counselor, on recent training activity and (2) the relationship of counselor attributes on training endorsement.

METHODS

The sample included 301 clinical staff in 49 treatment programs. A structural equation model was evaluated for key hypothesized relationships between exogenous and endogenous variables related to the two leadership roles.

RESULTS

The importance of organizational leadership, climate, and counselor attributes (particularly counseling innovation interest and influence) to recent training activity was supported. In a subset of 68 counselors who attended a developer-led training on a new intervention, it was found that training endorsement was higher among those with high innovation interest and influence.

CONCLUSIONS

The findings suggest that each leadership level impacts the organization in different ways, yet both can promote or impede technology transfer.

Implementing evidence-based practices in an emergency department: contradictions exposed when prioritising a flow culture

Background

An emergency department is typically a place of high activity where practitioners care for unanticipated presentations, which yields a flow culture so that actions that secure available beds are prioritised by the practitioners.

Objectives

How does the flow culture in an emergency department influence nurses’ use of a research‐based clinical guideline and a nutrition screening routine.

Methods

Ethnographic fieldwork was carried out over three months. The first author followed nurses, medical secretaries and doctors in the emergency department. Data were also collected by means of semi‐structured interviews. An activity system analysis, as described in the Cultural Historical Activity Theory, was conducted to identify various contradictions that could exist between different parts of the activity system.

Results

The main contradiction identified was that guidelines and screening routines provided a flow stop. Four associated contradictions were identified: insufficient time to implement guidelines; guilty conscience due to perceived nonadherence to evidence‐based practices; newcomers having different priorities; and conflicting views of what constituted being a professional.

Conclusion

We found that research‐supported guidelines and screening routines were not used if they were perceived to stop the patient flow, suggesting that the practice was not fully evidence based.

Making cognitive decision support work: Facilitating adoption, knowledge and behavior change through QI

This paper evaluates the role of facilitation in the successful implementation of Computerized Decision Support (CDS). Facilitation processes include education, specialized computerized decision support, and work process reengineering. These techniques, as well as modeling and feedback enhance self-efficacy, which we propose is one of the factors that mediate the effectiveness of any CDS. In this study, outpatient clinics implemented quality improvement (QI) projects focused on improving geriatric care. Quality Improvement is the systematic process of improving quality through continuous measurement and targeted actions. The program, entitled "Advancing Geriatric Education through Quality Improvement" (AGE QI), consisted of a 6-month, QI based, intervention: (1) 2h didactic session, (2) 1h QI planning session, (3) computerized decision support design and implementation, (4) QI facilitation activities, (5) outcome feedback, and (6) 20h of CME. Specifically, we examined the impact of the QI based program on clinician's perceived self-efficacy in caring for older adults and the relationship of implementation support and facilitation on perceived success. The intervention was implemented at 3 institutions, 27 community healthcare system clinics, and 134 providers. This study reports the results of pre/post surveys for the forty-nine clinicians who completed the full CME program. Self-efficacy ratings for specific clinical behaviors related to care of older adults were assessed using a Likert based instrument. Self-ratings of efficacy improved across the following domains (depression, falls, end-of-life, functional status and medication management) and specifically in QI targeted domains and were associated with overall clinic improvements.

Barriers and facilitators for implementing a new screening tool in an emergency department: A qualitative study applying the Theoretical Domains Framework

AIM

The aim was to identify the factors that were perceived as most important as facilitators or barriers to the introduction and intended use of a new tool in the emergency department among nurses and a geriatric team.

BACKGROUND

A high incidence of functional decline after hospitalisation for acute medical illness has been shown in the oldest patients and those who are physically frail. In Denmark, more than 35% of older medical patients acutely admitted to the emergency department are readmitted within 90 days after discharge. A new screening tool for use in the emergency department aiming to identify patients at particularly high risk of functional decline and readmission was developed.

DESIGN

Qualitative study based on semistructured interviews with nurses and a geriatric team in the emergency department and semistructured single interviews with their managers.

METHODS

The Theoretical Domains Framework guided data collection and analysis. Content analysis was performed whereby new themes and themes already existing within each domain were described.

RESULTS

Six predominant domains were identified: (1) professional role and identity; (2) beliefs about consequences; (3) goals; (4) knowledge; (5) optimism and (6) environmental context and resources. The content analysis identified three themes, each containing two subthemes. The themes were professional role and identity, beliefs about consequences and preconditions for a successful implementation.

CONCLUSIONS

Two different cultures were identified in the emergency department. These cultures applied to different professional roles and identity, different actions and sense making and identified how barriers and facilitators linked to the new screening tool were perceived.

RELEVANCE FOR CLINICAL PRACTICE

The results show that different cultures exist in the same local context and influence the perception of barriers and facilitators differently. These cultures must be identified and addressed when implementation is planned.

A systematic review of evidence-based assessment practices by allied health practitioners for children with cerebral palsy

AIM

The routine use of psychometrically robust assessment tools is integral to best practice. This systematic review aims to determine the extent to which evidence-based assessment tools were used by allied health practitioners for children with cerebral palsy (CP).

METHOD

The Preferred Reporting Items for Systematic Reviews and Meta-Analysis protocols 2015 was employed. A search strategy applied the free text terms: 'allied health practitioner', 'assessment', and 'cerebral palsy', and related subject headings to seven databases. Included articles reported assessment practices of occupational therapists, physiotherapists, or speech pathologists working with children with CP aged 0 to 18 years, published from the year 2000.

RESULTS

Fourteen articles met the inclusion criteria. Eighty-eight assessment tools were reported, of which 23 were in high use. Of these, three tools focused on gross motor function and had acceptable validity for use with children with CP: Gross Motor Function Measure, Gross Motor Function Classification System, and goniometry. Validated tools to assess other activity components, participation, quality of life, and pain were used infrequently or not at all.

INTERPRETATION

Allied health practitioners used only a few of the available evidence-based assessment tools. Assessment findings in many areas considered important by children and families were rarely documented using validated assessment tools.

Organizational Factors Affecting the Likelihood of Cancer Screening Among VA Patients

BACKGROUND

Preventive service delivery, including cancer screenings, continues to pose a challenge to quality improvement efforts. Although many studies have focused on person-level characteristics associated with screening, less is known about organizational influences on cancer screening.

OBJECTIVES

This study aims to understand the association between organizational factors and adherence to cancer screenings.

METHODS

This study employed a cross-sectional design using organizational-level, patient-level, and area-level data. Dependent variables included breast, cervical, and colorectal cancer screening. Organizational factors describing resource sufficiency were constructed using factor analyses from a survey of 250 Veterans Affairs primary care directors. We conducted random-effects logistic regression analyses, modeling cancer screening as a function of organizational factors, controlling for patient-level and area-level factors.

RESULTS

Overall, 87% of the patients received mammograms, 92% received cervical and 78% had colorectal screening. Quality improvement orientation increased the odds of cervical [odds ratio (OR): 1.27; 95% confidence interval (CI), 1.03-1.57] and colorectal cancer screening (OR: 1.10; 95% CI, 1.00-1.20). Authority in determining primary care components increased the odds of mammography screening (OR: 1.23; 95% CI, 1.03-1.51). Sufficiency in clinical staffing increased the odds of mammography and cervical cancer screenings. Several patient-level factors, serving as control variables, were associated with achievement of screenings.

CONCLUSIONS

Resource sufficiency led to increased odds of screening possibly because they promote excellence in patient care by conveying organizational goals and facilitate goal achievement with resources. Complementary to patient-level factors, our findings identified organizational processes associated with better performance, which offer concrete strategies in which facilities can evaluate their capabilities to implement best practices to foster and sustain a culture of quality care.

Making sense of implementation theories, models and frameworks

BACKGROUND

Implementation science has progressed towards increased use of theoretical approaches to provide better understanding and explanation of how and why implementation succeeds or fails. The aim of this article is to propose a taxonomy that distinguishes between different categories of theories, models and frameworks in implementation science, to facilitate appropriate selection and application of relevant approaches in implementation research and practice and to foster cross-disciplinary dialogue among implementation researchers.

DISCUSSION

Theoretical approaches used in implementation science have three overarching aims: describing and/or guiding the process of translating research into practice (process models); understanding and/or explaining what influences implementation outcomes (determinant frameworks, classic theories, implementation theories); and evaluating implementation (evaluation frameworks). This article proposes five categories of theoretical approaches to achieve three overarching aims. These categories are not always recognized as separate types of approaches in the literature. While there is overlap between some of the theories, models and frameworks, awareness of the differences is important to facilitate the selection of relevant approaches. Most determinant frameworks provide limited "how-to" support for carrying out implementation endeavours since the determinants usually are too generic to provide sufficient detail for guiding an implementation process. And while the relevance of addressing barriers and enablers to translating research into practice is mentioned in many process models, these models do not identify or systematically structure specific determinants associated with implementation success. Furthermore, process models recognize a temporal sequence of implementation endeavours, whereas determinant frameworks do not explicitly take a process perspective of implementation.

Trialability, observability and risk reduction accelerating individual innovation adoption decisions

Purpose

– The purpose of this paper is to provide a retrospective analysis of computer simulation’s role in accelerating individual innovation adoption decisions. The process innovation examined is Lean Systems Thinking, and the organizational context is the imaging department of an Australian public hospital.

Design/methodology/approach

– Intrinsic case study methods including observation, interviews with radiology and emergency personnel about scheduling procedures, mapping patient appointment processes and document analysis were used over three years and then complemented with retrospective interviews with key hospital staff. The multiple data sources and methods were combined in a pragmatic and reflexive manner to explore an extreme case that provides potential to act as an instructive template for effective change.

Findings

– Computer simulation of process change ideas offered by staff to improve patient-flow accelerated the adoption of the process changes, largely because animated computer simulation permitted experimentation (trialability), provided observable predictions of change results (observability) and minimized perceived risk.

Research limitations/implications

– The difficulty of making accurate comparisons between time periods in a health care setting is acknowledged.

Practical implications

– This work has implications for policy, practice and theory, particularly for inducing the rapid diffusion of process innovations to address challenges facing health service organizations and national health systems.

Originality/value

– The research demonstrates the value of animated computer simulation in presenting the need for change, identifying options, and predicting change outcomes and is the first work to indicate the importance of trialability, observability and risk reduction in individual adoption decisions in health services.

A maximum difference scaling survey of barriers to intensive combination treatment strategies with glucocorticoids in early rheumatoid arthritis

The objectives of the study were to determine the relative importance of barriers related to the provision of intensive combination treatment strategies with glucocorticoids (ICTS-GCs) in early rheumatoid arthritis (ERA) from the rheumatologists' perspective and to explore the relation between rheumatologists' characteristics and importance scores. A maximum difference scaling (MDS) survey was administered to 66 rheumatologists in Flanders and the Brussels-Capital Region. The survey included 25 barriers, previously being discovered in a qualitative study. The survey included 25 choice sets, each of which contained a different set of four barriers. In each choice situation, respondents were asked to choose the most important barrier. The mean relative importance score (RIS) for each barrier was calculated using hierarchical Bayes modeling. The potential relation between rheumatologists' characteristics and the RIS was examined using Spearman's correlation coefficient, Mann-Whitney U test, and Kruskal-Wallis H test. The three highest ranked barriers included "contraindicated for some patients (e.g., patients with comorbidities, older patients)," "an increased risk of side effects and related complications," and "patients' resistance" with a mean ± SD RIS of 9.76 ± 0.82, 8.50 ± 1.17, and 7.45 ± 1.22, respectively. Comparing the RISs based on rheumatologists' characteristics, a different ranking was found for three barriers depending on the age, university location, and/or frequency of prescribing ICTS-GCs. The dominant barriers hindering ICTS-GCs prescription from a rheumatologists' perspective are patient-related barriers and barriers related to the complexity of prescribing a combination therapy including GCs. A tailored improvement intervention is needed to overcome these barriers and should focus on the familiarity of rheumatologists with ICTS-GC and patient education.

Nursing staff stress from caregiving and attitudes toward family members of nursing home residents with dementia in Korea

PURPOSE

The purpose of this study was to examine nursing staff stress with their caregiving roles and attitudes toward family members of nursing home residents in Korea.

METHODS

The sample consisted of 267 nursing staff members from 10 long-term care facilities. Participants completed the Caregiver Stress Inventory and the Attitudes About Family Checklist.

RESULTS

The mean score on the total Caregiver Stress Inventory was 4.34 for nurses and 4.53 for nursing assistants (t = -1.42, p = .161). Nursing assistants reported higher stress levels than nurses from caring for the residents with aggressive behaviors (t = -2.28, p = .040). In contrast, nurses reported higher stress levels regarding resources deficiency (t = 2.18, p = .045). The mean score on the data from the Attitudes About Family Checklist was 4.45 for nurses and 3.56 for nursing assistants (t = 2.52, p = .025), indicating that nursing assistants reported more negative attitudes toward family members of residents with dementia.

CONCLUSIONS

The findings in this study showed a need for systematic educational programs for staff to enhance their dementia care knowledge, alleviate their stress, and finally change positively their attitudes toward family. As the number of dementia patients in long-term care facilities increases, it will be important for staff members to develop individually satisfying and mutually acceptable caregiving roles.

What supports physiotherapists' use of research in clinical practice? A qualitative study in Sweden

Background

Evidence-based practice has increasingly been recognized as a priority by professional physiotherapy organizations and influential researchers and clinicians in the field. Numerous studies in the past decade have documented that physiotherapists hold generally favorable attitudes to evidence-based practice and recognize the importance of using research to guide their clinical practice. Research has predominantly investigated barriers to research use. Less is known about the circumstances that actually support use of research by physiotherapists. This study explores the conditions at different system levels that physiotherapists in Sweden perceive to be supportive of their use of research in clinical practice.

Methods

Patients in Sweden do not need a referral from a physician to consult a physiotherapist and physiotherapists are entitled to choose and perform any assessment and treatment technique they find suitable for each patient. Eleven focus group interviews were conducted with 45 physiotherapists, each lasting between 90 and 110 minutes. An inductive approach was applied, using topics rather than questions to allow the participants to generate their own questions and pursue their own priorities within the framework of the aim. The data were analyzed using qualitative content analysis.

Results

Analysis of the data yielded nine favorable conditions at three system levels supporting the participant’s use of research in clinical practice: two at the individual level (attitudes and motivation concerning research use; research-related knowledge and skills), four at the workplace level (leadership support; organizational culture; research-related resources; knowledge exchange) and three at the extra-organizational level (evidence-based practice guidelines; external meetings, networks, and conferences; academic research and education).

Conclusions

Supportive conditions for physiotherapists’ use of research exist at multiple interdependent levels, including the individual, workplace, and extra-organizational levels. Research use in physiotherapy appears to be an interactive and interpretative social process that involves a great deal of interaction with various people, including colleagues and patients.

A measurement instrument for spread of quality improvement in healthcare

OBJECTIVE

The aim of this study was to develop and test a measurement instrument for spread of quality improvement in healthcare. The instrument distinguishes: (i) spread of work practices and their results and (ii) spread practices and effectiveness. Relations between spread and sustainability of changed work practices were also explored to assess convergent validity.

DESIGN

We developed and tested a measurement instrument for spread in a follow-up study. The instrument consisted of 18-items with four subscales.

SETTING AND PARTICIPANTS

The sample consisted of former improvement teams in a quality improvement program for long-term care (nteams = 73, nrespondents = 127). Data were collected in a questionnaire about 1 year post-pilot site improvement implementation.

INTERVENTIONS

Quality improvements in long-term care practices.

MAIN OUTCOME MEASURES

Four variables were construed: (i) actions for spread of work practices, (ii) actions for spread of results, (iii) effectiveness of spread of work practices and (iv) effectiveness of spread of results.

RESULTS

Psychometric analysis yielded positive results on the item level. The intended four-factor model yielded satisfactory fit. The internal consistency of each scale was fine (Cronbach's α 0.70-0.93). Bivariate correlations revealed that the spread variables were strongly related but distinct, and positively related to the sustainability variables.

CONCLUSIONS

The psychometric properties are in line with methodological standards. Convergent validity was confirmed with sustainability. The measurement instrument offers a good starting point for the analysis of spread.

Exploring the usefulness of two conceptual frameworks for understanding how organizational factors influence innovation implementation in cancer care

Moving knowledge into practice and the implementation of innovations in health care remain significant challenges. Few researchers adequately address the influence of organizations on the implementation of innovations in health care. The aims of this article are to (1) present 2 conceptual frameworks for understanding the organizational factors important to the successful implementation of innovations in health care settings; (2) discuss each in relation to the literature; and (3) briefly demonstrate how each may be applied to 3 initiatives involving the implementation of a specific innovation-synoptic reporting tools-in cancer care. Synoptic reporting tools capture information from diagnostic tests, surgeries, and pathology examinations in a standardized, structured manner and contain only the information necessary for patient care. The frameworks selected were the Promoting Action on Research Implementation in Health Services framework and an organizational framework of innovation implementation; these frameworks arise from different disciplines (nursing and management, respectively). The constructs from each framework are examined in relation to the literature, with each construct applied to synoptic reporting tool implementation to demonstrate how each may be used to inform both practice and research in this area. By improving our understanding of existing frameworks, we enhance our ability to more effectively study and target implementation processes.

State-of-the-art and future directions in multilevel interventions across the cancer control continuum

We conducted literature searches and analyses to describe the current state of multilevel intervention (MLI) research and to identify opportunities to advance cancer control and prevention. We found single-level studies that considered other contextually important levels, and multilevel health-care systems research and community-wide studies. This literature is characterized by limited reporting of theoretical, contextual, temporal, and implementation factors. Most MLIs focus on prevention and screening, rather than diagnosis, treatment, or survivorship. Opportunities relate to 1) dynamic, adaptive emergent interventions and research designs that evolve over time by attending to contextual factors and interactions across levels; 2) analyses that include simulation modeling, or multimethod approaches that integrate quantitative and qualitative methods; and 3) translation and intervention approaches that locally reinvent MLIs in different contexts. MLIs have great potential to reduce cancer burden by using theory and integrating quantitative, qualitative, participatory, and transdisciplinary methods that continually seek alignment across intervention levels, pay attention to context, and adapt over time.

Multilevel research and the challenges of implementing genomic medicine

Advances in genomics and related fields promise a new era of personalized medicine in the cancer care continuum. Nevertheless, there are fundamental challenges in integrating genomic medicine into cancer practice. We explore how multilevel research can contribute to implementation of genomic medicine. We first review the rapidly developing scientific discoveries in this field and the paucity of current applications that are ready for implementation in clinical and public health programs. We then define a multidisciplinary translational research agenda for successful integration of genomic medicine into policy and practice and consider challenges for successful implementation. We illustrate the agenda using the example of Lynch syndrome testing in newly diagnosed cases of colorectal cancer and cascade testing in relatives. We synthesize existing information in a framework for future multilevel research for integrating genomic medicine into the cancer care continuum.

Implementation and spread of interventions into the multilevel context of routine practice and policy: implications for the cancer care continuum

The promise of widespread implementation of efficacious interventions across the cancer continuum into routine practice and policy has yet to be realized. Multilevel influences, such as communities and families surrounding patients or health-care policies and organizations surrounding provider teams, may determine whether effective interventions are successfully implemented. Greater recognition of the importance of these influences in advancing (or hindering) the impact of single-level interventions has motivated the design and testing of multilevel interventions designed to address them. However, implementing research evidence from single- or multilevel interventions into sustainable routine practice and policy presents substantive challenges. Furthermore, relatively few multilevel interventions have been conducted along the cancer care continuum, and fewer still have been implemented, disseminated, or sustained in practice. The purpose of this chapter is, therefore, to illustrate and examine the concepts underlying the implementation and spread of multilevel interventions into routine practice and policy. We accomplish this goal by using a series of cancer and noncancer examples that have been successfully implemented and, in some cases, spread widely. Key concepts across these examples include the importance of phased implementation, recognizing the need for pilot testing, explicit engagement of key stakeholders within and between each intervention level; visible and consistent leadership and organizational support, including financial and human resources; better understanding of the policy context, fiscal climate, and incentives underlying implementation; explication of handoffs from researchers to accountable individuals within and across levels; ample integration of multilevel theories guiding implementation and evaluation; and strategies for long-term monitoring and sustainability.

Implementation of automated reporting of estimated glomerular filtration rate among Veterans Affairs laboratories: a retrospective study

BACKGROUND

Automated reporting of estimated glomerular filtration rate (eGFR) is a recent advance in laboratory information technology (IT) that generates a measure of kidney function with chemistry laboratory results to aid early detection of chronic kidney disease (CKD). Because accurate diagnosis of CKD is critical to optimal medical decision-making, several clinical practice guidelines have recommended the use of automated eGFR reporting. Since its introduction, automated eGFR reporting has not been uniformly implemented by U. S. laboratories despite the growing prevalence of CKD. CKD is highly prevalent within the Veterans Health Administration (VHA), and implementation of automated eGFR reporting within this integrated healthcare system has the potential to improve care. In July 2004, the VHA adopted automated eGFR reporting through a system-wide mandate for software implementation by individual VHA laboratories. This study examines the timing of software implementation by individual VHA laboratories and factors associated with implementation.

METHODS

We performed a retrospective observational study of laboratories in VHA facilities from July 2004 to September 2009. Using laboratory data, we identified the status of implementation of automated eGFR reporting for each facility and the time to actual implementation from the date the VHA adopted its policy for automated eGFR reporting. Using survey and administrative data, we assessed facility organizational characteristics associated with implementation of automated eGFR reporting via bivariate analyses.

RESULTS

Of 104 VHA laboratories, 88% implemented automated eGFR reporting in existing laboratory IT systems by the end of the study period. Time to initial implementation ranged from 0.2 to 4.0 years with a median of 1.8 years. All VHA facilities with on-site dialysis units implemented the eGFR software (52%, p<0.001). Other organizational characteristics were not statistically significant.

CONCLUSIONS

The VHA did not have uniform implementation of automated eGFR reporting across its facilities. Facility-level organizational characteristics were not associated with implementation, and this suggests that decisions for implementation of this software are not related to facility-level quality improvement measures. Additional studies on implementation of laboratory IT, such as automated eGFR reporting, could identify factors that are related to more timely implementation and lead to better healthcare delivery.

Determinants of successful clinical networks: the conceptual framework and study protocol

Background

Clinical networks are increasingly being viewed as an important strategy for increasing evidence-based practice and improving models of care, but success is variable and characteristics of networks with high impact are uncertain. This study takes advantage of the variability in the functioning and outcomes of networks supported by the Australian New South Wales (NSW) Agency for Clinical Innovation's non-mandatory model of clinical networks to investigate the factors that contribute to the success of clinical networks.

Methods/Design

The objective of this retrospective study is to examine the association between external support, organisational and program factors, and indicators of success among 19 clinical networks over a three-year period (2006-2008). The outcomes (health impact, system impact, programs implemented, engagement, user perception, and financial leverage) and explanatory factors will be collected using a web-based survey, interviews, and record review. An independent expert panel will provide judgements about the impact or extent of each network's initiatives on health and system impacts. The ratings of the expert panel will be the outcome used in multivariable analyses. Following the rating of network success, a qualitative study will be conducted to provide a more in-depth examination of the most successful networks.

Discussion

This is the first study to combine quantitative and qualitative methods to examine the factors that contribute to the success of clinical networks and, more generally, is the largest study of clinical networks undertaken. The adaptation of expert panel methods to rate the impacts of networks is the methodological innovation of this study. The proposed project will identify the conditions that should be established or encouraged by agencies developing clinical networks and will be of immediate use in forming strategies and programs to maximise the effectiveness of such networks.

Using Improvement Science to Promote Evidence-Based Practice in a Childhood Cancer and Hematology Center

A major children’s cancer and hematology center established a Quality Transformation (QT) Core to develop and monitor empirical outcomes that demonstrate excellence in clinical care. The QT Core, based on the Institute of Medicine’s domains of quality health care, aims to ensure that care is safe, effective, patient centered, timely, efficient, and equitable. Specific goals for the first year of the QT Core were to develop a team of improvement science experts, engage faculty and staff in QT initiatives, promote accountability for excellence in clinical care, and establish specific metrics to evaluate process, structure, and outcomes for QT Core projects. The purpose of this article is to discuss the successful development of a quality transformation core within a pediatric subspecialty and demonstrate the principles of improvement science through an actual quality transformation project designed to implement an evidence-based guideline for procedural sedation for children with cancer. The QT Core within this subspecialty was founded on principles of successful transformation of patient care that includes motivation to change, leaders committed to quality, active engagement of staff in meaningful problem-solving initiatives, alignment with organization goals with resource allocation, and integration to bridge boundaries throughout an organization. These key principles are demonstrated through the discussion of the development of the QT Core and implementation of an evidence-based procedure sedation guideline. Pediatric and pediatric subspecialty groups can be on the forefront of national initiatives that promote quality health care, exemplified by the QT Core developed within the cancer and hematology center.