How and under what circumstances do quality improvement collaboratives lead to better outcomes? A systematic review

Call for Action to Target Interhospital Variation in Cardiovascular Mortality, Readmissions, and Length-of-Stay: Results of a National Population Analysis

BACKGROUND

Excessive interhospital variation threatens healthcare quality. Data on variation in patient outcomes across the whole cardiovascular spectrum are lacking. We aimed to examine interhospital variability for 28 cardiovascular All Patient Refined-Diagnosis-related Groups (APR-DRGs).

METHODS

We studied 103,299 cardiovascular admissions in 99 (98%) Belgian acute-care hospitals between 2012 and 2018. Using generalized linear mixed models, we estimated hospital-specific and APR-DRG-specific risk-standardized rates for in-hospital mortality, 30-day readmissions, and length-of-stay above the APR-DRG-specific 90th percentile. Interhospital variation was assessed based on estimated variance components and time trends between the 2012-2014 and 2016-2018 periods were examined.

RESULTS

There was strong evidence of interhospital variation, with statistically significant variation across the 3 outcomes for 5 APR-DRGs after accounting for patient and hospital factors: percutaneous cardiovascular procedures with acute myocardial infarction, heart failure, hypertension, angina pectoris, and arrhythmia. Medical diagnoses, with in particular hypertension, heart failure, angina pectoris, and cardiac arrest, showed strongest variability, with hypertension displaying the largest median odds ratio for mortality (2.51). Overall, hospitals performing at the upper-quartile level should achieve improvements to the median level, and an annual 633 deaths, 322 readmissions, and 1578 extended hospital stays could potentially be avoided.

CONCLUSIONS

Analysis of interhospital variation highlights important outcome differences that are not explained by known patient or hospital characteristics. Targeting variation is therefore a promising strategy to improve cardiovascular care. Considering their treatment in multidisciplinary teams, policy makers, and managers should prioritize heart failure, hypertension, cardiac arrest, and angina pectoris improvements by targeting guideline implementation outside the cardiology department.

Impact of Medical Oncology-Focused Quality Programs on Cancer Care Around the World

Quality cancer care is efficient, accessible, coordinated, and evidence-based. Recognizing the necessary key components, development of pathways and guidelines to incorporate these key domains, and finally respectful adaptation to cultural differences can ensure that cancer care globally is of the highest quality. This quality care should be judged not only on how it optimizes health outcomes for patients, but also its impact on the care providers and the global community.

Quality improvement collaborative approach to COVID-19 pandemic preparedness in long-term care homes: a mixed-methods implementation study

BACKGROUND

The devastating impact of the COVID-19 pandemic on long-term care (LTC) homes underscores the importance of effective pandemic preparedness and response. This mixed-methods, implementation science study investigated how a virtual-based quality improvement (QI) collaborative approach can improve uptake of pandemic-related promising practices and shared learning across six LTC homes in British Columbia, Canada in 2021 during the COVID-19 pandemic health emergency.

METHODS

QI teams consisting of residents, family/informal caregivers, care providers and leadership in LTC homes are supported by QI facilitation and shared learning through virtual communication platforms. QI projects address gaps in outbreak preparation, prevention and response; planning for care; staffing; and family presence. Thematically analysed semi-structured qualitative interviews and a validated questionnaire on organisational readiness investigated participants' perceptions of challenges, success factors and benefits of participating in the virtual QI collaborative approach.

RESULTS

Nine themes were identified through interview analysis, including two related to challenges (ie, making time for QI and hands tied by external forces), four regarding factors for successes (ie, team buy-in, working together as a team, bringing together diverse perspectives and facilitators keep us on track) and three on the benefits of the QI collaborative approach (ie, seeing improvements, staff empowerment and appetite for change). Continuous QI facilitation and coaching for QI teams was feasible and sustainable virtually via video conferencing (Zoom). The QI team members showed limited engagement on the virtual communication platform (Slack), which was predominantly used by the implementation science team and QI facilitators to coordinate the study and QI projects, respectively.

CONCLUSIONS

The virtual-based QI collaborative approach to pandemic preparedness supported LTC homes to rapidly and successfully form multidisciplinary QI teams, learn about QI methods and conduct timely QI projects to implement promising practice for improved COVID-19 pandemic response.

Collaborative implementation of an evidence-based package of integrated primary mental healthcare using quality improvement within a learning health systems approach: Lessons from the Mental health INTegration programme in South Africa

Introduction

The treatment gap for mental health disorders persists in low- and middle-income countries despite overwhelming evidence of the efficacy of task-sharing mental health interventions. Key barriers in the uptake of these innovations include the absence of policy to support implementation and diverting of staff from usual routines in health systems that are already overstretched. South Africa enjoys a conducive policy environment; however, strategies for operationalizing the policy ideals are lacking. This paper describes the Mental health INTegration Programme (MhINT), which adopted a health system strengthening approach to embed an evidence-based task-sharing care package for depression to integrate mental health care into chronic care at primary health care (PHC).

Methods

The MhINT care package consisting of psycho-education talks, nurse-led mental health assessment, and a structured psychosocial counselling intervention provided by lay counsellors was implemented in Amajuba district in KwaZulu-Natal over a 2-year period. A learning health systems approach was adopted, using continuous quality improvement (CQI) strategies to facilitate embedding of the intervention.MhINT was implemented along five phases: the project phase wherein teams to drive implementation were formed; the diagnostic phase where routinely collected data were used to identify system barriers to integrated mental health care; the intervention phase consisting of capacity building and using Plan-Do-Study-Act cycles to address implementation barriers and the impact and sustaining improvement phases entailed assessing the impact of the program and initiation of system-level interventions to sustain and institutionalize successful change ideas.

Results

Integrated planning and monitoring were enabled by including key mental health service indicators in weekly meetings designed to track the performance of noncommunicable diseases and human immunovirus clinical programmes. Lack of standardization in mental health screening prompted the validation of a mental health screening tool and testing feasibility of its use in centralized screening stations. A culture of collaborative problem-solving was promoted through CQI data-driven learning sessions. The province-level screening rate increased by 10%, whilst the district screening rate increased by 7% and new patients initiated to mental health treatment increased by 16%.

Conclusions

The CQI approach holds promise in facilitating the attainment of integrated mental health care in resource-scarce contexts. A collaborative relationship between researchers and health system stakeholders is an important strategy for facilitating the uptake of evidence-based innovations. However, the lack of interventions to address healthcare workers' own mental health poses a threat to integrated mental health care at PHC.

How social networks influence the local implementation of initiatives developed in quality improvement collaboratives in health care: A qualitative process study

BACKGROUND

Quality improvement collaboratives (QICs) have facilitated cross-organizational knowledge exchange in health care. However, the local implementation of many quality improvement (QI) initiatives continues to fail, signaling a need to better understand the contributing factors. Organizational context, particularly the role of social networks in facilitating or hindering implementation within organizations, remains a potentially critical yet underexplored area to addressing this gap.

PURPOSE

We took a dynamic process perspective to understand how QI project managers' social networks influence the local implementation of QI initiatives developed through QICs.

METHODOLOGY

We explored the case of a QIC by triangulating data from an online survey, semistructured interviews, and archival documents from 10 organizations. We divided implementation into four stages and employed qualitative text analysis to examine the relationship between three characteristics of network structure (degree centrality, network density, and betweenness centrality) and the progress of each QI initiative.

RESULTS

The progress of QI initiatives varied considerably among organizations. The transition between stages was influenced by all three network characteristics to varying degrees, depending on the stage. Project managers whose QI initiatives progressed to advanced stages of implementation had formed ad hoc clusters of colleagues passionate about the initiatives.

CONCLUSION

Implementing QI initiatives appears to be facilitated by the formation of clusters of supportive individuals within organizations; this formation requires high betweenness centrality and high network density.

PRACTICE IMPLICATIONS

Flexibly modifying specific network characteristics depending on the stage of implementation may help project managers advance their QI initiatives, achieving more uniform results from QICs.

Virtual quality improvement collaborative with primary care practices during COVID-19: a case study within a clinically integrated network

INTRODUCTION

Quality improvement collaboratives (QICs) are a common approach to facilitate practice change and improve care delivery. Attention to QIC implementation processes and outcomes can inform best practices for designing and delivering collaborative content. In partnership with a clinically integrated network, we evaluated implementation outcomes for a virtual QIC with independent primary care practices delivered during COVID-19.

METHODS

We conducted a longitudinal case study evaluation of a virtual QIC in which practices participated in bimonthly online meetings and monthly tailored QI coaching sessions from July 2020 to June 2021. Implementation outcomes included: (1) level of engagement (meeting attendance and poll questions), (2) QI capacity (assessments completed by QI coaches), (3) use of QI tools (plan-do-check-act (PDCA) cycles started and completed) and (4) participant perceptions of acceptability (interviews and surveys).

RESULTS

Seven clinics from five primary care practices participated in the virtual QIC. Of the seven sites, five were community health centres, three were in rural counties and clinic size ranged from 1 to 7 physicians. For engagement, all practices had at least one member attend all online QIC meetings and most (9/11 (82%)) poll respondents reported meeting with their QI coach at least once per month. For QI capacity, practice-level scores showed improvements in foundational, intermediate and advanced QI work. For QI tools used, 26 PDCA cycles were initiated with 9 completed. Most (10/11 (91%)) survey respondents were satisfied with their virtual QIC experience. Twelve interviews revealed additional themes such as challenges in obtaining real-time data and working with multiple electronic medical record systems.

DISCUSSION

A virtual QIC conducted with independent primary care practices during COVID-19 resulted in high participation and satisfaction. QI capacity and use of QI tools increased over 1 year. These implementation outcomes suggest that virtual QICs may be an attractive alternative to engage independent practices in QI work.

Motivational drivers for health professionals in a large quality improvement collaborative project in Brazil: a qualitative study

BACKGROUND

The success of collaborative quality improvement (QI) projects in healthcare depends on the context and engagement of health teams; however, the factors that modulate teams' motivation to participate in these projects are still unclear. The objective of the current study was to explore the barriers to and facilitators of motivation; the perspective was health professionals in a large project aiming to implement evidence-based infection prevention practices in intensive care units of Brazilian hospitals.

METHODS

This qualitative study was based on content analysis of semistructured in-depth interviews held with health professionals who participated in a collaborative QI project named "Improving patient safety on a large scale in Brazil". In accordance with the principle of saturation, we selected a final sample of 12 hospitals located throughout the five regions of Brazil that have implemented QI; then, we conducted videoconference interviews with 28 health professionals from those hospitals. We encoded the interview data with NVivo software, and the interrelations among the data were assessed with the COM-B model.

RESULTS

The key barriers identified were belief that improvement increases workload, lack of knowledge about quality improvement, resistance to change, minimal involvement of physicians, lack of supplies, lack support from senior managers and work overload. The primary driver of motivation was tangible outcomes, as evidenced by a decrease in infections. Additionally, factors such as the active participation of senior managers, teamwork, learning in practice and understanding the reason for changes played significant roles in fostering motivation.

CONCLUSION

The motivation of health professionals to participate in collaborative QI projects is driven by a variety of barriers and facilitators. The interactions between the senior manager, quality improvement teams, and healthcare professionals generate attitudes that modulate motivation. Thus, these aspects should be considered during the implementation of such projects. Future research could explore the cost-effectiveness of motivational approaches.

Engaging health care professionals in quality improvement: A qualitative study exploring the synergies between projects of professionalisation and institutionalisation in quality improvement collaborative implementation in Denmark

OBJECTIVE

To examine the projects of professionalisation and institutionalisation forming health care professions' engagement in quality improvement collaborative (QIC) implementation in Denmark, and to analyse the synergies and tensions between the two projects given the opportunities afforded by the QICs.

METHODS

This was a cross-sectional interview study with professionals involved in the implementation of two national QICs in Denmark involving 23 individual interviews and focus group discussions with 75 people representing different professional groups. We conducted a reflexive thematic analysis of the data, drawing on institutional contributions to organisational studies of professions.

RESULTS

Study participants engaged widely in QIC implementation. This engagement was formed by a constructive interplay between the professions' projects of professionalisation and institutionalisation, with only few tensions identified. The project of professionalisation relates to a self-oriented agenda of contributing professional expertise and promoting professional recognition and development, while the project of institutionalisation focuses on improving health care processes and outcomes and advancing quality improvement. Both projects were largely similar across professional groups. The interplay between the two projects was enabled by the bottom-up approach to implementation, participation of QI specialists, and a clear focus on developing and delivering high-quality patient care.

CONCLUSIONS

Future strategies for QIC implementation should position QICs as a framework that promotes the integration of professions' projects of professionalisation and institutionalisation to successfully engage professionals in the implementation process, and thereby optimise the effectiveness of QICs in health care.

Barriers to and enablers of quality improvement in primary health care in low- and middle-income countries: A systematic review

The quality of health care remains generally poor across primary health care settings, especially in low- and middle-income countries where tertiary care tends to take up much of the limited resources despite primary health care being the first (and often the only) point of contact with the health system for nearly 80 per cent of people in these countries. Evidence is needed on barriers and enablers of quality improvement initiatives. This systematic review sought to answer the question: What are the enablers of and barriers to quality improvement in primary health care in low- and middle-income countries? It adopted an integrative review approach with narrative evidence synthesis, which combined qualitative and mixed methods research studies systematically. Using a customized geographic search filter for LMICs developed by the Cochrane Collaboration, Scopus, Academic Search Ultimate, MEDLINE, CINAHL, PSYCHINFO, EMBASE, ProQuest Dissertations and Overton.io (a new database for LMIC literature) were searched in January and February 2023, as were selected websites and journals. 7,077 reports were retrieved. After removing duplicates, reviewers independently screened titles, abstracts and full texts, performed quality appraisal and data extraction, followed by analysis and synthesis. 50 reports from 47 studies were included, covering 52 LMIC settings. Six themes related to barriers and enablers of quality improvement were identified and organized using the model for understanding success in quality (MUSIQ) and the consolidated framework for implementation research (CFIR). These were: microsystem of quality improvement, intervention attributes, implementing organization and team, health systems support and capacity, external environment and structural factors, and execution. Decision makers, practitioners, funders, implementers, and other stakeholders can use the evidence from this systematic review to minimize barriers and amplify enablers to better the chances that quality improvement initiatives will be successful in resource-limited settings. PROSPERO registration: CRD42023395166.

Decision-maker roles in healthcare quality improvement projects: a scoping review

OBJECTIVES

Evidence suggests that healthcare quality improvement (QI) projects are more successful when decision-makers are involved in the process. However, guidance regarding the engagement of decision-makers in QI projects is lacking. We conducted a scoping review to identify QI projects involving decision-makers published in the literature and to describe the roles decision-makers played.

METHODS

Following the Joanna Briggs Institute framework for scoping reviews, we systematically searched for all types of studies in English or French between 2002 and 2023 in: EMBASE, MEDLINE via PubMed, PsycINFO, and the Cumulative Index to Nursing and Allied Health Literature. Criteria for inclusion consisted of literature describing health sector QI projects that involved local, regional or system-level decision-makers. Descriptive analysis was performed. Drawing on QI and participatory research literature, the research team developed an inductive data extraction grid to provide a portrait of QI project characteristics, decision-makers' contributions, and advantages and challenges associated with their involvement.

RESULTS

After screening and review, we retained 29 references. 18 references described multi-site projects and 11 were conducted in single sites. Local decision-makers' contributions were documented in 27 of the 29 references and regional decision-makers' contributions were documented in 12. Local decision-makers were more often active participants in QI processes, contributing toward planning, implementation, change management and capacity building. Regional decision-makers more often served as initiators and supporters of QI projects, contributing toward strategic planning, recruitment, delegation, coordination of local teams, as well as assessment and capacity building. Advantages of decision-maker involvement described in the retained references include mutual learning, frontline staff buy-in, accountability, resource allocation, effective leadership and improved implementation feasibility. Considerations regarding their involvement included time constraints, variable supervisory expertise, issues concerning centralised leadership, relationship strengthening among stakeholders, and strategic alignment of frontline staff and managerial priorities CONCLUSIONS: This scoping review provides important insights into the various roles played by decision-makers, the benefits and challenges associated with their involvement, and identifies opportunities for strengthening their engagement. The results of this review highlight the need for practical collaboration and communication strategies that foster partnership between frontline staff and decision-makers at all levels.

Distributed leadership in health quality improvement collaboratives

BACKGROUND AND PURPOSE

Distributed leadership has been suggested for describing patterns of influence in collaborative settings where public services are performed across professions and organizations. This study explores how leadership in health quality improvement collaboratives (QICs) is characterized by aligned distributed leadership practices, and how these practices relate with experienced progress and achievements in the quality improvement (QI) work.

METHODS

The analysis relied on a qualitative, multicase study of two nationwide Danish QICs. Data consisted of 12 single-person and 21 group interviews with local QI teams and local and regional QIC coordinators (85 informants in total), participant observations of 34 meetings within the QICs, and a collection of documentary material. The collected data were analyzed thematically with NVivo.

RESULTS

Leadership practices in local QI teams are characterized by aligned distributed leadership, with leadership activities being widely distributed based on negotiated, emergent practices regarding the aims, roles, and scope of the QI work. However, local quality coordinators play a pivotal role in driving the QI activities, and hierarchical support from hospital/municipal management is a precondition for the contribution of aligned distributed leadership to experienced progress and QIs.

PRACTICE IMPLICATIONS

Emergent distributed leadership should be balanced by thorough consolidation of the practices to provide the best circumstances for robust QI. The active participation of formal managers and local coordinators plays a pivotal role in this consolidation and is decisive for the increased potential for long-term success and sustainability of the QI work, particularly within complex QICs.

Implementing the QUALI-DEC project in Argentina, Burkina Faso, Thailand and Viet Nam: a process delineation and theory-driven process evaluation protocol

The project 'Quality Decision-making by women and providers' (QUALI-DEC) combines four non-clinical interventions to promote informed decision-making surrounding mode of birth, improve women's birth experiences, and reduce caesarean sections among low-risk women. QUALI-DEC is currently being implemented in 32 healthcare facilities across Argentina, Burkina Faso, Thailand, and Viet Nam. In this paper, we detail implementation processes and the planned process evaluation, which aims to assess how and for whom QUALI-DEC worked, the mechanisms of change and their interactions with context and setting; adaptations to intervention and implementation strategies, feasibility of scaling-up, and cost-effectiveness of the intervention. We developed a project theory of change illustrating how QUALI-DEC might lead to impact. The theory of change, together with on the ground observations of implementation processes, guided the process evaluation strategy including what research questions and perspectives to prioritise. Main data sources will include: 1) regular monitoring visits in healthcare facilities, 2) quantitative process and output indicators, 3) a before and after cross-sectional survey among post-partum women, 4) qualitative interviews with all opinion leaders, and 5) qualitative interviews with postpartum women and health workers in two healthcare facilities per country, as part of a case study approach. We foresee that the QUALI-DEC process evaluation will generate valuable information that will improve interpretation of the effectiveness evaluation. At the policy level, we anticipate that important lessons and methodological insights will be drawn, with application to other settings and stakeholders looking to implement complex interventions aiming to improve maternal and newborn health and wellbeing.Trial registration: ISRCTN67214403.

What are the features of high-performing quality improvement collaboratives? A qualitative case study of a state-wide collaboratives programme

OBJECTIVES

Despite their widespread use, the evidence base for the effectiveness of quality improvement collaboratives remains mixed. Lack of clarity about 'what good looks like' in collaboratives remains a persistent problem. We aimed to identify the distinctive features of a state-wide collaboratives programme that has demonstrated sustained improvements in quality of care in a range of clinical specialties over a long period.

DESIGN

Qualitative case study involving interviews with purposively sampled participants, observations and analysis of documents.

SETTING

The Michigan Collaborative Quality Initiatives programme.

PARTICIPANTS

38 participants, including clinicians and managers from 10 collaboratives, and staff from the University of Michigan and Blue Cross Blue Shield of Michigan.

RESULTS

We identified five features that characterised success in the collaboratives programme: learning from positive deviance; high-quality coordination; high-quality measurement and comparative performance feedback; careful use of motivational levers; and mobilising professional leadership and building community. Rigorous measurement, securing professional leadership and engagement, cultivating a collaborative culture, creating accountability for quality, and relieving participating sites of unnecessary burdens associated with programme participation were all important to high performance.

CONCLUSIONS

Our findings offer valuable learning for optimising collaboration-based approaches to improvement in healthcare, with implications for the design, structure and resourcing of quality improvement collaboratives. These findings are likely to be useful to clinicians, managers, policy-makers and health system leaders engaged in multiorganisational approaches to improving quality and safety.

"Diving in the deep-end and swimming": a mixed methods study using normalization process theory to evaluate a learning collaborative approach for the implementation of palliative care practices in hemodialysis centers

BACKGROUND

Normalization Process Theory (NPT) is an implementation theory that can be used to explain how and why implementation strategies work or not in particular circumstances. We used it to understand the mechanisms that lead to the adoption and routinization of palliative care within hemodialysis centers.

METHODS

We employed a longitudinal, mixed methods approach to comprehensively evaluate the implementation of palliative care practices among ten hemodialysis centers participating in an Institute for Healthcare Improvement Breakthrough- Series learning collaborative. Qualitative methods included longitudinal observations of collaborative activities, and interviews with implementers at the end of the study. We used an inductive and deductive approach to thematic analysis informed by NPT constructs (coherence, cognitive participation, collective action, reflexive monitoring) and implementation outcomes. The NoMAD survey, which measures NPT constructs, was completed by implementers at each hemodialysis center during early and late implementation.

RESULTS

The four mechanisms posited in NPT had a dynamic and layered relationship during the implementation process. Collaborative participants participated because they believed in the value and legitimacy of palliative care for patients receiving hemodialysis and thus had high levels of cognitive participation at the start. Didactic Learning Sessions were important for building practice coherence, and sense-making was solidified through testing new skills in practice and first-hand observation during coaching visits by an expert. Collective action was hampered by limited time among team members and practical issues such as arranging meetings with patients. Reflexive monitoring of the positive benefit to patient and family experiences was key in shifting mindsets from disease-centric towards a patient-centered model of care. NoMAD survey scores showed modest improvement over time, with collective action having the lowest scores.

CONCLUSIONS

NPT was a useful framework for understanding the implementation of palliative care practices within hemodialysis centers. We found a nonlinear relationship among the mechanisms which is reflected in our model of implementation of palliative care practices through a learning collaborative. These findings suggest that the implementation of complex practices such as palliative care may be more successful through iterative learning and practice opportunities as the mechanisms for change are layered and mutually reinforcing.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT04125537 . Registered 14 October 2019 - Retrospectively registered.

"If you work alone on this project, you can't reach your target": unpacking the leader's role in well-performing teams in a maternal and neonatal quality improvement programme in South Africa, before and during COVID-19

The South African National Department of Health developed a quality improvement (QI) programme to reduce maternal and neonatal mortality and still births. The programme was implemented between 2018 and 2022 in 21 purposively selected public health facilities. We conducted a process evaluation to describe the characteristics and skills of the QI team leaders of well-performing teams. The evaluation was conducted in 15 of the 21 facilities. Facilities were purposively selected and comprised semi-structured interviews with leaders at three time points; reviewing of QI documentation; and 37 intermittently conducted semi-structured interviews with the QI advisors, being QI technical experts who supported the teams. These interviews focused on participants' experiences and perceptions of how the teams performed, and performance barriers and enablers. Thematic data analysis was conducted using Atlas.ti. Variation in team performance was associated with leaders' attributes and skills. However, the COVID-19 pandemic also affected team functioning. Well-performing teams had leaders who effectively navigated COVID-19 and other challenges, who embraced QI and had sound QI skills. These leaders cultivated trust by taking responsibility for failures, correcting members' mistakes in encouraging ways, and setting high standards of care. Moreover, they promoted programme ownership among members by delegating tasks. Given the critical role leaders play in team performance and thus in the outcomes of QI programmes, efforts should focus on leader selection, training, and support.

Closing the equity gap as we move to the elimination of seclusion: Early results from a national quality improvement project

OBJECTIVE

Use of seclusion within mental health inpatient facilities is harmful for consumers and staff, but it is still used in many Aotearoa New Zealand and Australian facilities, at higher, inequitable rates for the indigenous populations of both countries. We report early results from a national programme to eliminate seclusion in mental health services in Aotearoa New Zealand, using a bicultural approach to reduce inequity for Māori.

METHOD

The 'Zero Seclusion: Safety and dignity for all' programme, with programme teams nationwide, developed a co-designed bicultural change package combining Māori cultural and Western clinical interventions, incorporating quality improvement methodologies. Outcome measures included seclusion rates, duration, and average number of episodes per person admitted, by ethnicity, with a focus on equity.

RESULTS

Nationally, rates of seclusion for Māori reduced from the 12-month (to August 2019) baseline mean monthly rate of 7.5% to 6.8%, sustained from late 2020 to September 2022. The duration of seclusion for Māori reduced by 33% (4.5 h at baseline to 3.0).

CONCLUSION

A focus on inequity for Māori in use of seclusion, and a bicultural approach with cultural and clinical interventions, has been associated with a national reduction in rates and duration of seclusion for Māori.

Did the Acute Frailty Network improve outcomes for older people living with frailty? A staggered difference-in-difference panel event study

OBJECTIVES

To evaluate whether the Acute Frailty Network (AFN) was more effective than usual practice in supporting older people living with frailty to return home from hospital sooner and healthier.

DESIGN

Staggered difference-in-difference panel event study allowing for differential effects across intervention cohorts.

SETTING

All English National Health Service (NHS) acute hospital sites.

PARTICIPANTS

All 1 410 427 NHS patients aged 75+ with high frailty risk who had an emergency hospital admission to acute, general or geriatric medicine departments between 1 January 2012 and 31 March 2019.

INTERVENTION

Membership of the AFN, a quality improvement collaborative designed to support acute hospitals in England deliver evidence-based care for older people with frailty. 66 hospital sites joined the AFN in six sequential cohorts, the first starting in January 2015, the sixth in May 2018. Usual care was delivered in the remaining 248 control sites.

MAIN OUTCOME MEASURES

Length of hospital stay, in-hospital mortality, institutionalisation, hospital readmission.

RESULTS

No significant effects of AFN membership were found for any of the four outcomes nor were there significant effects for any individual cohort.

CONCLUSIONS

To realise its aims, the AFN might need to develop better resourced intervention and implementation strategies.

Mixed methods study protocol for combining stakeholder-led rapid evaluation with near real-time continuous registry data to facilitate evaluations of quality of care in intensive care units

Background

Improved access to healthcare in low- and middle-income countries (LMICs) has not equated to improved health outcomes. Absence or unsustained quality of care is partly to blame. Improving outcomes in intensive care units (ICUs) requires delivery of complex interventions by multiple specialties working in concert, and the simultaneous prevention of avoidable harms associated with the illness and the treatment interventions. Therefore, successful design and implementation of improvement interventions requires understanding of the behavioural, organisational, and external factors that determine care delivery and the likelihood of achieving sustained improvement. We aim to identify care processes that contribute to suboptimal clinical outcomes in ICUs located in LMICs and to establish barriers and enablers for improving the care processes.

Methods

Using rapid evaluation methods, we will use four data collection methods: 1) registry embedded indicators to assess quality of care processes and their associated outcomes; 2) process mapping to provide a preliminary framework to understand gaps between current and desired care practices; 3) structured observations of processes of interest identified from the process mapping and; 4) focus group discussions with stakeholders to identify barriers and enablers influencing the gap between current and desired care practices. We will also collect self-assessments of readiness for quality improvement. Data collection and analysis will be led by local stakeholders, performed in parallel and through an iterative process across eight countries: Kenya, India, Malaysia, Nepal, Pakistan, South Africa, Uganda and Vietnam.

Conclusions

The results of our study will provide essential information on where and how care processes can be improved to facilitate better quality of care to critically ill patients in LMICs; thus, reduce preventable mortality and morbidity in ICUs. Furthermore, understanding the rapid evaluation methods that will be used for this study will allow other researchers and healthcare professionals to carry out similar research in ICUs and other health services.

What factors influence a Quality Improvement Collaborative in improving contraceptive services for foreign-born women? A qualitative study in Sweden

BACKGROUND

Improved contraceptive services could reduce the unmet need for contraception and unintended pregnancies globally. This is especially true among foreign-born women in high-income countries, as the health outcomes related to unmet need of contraception disproportionally affect this group. A widely used quality improvement approach to improve health care services is Quality Improvement Collaborative (QIC). However, evidence on to what extent, how and why it is effective and what factors influence a QIC in different healthcare contexts is limited. The purpose of this study was to analyse what factors have influenced a successful QIC intervention that is aimed to improve contraceptive service in postpartum care, mainly targeting foreign-born women in Sweden.

METHODS

A qualitative, deductive design was used, guided by the Consolidated Framework for Implementation Research (CFIR). The study triangulated secondary data from four learning seminars as part of the QIC, with primary interview data with four QIC-facilitators. The QIC involved midwives at three maternal health clinics in Stockholm County, Sweden, 2018-2019.

RESULTS

Factors from all five CFIR domains were identified, however, the majority of factors that influenced the QIC were found inside the QIC-setting, in three domains: intervention characteristics, inner setting and process. Outside factors and those related to individuals were less influential. A favourable learning climate, emphasizing co-creation and mutual learning, facilitated reflections among the participating midwives. The application of the QIC was facilitated by adaptability, trialability, and a motivated and skilled project team. Our study further suggests that the QIC was complex because it required a high level of engagement from the midwives and facilitators. Additionally, it was challenging due to unclear roles and objectives in the initial phases.

CONCLUSIONS

The application of the CFIR framework identified crucial factors influencing the success of a QIC in contraceptive services in a high-income setting. These factors highlight the importance of establishing a learning climate characterised by co-creation and mutual learning among the participating midwives as well as the facilitators. Furthermore, to invest in planning and formation of the project group during the QIC initiation; and to ensure adaptability and trialability of the improvement activities.

Sustaining extended Kangaroo mother care in stable low birthweight babies in NICU: a quality improvement collaborative of six centres of Karnataka

BACKGROUND

Kangaroo mother care (KMC) is a proven intervention for intact survival in preterms. Despite evidence, its adoption has been low. We used a point of care quality improvement (QI) approach to implement and sustain KMC in stable low birthweight babies from a baseline of 1.5 hours/baby/day to above 4 hours/baby/day through a series of plan-do-study-act (PDSA) cycles over a period of 53 weeks.

METHODS

All babies with birth weight <2000 g not on any respiratory support or phototherapy and or umbilical lines were eligible. The key quantitative outcome was KMC hours/baby/day. A QI collaborative was formed between six centres of Karnataka mentored by a team with a previous QI experience on KMC. The potential barriers for extended KMC were evaluated using fishbone analysis. Baseline data were collected over 3 weeks. A bundled approach consisting of a variety of parent centric measures (such as staff awareness, making KMC an integral part of treatment order, foster KMC, awareness sessions to parents weekly, recognising KMC champions) was employed in multiple PDSA cycles. The data were aggregated biweekly and the teams shared their implementation experiences monthly.

RESULTS

A total of 1443 parent-baby dyads were enrolled. The majority barriers were similar across the centres. Bundled approach incorporating foster KMC helped in the quick implementation of KMC even in outborns. Parental involvement and empowering nurses helped in sustaining KMC. Two centres had KMC rates above 10 hours/baby/day, while remaining four centres had KMC rates sustained above 6 hours/baby/day. Cross-learnings from team meetings helped to sustain efforts. Extended KMC could be implemented and sustained by low intensity training and QI collaboration.

CONCLUSIONS

Formation of a QI collaborative with mentoring helped in scaling implementation of extended KMC. Extended KMC could be implemented by parent centric best practices in all the centres without any additional need of resources.

Developing an understanding of networks with a focus on LMIC health systems: How and why clinical and programmatic networks form and function to be able to change practices: A realist review

Networks are an increasingly employed approach to improve quality of care, service delivery, and health systems performance, particularly in low-and-middle income country (LMIC) health systems. The literature shows that networks can improve the provision and quality of services and health system functioning but there is limited evidence explaining how and why networks are established and work to achieve their reported results. We undertook a realist review to explore this. The objective of this realist review was to develop a programme theory outlining the underlying mechanisms and interactions of contexts that explain how and why a network's set-up and function enable high-quality care and services and improved clinical outcomes in LMIC health systems. We followed Pawson's five steps for realist reviews. The search strategy was based on a previously published scoping review with additional searches. Literature was selected based on its relevance to the programme theory and rigour. Context-mechanism-outcome configurations were developed from the extracted data to refine the initial programme theory with causal explanations. Theories on social movements and organisations supported the identification of mechanism and brought additional explanatory power to the programme theory. The programme theory explains how networks are initiated, formed, and function in a way that sets them up for network leadership and committed, engaged, and motivated network members to emerge and to change practices, which may lead to improved quality of care, service delivery, and clinical outcomes through the following phases: identify a problem, developing a collective vision, taking action to solve the problem, forming purposeful relationships, linkages, and partnerships, building a network identity and culture, and the creation of a psychological safe space. This deeper understanding of networks formation and functioning can lead to a more considered planning and implementation of networks, thereby improving health system functioning and performance.

Implementing medication adherence interventions in four Dutch living labs; context matters

BACKGROUND

Despite the abundant availability of effective medication adherence interventions, uptake of these interventions into routine care often lacks. Examples of effective medication adherence interventions include telephone counseling, consult preparation and the teach-back method. Assessing context is an important step in understanding implementation success of interventions, but context is often not reported or only moderately described. This study aims to describe context-specific characteristics in four living labs prior to the implementation of evidence-based interventions aiming to improve medication adherence.

METHODS

A qualitative study was conducted within four living labs using individual interviews (n = 12) and focus groups (n = 4) with project leaders and involved healthcare providers. The four living labs are multidisciplinary collaboratives that are early adopters of medication adherence interventions in the Dutch primary care system. Context is defined as the environment or setting in which the proposed change is to be implemented. Interview topics to assess context were formulated based on the 'inner setting' and 'outer setting' domains of the Consolidated Framework for Implementation Research (CFIR). Interviews were recorded and transcribed verbatim. Transcripts were deductively analyzed.

RESULTS

A total of 39 community pharmacists, pharmacy technicians, general practitioners and a home care employee participated in the (focus group) interviews. All four living labs proved to be pharmacy-driven and characterized by a high regard for innovation by staff members, a positive implementation climate, high levels of leadership engagement and high compatibility between the living labs and the interventions. Two living labs were larger in size and characterized by more formal communication. Two living labs were characterized by higher levels of cosmopolitanism which resulted in more adaptable interventions. Worries about external policy, most notably lack of reimbursement for sustainment and upscaling of the interventions, were shared among all living labs.

CONCLUSIONS

Contextual characteristics of four living labs that are early adopters of medication adherence interventions provide detailed examples of a positive implementation setting. These can be used to inform dissemination of medication adherence interventions in settings less experienced in implementing medication adherence interventions.

A cluster randomised controlled trial, process and economic evaluation of quality improvement collaboratives aligned to a national audit to improve the care for people with diabetes (EQUIPD): study protocol

BACKGROUND

People with type 1 diabetes and raised glucose levels are at greater risk of retinopathy, nephropathy, neuropathy, cardiovascular disease, sexual health problems and foot disease. The UK National Institute for Health and Care Excellence (NICE) recommends continuous subcutaneous 'insulin pump' therapy for people with type 1 diabetes whose HbA1c is above 69 mmol/mol. Insulin pump use can improve quality of life, cut cardiovascular risk and increase treatment satisfaction. About 90,000 people in England and Wales meet NICE criteria for insulin pumps but do not use one. Insulin pump use also varies markedly by deprivation, ethnicity, sex and location. Increasing insulin pump use is a key improvement priority. Audit and feedback is a common but variably effective intervention. Limited capabilities of healthcare providers to mount effective responses to feedback from national audits, such as the National Diabetes Audit (NDA), undermines efforts to improve care. We have co-developed a theoretically and empirically informed quality improvement collaborative (QIC) to strengthen local responses to feedback with patients and carers, national audits and healthcare providers. We will evaluate whether the QIC improves the uptake of insulin pumps following NDA feedback.

METHODS

We will undertake an efficient cluster randomised trial using routine data. The QIC will be delivered alongside the NDA to specialist diabetes teams in England and Wales. Our primary outcome will be the proportion of people with type 1 diabetes and an HbA1c above 69 mmol/mol who start and continue insulin pump use during the 18-month intervention period. Secondary outcomes will assess change in glucose control and duration of pump use. Subgroup analyses will explore impacts upon inequalities by ethnicity, sex, age and deprivation. A theory-informed process evaluation will explore diabetes specialist teams' engagement, implementation, fidelity and tailoring through observations, interviews, surveys and documentary analysis. An economic evaluation will micro-cost the QIC, estimate cost-effectiveness of NDA feedback with QIC and estimate the budget impact of NHS-wide QIC roll out.

DISCUSSION

Our study responds to a need for more head-to-head trials of different ways of reinforcing feedback delivery. Our findings will have implications for other large-scale audit and feedback programmes.

TRIAL REGISTRATION

ISRCTN82176651 Registered 18 October 2022.

From purists to pragmatists: a qualitative evaluation of how implementation processes and contexts shaped the uptake and methodological adaptations of a maternal and neonatal quality improvement programme in South Africa prior to, and during COVID-19

BACKGROUND

Despite progress, maternal and neonatal mortality and still births remain high in South Africa. The South African National Department of Health implemented a quality improvement (QI) programme, called Mphatlalatsane, to reduce maternal and neonatal mortality and still births. It was implemented in 21 public health facilities, seven per participating province, between 2018 and 2022.

METHODS

We conducted a qualitative process evaluation of the contextual and implementation process factors' influence on implementation uptake amongst the QI teams in 15 purposively selected facilities. Data collection included three interview rounds with the leaders and members of the QI teams in each facility; intermittent interviews with the QI advisors; programme documentation review; observation of programme management meetings; and keeping a fieldwork journal. All data were thematically analysed in Atlas.ti. Implementation uptake varied across the three provinces and between facilities within provinces.

RESULTS

Between March and August 2020, the COVID-19 pandemic disrupted uptake in all provinces but affected QI teams in one province more severely than others, because they received limited pre-pandemic training. Better uptake among other sites was attributed to receiving more QI training pre-COVID-19, having an experienced QI advisor, and good teamwork. Uptake was more challenging amongst hospital teams which had more staff and more complicated MNH services, versus the primary healthcare facilities. We also attributed better uptake to greater district management support. A key factor shaping uptake was leaders' intrinsic motivation to apply QI methodology. We found that, across sites, organic adaptations to the QI methodology were made by teams, started during COVID-19. Teams did away with rapid testing of change ideas and keeping a paper trail of the steps followed. Though still using data to identify service problems, they used self-developed audit tools to record intervention effectiveness, and not the prescribed tools.

CONCLUSIONS

Our study underscores the critical role of intrinsic motivation of team leaders, support from experienced technical QI advisors, and context-sensitive adaptations to maximise QI uptake when traditionally recognised QI steps cannot be followed.

Connecting the science and practice of implementation - applying the lens of context to inform study design in implementation research

The saying "horses for courses" refers to the idea that different people and things possess different skills or qualities that are appropriate in different situations. In this paper, we apply the analogy of "horses for courses" to stimulate a debate about how and why we need to get better at selecting appropriate implementation research methods that take account of the context in which implementation occurs. To ensure that implementation research achieves its intended purpose of enhancing the uptake of research-informed evidence in policy and practice, we start from a position that implementation research should be explicitly connected to implementation practice. Building on our collective experience as implementation researchers, implementation practitioners (users of implementation research), implementation facilitators and implementation educators and subsequent deliberations with an international, inter-disciplinary group involved in practising and studying implementation, we present a discussion paper with practical suggestions that aim to inform more practice-relevant implementation research.

Behaviour change, the itchy spot of healthcare quality improvement: How can psychology theory and skills help to scratch the itch?

Despite the clear utility and transferability, National Health Service (NHS) quality improvement initiatives have yet to benefit fully from what is already known within health psychology. Thus far, evidence from established, seminal behaviour change theory and practice have been ignored in favour of newly developed models and frameworks. Further, whilst there is a growing interest in what is commonly referred to as 'human factors' of change and improvement, there is scant transferability of known psychologically informed implementation skills into routine NHS Improvement practice. The science and practice of healthcare improvement is growing, and the behaviour change aspect is critical to sustainable outcomes. Therefore, this paper offers practical guidance on how seminal psychological behaviour change theory and motivational interviewing (a person-centred skills-based approach specifically developed to support people through change) can be combined to better address individual and organisational change within a healthcare improvement context.

'The objective was about not blaming one another': a qualitative study to explore how collaboration is experienced within quality improvement collaboratives in Ethiopia

BACKGROUND

Quality improvement collaboratives are a common approach to improving quality of care. They rely on collaboration across and within health facilities to enable and accelerate quality improvement. Originating in high-income settings, little is known about how collaboration transfers to low-income settings, despite the widespread use of these collaboratives.

METHOD

We explored collaboration within quality improvement collaboratives in Ethiopia through 42 in-depth interviews with staff of two hospitals and four health centers and three with quality improvement mentors. Data were analysed thematically using a deductive and inductive approach.

RESULTS

There was collaboration at learning sessions though experience sharing, co-learning and peer pressure. Respondents were used to a blaming environment, which they contrasted to the open and non-blaming environment at the learning sessions. Respondents formed new relationships that led to across facility practical support. Within facilities, those in the quality improvement team continued to collaborate through the plan-do-study-act cycles, although this required high engagement and support from mentors. Few staff were able to attend learning sessions and within facility transfer of quality improvement knowledge was rare. This affected broader participation and led to some resentment and resistance. Improved teamwork skills and behaviors occurred at individual rather than facility or systems level, with implications for sustainability. Challenges to collaboration included unequal participation, lack of knowledge transfer, high workloads, staff turnover and a culture of dependency.

CONCLUSION

We conclude that collaboration can occur and is valued within a traditionally hierarchical system, but may require explicit support at learning sessions and by mentors. More emphasis is needed on ensuring quality improvement knowledge transfer, buy-in and system level change. This could include a modified collaborative design to provide facility-level support for spread.

Intensified follow-up of patients with type 1 diabetes and poor glycaemic control: a multicentre quality improvement collaborative based on data from the Norwegian Diabetes Register for Adults

BACKGROUND

Patients with type 1 diabetes mellitus (T1DM) and poor glycaemic control are at high risk of developing microvascular and macrovascular complications. The aim of this study was to determine if a quality improvement collaborative (QIC) initiated by the Norwegian Diabetes Register for adults (NDR-A) could reduce the proportion of patients with T1DM with poor glycaemic control (defined as glycated haemoglobin (HbA1c)≥75 mmol/mol) and reduce mean HbA1c at participating clinics compared with 14 control clinics.

METHOD

Multicentre study with controlled before and after design. Representatives of 13 diabetes outpatient clinics (n=5145 patients with T1DM) in the intervention group attended four project meetings during an 18-month QIC. They were required to identify areas requiring improvement at their clinic and make action plans. Continuous feedback on HbA1c outcomes was provided by NDR-A during the project. In total 4084 patients with type 1 diabetes attended the control clinics.

RESULTS

Between 2016 and 2019, the overall proportion of patients with T1DM and HbA1c≥75 mmol/mol in the intervention group were reduced from 19.3% to 14.1% (p<0.001). Corresponding proportions in the control group were reduced from 17.3% (2016) to 14.4% (2019) (p<0.001). Between 2016 and 2019, overall mean HbA1c decreased by 2.8 mmol/mol (p<0.001) at intervention clinics compared with 2.3 mmol/mol (p<0.001) at control clinics. After adjusting for the baseline differences in glycaemic control, there were no significant differences in the overall improvement in glycaemic control between intervention and control clinics.

CONCLUSIONS

The registry linked QIC did not result in a significantly greater improvement in glycaemic control at intervention clinics compared with control clinics. However, there has been a sustained improvement in glycaemic control and importantly a significant reduction in the proportion of patients with poor glycaemic control at both intervention and control clinics during and after the QIC time frame. It is possible that some of this improvement may be due to a spillover effect from the QIC.

Towards achieving interorganisational collaboration between health-care providers: a realist evidence synthesis

Background

Interorganisational collaboration is currently being promoted to improve the performance of NHS providers. However, up to now, there has, to the best of our knowledge, been no systematic attempt to assess the effect of different approaches to collaboration or to understand the mechanisms through which interorganisational collaborations can work in particular contexts.

Objectives

Our objectives were to (1) explore the main strands of the literature about interorganisational collaboration and to identify the main theoretical and conceptual frameworks, (2) assess the empirical evidence with regard to how different interorganisational collaborations may (or may not) lead to improved performance and outcomes, (3) understand and learn from NHS evidence users and other stakeholders about how and where interorganisational collaborations can best be used to support turnaround processes, (4) develop a typology of interorganisational collaboration that considers different types and scales of collaboration appropriate to NHS provider contexts and (5) generate evidence-informed practical guidance for NHS providers, policy-makers and others with responsibility for implementing and assessing interorganisational collaboration arrangements.

Design

A realist synthesis was carried out to develop, test and refine theories about how interorganisational collaborations work, for whom and in what circumstances.

Data sources

Data sources were gathered from peer-reviewed and grey literature, realist interviews with 34 stakeholders and a focus group with patient and public representatives.

Review methods

Initial theories and ideas were gathered from scoping reviews that were gleaned and refined through a realist review of the literature. A range of stakeholder interviews and a focus group sought to further refine understandings of what works, for whom and in what circumstances with regard to high-performing interorganisational collaborations.

Results

A realist review and synthesis identified key mechanisms, such as trust, faith, confidence and risk tolerance, within the functioning of effective interorganisational collaborations. A stakeholder analysis refined this understanding and, in addition, developed a new programme theory of collaborative performance, with mechanisms related to cultural efficacy, organisational efficiency and technological effectiveness. A series of translatable tools, including a diagnostic survey and a collaboration maturity index, were also developed.

Limitations

The breadth of interorganisational collaboration arrangements included made it difficult to make specific recommendations for individual interorganisational collaboration types. The stakeholder analysis focused exclusively on England, UK, where the COVID-19 pandemic posed challenges for fieldwork.

Conclusions

Implementing successful interorganisational collaborations is a difficult, complex task that requires significant time, resource and energy to achieve the collaborative functioning that generates performance improvements. A delicate balance of building trust, instilling faith and maintaining confidence is required for high-performing interorganisational collaborations to flourish.

Future work

Future research should further refine our theory by incorporating other workforce and user perspectives. Research into digital platforms for interorganisational collaborations and outcome measurement are advocated, along with place-based and cross-sectoral partnerships, as well as regulatory models for overseeing interorganisational collaborations.

Study registration

The study is registered as PROSPERO CRD42019149009.

Funding

This project was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme and will be published in full in Health and Social Care Delivery Research; Vol. 11, No. 6. See the NIHR Journals Library website for further project information.

IMplementing best practice post-partum contraceptive services through a quality imPROVEment initiative for and with immigrant women in Sweden (IMPROVE it): a protocol for a cluster randomised control trial with a process evaluation

BACKGROUND

Immigrant women's challenges in realizing sexual and reproductive health and rights (SRHR) are exacerbated by the lack of knowledge regarding how to tailor post-partum contraceptive services to their needs. Therefore, the overall aim of the IMPROVE-it project is to promote equity in SRHR through improvement of contraceptive services with and for immigrant women, and, thus, to strengthen women's possibility to choose and initiate effective contraceptive methods post-partum.

METHODS

This Quality Improvement Collaborative (QIC) on contraceptive services and use will combine a cluster randomized controlled trial (cRCT) with a process evaluation. The cRCT will be conducted at 28 maternal health clinics (MHCs) in Sweden, that are the clusters and unit of randomization, and include women attending regular post-partum visits within 16 weeks post birth. Utilizing the Breakthrough Series Collaborative model, the study's intervention strategies include learning sessions, action periods, and workshops informed by joint learning, co-design, and evidence-based practices. The primary outcome, women's choice of an effective contraceptive method within 16 weeks after giving birth, will be measured using the Swedish Pregnancy Register (SPR). Secondary outcomes regarding women's experiences of contraceptive counselling, use and satisfaction of chosen contraceptive method will be evaluated using questionnaires completed by participating women at enrolment, 6 and 12 months post enrolment. The outcomes including readiness, motivation, competence and confidence will be measured through project documentation and questionnaires. The project's primary outcome involving women's choice of contraceptive method will be estimated by using a logistic regression analysis. A multivariate analysis will be performed to control for age, sociodemographic characteristics, and reproductive history. The process evaluation will be conducted using recordings from learning sessions, questionnaires aimed at participating midwives, intervention checklists and project documents.

DISCUSSION

The intervention's co-design activities will meaningfully include immigrants in implementation research and allow midwives to have a direct, immediate impact on improving patient care. This study will also provide evidence as to what extent, how and why the QIC was effective in post-partum contraceptive services.

TRIAL REGISTRATION

NCT05521646, August 30, 2022.

How do healthcare providers use national audit data for improvement?

BACKGROUND

Substantial resources are invested by Health Departments worldwide in introducing National Clinical Audits (NCAs). Yet, there is variable evidence on the NCAs' effectiveness and little is known on factors underlying the successful use of NCAs to improve local practice. This study will focus on a single NCA (the National Audit of Inpatient Falls -NAIF 2017) to explore: (i) participants' perspectives on the NCA reports, local feedback characteristics and actions undertaken following the feedback underpinning the effective use of the NCA feedback to improve local practice; (ii) reported changes in local practice following the NCA feedback in England and Wales.

METHODS

Front-line staff perspectives were gathered through interviews. An inductive qualitative approach was used. Eighteen participants were purposefully sampled from 7 of the 85 participating hospitals in England and Wales. Analysis was guided by constant comparative techniques.

RESULTS

Regarding the NAIF annual report, interviewees valued performance benchmarking with other hospitals, the use of visual representations and the inclusion of case studies and recommendations. Participants stated that feedback should target front-line healthcare professionals, be straightforward and focused, and be delivered through an encouraging and honest discussion. Interviewees highlighted the value of using other relevant data sources alongside NAIF feedback and the importance of continuous data monitoring. Participants reported that engagement of front-line staff in the NAIF and following improvement activities was critical. Leadership, ownership, management support and communication at different organisational levels were perceived as enablers, while staffing level and turnover, and poor quality improvement (QI) skills, were perceived as barriers to improvement. Reported changes in practice included increased awareness and attention to patient safety issues and greater involvement of patients and staff in falls prevention activities.

CONCLUSIONS

There is scope to improve the use of NCAs by front-line staff. NCAs should not be seen as isolated interventions but should be fully embedded and integrated into the QI strategic and operational plans of NHS trusts. The use of NCAs could be optimised, but knowledge of them is poor and distributed unevenly across different disciplines. More research is needed to provide guidance on key elements to consider throughout the whole improvement process at different organisational levels.

"Quality teaches you how to use water. It doesn't provide a water pump": a qualitative study of context and mechanisms of action in an Ethiopian quality improvement program

BACKGROUND

Quality improvement collaboratives are a common approach to bridging the quality-of-care gap, but little is known about implementation in low-income settings. Implementers rarely consider mechanisms of change or the role of context, which may explain collaboratives' varied impacts.

METHODS

To understand mechanisms and contextual influences we conducted 55 in-depth interviews with staff from four health centres and two hospitals involved in quality improvement collaboratives in Ethiopia. We also generated control charts for selected indicators to explore any impacts of the collaboratives.

RESULTS

The cross facility learning sessions increased the prominence and focus on quality, allowed learning from experts and peers and were motivational through public recognition of success or a desire to emulate peers. Within facilities, new structures and processes were created. These were fragile and sometimes alienating to those outside the improvement team. The trusted and respected mentors were important for support, motivation and accountability. Where mentor visits were infrequent or mentors less skilled, team function was impacted. These mechanisms were more prominent, and quality improvement more functional, in facilities with strong leadership and pre-existing good teamwork; as staff had shared goals, an active approach to problems and were more willing and able to be flexible to implement change ideas. Quality improvement structures and processes were more likely to be internally driven and knowledge transferred to other staff in these facilities, which reduced the impact of staff turnover and increased buy-in. In facilities which lacked essential inputs, staff struggled to see how the collaborative could meaningfully improve quality and were less likely to have functioning quality improvement. The unexpected civil unrest in one region strongly disrupted the health system and the collaborative. These contextual issues were fluid, with multiple interactions and linkages.

CONCLUSIONS

The study confirms the need to carefully consider context in the implementation of quality improvement collaboratives. Facilities that implement quality improvement successfully may be those that already have characteristics that foster quality. Quality improvement may be alienating to those outside of the improvement team and implementers should not assume the organic spread or transfer of quality improvement knowledge.

Moving from assessments to implementation: promising practices for strengthening multisectoral antimicrobial resistance containment capacity

BACKGROUND

Antimicrobial resistance (AMR) poses a global threat to human, animal, and environmental health. AMR is a technical area in the Global Health Security Agenda initiative which uses the Joint External Evaluation tool to evaluate national AMR containment capacity. This paper describes four promising practices for strengthening national antimicrobial resistance containment capacity based on the experiences of the US Agency for International Development's Medicines, Technologies, and Pharmaceutical Services Program work with 13 countries to implement their national action plans on AMR in the areas of multisectoral coordination, infection prevention and control, and antimicrobial stewardship.

METHODS

We use the World Health Organization (WHO) Benchmarks on International Health Regulations Capacities (2019) to guide national, subnational, and facility actions that advance Joint External Evaluation capacity levels from 1 (no capacity) to 5 (sustainable capacity). Our technical approach is based on scoping visits, baseline Joint External Evaluation scores, benchmarks tool guidance, and country resources and priorities.

RESULTS

We gleaned four promising practices to achieve AMR containment objectives: (1) implement appropriate actions using the WHO benchmarks tool, which prioritizes actions, making it easier for countries to incrementally increase their Joint External Evaluation capacity from level 1 to 5; (2) integrate AMR into national and global agendas. Ongoing agendas and programs at international, regional, and national levels provide opportunities to mainstream and interlink AMR containment efforts; (3) improve governance through multisectoral coordination on AMR. Strengthening multisectoral bodies' and their technical working groups' governance improved functioning, which led to better engagement with animal/agricultural sectors and a more coordinated COVID-19 pandemic response; and (4) mobilize and diversify funding for AMR containment. Long-term funding from diversified funding streams is vital for advancing and sustaining countries' Joint External Evaluation capacities.

CONCLUSIONS

The Global Health Security Agenda work has provided practical support to countries to frame and conduct AMR containment actions in terms of pandemic preparedness and health security. The WHO benchmarks tool that Global Health Security Agenda uses serves as a standardized organizing framework to prioritize capacity-appropriate AMR containment actions and transfer skills to help operationalize national action plans on AMR.

Rise of pediatric surgery collaboratives to facilitate quality improvement

Broad changes in pediatric surgical care delivery are limited by the rarity of pediatric surgical diseases and the geographic dispersion of pediatric surgical care across different hospital types. Pediatric surgical collaboratives and consortiums can provide the patient sample size, research resources, and infrastructure to advance clinical care for children with who require surgery. Additionally, collaboratives can bring together experts and exemplar institutions to overcome barriers to pediatric surgical research to advance quality surgical care. Despite challenges to collaboration, many successful pediatric surgical collaboratives emerged in the last decade and continue to push the field forward towards high-quality, evidence-based care and improved outcomes. This review will discuss the need for continued research and quality improvement collaboratives in pediatric surgery, identify challenges faced when building collaboratives, and introduce future directions to expand impact.

Impact of externally facilitated continuous quality improvement cohorts on Advanced Access to support primary healthcare teams: protocol for a quasi-randomized cluster trial

BACKGROUND

Improving access to primary health care is among top priorities for many countries. Advanced Access (AA) is one of the most recommended models to improve timely access to care. Over the past 15 years, the AA model has been implemented in Canada, but the implementation of AA varies substantially among providers and clinics. Continuous quality improvement (CQI) approaches can be used to promote organizational change like AA implementation. While CQI fosters the adoption of evidence-based practices, knowledge gaps remain, about the mechanisms by which QI happens and the sustainability of the results. The general aim of the study is to analyse the implementation and effects of CQI cohorts on AA for primary care clinics. Specific objectives are: 1) Analyse the process of implementing CQI cohorts to support PHC clinics in their improvement of AA. 2) Document and compare structural organisational changes and processes of care with respect to AA within study groups (intervention and control). 3) Assess the effectiveness of CQI cohorts on AA outcomes. 4) Appreciate the sustainability of the intervention for AA processes, organisational changes and outcomes.

METHODS

Cluster-controlled trial allowing for a comprehensive and rigorous evaluation of the proposed intervention 48 multidisciplinary primary care clinics will be recruited to participate. 24 Clinics from the intervention regions will receive the CQI intervention for 18 months including three activities carried out iteratively until the clinic's improvement objectives are achieved: 1) reflective sessions and problem priorisation; 2) plan-do-study-act cycles; and 3) group mentoring. Clinics located in the control regions will receive an audit-feedback report on access. Complementary qualitative and quantitative data reflecting the quintuple aim will be collected over a period of 36 months.

RESULTS

This research will contribute to filling the gap in the generalizability of CQI interventions and accelerate the spread of effective AA improvement strategies while strengthening local QI culture within clinics. This research will have a direct impact on patients' experiences of care.

CONCLUSION

This mixed-method approach offers a unique opportunity to contribute to the scientific literature on large-scale CQI cohorts to improve AA in primary care teams and to better understand the processes of CQI.

TRIAL REGISTRATION

Clinical Trials: NCT05715151.

Evaluating quality improvement at scale: A pilot study on routine reporting for executive board governance in a UK National Health Service organisation

BACKGROUND

Quality improvement (QI) in healthcare is a cultural transformation process. We explored how routine reporting could be developed to aid visibility of the process for QI governance.

METHOD

A retrospective evaluation of QI projects in a large healthcare organisation was conducted. We used an online survey so that the data accrual process resembled routine reporting to help identify implementation challenges. A purposive sample of QI projects was targeted to maximise contrast between projects that were or were not successful as determined by the resident QI team. To hone strategic focus in what should be reported, we also compared factors that might affect project outcomes.

RESULTS

Out of 52 QI projects, 10 led to a change in routine practice ('adoption'). Details of project outcomes were limited. Project team outcomes, indicative of capacity building, were not systematically documented. Service user involvement, quality of measurement plan, fidelity of plan-do-study-act (PDSA) cycles had a major impact on adoption.

CONCLUSION

Designing a routine reporting framework requires an iterative process to navigate data accrual demands. A retrospective evaluation, as in this study, can yield empirical insights to support development of QI governance, thereby honing the implementation science of QI in a healthcare organisation.

An Approach to Evaluating Multisector Partnerships to Support Evidence-Based Quality Improvement in Primary Care

BACKGROUND

Quality improvement (QI) interventions in primary care are increasingly designed and implemented by multisector partnerships, yet little guidance exists on how to best monitor or evaluate these partnerships. The goal of this project was to describe an approach for evaluating the development and effectiveness of a multisector partnership using data from the first year of the Healthy Hearts for Michigan (HH4M) Cooperative, a multisector partnership of nine organizations tasked with designing and implementing evidence-based QI strategies for hypertension management and tobacco cessation in 50 rural primary care practices.

METHODS

The researchers developed a 49-item online survey focused on factors that facilitate or hinder multisector partnerships, drawing on implementation science and partnership, engagement, and collaboration research. The team surveyed all 44 members of the HH4M Cooperative (79.5% response rate) and conducted interviews with 14 members. The interviews focused on implementation phase-specific goals, accomplishments, and challenges. Descriptive analysis was used for the survey results, and thematic analysis for the interview data.

RESULTS

Respondents reported strong overall performance by the Cooperative during its first year, which facilitated the successful completion of several intervention design tasks. Strengths included having a clear purpose and trust and respect among members. Areas for improvement included a need for common terminology, clarification of roles and functions, and improvement in communication across workgroups. Lack of engagement from physician practices due to capacity constraints, exacerbated by the COVID-19 pandemic, was the Cooperative's biggest challenge.

CONCLUSION

This multimethod approach to evaluating the development and effectiveness of a multisector partnership yielded practical, actionable feedback to program leaders.

Effectiveness of quality improvement collaboratives in UK surgical settings and barriers and facilitators influencing their implementation: a systematic review and evidence synthesis

BACKGROUND

High-quality surgical care is vital to deliver the excellent outcomes patients deserve following surgical treatment. Quality improvement collaboratives (QICs) are based on a multicentre model for improving healthcare. They are increasingly used but their effectiveness in the context of surgical services is unclear. This review assessed effectiveness of QICs in National Health Service (NHS) surgical settings, and identified factors that influenced implementation.

METHODS

A systematic search of MEDLINE and EMBASE, as well as grey literature, was conducted in January 2022 to identify evaluations of QICs in NHS surgical settings. Data were extracted on the intervention, setting, study results and factors that were identified as facilitators or barriers. These were coded using the Consolidated Framework for Implementation Research (CFIR). The quality of study reports was assessed using Quality Improvement Minimum Criteria Set.

RESULTS

Fifteen reports on 10 QICs met inclusion criteria. The evaluations used study designs of different strength, with one using a stepped-wedge randomised controlled trial (RCT). Eight studies reported the QIC had been successful in achieving their principal aims, which covered a mix of patient outcomes and process indicators. The study based on the RCT found the QIC was not successful (no improvement in patient outcomes). Each article reported a range of facilitators and barriers to effectiveness of implementation of the QIC, which were spread across the CFIR domains (intervention, outer setting, inner setting, individuals and process). There were few barriers reported in the intervention domain that related to the QIC. There was no clear relationship between numbers of facilitators and barriers reported and effectiveness.

CONCLUSIONS

Studies have reported QICs to be effective in increasingly complex contexts, but their results must be treated with caution. The evaluations often used weak study designs and the quality of reports was variable. Evaluation with strong study design should be integral to future QICs.

PROSPERO REGISTRATION NUMBER

CRD42022324970.

Implementation through translation: a qualitative case study of translation processes in the implementation of quality improvement collaboratives

BACKGROUND

Quality improvement collaboratives (QICs) are used extensively to implement quality improvement in healthcare, and current research is demonstrating positive yet varying evidence. To interpret the effectiveness results, it is necessary to illuminate the dynamics of QIC implementation in specific contexts. Using Scandinavian institutionalist translation theory as a theoretical framework, this study aims to make two contributions. First, we provide insights into the dynamics of the translation processes inherent in QIC implementation. Second, we discuss the implications of the translation processes as experienced by participating actors.

METHODS

We used empirical data from a qualitative case study investigating the implementation of QICs as an approach to quality improvement within a national Danish healthcare quality program. We included two diverse QICs to allow for exploration of the significance of organizational complexity for the translation processes. Data comprised qualitative interviews, participant observation and documentary material.

RESULTS

Translation was an inherent part of QIC implementation. Key actors at different organizational levels engaged in translation of their implementation roles, and the QIC content and methodology. They drew on different translation strategies and practices that mainly materialized as kinds of modification. The translations were motivated by deliberate, strategic, and pragmatic rationales, contingent on combinations of features of the actors' organizational contexts, and the transformability and organizational complexity of the QICs. The findings point to a transformative power of translation, as different translations led to various regional and local QIC versions. Furthermore, the findings indicate that translation affects the outcomes of the implementation process and the QIC intervention. Translation may positively affect the institutionalization of the QICs and the creation of professional engagement and negatively influence the QIC effects.

CONCLUSION

The findings extends the current research concerning the understanding of the dynamics of the translation processes embedded in the local implementation of QICs, and thus constitute a valuable contribution to a more sustainable and effective implementation of QICs in healthcare improvement. For researchers and practitioners, this highlights translation as an embedded part of the QIC implementation process, and encourages detailed attention to the implications of translation for both organizational institutionalization and realisation of the expected intervention outcomes.

From Pre-Implementation to Institutionalization: Lessons From Sustaining a Perinatal Audit Program in South Africa

INTRODUCTION

Maternal and perinatal death surveillance and response (MPDSR), or related forms of maternal and perinatal death audits, can strengthen health systems. We explore the history of initiating, scaling up, and institutionalizing a national perinatal audit program in South Africa.

METHODS

Data collection involved 56 individual interviews, a systematic document review, administration of a semistructured questionnaire, and 10 nonparticipant observations of meetings related to the perinatal audit program. Fieldwork and data collection in the subdistricts occurred from September 2019 to March 2020. Data analysis included thematic content analysis and application of a tool to measure subdistrict-level implementation. This study expands on case study research applied to 5 Western Cape subdistricts with long histories of implementation.

RESULTS

Although established in the early 1990s, the perinatal audit program was not integrated into national policy and guidelines until 2012 but was then excluded from policy in 2021. A network of national and subnational structures that benefited from a continuity of actors evolved and interacted to support uptake and implementation. Intentional efforts to demonstrate impact and enable local adaptation allowed for more ownership and buy-in. Implementation requires continuous efforts. Even in 5 subdistricts with long histories of practice, we found operational gaps, such as incomplete meeting minutes, signaling a need for strengthening. Nevertheless, the tool used to measure implementation may require revisions, particularly in settings with institutionalized practice.

CONCLUSION

This article provides lessons on how to initiate, expand, and strengthen perinatal audit. Despite a long history of implementation, the perinatal audit program in South Africa cannot be assumed to be indefinitely sustainable or final in its current form. To monitor uptake and sustainability of MPDSR, including perinatal audit, we need research approaches that allow exploration of context, local adaptation, and underlying issues that support sustainability, such as relationships, leadership, and trust.

Mixed methods study protocol for combining stakeholder-led rapid evaluation with near real-time continuous registry data to facilitate evaluations of quality of care in intensive care units

Background: Improved access to healthcare in low- and middle-income countries (LMICs) has not equated to improved health outcomes. Absence or unsustained quality of care is partly to blame. Improving outcomes in intensive care units (ICUs) requires delivery of complex interventions by multiple specialties working in concert, and the simultaneous prevention of avoidable harms associated with the illness and the treatment interventions. Therefore, successful design and implementation of improvement interventions requires understanding of the behavioural, organisational, and external factors that determine care delivery and the likelihood of achieving sustained improvement. We aim to identify care processes that contribute to suboptimal clinical outcomes in ICUs located in LMICs and to establish barriers and enablers for improving the care processes. Methods: Using rapid evaluation methods, we will use four data collection methods: 1) registry embedded indicators to assess quality of care processes and their associated outcomes; 2) process mapping to provide a preliminary framework to understand gaps between current and desired care practices; 3) structured observations of processes of interest identified from the process mapping and; 4) focus group discussions with stakeholders to identify barriers and enablers influencing the gap between current and desired care practices. We will also collect self-assessments of readiness for quality improvement. Data collection and analysis will be performed in parallel and through an iterative process across eight countries: Kenya, India, Malaysia, Nepal, Pakistan, South Africa, Uganda and Vietnam. Conclusions: The results of our study will provide essential information on where and how care processes can be improved to facilitate better quality of care to critically ill patients in LMICs; thus, reduce preventable mortality and morbidity in ICUs. Furthermore, understanding the rapid evaluation methods that will be used for this study will allow other researchers and healthcare professionals to carry out similar research in ICUs and other health services.

Implementing health system improvement: resources and strategies for interprofessional teams

Health system improvement (HSI) is focused on systematic changes to organisational processes and practices to improve the efficient delivery of safe care and quality outcomes. Guidelines that specify how interprofessional teams conduct HSI and knowledge translation are needed. We address this urgent requirement providing health professional teams with resources and strategies to investigate, analyse and implement system-level improvements. HSI encompasses similar, yet different, inter-related activities across a continuum. The continuum spans three categories of activities, such as quality improvement, health management research and translational health management research. A HSI decision making guide and checklist, comprising six-steps, is presented that can be used to select and plan projects. This resource comprises six interconnected steps including, defining the activity, project outcome, aim, use of evidence, appropriate methodology and implementation plan. Each step has been developed focusing on an objective, actions and resources. HSI activities provide a foundation for interprofessional collaboration, allowing multiple professions to create, share and disseminate knowledge for improved healthcare. When planned and executed well, HSI projects assist clinical and corporate staff to make evidence-informed decisions and directions for the benefit of the service, organisation and sector.

Mixed methods study protocol for combining stakeholder-led rapid evaluation with near real-time continuous registry data to facilitate evaluations of quality of care in intensive care units

Background: Improved access to healthcare in low- and middle-income countries (LMICs) has not equated to improved health outcomes. Absence or unsustained quality of care is partly to blame. Improving outcomes in intensive care units (ICUs) requires delivery of complex interventions by multiple specialties working in concert, and the simultaneous prevention of avoidable harms associated with the illness and the treatment interventions. Therefore, successful design and implementation of improvement interventions requires understanding of the behavioural, organisational, and external factors that determine care delivery and the likelihood of achieving sustained improvement. We aim to identify care processes that contribute to suboptimal clinical outcomes in ICUs located in LMICs and to establish barriers and enablers for improving the care processes. Methods: Using rapid evaluation methods, we will use four data collection methods: 1) registry embedded indicators to assess quality of care processes and their associated outcomes; 2) process mapping to provide a preliminary framework to understand gaps between current and desired care practices; 3) structured observations of processes of interest identified from the process mapping and; 4) focus group discussions with stakeholders to identify barriers and enablers influencing the gap between current and desired care practices. We will also collect self-assessments of readiness for quality improvement. Data collection and analysis will be performed in parallel and through an iterative process across eight countries: Kenya, India, Malaysia, Nepal, Pakistan, South Africa, Uganda and Vietnam. Conclusions: The results of our study will provide essential information on where and how care processes can be improved to facilitate better quality of care to critically ill patients in LMICs; thus, reduce preventable mortality and morbidity in ICUs. Furthermore, understanding the rapid evaluation methods that will be used for this study will allow other researchers and healthcare professionals to carry out similar research in ICUs and other health services.

Understanding maternity care providers' use of data in Southern Tanzania

INTRODUCTION

Health information management system data is collected for national planning and evaluation but is rarely used for healthcare improvements at subnational or facility-level in low-and-middle-income countries. Research suggests that perceived data quality and lack of feedback are contributing factors. We aimed to understand maternity care providers' perceptions of data and how they use it, with a view to co-design interventions to improve data quality and use.

METHODS

We based our research on constructivist grounded theory. We conducted 14 in-depth interviews, two focus group discussions with maternity care providers and 48 hours of observations in maternity wards to understand maternity providers' interaction with data in two rural hospitals in Southern Tanzania. Constant comparative data analysis was applied to develop initial and focused codes, subcategories and categories were continuously validated through peer and member checks.

RESULTS

Maternity care providers found routine health information data of little use to reconcile demands from managers, the community and their challenging working environment within their daily work. They thus added informal narrative documentation sources. They created alternative narratives through data of a maternity care where mothers and babies were safeguarded. The resulting documentation system, however, led to duplication and increased systemic complexity.

CONCLUSIONS

Current health information systems may not meet all data demands of maternity care providers, or other healthcare workers. Policy makers and health information system specialists need to acknowledge different ways of data use beyond health service planning, with an emphasis on healthcare providers' data needs for clinical documentation.

Experiences, barriers, and facilitators of health data use among performance monitoring teams (PMT) of health facilities in Eastern Ethiopia: A qualitative study

BACKGROUND

Routine health data is crucial in decision-making and improved health outcomes. Despite the significant investments in improving Ethiopia's Performance Monitoring Team (PMT), there is limited evidence on the involvement, implementation strategies, and facilitators and barriers to data utilization by these teams responding to present and emerging health challenges. Therefore, this study aimed to explore the PMT experiences, facilitators, and barriers to information use in healthcare facilities in Eastern Ethiopia.

METHOD

This study employed a phenomenological study design using the Consolidated Framework for Implementation Research (CFIR) to identify the most relevant constructs, aiming to describe the data use approaches at six facilities in Dire Dawa and Harari regions in July 2021. Key informant interviews were conducted among 18 purposively selected experts using a semi-structured interview guide. Thematic coding analysis was applied using a partially deductive approach informed by previous studies and an inductive technique with the creation of new emerging themes. Data were analyzed thematically using ATLAS.ti.

RESULTS

Study participants felt the primary function of PMT was improving health service delivery. This study also revealed that data quality, performance, service quality, and improvement strategies were among the major focus areas of the PMT. Data use by the PMT was affected by poor data quality, absence of accountability, and lack of recognition for outstanding performance. In addition, the engagement of PMT members on multiple committees negatively impacted data use leading to inadequate follow-up of PMT activities, weariness, and insufficient time to complete responsibilities.

CONCLUSION

Performance monitoring teams in the health facilities were established and functioning according to the national standard. However, barriers to operative data use included PMT engagement with multiple committees, poor data quality, lack of accountability, and poor documentation practices. Addressing the potential barriers by leveraging the PMT and existing structures have the potential to improve data use and health service performance.

Impact of hospital characteristics on implementation of a Pediatric Early Warning System in resource-limited cancer hospitals

Background

Pediatric Early Warning Systems (PEWS) aid in identification of deterioration in hospitalized children with cancer but are underutilized in resource-limited settings. Proyecto EVAT is a multicenter quality improvement (QI) collaborative in Latin America to implement PEWS. This study investigates the relationship between hospital characteristics and time required for PEWS implementation.

Methods

This convergent mixed-methods study included 23 Proyecto EVAT childhood cancer centers; 5 hospitals representing quick and slow implementers were selected for qualitative analysis. Semi-structured interviews were conducted with 71 stakeholders involved in PEWS implementation. Interviews were recorded, transcribed and translated to English, then coded using a priori and novel codes. Thematic content analysis explored the impact of hospital characteristics and QI experience on time required for PEWS implementation and was supplemented by quantitative analysis exploring the relationship between hospital characteristics and implementation time.

Results

In both quantitative and qualitative analysis, material and human resources to support PEWS significantly impacted time to implementation. Lack of resources produced various obstacles that extended time necessary for centers to achieve successful implementation. Hospital characteristics, such as funding structure and type, influenced PEWS implementation time by determining their resource-availability. Prior hospital or implementation leader experience with QI, however, helped facilitate implementation by assisting implementers predict and overcome resource-related challenges.

Conclusions

Hospital characteristics impact time required to implement PEWS in resource-limited childhood cancer centers; however, prior QI experience helps anticipate and adapt to resource challenges and more quickly implement PEWS. QI training should be a component of strategies to scale-up use of evidence-based interventions like PEWS in resource-limited settings.

Association of Tolerance of Uncertainty With Outcomes in a Quality Improvement Collaborative

BACKGROUND

Tolerance of uncertainty may influence how physicians and other providers practice and make clinical decisions. We hypothesized that increased tolerance of uncertainty would be associated with an increased uptake of a quality improvement (QI) intervention.

METHODS

We examined tolerance of uncertainty using the Physicians' Reactions to Uncertainty Scale in the context of a national QI project in the Value in Inpatient Pediatrics network. The QI project aimed to increase exclusive isotonic fluid use and decrease laboratory draws. Exposure to the intervention was measured by using the stepped wedge design with sequential implementation across a diverse group of US hospitals. Multivariable analysis was conducted by using exposure to the intervention and tolerance of uncertainty as independent variables and exclusive isotonic fluid use or laboratory testing as the dependent variable.

RESULTS

Of 106 participating hospitals, 97 contributed valid responses, with an overall mean reported tolerance of uncertainty of 3.39 (95% confidence interval: 3.27-3.50), with lower numbers on the 6-point scale indicating greater tolerance of uncertainty. Exposure to the QI intervention was significantly associated with exclusive isotonic fluid use (P <.001). Lower tolerance of uncertainty at baseline was associated with lower baseline isotonic fluid use and greater uptake of the use of isotonic fluids but not reduction in laboratory testing.

CONCLUSIONS

Contrary to our hypothesis, lower tolerance of uncertainty was associated with greater uptake of the QI intervention for the outcome of isotonic fluids. This initial association warrants further study to evaluate how tolerance of uncertainty plays a role in quality improvement science.

Feasibility, usability and acceptability of a novel digital hybrid-system for reporting of routine maternal health information in Southern Tanzania: A mixed-methods study

Health information systems are important for health planning and progress monitoring. Still, data from health facilities are often of limited quality in Low-and-Middle-Income Countries. Quality deficits are partially rooted in the fact that paper-based documentation is still the norm at facility level, leading to mistakes in summarizing and manual copying. Digitization of data at facility level would allow automatization of these procedural steps. Here we aimed to evaluate the feasibility, usability and acceptability of a scanning innovation called Smart Paper Technology for digital data processing. We used a mixed-methods design to understand users' engagement with Smart Paper Technology and identify potential positive and negative effects of this innovation in three health facilities in Southern Tanzania. Eight focus group discussions and 11 in-depth interviews with users were conducted. We quantified time used by health care providers for documentation and patient care using time-motion methods. Thematic analysis was used to analyze qualitative data. Descriptive statistics and multivariable linear models were generated to compare the difference before and after introduction and adjust for confounders. Health care providers and health care managers appreciated the forms' simple design features and perceived Smart Paper Technology as time-saving and easy to use. The time-motion study with 273.3 and 224.0 hours of observations before and after introduction of Smart Paper Technology, respectively, confirmed that working time spent on documentation did not increase (27.0% at baseline and 26.4% post-introduction; adjusted p = 0.763). Time spent on patient care was not negatively impacted (26.9% at baseline and 37.1% at post-intervention; adjusted p = 0.001). Health care providers described positive effects on their accountability for data and service provision relating to the fact that individually signed forms were filled. Health care providers perceived Smart Paper Technology as feasible, easy to integrate and acceptable in their setting, particularly as it did not add time to documentation.

Learning Collaboratives: a Strategy for Quality Improvement and Implementation in Behavioral Health

Learning collaboratives are increasingly used in behavioral health. They generally involve bringing together teams from different organizations and using experts to educate and coach the teams in quality improvement, implementing evidence-based practices, and measuring the effects. Although learning collaboratives have demonstrated some effectiveness in general health care, the evidence is less clear in behavioral health and more rigorous studies are needed. Learning collaboratives may contain a range of elements, and which elements are included in any one learning collaborative varies widely; the unique contribution of each element has not been established. This commentary seeks to clarify the concept of a learning collaborative, highlight its common elements, review evidence of its effectiveness, identify its application in behavioral health, and highlight recommendations to guide technical assistance purveyors and behavioral health providers as they employ learning collaboratives to improve behavioral health access and quality.