Multilevel impacts of a pediatric early warning system in resource-limited pediatric oncology hospitals

Fontes L, López Facundo NA, López Vázquez CB, Lozano Lozano IM, Mijares Tobias JM, Mora Robles LN, Noriega Acuña B, Endo Marques FP, Pérez Fermín CK, Quijano Lievano ML, Ribeiro Pereira Aguiar De Paula A, Rios L, Rivera J, Sahonero MA, Salas Mendoza B, Sánchez‐Martín M, Sepúlveda Ramírez J, Soto Chávez V, Velásquez Cabrera DM, Villanueva Hoyos EE, Zuñiga Quijano LY, Devidas M, Rodriguez‐Galindo C, for the Escala de Valoracion de Alerta Temprana Study Group. Multilevel mortality risk factors among pediatric hematology-oncology patients with deterioration

BACKGROUND

Hospitalized pediatric hematology-oncology patients have frequent clinical deterioration events (CDEs) requiring intensive care unit (ICU) interventions and resulting in high mortality, particularly in resource-limited settings. This study identifies independent risk factors for CDE mortality in hospitals providing childhood cancer care in Latin America and Spain.

METHODS

Centers implemented a prospective CDE registry, defined as unplanned transfer to a higher level of care, use of ICU-level interventions on the ward, or nonpalliative ward death. The authors analyzed registry data from April 2017 to December 2022. The primary outcome was CDEs mortality, defined as death occurring during ICU admission, <24 hours of ICU discharge, or end of ward-based ICU interventions. Multilevel modeling identified event-, patient-, and hospital-level independent risk factors for CDE mortality.

RESULTS

Among 69 participating hospitals in 18 countries, 4134 CDEs were reported in 3319 pediatric hematology-oncology patients with an event mortality of 26.8% (1108 events). Of all CDEs, 33.7% used ICU interventions on the ward and 87.5% were transferred to a higher level of care. In multilevel modeling, significant independent risk factors for event mortality present at the start of deterioration included patient (disease relapse) and event (e.g., reason for hospital admission, use of ICU intervention on wards, abnormal lactate, platelets, or C-reactive protein, reason for deterioration, and number of organs with dysfunction); hospital factors were not significant predictors of mortality.

CONCLUSIONS

Hospitalized pediatric hematology-oncology patients with CDE have high mortality with significant variability across centers. Mortality, however, is largely driven by modifiable event-level factors, demonstrating the need for targeted interventions to improve survival.

Connecting Clinical Capacity and Intervention Sustainability in Resource-Variable Pediatric Oncology Centers in Latin America

Clinical capacity for sustainability, or the clinical resources needed to sustain an evidence-based practice, represent proximal determinants that contribute to intervention sustainment. We examine the relationship between clinical capacity for sustainability and sustainment of PEWS, an evidence-based intervention to improve outcomes for pediatric oncology patients in resource-variable hospitals. We conducted a cross-sectional survey among Latin American pediatric oncology centers participating in Proyecto Escala de Valoración de Alerta Temprana (EVAT), an improvement collaborative to implement Pediatric Early Warning Systems (PEWS). Hospitals were eligible if they had completed PEWS implementation. Clinicians were eligible to participate if they were involved in PEWS implementation or used PEWS in clinical work. The Spanish language survey consisted of 56 close and open-ended questions about the respondent, hospital, participants' assessment of clinical capacity to sustain PEWS using the clinical sustainability assessment tool (CSAT), and perceptions about PEWS and its use as an intervention. Results were analyzed using a multi-level modeling approach to examine the relationship between individual, hospital, intervention, and clinical capacity determinants to PEWS sustainment. A total of 797 responses from 37 centers in 13 countries were included in the analysis. Eighty-seven percent of participants reported PEWS sustainment. After controlling for individual, hospital, and intervention factors, clinical capacity was significantly associated with PEWS sustainment (OR 3.27, p < .01). Marginal effects from the final model indicate that an increasing capacity score has a positive influence (11% for every additional CSAT point) of predicting PEWS sustainment. PEWS is a sustainable intervention and clinical capacity to sustain PEWS contributes meaningfully to PEWS sustainment.

Sustainability determinants of an intervention to identify clinical deterioration and improve childhood cancer survival in Latin American hospitals: the INSPIRE study protocol

BACKGROUND

More than 90% of children with cancer live in low-resourced settings, where survival is only 20%. Sustainable evidence-based (EB) interventions yielding ongoing beneficial patient outcomes are critical to improve childhood cancer survival. A better understanding of factors promoting intervention sustainability in these settings is urgently needed. The aim of this study is to provide an empirical understanding of how clinical capacity for sustainability, or the resources needed to sustain an intervention, impacts the sustainment of Pediatric Early Warning System (PEWS), an EB intervention that improves pediatric oncology outcomes in low-resource hospitals by detecting clinical deterioration and preventing the need for more intense treatment.

METHODS

We will conduct a prospective, longitudinal study of approximately 100 resource-variable hospitals implementing and sustaining PEWS participating in Proyecto EVAT, a quality improvement collaborative of Latin American pediatric oncology centers. Aim 1: We will evaluate how clinical capacity for sustainability changes over time through 5 to 9 prospective measurements of capacity via survey of clinical staff using PEWS (approximately n = 13 per center) during the phases of PEWS adoption, implementation, and sustainability using the Clinical Sustainability Assessment Tool (CSAT). Aim 2: We will determine the relationship between capacity and a) PEWS sustainment and b) clinical deterioration mortality among pediatric oncology patients at centers sustaining PEWS for 2 to 10 years using chart review and an existing patient outcomes registry. Aim 3: We will develop novel strategies to promote sustainability by gaining a deeper understanding of perceived challenges to building capacity and PEWS sustainment. In combination with quantitative outcomes, we will conduct 24 focus groups with staff (doctors, nurses, and administrators) from hospitals with both high (n = 4) and low capacity (n = 4). We will then use implementation mapping to generate theoretically driven, empirically-supported sustainability strategies.

DISCUSSION

This study will advance implementation science by providing a theoretically driven, foundational understanding of factors that predict sustainability among a large, diverse cohort of hospitals. We will then use this knowledge to develop sustainability evidence-informed strategies that optimize capacity and promote long-term sustainment of PEWS and improvements in patient outcomes, thus promoting equity in childhood cancer care globally.

Treatment-related mortality in children with cancer in low-income and middle-income countries: a systematic review and meta-analysis

BACKGROUND

Approximately 90% of children with cancer live in low-income and middle-income countries (LMICs), where 5-year survival is lower than 20%. Treatment-related mortality in high-income countries is approximately 3-5%; however, in LMICs, treatment-related mortality has been reported in up to 45% of children with cancer. This study aimed to systematically explore the burden of treatment-related mortality in children with cancer in LMICs and to explore the association between country income level and treatment-related mortality.

METHODS

For this systematic review and meta-analysis we identified articles published between Jan 1, 2010, and June 22, 2021, describing treatment-related mortality in paediatric patients (aged 0-21 years) with cancer in LMICs. We searched PubMed, Trip, Web of Science, Embase, and the WHO Global Metric Index databases. The search was limited to full-text articles and excluded case reports (<10 patients) and haematopoietic stem-cell transplantation recipients. Two reviewers independently screened studies for eligibility, extracted data from included publications, and evaluated data quality. Random and mixed-effects models were used to estimate treatment-related mortality burden and trends. The Cochran-Q statistic was used to assess heterogeneity between studies. This study is registered on PROSPERO (CRD42021264849).

FINDINGS

Of 13 269 identified abstracts, 501 studies representing 68 351 paediatric patients with cancer were included. The treatment-related mortality estimate was 6·82% (95% CI 5·99-7·64), accounting for 30·9% of overall mortality (4437 of 14 358 deaths). Treatment-related mortality was inversely related to country income. Treatment-related mortality was 14·19% (95% CI 9·65-18·73) in low-income countries, 9·21% (7·93-10·49) in lower-middle-income countries, and 4·47% (3·42-5·53) in upper-middle-income countries (Cochran-Q 42·39, p<0·0001). In upper-middle-income countries, the incidence of treatment-related mortality decreased over time (slope -0·002, p=0·0028); however, outcomes remained unchanged in low-income (p=0·21) and lower-middle-income countries (p=0·16).

INTERPRETATION

Approximately one in 15 children receiving cancer treatment in LMICs die from treatment-related complications. Although treatment-related mortality has decreased in upper-middle-income countries over time, it remains unchanged in LMICs. There is an urgent need for targeted supportive care interventions to reduce global disparities in childhood cancer survival.

FUNDING

American Lebanese Syrian Associated Charities and National Cancer Institute.

Effect of paediatric early warning systems (PEWS) implementation on clinical deterioration event mortality among children with cancer in resource-limited hospitals in Latin America: a prospective, multicentre cohort study

BACKGROUND

Paediatric early warning systems (PEWS) aid in the early identification of clinical deterioration events in children admitted to hospital. We aimed to investigate the effect of PEWS implementation on mortality due to clinical deterioration in children with cancer in 32 resource-limited hospitals across Latin America.

METHODS

Proyecto Escala de Valoración de Alerta Temprana (Proyecto EVAT) is a quality improvement collaborative to implement PEWS in hospitals providing childhood cancer care. In this prospective, multicentre cohort study, centres joining Proyecto EVAT and completing PEWS implementation between April 1, 2017, and May 31, 2021, prospectively tracked clinical deterioration events and monthly inpatient-days in children admitted to hospital with cancer. De-identified registry data reported between April 17, 2017, and Nov 30, 2021, from all hospitals were included in analyses; children with limitations on escalation of care were excluded. The primary outcome was clinical deterioration event mortality. Incidence rate ratios (IRRs) were used to compare clinical deterioration event mortality before and after PEWS implementation; multivariable analyses assessed the correlation between clinical deterioration event mortality and centre characteristics.

FINDINGS

Between April 1, 2017, and May 31, 2021, 32 paediatric oncology centres from 11 countries in Latin America successfully implemented PEWS through Proyecto EVAT; these centres documented 2020 clinical deterioration events in 1651 patients over 556 400 inpatient-days. Overall clinical deterioration event mortality was 32·9% (664 of 2020 events). The median age of patients with clinical deterioration events was 8·5 years (IQR 3·9-13·2), and 1095 (54·2%) of 2020 clinical deterioration events were reported in male patients; data on race or ethnicity were not collected. Data were reported per centre for a median of 12 months (IQR 10-13) before PEWS implementation and 18 months (16-18) after PEWS implementation. The mortality rate due to a clinical deterioration event was 1·33 events per 1000 patient-days before PEWS implementation and 1·09 events per 1000 patient-days after PEWS implementation (IRR 0·82 [95% CI 0·69-0·97]; p=0·021). In the multivariable analysis of centre characteristics, higher clinical deterioration event mortality rates before PEWS implementation (IRR 1·32 [95% CI 1·22-1·43]; p<0·0001), being a teaching hospital (1·18 [1·09-1·27]; p<0·0001), not having a separate paediatric haematology-oncology unit (1·38 [1·21-1·57]; p<0·0001), and having fewer PEWS omissions (0·95 [0·92-0·99]; p=0·0091) were associated with a greater reduction in clinical deterioration event mortality after PEWS implementation; no association was found with country income level (IRR 0·86 [95% CI 0·68-1·09]; p=0·22) or clinical deterioration event rates before PEWS implementation (1·04 [0·97-1·12]; p=0·29).

INTERPRETATION

PEWS implementation was associated with reduced clinical deterioration event mortality in paediatric patients with cancer across 32 resource-limited hospitals in Latin America. These data support the use of PEWS as an effective evidence-based intervention to reduce disparities in global survival for children with cancer.

FUNDING

American Lebanese Syrian Associated Charities, US National Institutes of Health, and Conquer Cancer Foundation.

TRANSLATIONS

For the Spanish and Portuguese translations of the abstract see Supplementary Materials section.

Stages of change: Strategies to promote use of a Pediatric Early Warning System in resource-limited pediatric oncology centers

BACKGROUND

Pediatric Early Warning Systems (PEWS) assist early detection of clinical deterioration in hospitalized children with cancer. Relevant to successful PEWS implementation, the "stages of change" model characterizes stakeholder support for PEWS based on willingness and effort to adopt the new practice.

METHODS

At five resource-limited pediatric oncology centers in Latin America, semi-structured interviews were conducted with 71 hospital staff involved in PEWS implementation. Purposive sampling was used to select centers requiring variable time to complete PEWS implementation, with low-barrier centers (3-4 months) and high-barrier centers (10-11 months). Interviews were conducted in Spanish, professionally transcribed, and translated into English. Thematic content analysis explored "stage of change" with constant comparative analysis across stakeholder types and study sites.

RESULTS

Participants identified six interventions (training, incentives, participation, evidence, persuasion, and modeling) and two policies (environmental planning and mandates) as effective strategies used by implementation leaders to promote stakeholder progression through stages of change. Key approaches involved presentation of evidence demonstrating PEWS effectiveness, persuasion and incentives addressing specific stakeholder interests, enthusiastic individuals serving as models for others, and policies enforced by hospital directors facilitating habitual PEWS use. Effective engagement targeted hospital directors during early implementation phases to provide programmatic legitimacy for clinical staff.

CONCLUSION

This study identifies strategies to promote adoption and maintained use of PEWS, highlighting the importance of tailoring implementation strategies to the motivations of each stakeholder type. These findings can guide efforts to implement PEWS and other evidence-based practices that improve childhood cancer outcomes in resource-limited hospitals.

Challenges to sustainability of pediatric early warning systems (PEWS) in low-resource hospitals in Latin America

Background

Sustainability, or continued use of evidence-based interventions for long-term patient benefit, is the least studied aspect of implementation science. In this study, we evaluate sustainability of a Pediatric Early Warning System (PEWS), an evidence-based intervention to improve early identification of clinical deterioration in hospitalized children, in low-resource settings using the Clinical Capacity for Sustainability Framework (CCS).

Methods

We conducted a secondary analysis of a qualitative study to identify barriers and enablers to PEWS implementation. Semi-structured interviews with PEWS implementation leaders and hospital directors at 5 Latin American pediatric oncology centers sustaining PEWS were conducted virtually in Spanish from June to August 2020. Interviews were recorded, professionally transcribed, and translated into English. Exploratory thematic content analysis yielded staff perceptions on PEWS sustainability. Coded segments were analyzed to identify participant perception about the current state and importance of sustaining PEWS, as well as sustainability successes and challenges. Identified sustainability determinants were mapped to the CCS to evaluate its applicability.

Results

We interviewed 71 staff including physicians (45%), nurses (45%), and administrators (10%). Participants emphasized the importance of sustaining PEWS for continued patient benefits. Identified sustainability determinants included supportive leadership encouraging ongoing interest in PEWS, beneficial patient outcomes enhancing perceived value of PEWS, integrating PEWS into the routine of patient care, ongoing staff turnover creating training challenges, adequate material resources to promote PEWS use, and the COVID-19 pandemic. While most identified factors mapped to the CCS, COVID-19 emerged as an additional external sustainability challenge. Together, these challenges resulted in multiple impacts on PEWS sustainment, ranging from a small reduction in PEWS quality to complete disruption of PEWS use and subsequent loss of benefits to patients. Participants described several innovative strategies to address identified challenges and promote PEWS sustainability.

Conclusion

This study describes clinician perspectives on sustainable implementation of evidence-based interventions in low-resource settings, including sustainability determinants and potential sustainability strategies. Identified factors mapped well to the CCS, however, external factors, such as the COVID pandemic, may additionally impact sustainability. This work highlights an urgent need for theoretically-driven, empirically-informed strategies to support sustainable implementation of evidence-based interventions in settings of all resource-levels.