Development and validation of a deep-learning-based pediatric early warning system: A single-center study

External Validation of Deep Learning-Based Cardiac Arrest Risk Management System for Predicting In-Hospital Cardiac Arrest in Patients Admitted to General Wards Based on Rapid Response System Operating and Nonoperating Periods: A Single-Center Study

OBJECTIVES

The limitations of current early warning scores have prompted the development of deep learning-based systems, such as deep learning-based cardiac arrest risk management systems (DeepCARS). Unfortunately, in South Korea, only two institutions operate 24-hour Rapid Response System (RRS), whereas most hospitals have part-time or no RRS coverage at all. This study validated the predictive performance of DeepCARS during RRS operation and nonoperation periods and explored its potential beyond RRS operating hours.

DESIGN

Retrospective cohort study.

SETTING

In this 1-year retrospective study conducted at Yonsei University Health System Severance Hospital in South Korea, DeepCARS was compared with conventional early warning systems for predicting in-hospital cardiac arrest (IHCA). The study focused on adult patients admitted to the general ward, with the primary outcome being IHCA-prediction performance within 24 hours of the alarm.

PATIENTS

We analyzed the data records of adult patients admitted to a general ward from September 1, 2019, to August 31, 2020.

INTERVENTIONS

None.

MEASUREMENTS AND MAIN RESULTS

Performance evaluation was conducted separately for the operational and nonoperational periods of the RRS, using the area under the receiver operating characteristic curve (AUROC) as the metric. DeepCARS demonstrated a superior AUROC as compared with the Modified Early Warning Score (MEWS) and the National Early Warning Score (NEWS), both during RRS operating and nonoperating hours. Although the MEWS and NEWS exhibited varying performance across the two periods, DeepCARS showed consistent performance.

CONCLUSIONS

The accuracy and efficiency for predicting IHCA of DeepCARS were superior to that of conventional methods, regardless of whether the RRS was in operation. These findings emphasize that DeepCARS is an effective screening tool suitable for hospitals with full-time RRS, part-time RRS, and even those without any RRS.

Development of a deep learning model that predicts critical events of pediatric patients admitted to general wards

Early detection of deteriorating patients is important to prevent life-threatening events and improve clinical outcomes. Efforts have been made to detect or prevent major events such as cardiopulmonary resuscitation, but previously developed tools are often complicated and time-consuming, rendering them impractical. To overcome this problem, we designed this study to create a deep learning prediction model that predicts critical events with simplified variables. This retrospective observational study included patients under the age of 18 who were admitted to the general ward of a tertiary children's hospital between 2020 and 2022. A critical event was defined as cardiopulmonary resuscitation, unplanned transfer to the intensive care unit, or mortality. The vital signs measured during hospitalization, their measurement intervals, sex, and age were used to train a critical event prediction model. Age-specific z-scores were used to normalize the variability of the normal range by age. The entire dataset was classified into a training dataset and a test dataset at an 8:2 ratio, and model learning and testing were performed on each dataset. The predictive performance of the developed model showed excellent results, with an area under the receiver operating characteristics curve of 0.986 and an area under the precision-recall curve of 0.896. We developed a deep learning model with outstanding predictive power using simplified variables to effectively predict critical events while reducing the workload of medical staff. Nevertheless, because this was a single-center trial, no external validation was carried out, prompting further investigation.

Automated prediction of cardiorespiratory deterioration in patients with single-ventricle parallel circulation: A multicenter validation study

Objectives

Patients with single-ventricle physiology have a significant risk of cardiorespiratory deterioration between their first- and second-stage palliation surgeries. Detection of deterioration episodes may allow for early intervention and improved outcomes.

Methods

A prospective study was executed at Nationwide Children's Hospital, Children's Hospital of Philadelphia, and Children's Hospital Colorado to collect physiologic data of subjects with single ventricle physiology during all hospitalizations between neonatal palliation and II surgeries using the Sickbay software platform (Medical Informatics Corp). Timing of cardiorespiratory deterioration events was captured via chart review. The predictive algorithm previously developed and validated at Texas Children's Hospital was applied to these data without retraining. Standard metrics such as receiver operating curve area, positive and negative likelihood ratio, and alert rates were calculated to establish clinical performance of the predictive algorithm.

Results

Our cohort consisted of 58 subjects admitted to the cardiac intensive care unit and stepdown units of participating centers over 14 months. Approximately 28,991 hours of high-resolution physiologic waveform and vital sign data were collected using the Sickbay. A total of 30 cardiorespiratory deterioration events were observed. the risk index metric generated by our algorithm was found to be both sensitive and specific for detecting impending events one to two hours in advance of overt extremis (receiver operating curve = 0.927).

Conclusions

Our algorithm can provide a 1- to 2-hour advanced warning for 53.6% of all cardiorespiratory deterioration events in children with single ventricle physiology during their initial postop course as well as interstage hospitalizations after stage I palliation with only 2.5 alarms being generated per patient per day.

Continuous Data-Driven Monitoring in Critical Congenital Heart Disease: Clinical Deterioration Model Development

BACKGROUND

Critical congenital heart disease (cCHD)-requiring cardiac intervention in the first year of life for survival-occurs globally in 2-3 of every 1000 live births. In the critical perioperative period, intensive multimodal monitoring at a pediatric intensive care unit (PICU) is warranted, as their organs-especially the brain-may be severely injured due to hemodynamic and respiratory events. These 24/7 clinical data streams yield large quantities of high-frequency data, which are challenging in terms of interpretation due to the varying and dynamic physiology innate to cCHD. Through advanced data science algorithms, these dynamic data can be condensed into comprehensible information, reducing the cognitive load on the medical team and providing data-driven monitoring support through automated detection of clinical deterioration, which may facilitate timely intervention.

OBJECTIVE

This study aimed to develop a clinical deterioration detection algorithm for PICU patients with cCHD.

METHODS

Retrospectively, synchronous per-second data of cerebral regional oxygen saturation (rSO₂) and 4 vital parameters (respiratory rate, heart rate, oxygen saturation, and invasive mean blood pressure) in neonates with cCHD admitted to the University Medical Center Utrecht, the Netherlands, between 2002 and 2018 were extracted. Patients were stratified based on mean oxygen saturation during admission to account for physiological differences between acyanotic and cyanotic cCHD. Each subset was used to train our algorithm in classifying data as either stable, unstable, or sensor dysfunction. The algorithm was designed to detect combinations of parameters abnormal to the stratified subpopulation and significant deviations from the patient's unique baseline, which were further analyzed to distinguish clinical improvement from deterioration. Novel data were used for testing, visualized in detail, and internally validated by pediatric intensivists.

RESULTS

A retrospective query yielded 4600 hours and 209 hours of per-second data in 78 and 10 neonates for, respectively, training and testing purposes. During testing, stable episodes occurred 153 times, of which 134 (88%) were correctly detected. Unstable episodes were correctly noted in 46 of 57 (81%) observed episodes. Twelve expert-confirmed unstable episodes were missed in testing. Time-percentual accuracy was 93% and 77% for, respectively, stable and unstable episodes. A total of 138 sensorial dysfunctions were detected, of which 130 (94%) were correct.

CONCLUSIONS

In this proof-of-concept study, a clinical deterioration detection algorithm was developed and retrospectively evaluated to classify clinical stability and instability, achieving reasonable performance considering the heterogeneous population of neonates with cCHD. Combined analysis of baseline (ie, patient-specific) deviations and simultaneous parameter-shifting (ie, population-specific) proofs would be promising with respect to enhancing applicability to heterogeneous critically ill pediatric populations. After prospective validation, the current-and comparable-models may, in the future, be used in the automated detection of clinical deterioration and eventually provide data-driven monitoring support to the medical team, allowing for timely intervention.

The use of machine learning and artificial intelligence within pediatric critical care

The field of pediatric critical care has been hampered in the era of precision medicine by our inability to accurately define and subclassify disease phenotypes. This has been caused by heterogeneity across age groups that further challenges the ability to perform randomized controlled trials in pediatrics. One approach to overcome these inherent challenges include the use of machine learning algorithms that can assist in generating more meaningful interpretations from clinical data. This review summarizes machine learning and artificial intelligence techniques that are currently in use for clinical data modeling with relevance to pediatric critical care. Focus has been placed on the differences between techniques and the role of each in the clinical arena. The various forms of clinical decision support that utilize machine learning are also described. We review the applications and limitations of machine learning techniques to empower clinicians to make informed decisions at the bedside. IMPACT: Critical care units generate large amounts of under-utilized data that can be processed through artificial intelligence. This review summarizes the machine learning and artificial intelligence techniques currently being used to process clinical data. The review highlights the applications and limitations of these techniques within a clinical context to aid providers in making more informed decisions at the bedside.

Explainable and efficient deep early warning system for cardiac arrest prediction from electronic health records

Cardiac arrest (CA) is a fatal acute event. The development of new CA early warning system based on time series of vital signs from electronic health records (EHR) has great potential to reduce CA damage. In this process, recursive architecture-based deep learning, as a powerful tool for time series data processing, enables automatically extract features from various monitoring clinical parameters and to further improve the performance for acute critical illness prediction. However, the unexplainable nature and excessive time caused by black box structure with poor parallelism are the limitations of its development, especially in the CA clinical application with strict requirement of emergency treatment and low hidden dangers. In this study, we present an explainable and efficient deep early warning system for CA prediction, which features are captured by an efficient temporal convolutional network (TCN) on EHR clinical parameters sequence and explained by deep Taylor decomposition (DTD) theoretical framework. To demonstrate the feasibility of our method and further evaluate its performance, prediction and explanation experiments were performed. Experimental results show that our method achieves superior CA prediction accuracy compared with standard national early warning score (NEWS), in terms of overall AUROC (0.850 Vs. 0.476) and F1-Score (0.750 Vs. 0.450). Furthermore, our method improves the interpretability and efficiency of deep learning-based CA early warning system. It provides the relevance of prediction results for each clinical parameter and about 1.7 times speed enhancement for system calculation compared with the long short-term memory network.

About gladiators and a sacred disease

In this special edition of the Biomedical Journal the reader gains an insight into drug-resistant epilepsy and according treatment approaches involving deep brain stimulation, the ketogenic diet and fecal microbiota transplant. Another emphasis is put on personalized medicine strategies, and covered in articles about the use of natriuretic peptides against cancer, along with an article about companion diagnostics involving extracellular vesicles. Recurrent infection with Clostridium difficile, associated risk factors and therapeutic options are discussed. We learn about a mechanism that helps Leishmania evade a host control mechanism, receive an update about human adenovirus and are presented with characteristic magnetic resonance neuroimaging in COVID-19 pediatric patients. An advanced assessment in pediatric septic shock and an improved model for a pediatric early warning system are proposed. Some of the genetic causes of renal hypomagnesemia are explored, the impact of air pollution on children is examined, and an antisiphon device is described for surgical treatment of hydrocephalus. The relation between energy metabolism, circadian rhythm and its influence on the ATPase in the SCN are investigated, and among others some of the genetics influencing smoking duration and lung cancer. Finally it is discussed how embryo quality can be improved in in vitro fertilization, and what impact high estradiol has on blastocyst implantation. The outcome of surgery to correct mandibular deficiency is assessed, and in two letters the inclusion of observational studies in the evaluation of clinical trials related to COVID-19 is elaborated.

Machine Learning-Based Systems for the Anticipation of Adverse Events After Pediatric Cardiac Surgery

Pediatric congenital heart disease (CHD) patients are at higher risk of postoperative complications and clinical deterioration either due to their underlying pathology or due to the cardiac surgery, contributing significantly to mortality, morbidity, hospital and family costs, and poor quality of life. In current clinical practice, clinical deterioration is detected, in most of the cases, when it has already occurred. Several early warning scores (EWS) have been proposed to assess children at risk of clinical deterioration using vital signs and risk indicators, in order to intervene in a timely manner to reduce the impact of deterioration and risk of death among children. However, EWS are based on measurements performed at a single time point without incorporating trends nor providing information about patient's risk trajectory. Moreover, some of these measurements rely on subjective assessment making them susceptible to different interpretations. All these limitations could explain why the implementation of EWS in high-resource settings failed to show a significant decrease in hospital mortality. By means of machine learning (ML) based algorithms we could integrate heterogeneous and complex data to predict patient's risk of deterioration. In this perspective article, we provide a brief overview of the potential of ML technologies to improve the identification of pediatric CHD patients at high-risk for clinical deterioration after cardiac surgery, and present the CORTEX traffic light, a ML-based predictive system that Sant Joan de Déu Barcelona Children's Hospital is implementing, as an illustration of the application of an ML-based risk stratification system in a relevant hospital setting.

Artificial Intelligence in Predicting Cardiac Arrest: Scoping Review

BACKGROUND

Cardiac arrest is a life-threatening cessation of activity in the heart. Early prediction of cardiac arrest is important, as it allows for the necessary measures to be taken to prevent or intervene during the onset. Artificial intelligence (AI) technologies and big data have been increasingly used to enhance the ability to predict and prepare for the patients at risk.

OBJECTIVE

This study aims to explore the use of AI technology in predicting cardiac arrest as reported in the literature.

METHODS

A scoping review was conducted in line with the guidelines of the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) extension for scoping reviews. Scopus, ScienceDirect, Embase, the Institute of Electrical and Electronics Engineers, and Google Scholar were searched to identify relevant studies. Backward reference list checks of the included studies were also conducted. Study selection and data extraction were independently conducted by 2 reviewers. Data extracted from the included studies were synthesized narratively.

RESULTS

Out of 697 citations retrieved, 41 studies were included in the review, and 6 were added after backward citation checking. The included studies reported the use of AI in the prediction of cardiac arrest. Of the 47 studies, we were able to classify the approaches taken by the studies into 3 different categories: 26 (55%) studies predicted cardiac arrest by analyzing specific parameters or variables of the patients, whereas 16 (34%) studies developed an AI-based warning system. The remaining 11% (5/47) of studies focused on distinguishing patients at high risk of cardiac arrest from patients who were not at risk. Two studies focused on the pediatric population, and the rest focused on adults (45/47, 96%). Most of the studies used data sets with a size of <10,000 samples (32/47, 68%). Machine learning models were the most prominent branch of AI used in the prediction of cardiac arrest in the studies (38/47, 81%), and the most used algorithm was the neural network (23/47, 49%). K-fold cross-validation was the most used algorithm evaluation tool reported in the studies (24/47, 51%).

CONCLUSIONS

AI is extensively used to predict cardiac arrest in different patient settings. Technology is expected to play an integral role in improving cardiac medicine. There is a need for more reviews to learn the obstacles to the implementation of AI technologies in clinical settings. Moreover, research focusing on how to best provide clinicians with support to understand, adapt, and implement this technology in their practice is also necessary.