1
|
Zeng Z, Shi Z, Li X. Comparing different scoring systems for predicting mortality risk in preterm infants: a systematic review and network meta-analysis. Front Pediatr 2023; 11:1287774. [PMID: 38161435 PMCID: PMC10757321 DOI: 10.3389/fped.2023.1287774] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Accepted: 12/04/2023] [Indexed: 01/03/2024] Open
Abstract
Background This study aimed to compare the predictive values of eight scoring systems (Neonatal Critical Illness Score [NCIS], Neonatal Therapeutical Intervention Score System [NTISS], Clinical Risk Index for Babies [CRIB], Clinical Risk Index for Babies II [CRIB-II], Score for Neonatal Acute Physiology Perinatal Extension [SNAPPE], Score for Neonatal Acute Physiology Perinatal Extension II [SNAPPE-II], Score for Neonatal Acute Physiology [SNAP], and Score for Neonatal Acute Physiology II [SNAP-II]) for the mortality risk among preterm infants. Methods The Embase, PubMed, Chinese Biomedical Database, Web of Science, and Cochrane Library databases were searched to collect studies that compared different scoring systems in predicting the mortality risk in preterm infants from database inception to March 2023. Literature screening, data extraction, and bias risk assessment were independently conducted by two researchers. Subsequently, the random-effects model was used for the network meta-analysis. Results A total of 19 articles were included, comprising 14,377 preterm infants and 8 scoring systems. Compared to CRIB-II, NCIS, NTISS, SNAP-II, and SNAPPE-II, CRIB demonstrated better predictive efficiency for preterm infant mortality risk (P < 0.05). Relative to CRIB, CRIB-II, and SNAPPE, SNAP-II had worse predictive efficiency for preterm infant mortality risk (P < 0.05). The surface under the cumulative ranking curve of the eight scoring systems was as follows: CRIB (0.980) > SNAPPE (0.718) >SNAP (0.534) >CRIB-II (0.525) >NTISS (0.478) >NCIS (0.422) >SNAPPE-II (0.298) >SNAP-II (0.046). Conclusion The CRIB scoring system showed the highest accuracy in predicting preterm infant mortality risk and was simple to perform. Therefore, CRIB selection can be prioritized in clinical practice. Systematic Review Registration https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=434731, PROSPERO (CRD42023434731).
Collapse
Affiliation(s)
- Zhaolan Zeng
- Department of Neonatology Nursing, West China Second University Hospital, Sichuan University/West China School of Nursing, Sichuan University, Chengdu, China
- Key Laboratory of Birth Defects and Related Diseases of Women and Children (Sichuan University), Ministry of Education, Chengdu, China
| | - Zeyao Shi
- Department of Neonatology Nursing, West China Second University Hospital, Sichuan University/West China School of Nursing, Sichuan University, Chengdu, China
- Key Laboratory of Birth Defects and Related Diseases of Women and Children (Sichuan University), Ministry of Education, Chengdu, China
| | - Xiaowen Li
- Department of Neonatology Nursing, West China Second University Hospital, Sichuan University/West China School of Nursing, Sichuan University, Chengdu, China
- Key Laboratory of Birth Defects and Related Diseases of Women and Children (Sichuan University), Ministry of Education, Chengdu, China
| |
Collapse
|
2
|
McAdams RM, Kaur R, Sun Y, Bindra H, Cho SJ, Singh H. Predicting clinical outcomes using artificial intelligence and machine learning in neonatal intensive care units: a systematic review. J Perinatol 2022; 42:1561-1575. [PMID: 35562414 DOI: 10.1038/s41372-022-01392-8] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/26/2021] [Revised: 03/30/2022] [Accepted: 04/01/2022] [Indexed: 01/19/2023]
Abstract
BACKGROUND Advances in technology, data availability, and analytics have helped improve quality of care in the neonatal intensive care unit. OBJECTIVE To provide an in-depth review of artificial intelligence (AI) and machine learning techniques being utilized to predict neonatal outcomes. METHODS The PRISMA protocol was followed that considered articles from established digital repositories. Included articles were categorized based on predictions of: (a) major neonatal morbidities such as sepsis, bronchopulmonary dysplasia, intraventricular hemorrhage, necrotizing enterocolitis, and retinopathy of prematurity; (b) mortality; and (c) length of stay. RESULTS A total of 366 studies were considered; 68 studies were eligible for inclusion in the review. The current set of predictor models are primarily built on supervised learning and mostly used regression models built on retrospective data. CONCLUSION With the availability of EMR data and data-sharing of NICU outcomes across neonatal research networks, machine learning algorithms have shown breakthrough performance in predicting neonatal disease.
Collapse
Affiliation(s)
- Ryan M McAdams
- Department of Pediatrics, University of Wisconsin School of Medicine and Public Health, Madison, WI, USA
| | - Ravneet Kaur
- Child Health Imprints (CHIL) USA Inc, Madison, WI, USA
| | - Yao Sun
- Division of Neonatology, University of California San Francisco, San Francisco, CA, USA
| | | | - Su Jin Cho
- College of Medicine, Ewha Womans University Seoul, Seoul, Korea
| | | |
Collapse
|
3
|
Multilayer dynamic ensemble model for intensive care unit mortality prediction of neonate patients. J Biomed Inform 2022; 135:104216. [DOI: 10.1016/j.jbi.2022.104216] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2021] [Revised: 09/25/2022] [Accepted: 09/28/2022] [Indexed: 12/26/2022]
|
4
|
Teji JS, Jain S, Gupta SK, Suri JS. NeoAI 1.0: Machine learning-based paradigm for prediction of neonatal and infant risk of death. Comput Biol Med 2022; 147:105639. [DOI: 10.1016/j.compbiomed.2022.105639] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2021] [Revised: 05/01/2022] [Accepted: 05/01/2022] [Indexed: 11/29/2022]
|
5
|
The Contribution of Data-Driven Technologies in Achieving the Sustainable Development Goals. SUSTAINABILITY 2022. [DOI: 10.3390/su14052497] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
The United Nations’ Sustainable Development Goals (SDGs) set out to improve the quality of life of people in developed, emerging, and developing countries by covering social and economic aspects, with a focus on environmental sustainability. At the same time, data-driven technologies influence our lives in all areas and have caused fundamental economical and societal changes. This study presents a comprehensive literature review on how data-driven approaches have enabled or inhibited the successful achievement of the 17 SDGs to date. Our findings show that data-driven analytics and tools contribute to achieving the 17 SDGs, e.g., by making information more reliable, supporting better-informed decision-making, implementing data-based policies, prioritizing actions, and optimizing the allocation of resources. Based on a qualitative content analysis, results were aggregated into a conceptual framework, including the following categories: (1) uses of data-driven methods (e.g., monitoring, measurement, mapping or modeling, forecasting, risk assessment, and planning purposes), (2) resulting positive effects, (3) arising challenges, and (4) recommendations for action to overcome these challenges. Despite positive effects and versatile applications, problems such as data gaps, data biases, high energy consumption of computational resources, ethical concerns, privacy, ownership, and security issues stand in the way of achieving the 17 SDGs.
Collapse
|
6
|
Nguyen S, Chan R, Cadena J, Soper B, Kiszka P, Womack L, Work M, Duggan JM, Haller ST, Hanrahan JA, Kennedy DJ, Mukundan D, Ray P. Budget constrained machine learning for early prediction of adverse outcomes for COVID-19 patients. Sci Rep 2021; 11:19543. [PMID: 34599200 PMCID: PMC8486861 DOI: 10.1038/s41598-021-98071-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2021] [Accepted: 08/25/2021] [Indexed: 02/08/2023] Open
Abstract
The combination of machine learning (ML) and electronic health records (EHR) data may be able to improve outcomes of hospitalized COVID-19 patients through improved risk stratification and patient outcome prediction. However, in resource constrained environments the clinical utility of such data-driven predictive tools may be limited by the cost or unavailability of certain laboratory tests. We leveraged EHR data to develop an ML-based tool for predicting adverse outcomes that optimizes clinical utility under a given cost structure. We further gained insights into the decision-making process of the ML models through an explainable AI tool. This cohort study was performed using deidentified EHR data from COVID-19 patients from ProMedica Health System in northwest Ohio and southeastern Michigan. We tested the performance of various ML approaches for predicting either increasing ventilatory support or mortality. We performed post hoc analysis to obtain optimal feature sets under various budget constraints. We demonstrate that it is possible to achieve a significant reduction in cost at the expense of a small reduction in predictive performance. For example, when predicting ventilation, it is possible to achieve a 43% reduction in cost with only a 3% reduction in performance. Similarly, when predicting mortality, it is possible to achieve a 50% reduction in cost with only a 1% reduction in performance. This study presents a quick, accurate, and cost-effective method to evaluate risk of deterioration for patients with SARS-CoV-2 infection at the time of clinical evaluation.
Collapse
Affiliation(s)
- Sam Nguyen
- grid.250008.f0000 0001 2160 9702Lawrence Livermore National Laboratory, 7000 East Ave, Livermore, CA 94550 USA
| | - Ryan Chan
- grid.250008.f0000 0001 2160 9702Lawrence Livermore National Laboratory, 7000 East Ave, Livermore, CA 94550 USA
| | - Jose Cadena
- grid.250008.f0000 0001 2160 9702Lawrence Livermore National Laboratory, 7000 East Ave, Livermore, CA 94550 USA
| | - Braden Soper
- grid.250008.f0000 0001 2160 9702Lawrence Livermore National Laboratory, 7000 East Ave, Livermore, CA 94550 USA
| | - Paul Kiszka
- ProMedica Health System, Inc, 3103 Executive Pkwy, Toledo, OH 43606 USA
| | - Lucas Womack
- ProMedica Health System, Inc, 3103 Executive Pkwy, Toledo, OH 43606 USA
| | - Mark Work
- ProMedica Health System, Inc, 3103 Executive Pkwy, Toledo, OH 43606 USA
| | - Joan M. Duggan
- grid.267337.40000 0001 2184 944XDepartment of Medicine, University of Toledo College of Medicine and Life Sciences, 3000 Arlington Ave, Toledo, OH 43614 USA
| | - Steven T. Haller
- grid.267337.40000 0001 2184 944XDepartment of Medicine, University of Toledo College of Medicine and Life Sciences, 3000 Arlington Ave, Toledo, OH 43614 USA
| | - Jennifer A. Hanrahan
- grid.267337.40000 0001 2184 944XDepartment of Medicine, University of Toledo College of Medicine and Life Sciences, 3000 Arlington Ave, Toledo, OH 43614 USA
| | - David J. Kennedy
- grid.267337.40000 0001 2184 944XDepartment of Medicine, University of Toledo College of Medicine and Life Sciences, 3000 Arlington Ave, Toledo, OH 43614 USA
| | - Deepa Mukundan
- grid.267337.40000 0001 2184 944XDepartment of Pediatrics, University of Toledo College of Medicine and Life Sciences, 3000 Arlington Ave, Toledo, OH 43614 USA
| | - Priyadip Ray
- grid.250008.f0000 0001 2160 9702Lawrence Livermore National Laboratory, 7000 East Ave, Livermore, CA 94550 USA
| |
Collapse
|
7
|
|
8
|
McLeod JS, Menon A, Matusko N, Weiner GM, Gadepalli SK, Barks J, Mychaliska GB, Perrone EE. Comparing mortality risk models in VLBW and preterm infants: systematic review and meta-analysis. J Perinatol 2020; 40:695-703. [PMID: 32203174 DOI: 10.1038/s41372-020-0650-0] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/06/2019] [Revised: 02/22/2020] [Accepted: 03/09/2020] [Indexed: 11/09/2022]
Abstract
OBJECTIVE To compare the prognostic accuracy of six neonatal illness severity scores (CRIB, CRIB II, SNAP, SNAP II, SNAP-PE, and SNAP-PE II), birthweight (BW), and gestational age (GA) for predicting pre-discharge mortality among very low birth weight (VLBW) infants (<1500 g) and very preterm infants (<32 weeks' gestational age). STUDY DESIGN PubMed, EMBASE, and Scopus were the data sources searched for studies published before January 2019. Data were extracted, pooled, and analyzed using random-effects models and reported as AUC with 95% confidence intervals (CI). RESULTS Of 1659 screened studies, 24 met inclusion criteria. CRIB was the most discriminate for predicting pre-discharge mortality [AUC 0.88 (0.86-0.90)]. GA was the least discriminate [AUC 0.76 (0.72-0.80)]. CONCLUSIONS Although the original CRIB score was the most accurate predictor of pre-discharge mortality, significant heterogeneity between studies lowers confidence in this pooled estimate. A more precise illness severity score to predict pre-discharge mortality is still needed.
Collapse
Affiliation(s)
- Jennifer S McLeod
- Department of Surgery, Section of Pediatric Surgery, University of Michigan, Michigan Medicine, Ann Arbor, MI, 48109, USA
| | - Anitha Menon
- University of Michigan Medical School, Ann Arbor, MI, 48109, USA
| | - Niki Matusko
- Department of Surgery Statistics, University of Michigan, Michigan Medicine, Ann Arbor, MI, 48109, USA
| | - Gary M Weiner
- University of Michigan, Michigan Medicine, Fetal Diagnosis and Treatment Center, Ann Arbor, MI, 48109, USA
- Department of Pediatrics, Neonatal-Perinatal Medicine Division, University of Michigan, Michigan Medicine, Ann Arbor, MI, 48109, USA
| | - Samir K Gadepalli
- Department of Surgery, Section of Pediatric Surgery, University of Michigan, Michigan Medicine, Ann Arbor, MI, 48109, USA
- University of Michigan, Michigan Medicine, Fetal Diagnosis and Treatment Center, Ann Arbor, MI, 48109, USA
| | - John Barks
- University of Michigan, Michigan Medicine, Fetal Diagnosis and Treatment Center, Ann Arbor, MI, 48109, USA
- Department of Pediatrics, Neonatal-Perinatal Medicine Division, University of Michigan, Michigan Medicine, Ann Arbor, MI, 48109, USA
| | - George B Mychaliska
- Department of Surgery, Section of Pediatric Surgery, University of Michigan, Michigan Medicine, Ann Arbor, MI, 48109, USA
- University of Michigan, Michigan Medicine, Fetal Diagnosis and Treatment Center, Ann Arbor, MI, 48109, USA
| | - Erin E Perrone
- Department of Surgery, Section of Pediatric Surgery, University of Michigan, Michigan Medicine, Ann Arbor, MI, 48109, USA.
- University of Michigan, Michigan Medicine, Fetal Diagnosis and Treatment Center, Ann Arbor, MI, 48109, USA.
| |
Collapse
|