1
|
Natanov D, Avihai B, McDonnell E, Lee E, Cook B, Altomare N, Ko T, Chaia A, Munoz C, Ouellette S, Nyalakonda S, Cederbaum V, Parikh PD, Blaser MJ. Predicting COVID-19 prognosis in hospitalized patients based on early status. mBio 2023; 14:e0150823. [PMID: 37681966 PMCID: PMC10653946 DOI: 10.1128/mbio.01508-23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2023] [Accepted: 07/17/2023] [Indexed: 09/09/2023] Open
Abstract
IMPORTANCE COVID-19 remains the fourth leading cause of death in the United States. Predicting COVID-19 patient prognosis is essential to help efficiently allocate resources, including ventilators and intensive care unit beds, particularly when hospital systems are strained. Our PLABAC and PRABLE models are unique because they accurately assess a COVID-19 patient's risk of death from only age and five commonly ordered laboratory tests. This simple design is important because it allows these models to be used by clinicians to rapidly assess a patient's risk of decompensation and serve as a real-time aid when discussing difficult, life-altering decisions for patients. Our models have also shown generalizability to external populations across the United States. In short, these models are practical, efficient tools to assess and communicate COVID-19 prognosis.
Collapse
Affiliation(s)
- David Natanov
- Rutgers Robert Wood Johnson Medical School, Piscataway, New Jersey, USA
| | - Byron Avihai
- Rutgers Robert Wood Johnson Medical School, Piscataway, New Jersey, USA
| | - Erin McDonnell
- Rutgers Robert Wood Johnson Medical School, Piscataway, New Jersey, USA
| | - Eileen Lee
- Rutgers Robert Wood Johnson Medical School, Piscataway, New Jersey, USA
| | - Brennan Cook
- Rutgers Robert Wood Johnson Medical School, Piscataway, New Jersey, USA
| | - Nicole Altomare
- Rutgers Robert Wood Johnson Medical School, Piscataway, New Jersey, USA
| | - Tomohiro Ko
- Rutgers Robert Wood Johnson Medical School, Piscataway, New Jersey, USA
| | - Angelo Chaia
- Rutgers Robert Wood Johnson Medical School, Piscataway, New Jersey, USA
| | - Carolayn Munoz
- Rutgers Robert Wood Johnson Medical School, Piscataway, New Jersey, USA
| | | | - Suraj Nyalakonda
- Rutgers Robert Wood Johnson Medical School, Piscataway, New Jersey, USA
| | - Vanessa Cederbaum
- Rutgers Robert Wood Johnson Medical School, Piscataway, New Jersey, USA
| | - Payal D. Parikh
- Department of Medicine, Robert Wood Johnson Medical School, New Brunswick, New Jersey, USA
| | - Martin J. Blaser
- Center for Advanced Biotechnology and Medicine, Rutgers University, New Brunswick, New Jersey, USA
| |
Collapse
|
2
|
Xin Y, Li H, Zhou Y, Yang Q, Mu W, Xiao H, Zhuo Z, Liu H, Wang H, Qu X, Wang C, Liu H, Yu K. The accuracy of artificial intelligence in predicting COVID-19 patient mortality: a systematic review and meta-analysis. BMC Med Inform Decis Mak 2023; 23:155. [PMID: 37559062 PMCID: PMC10410953 DOI: 10.1186/s12911-023-02256-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2022] [Accepted: 08/02/2023] [Indexed: 08/11/2023] Open
Abstract
BACKGROUND The purpose of this paper was to systematically evaluate the application value of artificial intelligence in predicting mortality among COVID-19 patients. METHODS The PubMed, Embase, Web of Science, CNKI, Wanfang, China Biomedical Literature, and VIP databases were systematically searched from inception to October 2022 to identify studies that evaluated the predictive effects of artificial intelligence on mortality among COVID-19 patients. The retrieved literature was screened according to the inclusion and exclusion criteria. The quality of the included studies was assessed using the QUADAS-2 tools. Statistical analysis of the included studies was performed using Review Manager 5.3, Stata 16.0, and Meta-DiSc 1.4 statistical software. This meta-analysis was registered in PROSPERO (CRD42022315158). FINDINGS Of 2193 studies, 23 studies involving a total of 25 AI models met the inclusion criteria. Among them, 18 studies explicitly mentioned training and test sets, and 5 studies did not explicitly mention grouping. In the training set, the pooled sensitivity was 0.93 [0.87, 0.96], the pooled specificity was 0.94 [0.87, 0.97], and the area under the ROC curve was 0.98 [0.96, 0.99]. In the validation set, the pooled sensitivity was 0.84 [0.78, 0.88], the pooled specificity was 0.89 [0.85, 0.92], and the area under the ROC curve was 0.93 [1.00, 0.00]. In the subgroup analysis, the areas under the summary receiver operating characteristic (SROC) curves of the artificial intelligence models KNN, SVM, ANN, RF and XGBoost were 0.98, 0.98, 0.94, 0.92, and 0.91, respectively. The Deeks funnel plot indicated that there was no significant publication bias in this study (P > 0.05). INTERPRETATION Artificial intelligence models have high accuracy in predicting mortality among COVID-19 patients and have high prognostic value. Among them, the KNN, SVM, ANN, RF, XGBoost, and other models have the highest levels of accuracy.
Collapse
Affiliation(s)
- Yu Xin
- Department of Critical Care Medicine, the First Affiliated Hospital of Harbin Medical University, Harbin, 150001, Heilongjiang Province, China
- Department of Critical Care Medicine, Harbin Medical University Cancer Hospital, No. 150 Haping Rd, Nangang District, Harbin, 150081, China
| | - Hongxu Li
- Department of Critical Care Medicine, the First Affiliated Hospital of Harbin Medical University, Harbin, 150001, Heilongjiang Province, China
- Department of Critical Care Medicine, Harbin Medical University Cancer Hospital, No. 150 Haping Rd, Nangang District, Harbin, 150081, China
| | - Yuxin Zhou
- Department of Critical Care Medicine, the First Affiliated Hospital of Harbin Medical University, Harbin, 150001, Heilongjiang Province, China
- Department of Critical Care Medicine, Harbin Medical University Cancer Hospital, No. 150 Haping Rd, Nangang District, Harbin, 150081, China
| | - Qing Yang
- Department of Critical Care Medicine, Harbin Medical University Cancer Hospital, No. 150 Haping Rd, Nangang District, Harbin, 150081, China
| | - Wenjing Mu
- Department of Critical Care Medicine, Harbin Medical University Cancer Hospital, No. 150 Haping Rd, Nangang District, Harbin, 150081, China
| | - Han Xiao
- Departments of Pharmacy and Cardiology, Harbin Medical University Cancer Hospital, No. 150 Haping Rd, Nangang District, Harbin, 150081, China
| | - Zipeng Zhuo
- Department of Critical Care Medicine, Harbin Medical University Cancer Hospital, No. 150 Haping Rd, Nangang District, Harbin, 150081, China
| | - Hongyu Liu
- Department of Anesthesiology, Harbin Medical University Cancer Hospital, No. 150 Haping Rd, Nangang District, Harbin, 150081, China
| | - Hongying Wang
- Department of Critical Care Medicine, Harbin Medical University Cancer Hospital, No. 150 Haping Rd, Nangang District, Harbin, 150081, China
| | - Xutong Qu
- Department of Anesthesiology, Harbin Medical University Cancer Hospital, No. 150 Haping Rd, Nangang District, Harbin, 150081, China
| | - Changsong Wang
- Department of Critical Care Medicine, the First Affiliated Hospital of Harbin Medical University, Harbin, 150001, Heilongjiang Province, China.
- Department of Critical Care Medicine, Harbin Medical University Cancer Hospital, No. 150 Haping Rd, Nangang District, Harbin, 150081, China.
| | - Haitao Liu
- Department of Critical Care Medicine, Harbin Medical University Cancer Hospital, No. 150 Haping Rd, Nangang District, Harbin, 150081, China.
| | - Kaijiang Yu
- Department of Critical Care Medicine, the First Affiliated Hospital of Harbin Medical University, Harbin, 150001, Heilongjiang Province, China.
| |
Collapse
|
3
|
Irfan FB, Telford B, Hollon N, Dehghani A, Schukow C, Syed AY, Rego RT, Waljee AK, Cunningham W, Ahmed FS. Coronavirus pandemic in the South Asia region: Health policy and economy trade-off. J Glob Health 2023; 13:06014. [PMID: 37141526 PMCID: PMC10159594 DOI: 10.7189/jogh.13.06014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/06/2023] Open
Abstract
Background The South Asian Association for Regional Cooperation (SAARC) covers Afghanistan, Bangladesh, Bhutan, India, Maldives, Nepal, Pakistan, and Sri Lanka. We conducted a comparative analysis of the trade-off between the health policies for the prevention of COVID-19 spread and the impact of these policies on the economies and livelihoods of the South Asia populations. Methods We analyzed COVID-19 data on epidemiology, public health and health policy, health system capacity, and macroeconomic indicators from January 2020 to March 2021 to determine temporal trends by conducting joinpoint regression analysis using average weekly percent change (AWPC). Results Bangladesh had the highest statistically significant AWPC for new COVID-19 cases (17.0; 95% CI = 7.7-27.1, P < 0.001), followed by the Maldives (12.9; 95% CI = 5.3-21.0, P < 0.001) and India (10.0; 95% CI = 8.4-11.5, P < 0.001). The AWPC for COVID-19 deaths was significant for India (6.5; 95% CI = 4.3-8.9, P < 0.001) and Bangladesh (6.1; 95% CI = 3.7-8.5, P < 0.001). Nepal (55.79%), and India (34.91%) had the second- and third-highest increase in unemployment, while Afghanistan (6.83%) and Pakistan (16.83%) had the lowest. The rate of change of real GDP had the highest decrease for Maldives (557.51%), and India (297.03%); Pakistan (46.46%) and Bangladesh (70.80%), however, had the lowest decrease. The government response stringency index for Pakistan had a see-saw pattern with a sharp decline followed by an increase in the government health policy restrictions that approximated the test-positivity trend. Conclusions Unlike developed economies, the South Asian developing countries experienced a trade-off between health policy and their economies during the COVID-19 pandemic. South Asian countries (Nepal and India), with extended periods of lockdowns and a mismatch between temporal trends of government response stringency index and the test-positivity or disease incidence, had higher adverse economic effects, unemployment, and burden of COVID-19. Pakistan demonstrated targeted lockdowns with a rapid see-saw pattern of government health policy response that approximated the test-positivity trend and resulted in lesser adverse economic effects, unemployment, and burden of COVID-19.
Collapse
Affiliation(s)
- Furqan B Irfan
- Institute of Global Health, Michigan State University, East Lansing, Michigan, USA
- Department of Neurology and Ophthalmology, College of Osteopathic Medicine, Michigan State University, East Lansing, Michigan, USA
| | - Ben Telford
- College of Osteopathic Medicine, Michigan State University, East Lansing, Michigan, USA
| | - Nick Hollon
- College of Osteopathic Medicine, Michigan State University, East Lansing, Michigan, USA
| | - Ali Dehghani
- College of Osteopathic Medicine, Michigan State University, East Lansing, Michigan, USA
| | - Casey Schukow
- College of Osteopathic Medicine, Michigan State University, East Lansing, Michigan, USA
| | | | - Ryan T Rego
- Center for Global Health Equity, University of Michigan, Ann Arbor, Michigan, USA
| | - Akbar K Waljee
- Center for Global Health Equity, University of Michigan, Ann Arbor, Michigan, USA
- Department of Learning Health Sciences, University of Michigan, Ann Arbor, Michigan, USA
- Michigan Integrated Center for Health Analytics and Medical Prediction (MiCHAMP), University of Michigan, Ann Arbor, Michigan, USA
| | - William Cunningham
- Institute of Global Health, Michigan State University, East Lansing, Michigan, USA
| | | |
Collapse
|
4
|
Giotta M, Trerotoli P, Palmieri VO, Passerini F, Portincasa P, Dargenio I, Mokhtari J, Montagna MT, De Vito D. Application of a Decision Tree Model to Predict the Outcome of Non-Intensive Inpatients Hospitalized for COVID-19. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:13016. [PMID: 36293594 PMCID: PMC9602523 DOI: 10.3390/ijerph192013016] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Revised: 09/30/2022] [Accepted: 10/03/2022] [Indexed: 05/05/2023]
Abstract
Many studies have identified predictors of outcomes for inpatients with coronavirus disease 2019 (COVID-19), especially in intensive care units. However, most retrospective studies applied regression methods to evaluate the risk of death or worsening health. Recently, new studies have based their conclusions on retrospective studies by applying machine learning methods. This study applied a machine learning method based on decision tree methods to define predictors of outcomes in an internal medicine unit with a prospective study design. The main result was that the first variable to evaluate prediction was the international normalized ratio, a measure related to prothrombin time, followed by immunoglobulin M response. The model allowed the threshold determination for each continuous blood or haematological parameter and drew a path toward the outcome. The model's performance (accuracy, 75.93%; sensitivity, 99.61%; and specificity, 23.43%) was validated with a k-fold repeated cross-validation. The results suggest that a machine learning approach could help clinicians to obtain information that could be useful as an alert for disease progression in patients with COVID-19. Further research should explore the acceptability of these results to physicians in current practice and analyze the impact of machine learning-guided decisions on patient outcomes.
Collapse
Affiliation(s)
- Massimo Giotta
- School of Specialization in Medical Statistics and Biometry, School of Medicine, University of Bari Aldo Moro, 70121 Bari, Italy
| | - Paolo Trerotoli
- Department of Interdisciplinary Medicine, University of Bari Aldo Moro, 70121 Bari, Italy
| | - Vincenzo Ostilio Palmieri
- Department of Biomedical Science and Human Oncology, University of Bari Aldo Moro, 70121 Bari, Italy
| | - Francesca Passerini
- Department of Biomedical Science and Human Oncology, University of Bari Aldo Moro, 70121 Bari, Italy
| | - Piero Portincasa
- Department of Biomedical Science and Human Oncology, University of Bari Aldo Moro, 70121 Bari, Italy
| | - Ilaria Dargenio
- School of Specialization in Medical Statistics and Biometry, School of Medicine, University of Bari Aldo Moro, 70121 Bari, Italy
| | - Jihad Mokhtari
- Department of Basic Medical Sciences, Neurosciences, and Sense Organs, Medical School, University of Bari Aldo Moro, 70121 Bari, Italy
| | - Maria Teresa Montagna
- Department of Interdisciplinary Medicine, University of Bari Aldo Moro, 70121 Bari, Italy
| | - Danila De Vito
- Department of Basic Medical Sciences, Neurosciences, and Sense Organs, Medical School, University of Bari Aldo Moro, 70121 Bari, Italy
| |
Collapse
|
5
|
Akter S, Das D, Haque RU, Quadery Tonmoy MI, Hasan MR, Mahjabeen S, Ahmed M. AD-CovNet: An exploratory analysis using a hybrid deep learning model to handle data imbalance, predict fatality, and risk factors in Alzheimer's patients with COVID-19. Comput Biol Med 2022; 146:105657. [DOI: 10.1016/j.compbiomed.2022.105657] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2022] [Revised: 05/14/2022] [Accepted: 05/18/2022] [Indexed: 11/30/2022]
|
6
|
Shanbehzadeh M, Nopour R, Kazemi-Arpanahi H. Design of an artificial neural network to predict mortality among COVID-19 patients. INFORMATICS IN MEDICINE UNLOCKED 2022; 31:100983. [PMID: 35664686 PMCID: PMC9148440 DOI: 10.1016/j.imu.2022.100983] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2022] [Revised: 05/26/2022] [Accepted: 05/26/2022] [Indexed: 12/23/2022] Open
Abstract
Introduction The fast pandemic of coronavirus disease 2019 (COVID-19) has challenged clinicians with many uncertainties and ambiguities regarding disease outcomes and complications. To deal with these uncertainties, our study aimed to develop and evaluate several artificial neural networks (ANNs) to predict the mortality risk in hospitalized COVID-19 patients. Material and methods The data of 1710 hospitalized COVID-19 patients were used in this retrospective and developmental study. First, a Chi-square test (P < 0.05), Eta coefficient (η > 0.4), and binary logistics regression (BLR) analysis were performed to determine the factors affecting COVID-19 mortality. Then, using the selected variables, two types of feed-forward (FF) models, including the back-propagation (BP) and distributed time delay (DTD) were trained. The models' performance was assessed using mean squared error (MSE), error histogram (EH), and area under the ROC curve (AUC-ROC) metrics. Results After applying the univariate and multivariate analysis, 13 variables were selected as important features in predicting COVID-19 mortality at P < 0.05. A comparison of the two ANN architectures using the MSE showed that the BP-ANN (validation error: 0.067, most of the classified samples having 0.049 and 0.05 error rates, and AUC-ROC: 0.888) was the best model. Conclusions Our findings show the acceptable performance of ANN for predicting the risk of mortality in hospitalized COVID-19 patients. Application of the developed ANN-based CDSS in a real clinical environment will improve patient safety and reduce disease severity and mortality.
Collapse
|