Artificial intelligence-driven prediction of COVID-19-related hospitalization and death: a systematic review

Unraveling relevant cross-waves pattern drifts in patient-hospital risk factors among hospitalized COVID-19 patients using explainable machine learning methods

BACKGROUND

Several studies explored factors related to adverse clinical outcomes among COVID-19 patients but lacked analysis of the impact of the temporal data shifts on the strength of association between different predictors and adverse outcomes. This study aims to evaluate factors related to patients and hospitals in the prediction of in-hospital mortality, need for invasive mechanical ventilation (IMV), and intensive care unit (ICU) transfer throughout the pandemic waves.

METHODS

This multicenter retrospective cohort included COVID-19 patients from 39 hospitals, from March/2020 to August/2022. The pandemic was divided into waves: 10/03/2020-14/11/2020 (first), 15/11/2020-25/12/2021 (second), 26/12/2021-03/08/2022 (third). Patient-related factors included clinical, demographic, and laboratory data, while hospital-related factors covered funding sources, accreditation, academic status, and socioeconomic characteristics. Shapley additive explanation (SHAP) values derived from the predictions of a light gradient-boosting machine (LightGBM) model were used to assess potential risk factors for death, IMV and ICU.

RESULTS

Overall, 16,958 adult patients were included (median age 59 years, 54.7% men). LightGBM achieved competitive effectiveness metrics across all periods. Temporal drifts were observed due to a decrease in various metrics, such as the recall for the positive class [ICU: 0.4211 (wave 1) to 0.1951 (wave 3); IMV: 0.2089 (wave 1) to 0.0438 (wave 3); death: 0.2711 (wave 1) to 0.1175 (wave 3)]. Peripheral arterial oxygen saturation to the fraction of inspired oxygen ratio (SatO2/FiO2) at admission had great predictive capacity for all outcomes, with an optimal cut-off value for death prediction of 227.78. Lymphopenia had its association strength increased over time for all outcomes, optimal threshold for death prediction of 643 × 109/L. Thrombocytopenia was the most important feature in wave 2 (ICU); overall, values below 143,000 × 109/L were more related to death.

CONCLUSION

Data drifts were observed in all scenarios, affecting potential predictive capabilities of explainable machine learning methods. Upon admission, SatO2/FiO2 values, platelet and lymphocyte count were significant predictors of adverse outcomes in COVID-19 patients. Overall, inflammatory response markers were more important than clinical characteristics. Limitations included sample representativeness and confounding factors. Integrating the drift's knowledge into models to improve effectiveness is a challenge, requiring continuous updates and monitoring of performance in real-world applications.

CLINICAL TRIAL NUMBER

Not applicable.

Off-the-Shelf Large Language Models for Causality Assessment of Individual Case Safety Reports: A Proof-of-Concept with COVID-19 Vaccines

BACKGROUND

This study evaluated the feasibility of ChatGPT and Gemini, two off-the-shelf large language models (LLMs), to automate causality assessments, focusing on Adverse Events Following Immunizations (AEFIs) of myocarditis and pericarditis related to COVID-19 vaccines.

METHODS

We assessed 150 COVID-19-related cases of myocarditis and pericarditis reported to the Vaccine Adverse Event Reporting System (VAERS) in the United States of America (USA). Both LLMs and human experts conducted the World Health Organization (WHO) algorithm for vaccine causality assessments, and inter-rater agreement was measured using percentage agreement. Adherence to the WHO algorithm was evaluated by comparing LLM responses to the expected sequence of the algorithm. Statistical analyses, including descriptive statistics and Random Forest modeling, explored case complexity (e.g., string length measurements) and factors affecting LLM performance and adherence.

RESULTS

ChatGPT showed higher adherence to the WHO algorithm (34%) compared to Gemini (7%) and had moderate agreement (71%) with human experts, whereas Gemini had fair agreement (53%). Both LLMs often failed to recognize listed AEFIs, with ChatGPT and Gemini incorrectly identifying 6.7% and 13.3% of AEFIs, respectively. ChatGPT showed inconsistencies in 8.0% of cases and Gemini in 46.7%. For ChatGPT, adherence to the algorithm was associated with lower string complexity in prompt sections. The random forest analysis achieved an accuracy of 55% (95% confidence interval: 35.7-73.5) for predicting adherence to the WHO algorithm for ChatGPT.

CONCLUSION

Notable limitations of ChatGPT and Gemini have been identified in their use for aiding causality assessments in vaccine safety. ChatGPT performed better, with higher adherence and agreement with human experts. In the investigated scenario, both models are better suited as complementary tools to human expertise.

Development of a prediction model for 30-day COVID-19 hospitalization and death in a national cohort of Veterans Health Administration patients-March 2022-April 2023

OBJECTIVE

The epidemiology of COVID-19 has substantially changed since its emergence given the availability of effective vaccines, circulation of different viral variants, and re-infections. We aimed to develop models to predict 30-day COVID-19 hospitalization and death in the Omicron era for contemporary clinical and research applications.

METHODS

We used comprehensive electronic health records from a national cohort of patients in the Veterans Health Administration (VHA) who tested positive for SARS-CoV-2 between March 1, 2022, and March 31, 2023. Full models incorporated 84 predictors, including demographics, comorbidities, and receipt of COVID-19 vaccinations and anti-SARS-CoV-2 treatments. Parsimonious models included 19 predictors. We created models for 30-day hospitalization or death, 30-day hospitalization, and 30-day all-cause mortality. We used the Super Learner ensemble machine learning algorithm to fit prediction models. Model performance was assessed with the area under the receiver operating characteristic curve (AUC), Brier scores, and calibration intercepts and slopes in a 20% holdout dataset.

RESULTS

Models were trained and tested on 198,174 patients, of whom 8% were hospitalized or died within 30 days of testing positive. AUCs for the full models ranged from 0.80 (hospitalization) to 0.91 (death). Brier scores were close to 0, with the lowest error in the mortality model (Brier score: 0.01). All three models were well calibrated with calibration intercepts <0.23 and slopes <1.05. Parsimonious models performed comparably to full models.

CONCLUSIONS

We developed prediction models that accurately estimate COVID-19 hospitalization and mortality risk following emergence of the Omicron variant and in the setting of COVID-19 vaccinations and antiviral treatments. These models may be used for risk stratification to inform COVID-19 treatment and to identify high-risk patients for inclusion in clinical trials.

Prediction of COVID-19 Hospitalization and Mortality Using Artificial Intelligence

BACKGROUND

COVID-19 has had a substantial influence on healthcare systems, requiring early prognosis for innovative therapies and optimal results, especially in individuals with comorbidities. AI systems have been used by healthcare practitioners for investigating, anticipating, and predicting diseases, through means including medication development, clinical trial analysis, and pandemic forecasting. This study proposes the use of AI to predict disease severity in terms of hospital mortality among COVID-19 patients.

METHODS

A cross-sectional study was conducted at King Abdulaziz University, Saudi Arabia. Data were cleaned by encoding categorical variables and replacing missing quantitative values with their mean. The outcome variable, hospital mortality, was labeled as death = 0 or survival = 1, with all baseline investigations, clinical symptoms, and laboratory findings used as predictors. Decision trees, SVM, and random forest algorithms were employed. The training process included splitting the data set into training and testing sets, performing 5-fold cross-validation to tune hyperparameters, and evaluating performance on the test set using accuracy.

RESULTS

The study assessed the predictive accuracy of outcomes and mortality for COVID-19 patients based on factors such as CRP, LDH, Ferritin, ALP, Bilirubin, D-Dimers, and hospital stay (p-value ≤ 0.05). The analysis revealed that hospital stay, D-Dimers, ALP, Bilirubin, LDH, CRP, and Ferritin significantly influenced hospital mortality (p ≤ 0.0001). The results demonstrated high predictive accuracy, with decision trees achieving 76%, random forest 80%, and support vector machines (SVMs) 82%.

CONCLUSIONS

Artificial intelligence is a tool crucial for identifying early coronavirus infections and monitoring patient conditions. It improves treatment consistency and decision-making via the development of algorithms.

Prediction of tuberculosis clusters in the riverine municipalities of the Brazilian Amazon with machine learning

OBJECTIVE

Tuberculosis (TB) is the second most deadly infectious disease globally, posing a significant burden in Brazil and its Amazonian region. This study focused on the "riverine municipalities" and hypothesizes the presence of TB clusters in the area. We also aimed to train a machine learning model to differentiate municipalities classified as hot spots vs. non-hot spots using disease surveillance variables as predictors.

METHODS

Data regarding the incidence of TB from 2019 to 2022 in the riverine town was collected from the Brazilian Health Ministry Informatics Department. Moran's I was used to assess global spatial autocorrelation, while the Getis-Ord GI* method was employed to detect high and low-incidence clusters. A Random Forest machine-learning model was trained using surveillance variables related to TB cases to predict hot spots among non-hot spot municipalities.

RESULTS

Our analysis revealed distinct geographical clusters with high and low TB incidence following a west-to-east distribution pattern. The Random Forest Classification model utilizes six surveillance variables to predict hot vs. non-hot spots. The machine learning model achieved an Area Under the Receiver Operator Curve (AUC-ROC) of 0.81.

CONCLUSION

Municipalities with higher percentages of recurrent cases, deaths due to TB, antibiotic regimen changes, percentage of new cases, and cases with smoking history were the best predictors of hot spots. This prediction method can be leveraged to identify the municipalities at the highest risk of being hot spots for the disease, aiding policymakers with an evidenced-based tool to direct resource allocation for disease control in the riverine municipalities.

Transformative Potential of AI in Healthcare: Definitions, Applications, and Navigating the Ethical Landscape and Public Perspectives

Artificial intelligence (AI) has emerged as a crucial tool in healthcare with the primary aim of improving patient outcomes and optimizing healthcare delivery. By harnessing machine learning algorithms, natural language processing, and computer vision, AI enables the analysis of complex medical data. The integration of AI into healthcare systems aims to support clinicians, personalize patient care, and enhance population health, all while addressing the challenges posed by rising costs and limited resources. As a subdivision of computer science, AI focuses on the development of advanced algorithms capable of performing complex tasks that were once reliant on human intelligence. The ultimate goal is to achieve human-level performance with improved efficiency and accuracy in problem-solving and task execution, thereby reducing the need for human intervention. Various industries, including engineering, media/entertainment, finance, and education, have already reaped significant benefits by incorporating AI systems into their operations. Notably, the healthcare sector has witnessed rapid growth in the utilization of AI technology. Nevertheless, there remains untapped potential for AI to truly revolutionize the industry. It is important to note that despite concerns about job displacement, AI in healthcare should not be viewed as a threat to human workers. Instead, AI systems are designed to augment and support healthcare professionals, freeing up their time to focus on more complex and critical tasks. By automating routine and repetitive tasks, AI can alleviate the burden on healthcare professionals, allowing them to dedicate more attention to patient care and meaningful interactions. However, legal and ethical challenges must be addressed when embracing AI technology in medicine, alongside comprehensive public education to ensure widespread acceptance.

Machine learning-driven development of a disease risk score for COVID-19 hospitalization and mortality: a Swedish and Norwegian register-based study

Aims

To develop a disease risk score for COVID-19-related hospitalization and mortality in Sweden and externally validate it in Norway.

Method

We employed linked data from the national health registries of Sweden and Norway to conduct our study. We focused on individuals in Sweden with confirmed SARS-CoV-2 infection through RT-PCR testing up to August 2022 as our study cohort. Within this group, we identified hospitalized cases as those who were admitted to the hospital within 14 days of testing positive for SARS-CoV-2 and matched them with five controls from the same cohort who were not hospitalized due to SARS-CoV-2. Additionally, we identified individuals who died within 30 days after being hospitalized for COVID-19. To develop our disease risk scores, we considered various factors, including demographics, infectious, somatic, and mental health conditions, recorded diagnoses, and pharmacological treatments. We also conducted age-specific analyses and assessed model performance through 5-fold cross-validation. Finally, we performed external validation using data from the Norwegian population with COVID-19 up to December 2021.

Results

During the study period, a total of 124,560 individuals in Sweden were hospitalized, and 15,877 individuals died within 30 days following COVID-19 hospitalization. Disease risk scores for both hospitalization and mortality demonstrated predictive capabilities with ROC-AUC values of 0.70 and 0.72, respectively, across the entire study period. Notably, these scores exhibited a positive correlation with the likelihood of hospitalization or death. In the external validation using data from the Norwegian COVID-19 population (consisting of 53,744 individuals), the disease risk score predicted hospitalization with an AUC of 0.47 and death with an AUC of 0.74.

Conclusion

The disease risk score showed moderately good performance to predict COVID-19-related mortality but performed poorly in predicting hospitalization when externally validated.

Mapping the Heartbeat of America with ChatGPT-4: Unpacking the Interplay of Social Vulnerability, Digital Literacy, and Cardiovascular Mortality in County Residency Choices

Cardiovascular disease remains a leading cause of morbidity and mortality in the United States (US). Although high-quality data are accessible in the US for cardiovascular research, digital literacy (DL) has not been explored as a potential factor influencing cardiovascular mortality, although the Social Vulnerability Index (SVI) has been used previously as a variable in predictive modeling. Utilizing a large language model, ChatGPT4, we investigated the variability in CVD-specific mortality that could be explained by DL and SVI using regression modeling. We fitted two models to calculate the crude and adjusted CVD mortality rates. Mortality data using ICD-10 codes were retrieved from CDC WONDER, and the geographic level data was retrieved from the US Department of Agriculture. Both datasets were merged using the Federal Information Processing Standards code. The initial exploration involved data from 1999 through 2020 (n = 65,791; 99.98% complete for all US Counties) for crude cardiovascular mortality (CCM). Age-adjusted cardiovascular mortality (ACM) had data for 2020 (n = 3118 rows; 99% complete for all US Counties), with the inclusion of SVI and DL in the model (a composite of literacy and internet access). By leveraging on the advanced capabilities of ChatGPT4 and linear regression, we successfully highlighted the importance of incorporating the SVI and DL in predicting adjusted cardiovascular mortality. Our findings imply that just incorporating internet availability in the regression model may not be sufficient without incorporating significant variables, such as DL and SVI, to predict ACM. Further, our approach could enable future researchers to consider DL and SVI as key variables to study other health outcomes of public-health importance, which could inform future clinical practices and policies.

COVID-19 and beyond: leveraging artificial intelligence for enhanced outbreak control

COVID-19 has brought significant changes to our political, social, and technological landscape. This paper explores the emergence and global spread of the disease and focuses on the role of Artificial Intelligence (AI) in containing its transmission. To the best of our knowledge, there has been no scientific presentation of the early pictorial representation of the disease's spread. Additionally, we outline various domains where AI has made a significant impact during the pandemic. Our methodology involves searching relevant articles on COVID-19 and AI in leading databases such as PubMed and Scopus to identify the ways AI has addressed pandemic-related challenges and its potential for further assistance. While research suggests that AI has not fully realized its potential against COVID-19, likely due to data quality and diversity limitations, we review and identify key areas where AI has been crucial in preparing the fight against any sudden outbreak of the pandemic. We also propose ways to maximize the utilization of AI's capabilities in this regard.