Machine learning and LACE index for predicting 30-day readmissions after heart failure hospitalization in elderly patients

Evaluation of machine learning methods for prediction of heart failure mortality and readmission: meta-analysis

BACKGROUND

Heart failure (HF) impacts nearly 6 million individuals in the U.S., with a projected 46% increase by 2030, is creating significant healthcare burdens. Predictive models, particularly machine learning (ML)-based models, offer promising solutions to identify patients at greater risk of adverse outcomes, such as mortality and hospital readmission. This review aims to assess the effectiveness of ML models in predicting HF-related outcomes, with a focus on their potential to improve patient care and clinical decision-making. We aim to assess how effectively machine learning models predict mortality and readmission in heart failure patients to improve clinical outcomes.

METHOD

The study followed PRISMA 2020 guidelines and was registered in the PROSPERO database (CRD42023481167). We conducted a systematic search in PubMed, Scopus, and Web of Science databases using specific keywords related to heart failure, machine learning, mortality and readmission. Extracted data focused on study characteristics, machine learning details, and outcomes, with AUC or c-index used as the primary outcomes for pooling analysis. The PROBAST tool was used to assess bias risk, evaluating models based on participants, predictors, outcomes, and statistical analysis. The meta-analysis pooled AUCs for different machine learning models predicting mortality and readmission. Prediction accuracy data was categorized by timeframes, with high heterogeneity determined by an I² value above 50%, leading to a random-effects model when applicable. Publication bias was assessed using Egger's and Begg's tests, with a p-value below 0.05 considered significant RESULT: A total of 4,505 studies were identified, and after screening, 64 were included in the final analysis, covering 943,941 patients. Of these, 40 studies focused on mortality, 17 on readmission, and 7 on both outcomes. In total, 346 machine learning models were evaluated, with the most common algorithms being random forest, logistic regression, and gradient boosting. The neural network model achieved the highest overall AUC for mortality prediction (0.808), while the support vector machine performed best for readmission prediction (AUC 0.733). The analysis revealed a significant risk of bias, primarily due to reliance on retrospective data and inadequate sample size justification.

CONCLUSION

In conclusion, this review emphasizes the strong potential of ML models in predicting HF readmission and mortality. ML algorithms show promise in improving prognostic accuracy and enabling personalized patient care. However, challenges like model interpretability, generalizability, and clinical integration persist. Overcoming these requires refined ML techniques and a robust regulatory framework to enhance HF outcomes.

Drug Burden Index Is a Modifiable Predictor of 30-Day Hospitalization in Community-Dwelling Older Adults With Complex Care Needs: Machine Learning Analysis of InterRAI Data

BACKGROUND

Older adults (≥65 years) account for a disproportionately high proportion of hospitalization and in-hospital mortality, some of which may be avoidable. Although machine learning (ML) models have already been built and validated for predicting hospitalization and mortality, there remains a significant need to optimize ML models further. Accurately predicting hospitalization may tremendously affect the clinical care of older adults as preventative measures can be implemented to improve clinical outcomes for the patient.

METHODS

In this retrospective cohort study, a data set of 14 198 community-dwelling older adults (≥65 years) with complex care needs from the International Resident Assessment Instrument-Home Care database was used to develop and optimize 3 ML models to predict 30-day hospitalization. The models developed and optimized were Random Forest (RF), XGBoost (XGB), and Logistic Regression (LR). Variable importance plots were generated for all 3 models to identify key predictors of 30-day hospitalization.

RESULTS

The area under the receiver-operating characteristics curve for the RF, XGB, and LR models were 0.97, 0.90, and 0.72, respectively. Variable importance plots identified the Drug Burden Index and alcohol consumption as important, immediately potentially modifiable variables in predicting 30-day hospitalization.

CONCLUSIONS

Identifying immediately potentially modifiable risk factors such as the Drug Burden Index and alcohol consumption is of high clinical relevance. If clinicians can influence these variables, they could proactively lower the risk of 30-day hospitalization. ML holds promise to improve the clinical care of older adults. It is crucial that these models undergo extensive validation through large-scale clinical studies before being utilized in the clinical setting.

HR-BGCN : Predicting readmission for heart failure from electronic health records

Heart failure has become a huge public health problem, and failure to accurately predict readmission will further lead to the disease's high cost and high mortality. The construction of readmission prediction model can assist doctors in making decisions to prevent patients from deteriorating and reduce the cost burden. This paper extracts the patient discharge records from the MIMIC-III database. It divides the patients into three research categories: no readmission, readmission within 30 days, and readmission after 30 days, to predict the readmission of patients. We propose the HR-BGCN model to predict the readmission of patients. First, we use the Adaptive-TMix to improve the prediction indicators of a few categories and reduce the impact of unbalanced categories. Then, the knowledge-informed graph attention mechanism is proposed. By introducing a document-level explicit diagram structure, the coding ability of graph node features is significantly improved. The paragraph-level representation obtained through graph learning is combined with the context token-level representation of BERT, and finally, the multi-classification task is carried out. We also compare several typical graph learning classification models to verify the model's effectiveness, such as the IA-GCN model, GAT model, etc. The results show that the average F1 score of the HR-BGCN model proposed in this paper for 30-day readmission of heart failure patients is 88.26%, and the average accuracy is 90.47%. The HR-BGCN model is significantly better than the graph learning classification model for predicting heart failure readmission. It can help doctors predict the 30-day readmission of patients, then reduce the readmission rate of patients.

Application of machine learning approaches in predicting clinical outcomes in older adults - a systematic review and meta-analysis

BACKGROUND

Machine learning-based prediction models have the potential to have a considerable positive impact on geriatric care.

DESIGN

Systematic review and meta-analyses.

PARTICIPANTS

Older adults (≥ 65 years) in any setting.

INTERVENTION

Machine learning models for predicting clinical outcomes in older adults were evaluated. A random-effects meta-analysis was conducted in two grouped cohorts, where the predictive models were compared based on their performance in predicting mortality i) under and including 6 months ii) over 6 months.

OUTCOME MEASURES

Studies were grouped into two groups by the clinical outcome, and the models were compared based on the area under the receiver operating characteristic curve metric.

RESULTS

Thirty-seven studies that satisfied the systematic review criteria were appraised, and eight studies predicting a mortality outcome were included in the meta-analyses. We could only pool studies by mortality as there were inconsistent definitions and sparse data to pool studies for other clinical outcomes. The area under the receiver operating characteristic curve from the meta-analysis yielded a summary estimate of 0.80 (95% CI: 0.76 - 0.84) for mortality within 6 months and 0.81 (95% CI: 0.76 - 0.86) for mortality over 6 months, signifying good discriminatory power.

CONCLUSION

The meta-analysis indicates that machine learning models display good discriminatory power in predicting mortality. However, more large-scale validation studies are necessary. As electronic healthcare databases grow larger and more comprehensive, the available computational power increases and machine learning models become more sophisticated; there should be an effort to integrate these models into a larger research setting to predict various clinical outcomes.

Prediction of Early and Long-Term Hospital Readmission in Patients with Severe Obesity: A Retrospective Cohort Study

Adults with obesity have a higher risk of hospitalization and high hospitalization-related healthcare costs. However, a predictive model for the risk of readmission in patients with severe obesity is lacking. We conducted a retrospective cohort study enrolling all patients admitted for severe obesity (BMI ≥ 40 kg/m2) between 2009 and 2018 to the Istituto Auxologico Italiano in Piancavallo. For each patient, all subsequent hospitalizations were identified from the regional database by a deterministic record-linkage procedure. A total of 1136 patients were enrolled and followed up for a median of 5.7 years (IQR: 3.1-8.2). The predictive factors associated with hospital readmission were age (HR = 1.02, 95%CI: 1.01-1.03, p < 0.001), BMI (HR = 1.02, 95%CI: 1.01-1.03, p = 0.001), smoking habit (HR = 1.17, 95%CI: 0.99-1.38, p = 0.060), serum creatinine (HR = 1.22, 95%CI: 1.04-1.44, p = 0.016), diabetes (HR = 1.17, 95%CI: 1.00-1.36, p = 0.045), and number of admissions in the previous two years (HR = 1.15, 95%CI: 1.07-1.23, p < 0.001). BMI lost its predictive role when restricting the analysis to readmissions within 90 days. BMI and diabetes lost their predictive roles when further restricting the analysis to readmissions within 30 days. In conclusion, in this study, we identified predictive variables associated with early and long-term hospital readmission in patients with severe obesity. Whether addressing modifiable risk factors could improve the outcome remains to be established.

Cardiovascular disease (CVD) outcomes and associated risk factors in a medicare population without prior CVD history: an analysis using statistical and machine learning algorithms

There is limited information on predicting incident cardiovascular outcomes among high- to very high-risk populations such as the elderly (≥ 65 years) in the absence of prior cardiovascular disease and the presence of non-cardiovascular multi-morbidity. We hypothesized that statistical/machine learning modeling can improve risk prediction, thus helping inform care management strategies. We defined a population from the Medicare health plan, a US government-funded program mostly for the elderly and varied levels of non-cardiovascular multi-morbidity. Participants were screened for cardiovascular disease (CVD), coronary or peripheral artery disease (CAD or PAD), heart failure (HF), atrial fibrillation (AF), ischemic stroke (IS), transient ischemic attack (TIA), and myocardial infarction (MI) for a 3-yr period in the comorbid history. They were followed up for up to 45.2 months. Analyses included descriptive approaches in terms of incidence rates and density ratios, and inferential in terms of main effect statistical/complex machine learning modeling. The contemporary risk factors of interest spanned across the domains of comorbidity, lifestyle, and healthcare utilization history. The cohort consisted of 154,551 individuals (mean age 68.8 years; 62.2% female). The overall crude incidence rate of CVD events was 9.9 new cases per 100 person-years. The highest rates among its component outcomes were obtained for CAD or PAD (3.6 for each), followed by HF (2.2) and AF (1.8), then IS (1.3), and finally TIA (1.0) and MI (0.9).Model performance was modest in terms of discriminatory power (C index: 0.67, 95%CI 0.667-0.674 for training; and 0.668, 95%CI 0.663-0.673 for validation data), equal agreement between predicted and observed events for calibration purposes, and good clinical utility in terms of a net benefit of 15 true positives per 100 patients relative to the All-patient treatment strategy. Complex models based on machine learning algorithms yielded incrementally better discriminatory power and much improved goodness-of-fitness tests from those based on main effect statistical modeling. This Medicare population represents a highly vulnerable group for incident CVD events. This population would benefit from an integrated approach to their care and management, including attention to their comorbidities and lifestyle factors, as well as medication adherence.

Machine Learning for Mortality Prediction in Patients With Heart Failure With Mildly Reduced Ejection Fraction

Background Machine-learning-based prediction models (MLBPMs) have shown satisfactory performance in predicting clinical outcomes in patients with heart failure with reduced and preserved ejection fraction. However, their usefulness has yet to be fully elucidated in patients with heart failure with mildly reduced ejection fraction. This pilot study aims to evaluate the prediction performance of MLBPMs in a heart failure with mildly reduced ejection fraction cohort with long-term follow-up data. Methods and Results A total of 424 patients with heart failure with mildly reduced ejection fraction were enrolled in our study. The primary outcome was all-cause mortality. Two feature selection strategies were introduced for MLBPM development. The "All-in" (67 features) strategy was based on feature correlation, multicollinearity, and clinical significance. The other strategy was the CoxBoost algorithm with 10-fold cross-validation (17 features), which was based on the selection result of the "All-in" strategy. Six MLBPMs with 5-fold cross-validation based on the "All-in" and the CoxBoost algorithm with 10-fold cross-validation strategy were developed by the eXtreme Gradient Boosting, random forest, and support vector machine algorithms. The logistic regression model with 14 benchmark predictors was used as a reference model. During a median follow-up of 1008 (750, 1937) days, 121 patients met the primary outcome. Overall, MLBPMs outperformed the logistic model. The "All-in" eXtreme Gradient Boosting model had the best performance, with an accuracy of 85.4% and a precision of 70.3%. The area under the receiver-operating characteristic curve was 0.916 (95% CI, 0.887-0.945). The Brier score was 0.12. Conclusions The MLBPMs could significantly improve outcome prediction in patients with heart failure with mildly reduced ejection fraction, which would further optimize the management of these patients.