XGBoost Machine Learning Algorithm for Prediction of Outcome in Aneurysmal Subarachnoid Hemorrhage

Implementation of a Machine Learning Approach Evaluating Risk Factors for Complications after Single-Stage Augmentation Mastopexy

BACKGROUND

Single-stage mastopexy augmentation is a much-debated intervention due to its complexity and the associated relatively high complication rates. This study aimed to reevaluate the risk factors for these complications using a novel approach based on artificial intelligence and to demonstrate its possible limitations.

PATIENTS AND METHODS

Complete datasets of patients who underwent single-staged augmentation mastopexy during 2014-2023 at one institution by a single surgeon were collected retrospectively. These were subsequently processed and analyzed by CART, RF and XGBoost algorithms.

RESULTS

A total of 342 patients were included in the study, of which 43 (12.57%) reported surgery-associated complications, whereby capsular contracture (n = 19) was the most common. BMI represented the most important variable for the development of complications (FIS = 0.44 in CART). 2.9% of the patients expressed the desire for implant change in the course, with absence of any complications. A statistically significant correlation between smoking and the desire for implant change (p < 0.001) was revealed.

CONCLUSION

The importance of implementing artificial intelligence into clinical research could be underpinned by this study, as risk variables can be reclassified based on factors previously considered less or even irrelevant. Thereby we encountered limitations using ML approaches. Further studies will be needed to investigate the association between smoking, BMI and the current implant size with the desire for implant change without any complications. Moreover, we could show that the procedure can be performed safely without high risk of developing major complications.

LEVEL OF EVIDENCE IV

This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266.

Artificial Intelligence and Machine Learning Applications in Critically Ill Brain Injured Patients

The utilization of Artificial Intelligence (AI) and Machine Learning (ML) is paving the way for significant strides in patient diagnosis, treatment, and prognostication in neurocritical care. These technologies offer the potential to unravel complex patterns within vast datasets ranging from vast clinical data and EEG (electroencephalogram) readings to advanced cerebral imaging facilitating a more nuanced understanding of patient conditions. Despite their promise, the implementation of AI and ML faces substantial hurdles. Historical biases within training data, the challenge of interpreting multifaceted data streams, and the "black box" nature of ML algorithms present barriers to widespread clinical adoption. Moreover, ethical considerations around data privacy and the need for transparent, explainable models remain paramount to ensure trust and efficacy in clinical decision-making.This article reflects on the emergence of AI and ML as integral tools in neurocritical care, discussing their roles from the perspective of both their scientific promise and the associated challenges. We underscore the importance of extensive validation in diverse clinical settings to ensure the generalizability of ML models, particularly considering their potential to inform critical medical decisions such as withdrawal of life-sustaining therapies. Advancement in computational capabilities is essential for implementing ML in clinical settings, allowing for real-time analysis and decision support at the point of care. As AI and ML are poised to become commonplace in clinical practice, it is incumbent upon health care professionals to understand and oversee these technologies, ensuring they adhere to the highest safety standards and contribute to the realization of personalized medicine. This engagement will be pivotal in integrating AI and ML into patient care, optimizing outcomes in neurocritical care through informed and data-driven decision-making.

Prediction of early neurologic deterioration in patients with perforating artery territory infarction using machine learning: a retrospective study

Background

Early neurological deterioration (END) is a frequent complication in patients with perforating artery territory infarction (PAI), leading to poorer outcomes. Therefore, we aimed to apply machine learning (ML) algorithms to predict the occurrence of END in PAI and investigate related risk factors.

Methods

This retrospective study analyzed a cohort of PAI patients, excluding those with severe stenosis of the parent artery. We included demographic characteristics, clinical features, laboratory data, and imaging variables. Recursive feature elimination with cross-validation (RFECV) was performed to identify critical features. Seven ML algorithms, namely logistic regression, random forest, adaptive boosting, gradient boosting decision tree, histogram-based gradient boosting, extreme gradient boosting, and category boosting, were developed to predict END in PAI patients using these critical features. We compared the accuracy of these models in predicting outcomes. Additionally, SHapley Additive exPlanations (SHAP) values were introduced to interpret the optimal model and assess the significance of input features.

Results

The study enrolled 1,020 PAI patients with a mean age of 60.46 (range 49.11-71.81) years. Of these, 30.39% were women, and 129 (12.65%) experienced END. RFECV selected 13 critical features, including blood urea nitrogen (BUN), total cholesterol (TC), low-density-lipoprotein cholesterol (LDL-C), apolipoprotein B (apoB), atrial fibrillation, loading dual antiplatelet therapy (DAPT), single antiplatelet therapy (SAPT), argatroban, the basal ganglia, the thalamus, the posterior choroidal arteries, maximal axial infarct diameter (measured at < 15 mm), and stroke subtype. The gradient-boosting decision tree had the highest area under the curve (0.914) among the seven ML algorithms. The SHAP analysis identified apoB as the most significant variable for END.

Conclusion

Our results suggest that ML algorithms, especially the gradient-boosting decision tree, are effective in predicting the occurrence of END in PAI patients.

Predicting Outcomes Following Lower Extremity Endovascular Revascularization Using Machine Learning

BACKGROUND

Lower extremity endovascular revascularization for peripheral artery disease carries nonnegligible perioperative risks; however, outcome prediction tools remain limited. Using machine learning, we developed automated algorithms that predict 30-day outcomes following lower extremity endovascular revascularization.

METHODS AND RESULTS

The National Surgical Quality Improvement Program targeted vascular database was used to identify patients who underwent lower extremity endovascular revascularization (angioplasty, stent, or atherectomy) for peripheral artery disease between 2011 and 2021. Input features included 38 preoperative demographic/clinical variables. The primary outcome was 30-day postprocedural major adverse limb event (composite of major reintervention, untreated loss of patency, or major amputation) or death. Data were split into training (70%) and test (30%) sets. Using 10-fold cross-validation, 6 machine learning models were trained using preoperative features. The primary model evaluation metric was area under the receiver operating characteristic curve. Overall, 21 886 patients were included, and 30-day major adverse limb event/death occurred in 1964 (9.0%) individuals. The best performing model for predicting 30-day major adverse limb event/death was extreme gradient boosting, achieving an area under the receiver operating characteristic curve of 0.93 (95% CI, 0.92-0.94). In comparison, logistic regression had an area under the receiver operating characteristic curve of 0.72 (95% CI, 0.70-0.74). The calibration plot showed good agreement between predicted and observed event probabilities with a Brier score of 0.09. The top 3 predictive features in our algorithm were (1) chronic limb-threatening ischemia, (2) tibial intervention, and (3) congestive heart failure.

CONCLUSIONS

Our machine learning models accurately predict 30-day outcomes following lower extremity endovascular revascularization using preoperative data with good discrimination and calibration. Prospective validation is warranted to assess for generalizability and external validity.

Using Machine Learning (XGBoost) to Predict Outcomes After Infrainguinal Bypass for Peripheral Artery Disease

OBJECTIVE

To develop machine learning (ML) algorithms that predict outcomes after infrainguinal bypass.

BACKGROUND

Infrainguinal bypass for peripheral artery disease carries significant surgical risks; however, outcome prediction tools remain limited.

METHODS

The Vascular Quality Initiative database was used to identify patients who underwent infrainguinal bypass for peripheral artery disease between 2003 and 2023. We identified 97 potential predictor variables from the index hospitalization [68 preoperative (demographic/clinical), 13 intraoperative (procedural), and 16 postoperative (in-hospital course/complications)]. The primary outcome was 1-year major adverse limb event (composite of surgical revision, thrombectomy/thrombolysis, or major amputation) or death. Our data were split into training (70%) and test (30%) sets. Using 10-fold cross-validation, we trained 6 ML models using preoperative features. The primary model evaluation metric was the area under the receiver operating characteristic curve (AUROC). The top-performing algorithm was further trained using intraoperative and postoperative features. Model robustness was evaluated using calibration plots and Brier scores.

RESULTS

Overall, 59,784 patients underwent infrainguinal bypass, and 15,942 (26.7%) developed 1-year major adverse limb event/death. The best preoperative prediction model was XGBoost, achieving an AUROC (95% CI) of 0.94 (0.93-0.95). In comparison, logistic regression had an AUROC (95% CI) of 0.61 (0.59-0.63). Our XGBoost model maintained excellent performance at the intraoperative and postoperative stages, with AUROCs (95% CI's) of 0.94 (0.93-0.95) and 0.96 (0.95-0.97), respectively. Calibration plots showed good agreement between predicted and observed event probabilities with Brier scores of 0.08 (preoperative), 0.07 (intraoperative), and 0.05 (postoperative).

CONCLUSIONS

ML models can accurately predict outcomes after infrainguinal bypass, outperforming logistic regression.

Early prediction of ventricular peritoneal shunt dependency in aneurysmal subarachnoid haemorrhage patients by recurrent neural network-based machine learning using routine intensive care unit data

Aneurysmal subarachnoid haemorrhage (aSAH) can lead to complications such as acute hydrocephalic congestion. Treatment of this acute condition often includes establishing an external ventricular drainage (EVD). However, chronic hydrocephalus develops in some patients, who then require placement of a permanent ventriculoperitoneal (VP) shunt. The aim of this study was to employ recurrent neural network (RNN)-based machine learning techniques to identify patients who require VP shunt placement at an early stage. This retrospective single-centre study included all patients who were diagnosed with aSAH and treated in the intensive care unit (ICU) between November 2010 and May 2020 (n = 602). More than 120 parameters were analysed, including routine neurocritical care data, vital signs and blood gas analyses. Various machine learning techniques, including RNNs and gradient boosting machines, were evaluated for their ability to predict VP shunt dependency. VP-shunt dependency could be predicted using an RNN after just one day of ICU stay, with an AUC-ROC of 0.77 (CI: 0.75-0.79). The accuracy of the prediction improved after four days of observation (Day 4: AUC-ROC 0.81, CI: 0.79-0.84). At that point, the accuracy of the prediction was 76% (CI: 75.98-83.09%), with a sensitivity of 85% (CI: 83-88%) and a specificity of 74% (CI: 71-78%). RNN-based machine learning has the potential to predict VP shunt dependency on Day 4 after ictus in aSAH patients using routine data collected in the ICU. The use of machine learning may allow early identification of patients with specific therapeutic needs and accelerate the execution of required procedures.

Machine Learning to Predict Outcomes of Endovascular Intervention for Patients With PAD

Importance

Endovascular intervention for peripheral artery disease (PAD) carries nonnegligible perioperative risks; however, outcome prediction tools are limited.

Objective

To develop machine learning (ML) algorithms that can predict outcomes following endovascular intervention for PAD.

Design, Setting, and Participants

This prognostic study included patients who underwent endovascular intervention for PAD between January 1, 2004, and July 5, 2023, with 1 year of follow-up. Data were obtained from the Vascular Quality Initiative (VQI), a multicenter registry containing data from vascular surgeons and interventionalists at more than 1000 academic and community hospitals. From an initial cohort of 262 242 patients, 26 565 were excluded due to treatment for acute limb ischemia (n = 14 642) or aneurysmal disease (n = 3456), unreported symptom status (n = 4401) or procedure type (n = 2319), or concurrent bypass (n = 1747). Data were split into training (70%) and test (30%) sets.

Exposures

A total of 112 predictive features (75 preoperative [demographic and clinical], 24 intraoperative [procedural], and 13 postoperative [in-hospital course and complications]) from the index hospitalization were identified.

Main Outcomes and Measures

Using 10-fold cross-validation, 6 ML models were trained using preoperative features to predict 1-year major adverse limb event (MALE; composite of thrombectomy or thrombolysis, surgical reintervention, or major amputation) or death. The primary model evaluation metric was area under the receiver operating characteristic curve (AUROC). After selecting the best performing algorithm, additional models were built using intraoperative and postoperative data.

Results

Overall, 235 677 patients who underwent endovascular intervention for PAD were included (mean [SD] age, 68.4 [11.1] years; 94 979 [40.3%] female) and 71 683 (30.4%) developed 1-year MALE or death. The best preoperative prediction model was extreme gradient boosting (XGBoost), achieving the following performance metrics: AUROC, 0.94 (95% CI, 0.93-0.95); accuracy, 0.86 (95% CI, 0.85-0.87); sensitivity, 0.87; specificity, 0.85; positive predictive value, 0.85; and negative predictive value, 0.87. In comparison, logistic regression had an AUROC of 0.67 (95% CI, 0.65-0.69). The XGBoost model maintained excellent performance at the intraoperative and postoperative stages, with AUROCs of 0.94 (95% CI, 0.93-0.95) and 0.98 (95% CI, 0.97-0.99), respectively.

Conclusions and Relevance

In this prognostic study, ML models were developed that accurately predicted outcomes following endovascular intervention for PAD, which performed better than logistic regression. These algorithms have potential for important utility in guiding perioperative risk-mitigation strategies to prevent adverse outcomes following endovascular intervention for PAD.

Predicting Outcomes Following Endovascular Abdominal Aortic Aneurysm Repair Using Machine Learning

OBJECTIVE

To develop machine learning (ML) models that predict outcomes following endovascular aneurysm repair (EVAR) for abdominal aortic aneurysm (AAA).

BACKGROUND

EVAR carries non-negligible perioperative risks; however, there are no widely used outcome prediction tools.

METHODS

The National Surgical Quality Improvement Program targeted database was used to identify patients who underwent EVAR for infrarenal AAA between 2011 and 2021. Input features included 36 preoperative variables. The primary outcome was 30-day major adverse cardiovascular event (composite of myocardial infarction, stroke, or death). Data were split into training (70%) and test (30%) sets. Using 10-fold cross-validation, 6 ML models were trained using preoperative features. The primary model evaluation metric was area under the receiver operating characteristic curve. Model robustness was evaluated with calibration plot and Brier score. Subgroup analysis was performed to assess model performance based on age, sex, race, ethnicity, and prior AAA repair.

RESULTS

Overall, 16,282 patients were included. The primary outcome of 30-day major adverse cardiovascular event occurred in 390 (2.4%) patients. Our best-performing prediction model was XGBoost, achieving an area under the receiver operating characteristic curve (95% CI) of 0.95 (0.94-0.96) compared with logistic regression [0.72 [0.70-0.74)]. The calibration plot showed good agreement between predicted and observed event probabilities with a Brier score of 0.06. Model performance remained robust on all subgroup analyses.

CONCLUSIONS

Our newer ML models accurately predict 30-day outcomes following EVAR using preoperative data and perform better than logistic regression. Our automated algorithms can guide risk mitigation strategies for patients being considered for EVAR.

Using machine learning to predict outcomes following suprainguinal bypass

OBJECTIVE

Suprainguinal bypass for peripheral artery disease (PAD) carries important surgical risks; however, outcome prediction tools remain limited. We developed machine learning (ML) algorithms that predict outcomes following suprainguinal bypass.

METHODS

The Vascular Quality Initiative database was used to identify patients who underwent suprainguinal bypass for PAD between 2003 and 2023. We identified 100 potential predictor variables from the index hospitalization (68 preoperative [demographic/clinical], 13 intraoperative [procedural], and 19 postoperative [in-hospital course/complications]). The primary outcomes were major adverse limb events (MALE; composite of untreated loss of patency, thrombectomy/thrombolysis, surgical revision, or major amputation) or death at 1 year following suprainguinal bypass. Our data were split into training (70%) and test (30%) sets. Using 10-fold cross-validation, we trained six ML models using preoperative features (Extreme Gradient Boosting [XGBoost], random forest, Naïve Bayes classifier, support vector machine, artificial neural network, and logistic regression). The primary model evaluation metric was area under the receiver operating characteristic curve (AUROC). The best performing algorithm was further trained using intra- and postoperative data. Model robustness was evaluated using calibration plots and Brier scores. Performance was assessed on subgroups based on age, sex, race, ethnicity, rurality, median Area Deprivation Index, symptom status, procedure type, prior intervention for PAD, concurrent interventions, and urgency.

RESULTS

Overall, 16,832 patients underwent suprainguinal bypass, and 3136 (18.6%) developed 1-year MALE or death. Patients with 1-year MALE or death were older (mean age, 64.9 vs 63.5 years; P < .001) with more comorbidities, had poorer functional status (65.7% vs 80.9% independent at baseline; P < .001), and were more likely to have chronic limb-threatening ischemia (67.4% vs 47.6%; P < .001) than those without an outcome. Despite being at higher cardiovascular risk, they were less likely to receive acetylsalicylic acid or statins preoperatively and at discharge. Our best performing prediction model at the preoperative stage was XGBoost, achieving an AUROC of 0.92 (95% confidence interval [CI], 0.91-0.93). In comparison, logistic regression had an AUROC of 0.67 (95% CI, 0.65-0.69). Our XGBoost model maintained excellent performance at the intra- and postoperative stages, with AUROCs of 0.93 (95% CI, 0.92-0.94) and 0.98 (95% CI, 0.97-0.99), respectively. Calibration plots showed good agreement between predicted and observed event probabilities with Brier scores of 0.12 (preoperative), 0.11 (intraoperative), and 0.10 (postoperative). Of the top 10 predictors, nine were preoperative features including chronic limb-threatening ischemia, previous procedures, comorbidities, and functional status. Model performance remained robust on all subgroup analyses.

CONCLUSIONS

We developed ML models that accurately predict outcomes following suprainguinal bypass, performing better than logistic regression. Our algorithms have potential for important utility in guiding perioperative risk mitigation strategies to prevent adverse outcomes following suprainguinal bypass.

Predicting outcomes following lower extremity open revascularization using machine learning

Lower extremity open revascularization is a treatment option for peripheral artery disease that carries significant peri-operative risks; however, outcome prediction tools remain limited. Using machine learning (ML), we developed automated algorithms that predict 30-day outcomes following lower extremity open revascularization. The National Surgical Quality Improvement Program targeted vascular database was used to identify patients who underwent lower extremity open revascularization for chronic atherosclerotic disease between 2011 and 2021. Input features included 37 pre-operative demographic/clinical variables. The primary outcome was 30-day major adverse limb event (MALE; composite of untreated loss of patency, major reintervention, or major amputation) or death. Our data were split into training (70%) and test (30%) sets. Using tenfold cross-validation, we trained 6 ML models. Overall, 24,309 patients were included. The primary outcome of 30-day MALE or death occurred in 2349 (9.3%) patients. Our best performing prediction model was XGBoost, achieving an area under the receiver operating characteristic curve (95% CI) of 0.93 (0.92-0.94). The calibration plot showed good agreement between predicted and observed event probabilities with a Brier score of 0.08. Our ML algorithm has potential for important utility in guiding risk mitigation strategies for patients being considered for lower extremity open revascularization to improve outcomes.

Identification of CXC Chemokine Receptor 2 (CXCR2) as a Novel Eosinophils-Independent Diagnostic Biomarker of Pediatric Eosinophilic Esophagitis by Integrated Bioinformatic and Machine-Learning Analysis

Background

Eosinophilic esophagitis (EoE) is a complex allergic condition frequently accompanied by various atopic comorbidities in children, which significantly affects their life qualities. Therefore, this study aimed to evaluate pivotal molecular markers that may facilitate the diagnosis of EoE in pediatric patients.

Methods

Three available EoE-associated gene expression datasets in children: GSE184182, GSE 197702, GSE55794, along with GSE173895 were downloaded from the GEO database. Differentially expressed genes (DEGs) identified by "limma" were intersected with key module genes identified by weighted gene co-expression network analysis (WGCNA), and the shared genes went through functional enrichment analysis. The protein-protein interaction (PPI) network and the machine learning algorithms: least absolute shrinkage and selection operator (LASSO), random forest (RF), and XGBoost were used to reveal candidate diagnostic markers for EoE. The receiver operating characteristic (ROC) curve showed the efficacy of differential diagnosis of this marker, along with online databases predicting its molecular regulatory network. Finally, we performed gene set enrichment analysis (GSEA) and assessed immune cell infiltration of EoE/control samples by using the CIBERSORT algorithm. The correlations between the key diagnostic biomarker and immune cells were also investigated.

Results

The intersection of 936 DEGs and 1446 key module genes in EoE generated 567 genes, which were primarily enriched in immune regulation. Following the construction of the PPI network and filtration by machine learning, CXCR2 served as a potential diagnostic biomarker of pediatric EoE with a perfect diagnostic efficacy (AUC = ~1.00) in regional tissue/peripheral whole blood samples. Multiple infiltrated immune cells were observed to participate in disrupting the homeostasis of esophageal epithelium to varying degrees.

Conclusion

The immune-correlated CXCR2 gene was proved to be a promising diagnostic indicator for EoE, and dysregulated regulatory T cells (Tregs)/neutrophils might play a crucial role in the pathogenesis of EoE in children.

Using machine learning to predict outcomes following open abdominal aortic aneurysm repair

OBJECTIVE

Prediction of outcomes following open abdominal aortic aneurysm (AAA) repair remains challenging with a lack of widely used tools to guide perioperative management. We developed machine learning (ML) algorithms that predict outcomes following open AAA repair.

METHODS

The Vascular Quality Initiative (VQI) database was used to identify patients who underwent elective open AAA repair between 2003 and 2023. Input features included 52 preoperative demographic/clinical variables. All available preoperative variables from VQI were used to maximize predictive performance. The primary outcome was in-hospital major adverse cardiovascular event (MACE; composite of myocardial infarction, stroke, or death). Secondary outcomes were individual components of the primary outcome, other in-hospital complications, and 1-year mortality and any reintervention. We split our data into training (70%) and test (30%) sets. Using 10-fold cross-validation, six ML models were trained using preoperative features (Extreme Gradient Boosting [XGBoost], random forest, Naïve Bayes classifier, support vector machine, artificial neural network, and logistic regression). The primary model evaluation metric was area under the receiver operating characteristic curve (AUROC). Model robustness was evaluated with calibration plot and Brier score. The top 10 predictive features in our final model were determined based on variable importance scores. Performance was assessed on subgroups based on age, sex, race, ethnicity, rurality, median area deprivation index, proximal clamp site, prior aortic surgery, and concomitant procedures.

RESULTS

Overall, 12,027 patients were included. The primary outcome of in-hospital MACE occurred in 630 patients (5.2%). Compared with patients without a primary outcome, those who developed in-hospital MACE were older with more comorbidities, demonstrated poorer functional status, had more complex aneurysms, and were more likely to require concomitant procedures. Our best performing prediction model for in-hospital MACE was XGBoost, achieving an AUROC of 0.93 (95% confidence interval, 0.92-0.94). Comparatively, logistic regression had an AUROC of 0.71 (95% confidence interval, 0.70-0.73). For secondary outcomes, XGBoost achieved AUROCs between 0.84 and 0.94. The calibration plot showed good agreement between predicted and observed event probabilities with a Brier score of 0.05. These findings highlight the excellent predictive performance of the XGBoost model. The top three predictive features in our algorithm for in-hospital MACE following open AAA repair were: (1) coronary artery disease; (2) American Society of Anesthesiologists classification; and (3) proximal clamp site. Model performance remained robust on all subgroup analyses.

CONCLUSIONS

Open AAA repair outcomes can be accurately predicted using preoperative data with our ML models, which perform better than logistic regression. Our automated algorithms can help guide risk-mitigation strategies for patients being considered for open AAA repair to improve outcomes.

Machine learning to predict mortality for aneurysmal subarachnoid hemorrhage (aSAH) using a large nationwide EHR database

Aneurysmal subarachnoid hemorrhage (aSAH) develops quickly once it occurs and threatens the life of patients. We aimed to use machine learning to predict mortality for SAH patients at an early stage which can help doctors make clinical decisions. In our study, we applied different machine learning methods to an aSAH cohort extracted from a national EHR database, the Cerner Health Facts EHR database (2000-2018). The outcome of interest was in-hospital mortality, as either passing away while still in the hospital or being discharged to hospice care. Machine learning-based models were primarily evaluated by the area under the receiver operating characteristic curve (AUC). The population size of the SAH cohort was 6728. The machine learning methods achieved an average of AUCs of 0.805 for predicting mortality with only the initial 24 hours' EHR data. Without losing the prediction power, we used the logistic regression to identify 42 risk factors, -examples include age and serum glucose-that exhibit a significant correlation with the mortality of aSAH patients. Our study illustrates the potential of utilizing machine learning techniques as a practical prognostic tool for predicting aSAH mortality at the bedside.

Predicting outcomes following open revascularization for aortoiliac occlusive disease using machine learning

OBJECTIVE

Open surgical treatment options for aortoiliac occlusive disease carry significant perioperative risks; however, outcome prediction tools remain limited. Using machine learning (ML), we developed automated algorithms that predict 30-day outcomes following open aortoiliac revascularization.

METHODS

The National Surgical Quality Improvement Program (NSQIP) targeted vascular database was used to identify patients who underwent open aortoiliac revascularization for atherosclerotic disease between 2011 and 2021. Input features included 38 preoperative demographic/clinical variables. The primary outcome was 30-day major adverse limb event (MALE; composite of untreated loss of patency, major reintervention, or major amputation) or death. The 30-day secondary outcomes were individual components of the primary outcome, major adverse cardiovascular event (MACE; composite of myocardial infarction, stroke, or death), individual components of MACE, wound complication, bleeding, other morbidity, non-home discharge, and unplanned readmission. Our data were split into training (70%) and test (30%) sets. Using 10-fold cross-validation, we trained six ML models using preoperative features. The primary model evaluation metric was area under the receiver operating characteristic curve (AUROC). Model robustness was evaluated with calibration plot and Brier score. Variable importance scores were calculated to determine the top 10 predictive features. Performance was assessed on subgroups based on age, sex, race, ethnicity, symptom status, procedure type, and urgency.

RESULTS

Overall, 9649 patients were included. The primary outcome of 30-day MALE or death occurred in 1021 patients (10.6%). Our best performing prediction model for 30-day MALE or death was XGBoost, achieving an AUROC of 0.95 (95% confidence interval [CI], 0.94-0.96). In comparison, logistic regression had an AUROC of 0.79 (95% CI, 0.77-0.81). For 30-day secondary outcomes, XGBoost achieved AUROCs between 0.87 and 0.97 (untreated loss of patency [0.95], major reintervention [0.88], major amputation [0.96], death [0.97], MACE [0.95], myocardial infarction [0.88], stroke [0.93], wound complication [0.94], bleeding [0.87], other morbidity [0.96], non-home discharge [0.90], and unplanned readmission [0.91]). The calibration plot showed good agreement between predicted and observed event probabilities with a Brier score of 0.05. The strongest predictive feature in our algorithm was chronic limb-threatening ischemia. Model performance remained robust on all subgroup analyses of specific demographic/clinical populations.

CONCLUSIONS

Our ML models accurately predict 30-day outcomes following open aortoiliac revascularization using preoperative data, performing better than logistic regression. They have potential for important utility in guiding risk-mitigation strategies for patients being considered for open aortoiliac revascularization to improve outcomes.

Comparison of Prognostic Models for Functional Outcome in Aneurysmal Subarachnoid Hemorrhage Based on Machine Learning

BACKGROUND

Controversy exists regarding the superiority of the performance of prognostic tools based on advanced machine learning (ML) algorithms for patients with aneurysmal subarachnoid hemorrhage (aSAH). However, it is unclear whether ML prognostic models will benefit patients due to the lack of a comprehensive assessment. We aimed to develop and evaluate ML models for predicting unfavorable functional outcomes for aSAH patients and identify the model with the greatest performance.

METHODS

In this retrospective study, a dataset of 955 patients with aSAH was used to construct and validate prognostic models for functional outcomes assessed using the modified Rankin scale during a follow-up period of 3-6 months. Clinical scores and clinical and radiological features on admission and secondary complications were used to construct models based on 5 ML algorithms (i.e., logistic regression [LR], k-nearest neighbor, extreme gradient boosting, random forest, and artificial neural network). For evaluation among the models, the area under the receiver operating characteristic curve, area under the precision-recall curve, calibration curve, and decision curve analysis were used.

RESULTS

Composite models had significantly higher area under the receiver operating characteristic curves than did simple models in predicting unfavorable functional outcomes. Compared with other composite models (random forest and extreme gradient boosting) with good calibration, LR had the highest area under the precision-recall score and showed the greatest benefit in decision curve analysis.

CONCLUSIONS

Of the 5 studied ML models, the conventional LR model outperformed the advanced algorithms in predicting the prognosis and could be a useful tool for health care professionals.

Predicting the Outcome of Patients with Aneurysmal Subarachnoid Hemorrhage: A Machine-Learning-Guided Scorecard

Aneurysmal subarachnoid hemorrhage (aSAH) frequently causes long-term disability, but predicting outcomes remains challenging. Routine parameters such as demographics, admission status, CT findings, and blood tests can be used to predict aSAH outcomes. The aim of this study was to compare the performance of traditional logistic regression with several machine learning algorithms using readily available indicators and to generate a practical prognostic scorecard based on machine learning. Eighteen routinely available indicators were collected as outcome predictors for individuals with aSAH. Logistic regression (LR), random forest (RF), support vector machines (SVMs), and fully connected neural networks (FCNNs) were compared. A scorecard system was established based on predictor weights. The results show that machine learning models and a scorecard achieved 0.75~0.8 area under the curve (AUC) predicting aSAH outcomes (LR 0.739, RF 0.749, SVM 0.762~0.793, scorecard 0.794). FCNNs performed best (~0.95) but lacked interpretability. The scorecard model used only five factors, generating a clinically useful tool with a total cutoff score of ≥5, indicating poor prognosis. We developed and validated machine learning models proven to predict outcomes more accurately in individuals with aSAH. The parameters found to be the most strongly predictive of outcomes were NLR, lymphocyte count, monocyte count, hypertension status, and SEBES. The scorecard system provides a simplified means of applying predictive analytics at the bedside using a few key indicators.

Machine learning to predict outcomes following endovascular abdominal aortic aneurysm repair

BACKGROUND

Endovascular aneurysm repair (EVAR) for abdominal aortic aneurysm (AAA) carries important perioperative risks; however, there are no widely used outcome prediction tools. The aim of this study was to apply machine learning (ML) to develop automated algorithms that predict 1-year mortality following EVAR.

METHODS

The Vascular Quality Initiative database was used to identify patients who underwent elective EVAR for infrarenal AAA between 2003 and 2023. Input features included 47 preoperative demographic/clinical variables. The primary outcome was 1-year all-cause mortality. Data were split into training (70 per cent) and test (30 per cent) sets. Using 10-fold cross-validation, 6 ML models were trained using preoperative features with logistic regression as the baseline comparator. The primary model evaluation metric was area under the receiver operating characteristic curve (AUROC). Model robustness was evaluated with calibration plot and Brier score.

RESULTS

Some 63 655 patients were included. One-year mortality occurred in 3122 (4.9 per cent) patients. The best performing prediction model for 1-year mortality was XGBoost, achieving an AUROC (95 per cent c.i.) of 0.96 (0.95-0.97). Comparatively, logistic regression had an AUROC (95 per cent c.i.) of 0.69 (0.68-0.71). The calibration plot showed good agreement between predicted and observed event probabilities with a Brier score of 0.04. The top 3 predictive features in the algorithm were 1) unfit for open AAA repair, 2) functional status, and 3) preoperative dialysis.

CONCLUSIONS

In this data set, machine learning was able to predict 1-year mortality following EVAR using preoperative data and outperformed standard logistic regression models.

Machine learning applications for the prediction of extended length of stay in geriatric hip fracture patients

BACKGROUND

Geriatric hip fractures are one of the most common fractures in elderly individuals, and prolonged hospital stays increase the risk of death and complications. Machine learning (ML) has become prevalent in clinical data processing and predictive models. This study aims to develop ML models for predicting extended length of stay (eLOS) among geriatric patients with hip fractures and to identify the associated risk factors.

AIM

To develop ML models for predicting the eLOS among geriatric patients with hip fractures, identify associated risk factors, and compare the performance of each model.

METHODS

A retrospective study was conducted at a single orthopaedic trauma centre, enrolling all patients who underwent hip fracture surgery between January 2018 and December 2022. The study collected various patient characteristics, encompassing demographic data, general health status, injury-related data, laboratory examinations, surgery-related data, and length of stay. Features that exhibited significant differences in univariate analysis were integrated into the ML model establishment and subsequently cross-verified. The study compared the performance of the ML models and determined the risk factors for eLOS.

RESULTS

The study included 763 patients, with 380 experiencing eLOS. Among the models, the decision tree, random forest, and extreme Gradient Boosting models demonstrated the most robust performance. Notably, the artificial neural network model also exhibited impressive results. After cross-validation, the support vector machine and logistic regression models demonstrated superior performance. Predictors for eLOS included delayed surgery, D-dimer level, American Society of Anaesthesiologists (ASA) classification, type of surgery, and sex.

CONCLUSION

ML proved to be highly accurate in predicting the eLOS for geriatric patients with hip fractures. The identified key risk factors were delayed surgery, D-dimer level, ASA classification, type of surgery, and sex. This valuable information can aid clinicians in allocating resources more efficiently to meet patient demand effectively.

Predicting Major Adverse Cardiovascular Events Following Carotid Endarterectomy Using Machine Learning

Background Carotid endarterectomy (CEA) is a major vascular operation for stroke prevention that carries significant perioperative risks; however, outcome prediction tools remain limited. The authors developed machine learning algorithms to predict outcomes following CEA. Methods and Results The National Surgical Quality Improvement Program targeted vascular database was used to identify patients who underwent CEA between 2011 and 2021. Input features included 36 preoperative demographic/clinical variables. The primary outcome was 30-day major adverse cardiovascular events (composite of stroke, myocardial infarction, or death). The data were split into training (70%) and test (30%) sets. Using 10-fold cross-validation, 6 machine learning models were trained using preoperative features. The primary metric for evaluating model performance was area under the receiver operating characteristic curve. Model robustness was evaluated with calibration plot and Brier score. Overall, 38 853 patients underwent CEA during the study period. Thirty-day major adverse cardiovascular events occurred in 1683 (4.3%) patients. The best performing prediction model was XGBoost, achieving an area under the receiver operating characteristic curve of 0.91 (95% CI, 0.90-0.92). In comparison, logistic regression had an area under the receiver operating characteristic curve of 0.62 (95% CI, 0.60-0.64), and existing tools in the literature demonstrate area under the receiver operating characteristic curve values ranging from 0.58 to 0.74. The calibration plot showed good agreement between predicted and observed event probabilities with a Brier score of 0.02. The strongest predictive feature in our algorithm was carotid symptom status. Conclusions The machine learning models accurately predicted 30-day outcomes following CEA using preoperative data and performed better than existing tools. They have potential for important utility in guiding risk-mitigation strategies to improve outcomes for patients being considered for CEA.

Using machine learning to predict outcomes following carotid endarterectomy

OBJECTIVE

Prediction of outcomes following carotid endarterectomy (CEA) remains challenging, with a lack of standardized tools to guide perioperative management. We used machine learning (ML) to develop automated algorithms that predict outcomes following CEA.

METHODS

The Vascular Quality Initiative (VQI) database was used to identify patients who underwent CEA between 2003 and 2022. We identified 71 potential predictor variables (features) from the index hospitalization (43 preoperative [demographic/clinical], 21 intraoperative [procedural], and 7 postoperative [in-hospital complications]). The primary outcome was stroke or death at 1 year following CEA. Our data were split into training (70%) and test (30%) sets. Using 10-fold cross-validation, we trained six ML models using preoperative features (Extreme Gradient Boosting [XGBoost], random forest, Naïve Bayes classifier, support vector machine, artificial neural network, and logistic regression). The primary model evaluation metric was area under the receiver operating characteristic curve (AUROC). After selecting the best performing algorithm, additional models were built using intra- and postoperative data. Model robustness was evaluated using calibration plots and Brier scores. Performance was assessed on subgroups based on age, sex, race, ethnicity, insurance status, symptom status, and urgency of surgery.

RESULTS

Overall, 166,369 patients underwent CEA during the study period. In total, 7749 patients (4.7%) had the primary outcome of stroke or death at 1 year. Patients with an outcome were older with more comorbidities, had poorer functional status, and demonstrated higher risk anatomic features. They were also more likely to undergo intraoperative surgical re-exploration and have in-hospital complications. Our best performing prediction model at the preoperative stage was XGBoost, achieving an AUROC of 0.90 (95% confidence interval [CI], 0.89-0.91). In comparison, logistic regression had an AUROC of 0.65 (95% CI, 0.63-0.67), and existing tools in the literature demonstrate AUROCs ranging from 0.58 to 0.74. Our XGBoost models maintained excellent performance at the intra- and postoperative stages, with AUROCs of 0.90 (95% CI, 0.89-0.91) and 0.94 (95% CI, 0.93-0.95), respectively. Calibration plots showed good agreement between predicted and observed event probabilities with Brier scores of 0.15 (preoperative), 0.14 (intraoperative), and 0.11 (postoperative). Of the top 10 predictors, eight were preoperative features, including comorbidities, functional status, and previous procedures. Model performance remained robust on all subgroup analyses.

CONCLUSIONS

We developed ML models that accurately predict outcomes following CEA. Our algorithms perform better than logistic regression and existing tools, and therefore, have potential for important utility in guiding perioperative risk mitigation strategies to prevent adverse outcomes.

Field Measures Are All You Need: Predicting Need for Surgery in Elderly Ground-Level Fall Patients via Machine Learning

BACKGROUND

As ground-level falls (GLFs) are a significant cause of mortality in elderly patients, field triage plays an essential role in patient outcomes. This research investigates how machine learning algorithms can supplement traditional t-tests to recognize statistically significant patterns in medical data and to aid clinical guidelines.

METHODS

This is a retrospective study using data from 715 GLF patients over 75 years old. We first calculated P-values for each recorded factor to determine the factor's significance in contributing to a need for surgery (P < .05 is significant). We then utilized the XGBoost machine learning method to rank contributing factors. We applied SHapley Additive exPlanations (SHAP) values to interpret the feature importance and provide clinical guidance via decision trees.

RESULTS

The three most significant P-values when comparing patients with and without surgery are as follows: Glasgow Coma Scale (GCS) (P < .001), no comorbidities (P < .001), and transfer-in (P = .019). The XGBoost algorithm determined that GCS and systolic blood pressure contribute most strongly. The prediction accuracy of these XGBoost results based on the test/train split was 90.3%.

DISCUSSION

When compared to P-values, XGBoost provides more robust, detailed results regarding the factors that suggest a need for surgery. This demonstrates the clinical applicability of machine learning algorithms. Paramedics can use resulting decision trees to inform medical decision-making in real time. XGBoost's generalizability power increases with more data and can be tuned to prospectively assist individual hospitals.

Predicting sepsis onset in ICU using machine learning models: a systematic review and meta-analysis

BACKGROUND

Sepsis is a life-threatening condition caused by an abnormal response of the body to infection and imposes a significant health and economic burden worldwide due to its high mortality rate. Early recognition of sepsis is crucial for effective treatment. This study aimed to systematically evaluate the performance of various machine learning models in predicting the onset of sepsis.

METHODS

We conducted a comprehensive search of the Cochrane Library, PubMed, Embase, and Web of Science databases, covering studies from database inception to November 14, 2022. We used the PROBAST tool to assess the risk of bias. We calculated the predictive performance for sepsis onset using the C-index and accuracy. We followed the PRISMA guidelines for this study.

RESULTS

We included 23 eligible studies with a total of 4,314,145 patients and 26 different machine learning models. The most frequently used models in the studies were random forest (n = 9), extreme gradient boost (n = 7), and logistic regression (n = 6) models. The random forest (test set n = 9, acc = 0.911) and extreme gradient boost (test set n = 7, acc = 0.957) models were the most accurate based on our analysis of the predictive performance. In terms of the C-index outcome, the random forest (n = 6, acc = 0.79) and extreme gradient boost (n = 7, acc = 0.83) models showed the highest performance.

CONCLUSION

Machine learning has proven to be an effective tool for predicting sepsis at an early stage. However, to obtain more accurate results, additional machine learning methods are needed. In our research, we discovered that the XGBoost and random forest models exhibited the best predictive performance and were most frequently utilized for predicting the onset of sepsis.

TRIAL REGISTRATION

CRD42022384015.

Artificial Intelligence and Neurosurgery: Tracking Antiplatelet Response Patterns for Endovascular Intervention

Platelets play a critical role in blood clotting and the development of arterial blockages. Antiplatelet therapy is vital for preventing recurring events in conditions like coronary artery disease and strokes. However, there is a lack of comprehensive guidelines for using antiplatelet agents in elective neurosurgery. Continuing therapy during surgery poses a bleeding risk, while discontinuing it before surgery increases the risk of thrombosis. Discontinuation is recommended in neurosurgical settings but carries an elevated risk of ischemic events. Conversely, maintaining antithrombotic therapy may increase bleeding and the need for transfusions, leading to a poor prognosis. Artificial intelligence (AI) holds promise in making difficult decisions regarding antiplatelet therapy. This paper discusses current clinical guidelines and supported regimens for antiplatelet therapy in neurosurgery. It also explores methodologies like P2Y12 reaction units (PRU) monitoring and thromboelastography (TEG) mapping for monitoring the use of antiplatelet regimens as well as their limitations. The paper explores the potential of AI to overcome such limitations associated with PRU monitoring and TEG mapping. It highlights various studies in the field of cardiovascular and neuroendovascular surgery which use AI prediction models to forecast adverse outcomes such as ischemia and bleeding, offering assistance in decision-making for antiplatelet therapy. In addition, the use of AI to improve patient adherence to antiplatelet regimens is also considered. Overall, this research aims to provide insights into the use of antiplatelet therapy and the role of AI in optimizing treatment plans in neurosurgical settings.

Comparison of intracranial pressure prediction in hydrocephalus patients among linear, non-linear, and machine learning regression models in Thailand

BACKGROUND

Hydrocephalus (HCP) is one of the most significant concerns in neurosurgical patients because it can cause increased intracranial pressure (ICP), resulting in mortality and morbidity. To date, machine learning (ML) has been helpful in predicting continuous outcomes. The primary objective of the present study was to identify the factors correlated with ICP, while the secondary objective was to compare the predictive performances among linear, non-linear, and ML regression models for ICP prediction.

METHODS

A total of 412 patients with various types of HCP who had undergone ventriculostomy was retrospectively included in the present study, and intraoperative ICP was recorded following ventricular catheter insertion. Several clinical factors and imaging parameters were analyzed for the relationship with ICP by linear correlation. The predictive performance of ICP was compared among linear, non-linear, and ML regression models.

RESULTS

Optic nerve sheath diameter (ONSD) had a moderately positive correlation with ICP (r=0.530, P<0.001), while several ventricular indexes were not statistically significant in correlation with ICP. For prediction of ICP, random forest (RF) and extreme gradient boosting (XGBoost) algorithms had low mean absolute error and root mean square error values and high R2 values compared to linear and non-linear regression when the predictive model included ONSD and ventricular indexes.

CONCLUSIONS

The XGBoost and RF algorithms are advantageous for predicting preoperative ICP and establishing prognoses for HCP patients. Furthermore, ML-based prediction could be used as a non-invasive method.

Assessing Metabolic Markers in Glioblastoma Using Machine Learning: A Systematic Review

Glioblastoma (GBM) is a common and deadly brain tumor with late diagnoses and poor prognoses. Machine learning (ML) is an emerging tool that can create highly accurate diagnostic and prognostic prediction models. This paper aimed to systematically search the literature on ML for GBM metabolism and assess recent advancements. A literature search was performed using predetermined search terms. Articles describing the use of an ML algorithm for GBM metabolism were included. Ten studies met the inclusion criteria for analysis: diagnostic (n = 3, 30%), prognostic (n = 6, 60%), or both (n = 1, 10%). Most studies analyzed data from multiple databases, while 50% (n = 5) included additional original samples. At least 2536 data samples were run through an ML algorithm. Twenty-seven ML algorithms were recorded with a mean of 2.8 algorithms per study. Algorithms were supervised (n = 24, 89%), unsupervised (n = 3, 11%), continuous (n = 19, 70%), or categorical (n = 8, 30%). The mean reported accuracy and AUC of ROC were 95.63% and 0.779, respectively. One hundred six metabolic markers were identified, but only EMP3 was reported in multiple studies. Many studies have identified potential biomarkers for GBM diagnosis and prognostication. These algorithms show promise; however, a consensus on even a handful of biomarkers has not yet been made.