Machine learning for the prediction of acute kidney injury and paraplegia after thoracoabdominal aortic aneurysm repair

Statistical models versus machine learning approach for competing risks in proctological surgery

Clinical risk prediction models are ubiquitous in many surgical domains. The traditional approach to develop these models involves the use of regression analysis. Machine learning algorithms are gaining in popularity as an alternative approach for prediction and classification problems. They can detect non-linear relationships between independent and dependent variables and incorporate many of them. In our work, we aimed to investigate the potential role of machine learning versus classical logistic regression for the preoperative risk assessment in proctological surgery. We used clinical data from a nationwide audit: the database consisted of 1510 patients affected by Goligher's grade III hemorrhoidal disease who underwent elective surgery. We collected anthropometric, clinical, and surgical data and we considered ten predictors to evaluate model-predictive performance. The clinical outcome was the complication rate evaluated at 30-day follow-up. Logistic regression and three machine learning techniques (Decision Tree, Support Vector Machine, Extreme Gradient Boosting) were compared in terms of area under the curve, balanced accuracy, sensitivity, and specificity. In our setting, machine learning and logistic regression models reached an equivalent predictive performance. Regarding the relative importance of the input features, all models agreed in identifying the most important factor. Combining and comparing statistical analysis and machine learning approaches in clinical field should be a common ambition, focused on improving and expanding interdisciplinary cooperation.

Predicting the risk factors of diabetic ketoacidosis-associated acute kidney injury: A machine learning approach using XGBoost

Objective

The purpose of this study was to develop and validate a predictive model based on a machine learning (ML) approach to identify patients with DKA at increased risk of AKI within 1 week of hospitalization in the intensive care unit (ICU).

Methods

Patients diagnosed with DKA from the Medical Information Mart for Intensive Care IV (MIMIC-IV) database according to the International Classification of Diseases (ICD)-9/10 code were included. The patient's medical history is extracted, along with data on their demographics, vital signs, clinical characteristics, laboratory results, and therapeutic measures. The best-performing model is chosen by contrasting the 8 Ml models. The area under the receiver operating characteristic curve (AUC), sensitivity, accuracy, and specificity were calculated to select the best-performing ML model.

Results

The final study enrolled 1,322 patients with DKA in total, randomly split into training (1,124, 85%) and validation sets (198, 15%). 497 (37.5%) of them experienced AKI within a week of being admitted to the ICU. The eXtreme Gradient Boosting (XGBoost) model performed best of the 8 Ml models, and the AUC of the training and validation sets were 0.835 and 0.800, respectively. According to the result of feature importance, the top 5 main features contributing to the XGBoost model were blood urea nitrogen (BUN), urine output, weight, age, and platelet count (PLT).

Conclusion

An ML-based individual prediction model for DKA-associated AKI (DKA-AKI) was developed and validated. The model performs robustly, identifies high-risk patients early, can assist in clinical decision-making, and can improve the prognosis of DKA patients to some extent.

Artificial Intelligence and Machine Learning in Perioperative Acute Kidney Injury

Acute kidney injury (AKI) is a common complication after a surgery, especially in cardiac and aortic procedures, and has a significant impact on morbidity and mortality. Early identification of high-risk patients and providing effective prevention and therapeutic approach are the main strategies for reducing the possibility of perioperative AKI. Consequently, several risk-prediction models and risk assessment scores have been developed for the prediction of perioperative AKI. However, a majority of these risk scores are only derived from preoperative data while the intraoperative time-series monitoring data such as heart rate and blood pressure were not included. Moreover, the complexity of the pathophysiology of AKI, as well as its nonlinear and heterogeneous nature, imposes limitations on the use of linear statistical techniques. The development of clinical medicine's digitization, the widespread availability of electronic medical records, and the increase in the use of continuous monitoring have generated vast quantities of data. Machine learning has recently shown promise as a method for automatically integrating large amounts of data in predicting the risk of perioperative outcomes. In this article, we discussed the development, limitations of existing work, and the potential future direction of models using machine learning techniques to predict AKI after a surgery.

Artificial intelligence for the prediction of acute kidney injury during the perioperative period: systematic review and Meta-analysis of diagnostic test accuracy

BACKGROUND

Acute kidney injury (AKI) is independently associated with morbidity and mortality in a wide range of surgical settings. Nowadays, with the increasing use of electronic health records (EHR), advances in patient information retrieval, and cost reduction in clinical informatics, artificial intelligence is increasingly being used to improve early recognition and management for perioperative AKI. However, there is no quantitative synthesis of the performance of these methods. We conducted this systematic review and meta-analysis to estimate the sensitivity and specificity of artificial intelligence for the prediction of acute kidney injury during the perioperative period.

METHODS

Pubmed, Embase, and Cochrane Library were searched to 2nd October 2021. Studies presenting diagnostic performance of artificial intelligence in the early detection of perioperative acute kidney injury were included. True positives, false positives, true negatives and false negatives were pooled to collate specificity and sensitivity with 95% CIs and results were portrayed in forest plots. The risk of bias of eligible studies was assessed using the PROBAST tool.

RESULTS

Nineteen studies involving 304,076 patients were included. Quantitative random-effects meta-analysis using the Rutter and Gatsonis hierarchical summary receiver operating characteristics (HSROC) model revealed pooled sensitivity, specificity, and diagnostic odds ratio of 0.77 (95% CI: 0.73 to 0.81),0.75 (95% CI: 0.71 to 0.80), and 10.7 (95% CI 8.5 to 13.5), respectively. Threshold effect was found to be the only source of heterogeneity, and there was no evidence of publication bias.

CONCLUSIONS

Our review demonstrates the promising performance of artificial intelligence for early prediction of perioperative AKI. The limitations of lacking external validation performance and being conducted only at a single center should be overcome.

TRIAL REGISTRATION

This study was not registered with PROSPERO.

Machine learning models for predicting acute kidney injury: a systematic review and critical appraisal

BACKGROUND

The number of studies applying machine learning (ML) to predict acute kidney injury (AKI) has grown steadily over the past decade. We assess and critically appraise the state of the art in ML models for AKI prediction, considering performance, methodological soundness, and applicability.

METHODS

We searched PubMed and ArXiv, extracted data, and critically appraised studies based on the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD), Checklist for Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies (CHARMS), and Prediction Model Risk of Bias Assessment Tool (PROBAST) guidelines.

RESULTS

Forty-six studies from 3166 titles were included. Thirty-eight studies developed a model, five developed and externally validated one, and three studies externally validated one. Flexible ML methods were used more often than deep learning, although the latter was common with temporal variables and text as predictors. Predictive performance showed an area under receiver operating curves ranging from 0.49 to 0.99. Our critical appraisal identified a high risk of bias in 39 studies. Some studies lacked internal validation, whereas external validation and interpretability of results were rarely considered. Fifteen studies focused on AKI prediction in the intensive care setting, and the US-derived Medical Information Mart for Intensive Care (MIMIC) data set was commonly used. Reproducibility was limited as data and code were usually unavailable.

CONCLUSIONS

Flexible ML methods are popular for the prediction of AKI, although more complex models based on deep learning are emerging. Our critical appraisal identified a high risk of bias in most models: Studies should use calibration measures and external validation more often, improve model interpretability, and share data and code to improve reproducibility.

Prediction of Acute Kidney Injury After Cardiac Surgery Using Interpretable Machine Learning

Background

Acute kidney injury (AKI) is a complication that occurs for various reasons after surgery, especially cardiac surgery. This complication can lead to a prolonged treatment process, increased costs, and sometimes death. Prediction of postoperative AKI can help anesthesiologists to implement preventive and early treatment strategies to reduce the risk of AKI.

Objectives

This study tries to predict postoperative AKI using interpretable machine learning models.

Methods

For this study, the information of 1435 patients was collected from multiple centers. The gathered data are in six categories: demographic characteristics and type of surgery, past medical history (PMH), drug history (DH), laboratory information, anesthesia and surgery information, and postoperative variables. Machine learning methods, including support vector machine (SVM), multilayer perceptron (MLP), decision tree (DT), random forest (RF), logistic regression, XGBoost, and AdaBoost, were used to predict postoperative AKI. Local interpretable model-agnostic explanations (LIME) and the Shapley methods were then leveraged to check the interpretability of models.

Results

Comparing the area under the curves (AUCs) obtained for different machine learning models show that the RF and XGBoost methods with values of 0.81 and 0.80 best predict postoperative AKI. The interpretations obtained for the machine learning models show that creatinine (Cr), cardiopulmonary bypass time (CPB time), blood sugar (BS), and albumin (Alb) have the most significant impact on predictions.

Conclusions

The treatment team can be informed about the possibility of postoperative AKI before cardiac surgery using machine learning models such as RF and XGBoost and adjust the treatment procedure accordingly. Interpretability of predictions for each patient ensures the validity of obtained predictions.

Machine Learning for the Prediction of Complications in Patients After Mitral Valve Surgery

Background: This study intended to use a machine learning model to identify critical preoperative and intraoperative variables and predict the risk of several severe complications (myocardial infarction, stroke, renal failure, and hospital mortality) after cardiac valvular surgery.

Study Design and Methods: A total of 1,488 patients undergoing cardiac valvular surgery in eight large tertiary hospitals in China were examined. Fifty-four perioperative variables, such as essential demographic characteristics, concomitant disease, preoperative laboratory indicators, operation type, and intraoperative information, were collected. Machine learning models were developed and validated by 10-fold cross-validation. In each fold, Recursive Feature Elimination was used to select key variables. Ten machine learning models and logistic regression were developed. The area under the receiver operating characteristic (AUROC), accuracy (ACC), Youden index, sensitivity, specificity, F1-score, positive predictive value (PPV), and negative predictive value (NPV) were used to compare the prediction performance of different models. The SHapley Additive ex Planations package was applied to interpret the best machine learning model. Finally, a model was trained on the whole dataset with the merged key variables, and a web tool was created for clinicians to use.

Results: In this study, 14 vital variables, namely, intraoperative total input, intraoperative blood loss, intraoperative colloid bolus, Classification of New York Heart Association (NYHA) heart function, preoperative hemoglobin (Hb), preoperative platelet (PLT), age, preoperative fibrinogen (FIB), intraoperative minimum red blood cell volume (Hct), body mass index (BMI), creatinine, preoperative Hct, intraoperative minimum Hb, and intraoperative autologous blood, were finally selected. The eXtreme Gradient Boosting algorithms (XGBOOST) algorithm model presented a significantly better predictive performance (AUROC: 0.90) than the other models (ACC: 81%, Youden index: 70%, sensitivity: 89%, specificity: 81%, F1-score:0.26, PPV: 15%, and NPV: 99%).

Conclusion: A model for predicting several severe complications after cardiac valvular surgery was successfully developed using a machine learning algorithm based on 14 perioperative variables, which could guide clinical physicians to take appropriate preventive measures and diminish the complications for patients at high risk.

Does Artificial Intelligence Make Clinical Decision Better? A Review of Artificial Intelligence and Machine Learning in Acute Kidney Injury Prediction

Acute kidney injury (AKI) is a common complication of hospitalization that greatly and negatively affects the short-term and long-term outcomes of patients. Current guidelines use serum creatinine level and urine output rate for defining AKI and as the staging criteria of AKI. However, because they are not sensitive or specific markers of AKI, clinicians find it difficult to predict the occurrence of AKI and prescribe timely treatment. Advances in computing technology have led to the recent use of machine learning and artificial intelligence in AKI prediction, recent research reported that by using electronic health records (EHR) the AKI prediction via machine-learning models can reach AUROC over 0.80, in some studies even reach 0.93. Our review begins with the background and history of the definition of AKI, and the evolution of AKI risk factors and prediction models is also appraised. Then, we summarize the current evidence regarding the application of e-alert systems and machine-learning models in AKI prediction.

The cardiac surgeon's guide to artificial intelligence

PURPOSE OF REVIEW

Artificial intelligence is the ability for machines to perform intelligent tasks. Artificial intelligence is already penetrating many aspects of medicine including cardiac surgery. Here, we offer a platform introduction to artificial intelligence for cardiac surgeons to understand the implementations of this transformative tool.

RECENT FINDINGS

Artificial intelligence has contributed greatly to the automation of cardiac imaging, including echocardiography, cardiac computed tomography, cardiac MRI and most recently, in radiomics. There are also several artificial intelligence based clinical prediction tools that predict complex outcomes after cardiac surgery. Waveform analysis, specifically, automated electrocardiogram analysis, has seen significant strides with promise in wearables and remote monitoring. Experimentally, artificial intelligence has also entered the operating room in the form of augmented reality and automated robotic surgery.

SUMMARY

Artificial intelligence has many potential exciting applications in cardiac surgery. It can streamline physician workload and help make medicine more human again by placing the physician back at the bedside. Here, we offer cardiac surgeons an introduction to this transformative tool so that they may actively participate in creating clinically relevant implementations to improve our practice.

Artificial intelligence and machine learning in aortic disease

PURPOSE OF REVIEW

Discuss foundational concepts for artificial intelligence (AI) and review recent literature on its application to aortic disease.

RECENT FINDINGS

Machine learning (ML) techniques are rapidly evolving for the evaluation of aortic disease - broadly categorized as algorithms for aortic segmentation, detection of pathology, and risk stratification. Advances in deep learning, particularly U-Net architectures, have revolutionized segmentation of the aorta and show potential for monitoring the size of aortic aneurysm and characterizing aortic dissection. These algorithms also facilitate application of more complex technologies including analysis of flow dynamics with 4D Flow magnetic resonance imaging (MRI) and computational simulation of fluid dynamics for aortic coarctation. In addition, AI algorithms have been proposed to assist in 'opportunistic' screening from routine imaging exams, including automated aortic calcification score, which has emerged as a strong predictor of cardiovascular risk. Finally, several ML algorithms are being explored for risk stratification of patients with aortic aneurysm and dissection, in addition to prediction of postprocedural complications.

SUMMARY

Multiple ML techniques have potential for characterization and risk prediction of aortic aneurysm, dissection, coarctation, and atherosclerotic disease on computed tomography and MRI. This nascent field shows considerable promise with many applications in development and in early preclinical evaluation.

Comparison of machine learning and logistic regression models in predicting acute kidney injury: A systematic review and meta-analysis

INTRODUCTION

We aimed to assess whether machine learning models are superior at predicting acute kidney injury (AKI) compared to logistic regression (LR), a conventional prediction model.

METHODS

Eligible studies were identified using PubMed and Embase. A total of 24 studies consisting of 84 prediction models met inclusion criteria. Independent samples t-test was performed to detect mean differences in area under the curve (AUC) between ML and LR models. One-way ANOVA and post-hoc t-tests were performed to assess mean differences in AUC between ML methods.

RESULTS

AUC data were similar between ML (0.736 ± 0.116) and LR (0.748 ± 0.057) models (p = 0.538). However, specific ML models, such as gradient boosting (0.838 ± 0.077), exhibited superior performance at predicting AKI as compared to other ML models in the literature (p < 0.05). Creatinine and urine output, standard variables assessed for AKI staging, were classified as significant predictors across multiple ML models, although the majority of significant predictors were unique and study specific.

CONCLUSIONS

These data suggest that ML models perform equally to that of LR, however ML models exhibit variable performance with some ML models displaying exceptional performance. The variability in ML prediction of AKI can be attributed, in part, to the specific ML model utilized, variable selection and processing, study and subject characteristics, and the steps associated with model training, validation, testing, and calibration.

Preoperative assessment of patient comorbidities before left colectomy: Comparison between ASA performance status scale and a new computed tomography physical status score

PURPOSE

To compare a newly developed preoperative computed tomography physical status (CT-PS) score with the American Society of Anesthesiology performance status (ASA-PS) scale in the assessment of patient preoperative health status and stratification of perioperative risk before left colectomy.

MATERIALS AND METHODS

Preoperative chest-abdomen-pelvis CT examinations of patients who were scheduled to undergo elective laparoscopic left colonic resection for cancer in two centers were reviewed by two radiologists blinded to clinical data for the presence of several key imaging features in order to assess general, cardiac, pulmonary, abdominal, renal, vascular and musculoskeletal status. CT examinations of patients from center 1 were used to build a CT-PS score to predict ASA-PS≥III. CT-PS score was further validated using an external cohort of patients from center 2.

RESULTS

During a 2-year period, 117 consecutive patients (63 men, 54 women; mean age, 65±13 [SD] years; age range: 53-90 years) who underwent laparoscopic left colectomy for cancer in center 1 (66 patients, building cohort) and center 2 (51 patients, validation cohort) were retrospectively included. Ninety-one percent of patients were ASA-PS 1-2. Overall postoperative morbidity was 23% and severe morbidity 12%. The area under the receiver operating characteristic curve of CT-PS score was 0.968 (95% CI: 0.901-1.000) in the building cohort and 0.828 (95% CI: 0.693-0.963) in the validation cohort. The optimal thresholds yielded 87% (95% CI: 83-91%) sensitivity and 100% (95% CI: 91-100%) specificity in the building cohort and 75% (95% CI: 69-81%) sensitivity and 83% (95% CI: 77-88%) specificity in the validation cohort for the prediction of ASA-PS.

CONCLUSION

Preoperative chest-abdomen-pelvis CT thoroughly and wisely read is highly accurate to differentiate patients with ASA-PS I/II from those with ASA-PS III/IV before left colectomy.

Promises of Big Data and Artificial Intelligence in Nephrology and Transplantation

Kidney diseases form part of the major health burdens experienced all over the world. Kidney diseases are linked to high economic burden, deaths, and morbidity rates. The great importance of collecting a large quantity of health-related data among human cohorts, what scholars refer to as "big data", has increasingly been identified, with the establishment of a large group of cohorts and the usage of electronic health records (EHRs) in nephrology and transplantation. These data are valuable, and can potentially be utilized by researchers to advance knowledge in the field. Furthermore, progress in big data is stimulating the flourishing of artificial intelligence (AI), which is an excellent tool for handling, and subsequently processing, a great amount of data and may be applied to highlight more information on the effectiveness of medicine in kidney-related complications for the purpose of more precise phenotype and outcome prediction. In this article, we discuss the advances and challenges in big data, the use of EHRs and AI, with great emphasis on the usage of nephrology and transplantation.