Machine learning algorithm to predict mortality in patients undergoing continuous renal replacement therapy

Prediction of successful weaning from renal replacement therapy in critically ill patients based on machine learning

BACKGROUND

Predicting the successful weaning of acute kidney injury (AKI) patients from renal replacement therapy (RRT) has emerged as a research focus, and we successfully built predictive models for RRT withdrawal in patients with severe AKI by machine learning.

METHODS

This retrospective single-center study utilized data from our general intensive care unit (ICU) Database, focusing on patients diagnosed with severe AKI who underwent RRT. We evaluated RRT weaning success based on patients being free of RRT in the subsequent week and their overall survival. Multiple logistic regression (MLR) and machine learning algorithms were adopted to construct the prediction models.

RESULTS

A total of 976 patients were included, with 349 patients successfully weaned off RRT. Longer RRT duration (7.0 vs. 9.6 d, p = 0.002, OR = 0.94), higher serum cystatin C levels (1.2 vs. 3.2 mg/L, p < 0.001, OR = 0.46), and the presence of septic shock (28.1% vs. 41.5%, p < 0.001, OR = 0.63) were associated with reduced likelihood of RRT weaning. Conversely, a positive furosemide stress test (FST) (60.2% vs. 40.7%, p < 0.001, OR = 2.75) and higher total urine volume 3 d before RRT withdrawal (755 vs. 125 mL/d, p < 0.001, OR = 2.12) were associated with an increased likelihood of successful weaning from RRT. Next, we demonstrated that machine learning models, especially Random Forest and XGBoost, achieving an AUROC of 0.95. The XGBoost model exhibited superior accuracy, yielding an AUROC of 0.849.

CONCLUSION

High-risk factors for unsuccessful RRT weaning in severe AKI patients include prolonged RRT duration. Machine learning prediction models, when compared to models based on multivariate logistic regression using these indicators, offer distinct advantages in predictive accuracy.

Ensemble Machine Learning for Predicting 90-Day Outcomes and Analyzing Risk Factors in Acute Kidney Injury Requiring Dialysis

Purpose

Our objectives were to (1) employ ensemble machine learning algorithms utilizing real-world clinical data to predict 90-day prognosis, including dialysis dependence and mortality, following the first hospitalized dialysis and (2) identify the significant factors associated with overall outcomes.

Patients and Methods

We identified hospitalized patients with Acute kidney injury requiring dialysis (AKI-D) from a dataset of the Taipei Medical University Clinical Research Database (TMUCRD) from January 2008 to December 2020. The extracted data comprise demographics, comorbidities, medications, and laboratory parameters. Ensemble machine learning models were developed utilizing real-world clinical data through the Google Cloud Platform.

Results

The Study Analyzed 1080 Patients in the Dialysis-Dependent Module, Out of Which 616 Received Regular Dialysis After 90 Days. Our Ensemble Model, Consisting of 25 Feedforward Neural Network Models, Demonstrated the Best Performance with an Auroc of 0.846. We Identified the Baseline Creatinine Value, Assessed at Least 90 Days Before the Initial Dialysis, as the Most Crucial Factor. We selected 2358 patients, 984 of whom were deceased after 90 days, for the survival module. The ensemble model, comprising 15 feedforward neural network models and 10 gradient-boosted decision tree models, achieved superior performance with an AUROC of 0.865. The pre-dialysis creatinine value, tested within 90 days prior to the initial dialysis, was identified as the most significant factor.

Conclusion

Ensemble machine learning models outperform logistic regression models in predicting outcomes of AKI-D, compared to existing literature. Our study, which includes a large sample size from three different hospitals, supports the significance of the creatinine value tested before the first hospitalized dialysis in determining overall prognosis. Healthcare providers could benefit from utilizing our validated prediction model to improve clinical decision-making and enhance patient care for the high-risk population.

Identification and validation of an explainable prediction model of acute kidney injury with prognostic implications in critically ill children: a prospective multicenter cohort study

Background

Acute kidney injury (AKI) is a common and serious organ dysfunction in critically ill children. Early identification and prediction of AKI are of great significance. However, current AKI criteria are insufficiently sensitive and specific, and AKI heterogeneity limits the clinical value of AKI biomarkers. This study aimed to establish and validate an explainable prediction model based on the machine learning (ML) approach for AKI, and assess its prognostic implications in children admitted to the pediatric intensive care unit (PICU).

Methods

This multicenter prospective study in China was conducted on critically ill children for the derivation and validation of the prediction model. The derivation cohort, consisting of 957 children admitted to four independent PICUs from September 2020 to January 2021, was separated for training and internal validation, and an external data set of 866 children admitted from February 2021 to February 2022 was employed for external validation. AKI was defined based on serum creatinine and urine output using the Kidney Disease: Improving Global Outcome (KDIGO) criteria. With 33 medical characteristics easily obtained or evaluated during the first 24 h after PICU admission, 11 ML algorithms were used to construct prediction models. Several evaluation indexes, including the area under the receiver-operating-characteristic curve (AUC), were used to compare the predictive performance. The SHapley Additive exPlanation method was used to rank the feature importance and explain the final model. A probability threshold for the final model was identified for AKI prediction and subgrouping. Clinical outcomes were evaluated in various subgroups determined by a combination of the final model and KDIGO criteria.

Findings

The random forest (RF) model performed best in discriminative ability among the 11 ML models. After reducing features according to feature importance rank, an explainable final RF model was established with 8 features. The final model could accurately predict AKI in both internal (AUC = 0.929) and external (AUC = 0.910) validations, and has been translated into a convenient tool to facilitate its utility in clinical settings. Critically ill children with a probability exceeding or equal to the threshold in the final model had a higher risk of death and multiple organ dysfunctions, regardless of whether they met the KDIGO criteria for AKI.

Interpretation

Our explainable ML model was not only successfully developed to accurately predict AKI but was also highly relevant to adverse outcomes in individual children at an early stage of PICU admission, and it mitigated the concern of the "black-box" issue with an undirect interpretation of the ML technique.

Funding

The National Natural Science Foundation of China, Jiangsu Province Science and Technology Support Program, Key talent of women's and children's health of Jiangsu Province, and Postgraduate Research & Practice Innovation Program of Jiangsu Province.

MACHINE LEARNING FOR PREDICTING HEMODYNAMIC DETERIORATION OF PATIENTS WITH INTERMEDIATE-RISK PULMONARY EMBOLISM IN INTENSIVE CARE UNIT

ABSTRACT

Background: Intermediate-risk pulmonary embolism (PE) patients in the intensive care unit (ICU) are at a higher risk of hemodynamic deterioration than those in the general ward. This study aimed to construct a machine learning (ML) model to accurately identify the tendency for hemodynamic deterioration in the ICU patients with intermediate-risk PE. Method: A total of 704 intermediate-risk PE patients from the MIMIC-IV database were retrospectively collected. The primary outcome was defined as hemodynamic deterioration occurring within 30 days after admission to ICU. Four ML algorithms were used to construct models on the basis of all variables from MIMIC IV database with missing values less than 20%. The extreme gradient boosting (XGBoost) model was further simplified for clinical application. The performance of the ML models was evaluated by using the receiver operating characteristic curve, calibration plots, and decision curve analysis. Predictive performance of simplified XGBoost was compared with the simplified Pulmonary Embolism Severity Index score. SHapley Additive explanation (SHAP) was performed on a simplified XGBoost model to calculate the contribution and impact of each feature on the predicted outcome and presents it visually. Results: Among the 704 intermediate-risk PE patients included in this study, 120 patients experienced hemodynamic deterioration within 30 days after admission to the ICU. Simplified XGBoost model demonstrated the best predictive performance with an area under the curve of 0.866 (95% confidence interval, 0.800-0.925), and after recalibrated by isotonic regression, the area under the curve improved to 0.885 (95% confidence interval, 0.822-0.935). Based on the simplified XGBoost model, a web app was developed to identify the tendency for hemodynamic deterioration in ICU patients with intermediate-risk PE. Conclusion: A simplified XGBoost model can accurately predict the occurrence of hemodynamic deterioration for intermediate-risk PE patients in the ICU, assisting clinical workers in providing more personalized management for PE patients in the ICU.

Supervised machine learning model to predict mortality in patients undergoing venovenous extracorporeal membrane oxygenation from a nationwide multicentre registry

BACKGROUND

Existing models have performed poorly when predicting mortality for patients undergoing venovenous extracorporeal membrane oxygenation (VV-ECMO). This study aimed to develop and validate a machine learning (ML)-based prediction model to predict 90-day mortality in patients undergoing VV-ECMO.

METHODS

This study included 368 patients with acute respiratory failure undergoing VV-ECMO from 16 tertiary hospitals across South Korea between 2012 and 2015. The primary outcome was the 90-day mortality after ECMO initiation. The inputs included all available features (n=51) and those from the electronic health record (EHR) systems without preprocessing (n=40). The discriminatory strengths of ML models were evaluated in both internal and external validation sets. The models were compared with conventional models, such as respiratory ECMO survival prediction (RESP) and predicting death for severe acute respiratory distress syndrome on VV-ECMO (PRESERVE).

RESULTS

Extreme gradient boosting (XGB) (areas under the receiver operating characteristic curve, AUROC 0.82, 95% CI (0.73 to 0.89)) and light gradient boosting (AUROC 0.81 (95% CI 0.71 to 0.88)) models achieved the highest performance using EHR's and all other available features. The developed models had higher AUROCs (95% CI 0.76 to 0.82) than those of RESP (AUROC 0.66 (95% CI 0.56 to 0.76)) and PRESERVE (AUROC 0.71 (95% CI 0.61 to 0.81)). Additionally, we achieved an AUROC (0.75) for 90-day mortality in external validation in the case of the XGB model, which was higher than that of RESP (0.70) and PRESERVE (0.67) in the same validation dataset.

CONCLUSIONS

ML prediction models outperformed previous mortality risk models. This model may be used to identify patients who are unlikely to benefit from VV-ECMO therapy during patient selection.

Mortality prediction with adaptive feature importance recalibration for peritoneal dialysis patients

The study aims to develop AICare, an interpretable mortality prediction model, using electronic medical records (EMR) from follow-up visits for end-stage renal disease (ESRD) patients. AICare includes a multichannel feature extraction module and an adaptive feature importance recalibration module. It integrates dynamic records and static features to perform personalized health context representation learning. The dataset encompasses 13,091 visits and demographic data of 656 peritoneal dialysis (PD) patients spanning 12 years. An additional public dataset of 4,789 visits from 1,363 hemodialysis (HD) patients is also considered. AICare outperforms traditional deep learning models in mortality prediction while retaining interpretability. It uncovers mortality-feature relationships and variations in feature importance and provides reference values. An AI-doctor interaction system is developed for visualizing patients' health trajectories and risk indicators.

Risk factors of hemodialysis catheter dysfunction in patients undergoing continuous renal replacement therapy: a retrospective study

BACKGROUND

Continuous renal replacement therapy is a relatively common modality applied to critically ill patients with renal impairment. To maintain stable continuous renal replacement therapy, sufficient blood flow through the circuit is crucial, but catheter dysfunction reduces the blood flow by inadequate pressures within the circuit. Therefore, exploring and modifying the possible risk factors related to catheter dysfunction can help to provide continuous renal replacement therapy with minimal interruption.

METHODS

Adult patients who received continuous renal replacement therapy at Seoul National University Hospital between January 2019 and December 2021 were retrospectively analyzed. Patients who received continuous renal replacement therapy via a temporary hemodialysis catheter, inserted at the bedside under ultrasound guidance within 12 h of continuous renal replacement therapy initiation were included.

RESULTS

A total of 507 continuous renal replacement therapy sessions in 457 patients were analyzed. Dialysis catheter dysfunction occurred in 119 sessions (23.5%). Multivariate analysis showed that less prolonged prothrombin time (adjusted OR 0.49, 95% CI, 0.30-0.82, p = 0.007) and activated partial thromboplastin time (adjusted OR 1.01, 95% CI, 1.00-1.01, p = 0.049) were associated with increased risk of catheter dysfunction. Risk factors of re-catheterization included vascular access to the left jugular and femoral vein.

CONCLUSIONS

In critically ill patients undergoing continuous renal replacement therapy, less prolonged prothrombin time was associated with earlier catheter dysfunction. Use of left internal jugular veins and femoral vein were associated with increased risk of re-catheterization compared to the right internal jugular vein.

Explainable machine learning using perioperative serial laboratory results to predict postoperative mortality in patients with peritonitis-induced sepsis

Purpose

Sepsis is one of the most common causes of death after surgery. Several conventional scoring systems have been developed to predict the outcome of sepsis; however, their predictive power is insufficient. The present study applies explainable machine-learning algorithms to improve the accuracy of predicting postoperative mortality in patients with sepsis caused by peritonitis.

Methods

We performed a retrospective analysis of data from demographic, clinical, and laboratory analyses, including the delta neutrophil index (DNI), WBC and neutrophil counts, and CRP level. Laboratory data were measured before surgery, 12-36 hours after surgery, and 60-84 hours after surgery. The primary study output was the probability of mortality. The areas under the receiver operating characteristic curves (AUCs) of several machine-learning algorithms using the Sequential Organ Failure Assessment (SOFA) and Simplified Acute Physiology Score (SAPS) 3 models were compared. 'SHapley Additive exPlanations' values were used to indicate the direction of the relationship between a variable and mortality.

Results

The CatBoost model yielded the highest AUC (0.933) for mortality compared to SAPS3 and SOFA (0.860 and 0.867, respectively). Increased DNI on day 3, septic shock, use of norepinephrine therapy, and increased international normalized ratio on day 3 had the greatest impact on the model's prediction of mortality.

Conclusion

Machine-learning algorithms increase the accuracy of predicting postoperative mortality in patients with sepsis caused by peritonitis.

Risk factor mining and prediction of urine protein progression in chronic kidney disease: a machine learning- based study

BACKGROUND

Chronic kidney disease (CKD) is a global public health concern. Therefore, to provide timely intervention for non-hospitalized high-risk patients and rationally allocate limited clinical resources is important to mine the key factors when designing a CKD prediction model.

METHODS

This study included data from 1,358 patients with CKD pathologically confirmed during the period from December 2017 to September 2020 at Zhongshan Hospital. A CKD prediction interpretation framework based on machine learning was proposed. From among 100 variables, 17 were selected for the model construction through a recursive feature elimination with logistic regression feature screening. Several machine learning classifiers, including extreme gradient boosting, gaussian-based naive bayes, a neural network, ridge regression, and linear model logistic regression (LR), were trained, and an ensemble model was developed to predict 24-hour urine protein. The detailed relationship between the risk of CKD progression and these predictors was determined using a global interpretation. A patient-specific analysis was conducted using a local interpretation.

RESULTS

The results showed that LR achieved the best performance, with an area under the curve (AUC) of 0.850 in a single machine learning model. The ensemble model constructed using the voting integration method further improved the AUC to 0.856. The major predictors of moderate-to-severe severity included lower levels of 25-OH-vitamin, albumin, transferrin in males, and higher levels of cystatin C.

CONCLUSIONS

Compared with the clinical single kidney function evaluation indicators (eGFR, Scr), the machine learning model proposed in this study improved the prediction accuracy of CKD progression by 17.6% and 24.6%, respectively, and the AUC was improved by 0.250 and 0.236, respectively. Our framework can achieve a good predictive interpretation and provide effective clinical decision support.

Predicting dry weight change in Hemodialysis patients using machine learning

BACKGROUND

Machine Learning has been increasingly used in the medical field, including managing patients undergoing hemodialysis. The random forest classifier is a Machine Learning method that can generate high accuracy and interpretability in the data analysis of various diseases. We attempted to apply Machine Learning to adjust dry weight, the appropriate volume status of patients undergoing hemodialysis, which requires a complex decision-making process considering multiple indicators and the patient's physical conditions.

METHODS

All medical data and 69,375 dialysis records of 314 Asian patients undergoing hemodialysis at a single dialysis center in Japan between July 2018 and April 2020 were collected from the electronic medical record system. Using the random forest classifier, we developed models to predict the probabilities of adjusting the dry weight at each dialysis session.

RESULTS

The areas under the receiver-operating-characteristic curves of the models for adjusting the dry weight upward and downward were 0.70 and 0.74, respectively. The average probability of upward adjustment of the dry weight had sharp a peak around the actual change over time, while the average probability of downward adjustment of the dry weight formed a gradual peak. Feature importance analysis revealed that median blood pressure decline was a strong predictor for adjusting the dry weight upward. In contrast, elevated serum levels of C-reactive protein and hypoalbuminemia were important indicators for adjusting the dry weight downward.

CONCLUSIONS

The random forest classifier should provide a helpful guide to predict the optimal changes to the dry weight with relative accuracy and may be useful in clinical practice.

Urinary neutrophil gelatinase-associated lipocalin and plasma IL-6 in discontinuation of continuous venovenous hemodiafiltration for severe acute kidney injury: a multicenter prospective observational study

BACKGROUND

Patients with severe acute kidney injury (AKI) who require continuous venovenous hemodiafiltration (CVVHDF) in intensive care unit (ICU) are at high mortality risk. Little is known about clinical biomarkers for risk prediction, optimal initiation, and optimal discontinuation of CVVHDF.

METHODS

This prospective observational study was conducted in seven university-affiliated ICUs. For urinary neutrophil gelatinase-associated lipocalin (NGAL) and plasma IL-6 measurements, samples were collected at initiation, 24 h, 48 h after, and CVVHDF discontinuation in adult patients with severe AKI. The outcomes were deaths during CVVHDF and CVVHDF dependence.

RESULTS

A total number of 133 patients were included. Twenty-eight patients died without CVVHDF discontinuation (CVVHDF nonsurvivors). Urinary NGAL and plasma IL-6 at the CVVHDF initiation were significantly higher in CVVHDF nonsurvivors than in survivors. Among 105 CVVHDF survivors, 70 patients were free from renal replacement therapy (RRT) or death in the next 7 days after discontinuation (success group), whereas 35 patients died or needed RRT again (failure group). Urinary NGAL at CVVHDF discontinuation was significantly lower in the success group (93.8 ng/ml vs. 999 ng/ml, p < 0.01), whereas no significant difference was observed in plasma IL-6 between the groups. Temporal elevations of urinary NGAL levels during the first 48 h since CVVHDF initiation were observed in CVVHDF nonsurvivors and those who failed in CVVHDF discontinuation.

CONCLUSIONS

Urinary NGAL at CVVHDF initiation and discontinuation was associated with mortality and RRT dependence, respectively. The serial changes of urinary NGAL might also help predict the prognosis of patients with AKI on CVVHDF.

Predicting outcomes of continuous renal replacement therapy using body composition monitoring: a deep-learning approach

Fluid balance is a critical prognostic factor for patients with severe acute kidney injury (AKI) requiring continuous renal replacement therapy (CRRT). This study evaluated whether repeated fluid balance monitoring could improve prognosis in this clinical population. This was a multicenter retrospective study that included 784 patients (mean age, 67.8 years; males, 66.4%) with severe AKI requiring CRRT during 2017-2019 who were treated in eight tertiary hospitals in Korea. Sequential changes in total body water were compared between patients who died (event group) and those who survived (control group) using mixed-effects linear regression analyses. The performance of various machine learning methods, including recurrent neural networks, was compared to that of existing prognostic clinical scores. After adjusting for confounding factors, a marginal benefit of fluid balance was identified for the control group compared to that for the event group (p = 0.074). The deep-learning model using a recurrent neural network with an autoencoder and including fluid balance monitoring provided the best differentiation between the groups (area under the curve, 0.793) compared to 0.604 and 0.606 for SOFA and APACHE II scores, respectively. Our prognostic, deep-learning model underlines the importance of fluid balance monitoring for prognosis assessment among patients receiving CRRT.

Prediction of acute organophosphate poisoning severity using machine learning techniques

Poisoning with organophosphate compounds is a significant public health risk, especially in developing countries. Considering the importance of early and accurate prediction of organophosphate poisoning prognosis, the aim of this study was to develop a machine learning-based prediction model to predict the severity of organophosphate poisoning. The data of patients with organophosphate poisoning were retrospectively extracted and split into training and test sets in a ratio of 70:30. The feature selection was done by least absolute shrinkage and selection operator method. Selected features were fed into five machine learning techniques, including Histogram Boosting Gradient, eXtreme Gradient Boosting, K-Nearest Neighborhood, Support Vector Machine (SVM) (kernel = linear), and Random Forest. The Scikit-learn library in Python programming language was used to implement the models. Finally, the performance of developed models was measured using ten-fold cross-validation methods and some evaluation criteria with 95 % confidence intervals. A total of 1237 patients were used to train and test the machine learning models. According to the criteria determining severe organophosphate poisoning, 732 patients were assigned to group 1 (patients with mild to moderate poisoning) and 505 patients were assigned to group 2 (patients with severe poisoning). With an AUC value of 0.907 (95 % CI 0.89-0.92), the model developed using XGBoost outperformed other models. Feature importance evaluation found that venous blood gas-pH, white blood cells, and plasma cholinesterase activity were the top three variables that contribute the most to the prediction performance of the prognosis in patients with organophosphate poisoning. XGBoost model yield an accuracy of 90.1 % (95 % CI 0.891-0.918), specificity of 91.4 % (95 % CI 0.90-0.92), a sensitivity of 89.5 % (95 % CI 0.87-0.91), F-measure of 91.2 % (95 % CI 0.90-0.921), and Kappa statistic of 91.2 % (95 % CI 0.90-0.92). The machine learning-based prediction models can accurately predict the severity of organophosphate poisoning. Based on feature selection techniques, the most important predictors of organophosphate poisoning were VBG-pH, white blood cell count, plasma cholinesterase activity, VBG-BE, and age. The best algorithm with the highest predictive performance was the XGBoost classifier.

Development and validation of a machine learning-based predictive model for secondary post-tonsillectomy hemorrhage

Background

The main obstacle to a patient's recovery following a tonsillectomy is complications, and bleeding is the most frequent culprit. Predicting post-tonsillectomy hemorrhage (PTH) allows for accurate identification of high-risk populations and the implementation of protective measures. Our study aimed to investigate how well machine learning models predict the risk of PTH.

Methods

Data were obtained from 520 patients who underwent a tonsillectomy at The 940th Hospital of Joint Logistics Support Force of Chinese People's Liberation Army. The age range of the patients was 2-57 years, and 364 (70%) were male. The prediction models were developed using five machine learning models: decision tree, support vector machine (SVM), extreme gradient boosting (XGBoost), random forest, and logistic regression. The performance of the models was evaluated using the area under the receiver operating characteristic curve (AUC). Shapley additive explanation (SHAP) was used to interpret the results of the best-performing model.

Results

The frequency of PTH was 11.54% among the 520 patients, with 10.71% in the training group and 13.46% in the validation set. Age, BMI, season, smoking, blood type, INR, combined secretory otitis media, combined adenoidectomy, surgical wound, and use of glucocorticoids were selected by mutual information (MI) method. The XGBoost model had best AUC (0.812) and Brier score (0.152). Decision curve analysis (DCA) showed that the model had a high clinical utility. The SHAP method revealed the top 10 variables of MI according to the importance ranking, and the average of the age was recognized as the most important predictor variable.

Conclusion

This study built a PTH risk prediction model using machine learning. The XGBoost model is a tool with potential to facilitate population management strategies for PTH.

Development and validation of clinical prediction models for acute kidney injury recovery at hospital discharge in critically ill adults

PURPOSE

Acute kidney injury (AKI) recovery prediction remains challenging. The purpose of the present study is to develop and validate prediction models for AKI recovery at hospital discharge in critically ill patients with ICU-acquired AKI stage 3 (AKI-3).

METHODS

Models were developed and validated in a development cohort (n = 229) and a matched validation cohort (n = 244) from the multicenter EPaNIC database to create prediction models with the least absolute shrinkage and selection operator (Lasso) machine-learning algorithm. We evaluated the discrimination and calibration of the models and compared their performance with plasma neutrophil gelatinase-associated lipocalin (NGAL) measured on first AKI-3 day (NGAL_AKI3) and reference model that only based on age.

RESULTS

Complete recovery and complete or partial recovery occurred in 33.20% and 51.23% of the validation cohort patients respectively. The prediction model for complete recovery based on age, need for renal replacement therapy (RRT), diagnostic group (cardiac/surgical/trauma/others), and sepsis on admission had an area under the receiver operating characteristics curve (AUROC) of 0.53. The prediction model for complete or partial recovery based on age, need for RRT, platelet count, urea, and white blood cell count had an AUROC of 0.61. NGAL_AKI3 showed AUROCs of 0.55 and 0.53 respectively. In cardiac patients, the models had higher AUROCs of 0.60 and 0.71 than NGAL_AKI3's AUROCs of 0.52 and 0.54. The developed models demonstrated a better performance over the reference models (only based on age) for cardiac surgery patients, but not for patients with sepsis and for a general ICU population.

CONCLUSION

Models to predict AKI recovery upon hospital discharge in critically ill patients with AKI-3 showed poor performance in the general ICU population, similar to the biomarker NGAL. In cardiac surgery patients, discrimination was acceptable, and better than NGAL. These findings demonstrate the difficulty of predicting non-reversible AKI early.

Artificial Intelligence in Pediatric Nephrology-A Call for Action

Artificial intelligence is playing an increasingly important role in many fields of clinical care to assist health care providers in patient management. In adult-focused nephrology, artificial intelligence is beginning to be used to improve clinical care, hemodialysis prescriptions, and follow-up of transplant recipients. This article provides an overview of medical artificial intelligence applications relevant to pediatric nephrology. We describe the core concepts of artificial intelligence and machine learning and cover the basics of neural networks and deep learning. We also discuss some examples for clinical applications of artificial intelligence in pediatric nephrology, including neonatal kidney function, early recognition of acute kidney injury, renally cleared drug dosing, intrapatient variability, urinary tract infection workup in infancy, and longitudinal disease progression. Furthermore, we consider the future of artificial intelligence in clinical pediatric nephrology and its potential impact on medical practice and address the ethical issues artificial intelligence raises in terms of clinical decision-making, health care provider-patient relationship, patient privacy, and data collection. This article also represents a call for action involving those of us striving to provide optimal services for children, adolescents, and young adults with chronic conditions.

KIT-LSTM: Knowledge-guided Time-aware LSTM for Continuous Clinical Risk Prediction

Rapid accumulation of temporal Electronic Health Record (EHR) data and recent advances in deep learning have shown high potential in precisely and timely predicting patients' risks using AI. However, most existing risk prediction approaches ignore the complex asynchronous and irregular problems in real-world EHR data. This paper proposes a novel approach called Knowledge-guIded Time-aware LSTM (KIT-LSTM) for continuous mortality predictions using EHR. KIT-LSTM extends LSTM with two time-aware gates and a knowledge-aware gate to better model EHR and interprets results. Experiments on real-world data for patients with acute kidney injury with dialysis (AKI-D) demonstrate that KIT-LSTM performs better than the state-of-the-art methods for predicting patients' risk trajectories and model interpretation. KIT-LSTM can better support timely decision-making for clinicians.

Development of New Equations Predicting the Mortality Risk of Patients on Continuous RRT

Background

Predicting the risk of death in patients admitted to the critical care unit facilitates appropriate management. In particular, among patients who are critically ill, patients with continuous RRT (CRRT) have high mortality, and predicting the mortality risk of these patients is difficult. The purpose of this study was to develop models for predicting the mortality risk of patients on CRRT and to validate the models externally.

Methods

A total of 699 adult patients with CRRT who participated in the VolumE maNagement Under body composition monitoring in critically ill patientS on CRRT (VENUS) trial and 1515 adult patients with CRRT in Seoul National University Hospital were selected as the development and validation cohorts, respectively. Using 11 predictor variables selected by the Cox proportional hazards model and clinical importance, equations predicting mortality within 7, 14, and 28 days were developed with development cohort data.

Results

The equation using 11 variables had area under the time-dependent receiver operating characteristic curve (AUROC) values of 0.75, 0.74, and 0.73 for predicting 7-, 14-, and 28-day mortality, respectively. All equations had significantly higher AUROCs than the Sequential Organ Failure Assessment (SOFA) and Acute Physiology and Chronic Health Evaluation II (APACHE II) scores. The 11-variable equation was superior to the SOFA and APACHE II scores in the integrated discrimination index and net reclassification improvement analyses.

Conclusions

The newly developed equations for predicting CRRT patient mortality showed superior performance to the previous scoring systems, and they can help physicians manage patients.

Predicting Mortality Using Machine Learning Algorithms in Patients Who Require Renal Replacement Therapy in the Critical Care Unit

Background: General severity of illness scores are not well calibrated to predict mortality among patients receiving renal replacement therapy (RRT) for acute kidney injury (AKI). We developed machine learning models to make mortality prediction and compared their performance to that of the Sequential Organ Failure Assessment (SOFA) and HEpatic failure, LactatE, NorepInephrine, medical Condition, and Creatinine (HELENICC) scores. Methods: We extracted routinely collected clinical data for AKI patients requiring RRT in the MIMIC and eICU databases. The development models were trained in 80% of the pooled dataset and tested in the rest of the pooled dataset. We compared the area under the receiver operating characteristic curves (AUCs) of four machine learning models (multilayer perceptron [MLP], logistic regression, XGBoost, and random forest [RF]) to that of the SOFA, nonrenal SOFA, and HELENICC scores and assessed calibration, sensitivity, specificity, positive (PPV) and negative (NPV) predicted values, and accuracy. Results: The mortality AUC of machine learning models was highest for XGBoost (0.823; 95% confidence interval [CI], 0.791−0.854) in the testing dataset, and it had the highest accuracy (0.758). The XGBoost model showed no evidence of lack of fit with the Hosmer−Lemeshow test (p > 0.05). Conclusion: XGBoost provided the highest performance of mortality prediction for patients with AKI requiring RRT compared with previous scoring systems.

Can Artificial Intelligence Assist in Delivering Continuous Renal Replacement Therapy?

Continuous renal replacement therapy (CRRT) is widely utilized to support critically ill patients with acute kidney injury. Artificial intelligence (AI) has the potential to enhance CRRT delivery, but evidence is limited. We reviewed existing literature on the utilization of AI in CRRT with the objective of identifying current gaps in evidence and research considerations. We conducted a scoping review focusing on the development or use of AI-based tools in patients receiving CRRT. Ten papers were identified; 6 of 10 (60%) published in 2021, and 6 of 10 (60%) focused on machine learning models to augment CRRT delivery. All innovations were in the design/early validation phase of development. Primary research interests focused on early indicators of CRRT need, prognostication of mortality and kidney recovery, and identification of risk factors for mortality. Secondary research priorities included dynamic CRRT monitoring, predicting CRRT-related complications, and automated data pooling for point-of-care analysis. Literature gaps included prospective validation and implementation, biases ascertainment, and evaluation of AI-generated health care disparities. Research on AI applications to enhance CRRT delivery has grown exponentially in the last years, but the field remains premature. There is a need to evaluate how these applications could enhance bedside decision-making capacity and assist structure and processes of CRRT delivery.

Development and validation of outcome prediction models for acute kidney injury patients undergoing continuous renal replacement therapy

Object

This study aimed to develop and validate a set of practical predictive tools that reliably estimate the 28-day prognosis of acute kidney injury patients undergoing continuous renal replacement therapy.

Methods

The clinical data of acute kidney injury patients undergoing continuous renal replacement therapy were extracted from the Medical Information Mart for Intensive Care IV database with structured query language and used as the development cohort. An all-subset regression was used for the model screening. Predictive models were constructed via a logistic regression, and external validation of the models was performed using independent external data.

Results

Clinical prediction models were developed with clinical data from 1,148 patients and validated with data from 121 patients. The predictive model based on seven predictors (age, vasopressor use, red cell volume distribution width, lactate, white blood cell count, platelet count, and phosphate) exhibited good predictive performance, as indicated by a C-index of 0.812 in the development cohort, 0.811 in the internal validation cohort and 0.768 in the external validation cohort.

Conclusions

The model reliably predicted the 28-day prognosis of acute kidney injury patients undergoing continuous renal replacement therapy. The predictive items are readily available, and the web-based prognostic calculator (https://libo220284.shinyapps.io/DynNomapp/) can be used as an adjunctive tool to support the management of patients.

Explainable Machine Learning-Based Risk Prediction Model for In-Hospital Mortality after Continuous Renal Replacement Therapy Initiation

In this study, we established an explainable and personalized risk prediction model for in-hospital mortality after continuous renal replacement therapy (CRRT) initiation. This retrospective cohort study was conducted at Changhua Christian Hospital (CCH). A total of 2932 consecutive intensive care unit patients receiving CRRT between 1 January 2010, and 30 April 2021, were identified from the CCH Clinical Research Database and were included in this study. The recursive feature elimination method with 10-fold cross-validation was used and repeated five times to select the optimal subset of features for the development of machine learning (ML) models to predict in-hospital mortality after CRRT initiation. An explainable approach based on ML and the SHapley Additive exPlanation (SHAP) and a local explanation method were used to evaluate the risk of in-hospital mortality and help clinicians understand the results of ML models. The extreme gradient boosting and gradient boosting machine models exhibited a higher discrimination ability (area under curve [AUC] = 0.806, 95% CI = 0.770–0.843 and AUC = 0.823, 95% CI = 0.788–0.858, respectively). The SHAP model revealed that the Acute Physiology and Chronic Health Evaluation II score, albumin level, and the timing of CRRT initiation were the most crucial features, followed by age, potassium and creatinine levels, SPO2, mean arterial pressure, international normalized ratio, and vasopressor support use. ML models combined with SHAP and local interpretation can provide the visual interpretation of individual risk predictions, which can help clinicians understand the effect of critical features and make informed decisions for preventing in-hospital deaths.

Predicting mortality in critically ill patients requiring renal replacement therapy for acute kidney injury in a retrospective single-center study of two cohorts

Half of the critically ill patients with renal replacement therapy (RRT) dependent acute kidney injury (AKI) die within one year despite RRT. General intensive care prediction models perform inadequately in AKI. Predictive models for mortality would be an invaluable complementary tool to aid clinical decision making. We aimed to develop and validate new prediction models for intensive care unit (ICU) and hospital mortality customized for patients with RRT dependent AKI in a retrospective single-center study. The models were first developed in a cohort of 471 critically ill patients with continuous RRT (CRRT) and then validated in a cohort of 193 critically ill patients with intermittent hemodialysis (IHD) as the primary modality for RRT. Forty-two risk factors for mortality were examined at ICU admission and CRRT initiation, respectively, in the first univariate models followed by multivariable model development. Receiver operating characteristics curve analyses were conducted to estimate the area under the curve (AUC), to measure discriminative capacity of the models for mortality. AUCs of the respective models ranged between 0.76 and 0.83 in the CRRT model development cohort, thereby showing acceptable to excellent predictive power for the mortality events (ICU mortality and hospital mortality). The models showed acceptable external validity in a validation cohort of IHD patients. In the IHD validation cohort the AUCs of the MALEDICT RRT initiation model were 0.74 and 0.77 for ICU and hospital mortality, respectively. The MALEDICT model shows promise for mortality prediction in critically ill patients with RRT dependent AKI. After further validation, the model might serve as an additional clinical tool for estimating individual mortality risk at the time of RRT initiation.

Development and Validation of Machine Learning Models for Real-Time Mortality Prediction in Critically Ill Patients With Sepsis-Associated Acute Kidney Injury

Background

Sepsis-associated acute kidney injury (SA-AKI) is common in critically ill patients, which is associated with significantly increased mortality. Existing mortality prediction tools showed insufficient predictive power or failed to reflect patients' dynamic clinical evolution. Therefore, the study aimed to develop and validate machine learning-based models for real-time mortality prediction in critically ill patients with SA-AKI.

Methods

The multi-center retrospective study included patients from two distinct databases. A total of 12,132 SA-AKI patients from the Medical Information Mart for Intensive Care IV (MIMIC-IV) were randomly allocated to the training, validation, and internal test sets. An additional 3,741 patients from the eICU Collaborative Research Database (eICU-CRD) served as an external test set. For every 12 h during the ICU stays, the state-of-the-art eXtreme Gradient Boosting (XGBoost) algorithm was used to predict the risk of in-hospital death in the following 48, 72, and 120 h and in the first 28 days after ICU admission. Area under the receiver operating characteristic curves (AUCs) were calculated to evaluate the models' performance.

Results

The XGBoost models, based on routine clinical variables updated every 12 h, showed better performance in mortality prediction than the SOFA score and SAPS-II. The AUCs of the XGBoost models for mortality over different time periods ranged from 0.848 to 0.804 in the internal test set and from 0.818 to 0.748 in the external test set. The shapley additive explanation method provided interpretability for the XGBoost models, which improved the understanding of the association between the predictor variables and future mortality.

Conclusions

The interpretable machine learning XGBoost models showed promising performance in real-time mortality prediction in critically ill patients with SA-AKI, which are useful tools for early identification of high-risk patients and timely clinical interventions.

Outcome prediction for acute kidney injury among hospitalized children via eXtreme Gradient Boosting algorithm

Acute kidney injury (AKI) is common among hospitalized children and is associated with a poor prognosis. The study sought to develop machine learning-based models for predicting adverse outcomes among hospitalized AKI children. We performed a retrospective study of hospitalized AKI patients aged 1 month to 18 years in the Second Xiangya Hospital of Central South University in China from 2015 to 2020. The primary outcomes included major adverse kidney events within 30 days (MAKE30) (death, new renal replacement therapy, and persistent renal dysfunction) and 90-day adverse outcomes (chronic dialysis and death). The state-of-the-art machine learning algorithm, eXtreme Gradient Boosting (XGBoost), and the traditional logistic regression were used to establish prediction models for MAKE30 and 90-day adverse outcomes. The models’ performance was evaluated by split-set test. A total of 1394 pediatric AKI patients were included in the study. The incidence of MAKE30 and 90-day adverse outcomes was 24.1% and 8.1%, respectively. In the test set, the area under the receiver operating characteristic curve (AUC) of the XGBoost model was 0.810 (95% CI 0.763–0.857) for MAKE30 and 0.851 (95% CI 0.785–0.916) for 90-day adverse outcomes, The AUC of the logistic regression model was 0.786 (95% CI 0.731–0.841) for MAKE30 and 0.759 (95% CI 0.654–0.864) for 90-day adverse outcomes. A web-based risk calculator can facilitate the application of the XGBoost models in daily clinical practice. In conclusion, XGBoost showed good performance in predicting MAKE30 and 90-day adverse outcomes, which provided clinicians with useful tools for prognostic assessment in hospitalized AKI children.

Mortality prediction of patients in intensive care units using machine learning algorithms based on electronic health records

Improving predictive models for intensive care unit (ICU) inpatients requires a new strategy that periodically includes the latest clinical data and can be updated to reflect local characteristics. We extracted data from all adult patients admitted to the ICUs of two university hospitals with different characteristics from 2006 to 2020, and a total of 85,146 patients were included in this study. Machine learning algorithms were trained to predict in-hospital mortality. The predictive performance of conventional scoring models and machine learning algorithms was assessed by the area under the receiver operating characteristic curve (AUROC). The conventional scoring models had various predictive powers, with the SAPS III (AUROC 0.773 [0.766-0.779] for hospital S) and APACHE III (AUROC 0.803 [0.795-0.810] for hospital G) showing the highest AUROC among them. The best performing machine learning models achieved an AUROC of 0.977 (0.973-0.980) in hospital S and 0.955 (0.950-0.961) in hospital G. The use of ML models in conjunction with conventional scoring systems can provide more useful information for predicting the prognosis of critically ill patients. In this study, we suggest that the predictive model can be made more robust by training with the individual data of each hospital.

Artificial intelligence-enabled decision support in nephrology

Kidney pathophysiology is often complex, nonlinear and heterogeneous, which limits the utility of hypothetical-deductive reasoning and linear, statistical approaches to diagnosis and treatment. Emerging evidence suggests that artificial intelligence (AI)-enabled decision support systems - which use algorithms based on learned examples - may have an important role in nephrology. Contemporary AI applications can accurately predict the onset of acute kidney injury before notable biochemical changes occur; can identify modifiable risk factors for chronic kidney disease onset and progression; can match or exceed human accuracy in recognizing renal tumours on imaging studies; and may augment prognostication and decision-making following renal transplantation. Future AI applications have the potential to make real-time, continuous recommendations for discrete actions and yield the greatest probability of achieving optimal kidney health outcomes. Realizing the clinical integration of AI applications will require cooperative, multidisciplinary commitment to ensure algorithm fairness, overcome barriers to clinical implementation, and build an AI-competent workforce. AI-enabled decision support should preserve the pre-eminence of wisdom and augment rather than replace human decision-making. By anchoring intuition with objective predictions and classifications, this approach should favour clinician intuition when it is honed by experience.

A time-incorporated SOFA score-based machine learning model for predicting mortality in critically ill patients: A multicenter, real-world study

BACKGROUND

Organ dysfunction (OD) assessment is essential in intensive care units (ICUs). However, current OD assessment scores merely describe the number and the severity of each OD, without evaluating the duration of organ injury. The objective of this study is to develop and validate a machine learning model based on the Sequential Organ Failure Assessment (SOFA) score for the prediction of mortality in critically ill patients.

MATERIAL AND METHODS

Data from the eICU Collaborative Research Database and Medical Information Mart for Intensive Care (MIMIC) -III were mixed for model development. The MIMIC-IV and Nanjing Jinling Hospital Surgical ICU database were used as external test set A and set B, respectively. The outcome of interest was in-ICU mortality. A modified SOFA model incorporating time-dimension (T-SOFA) was stepwise developed to predict ICU mortality using extreme gradient boosting (XGBoost), support vector machine, random forest and logistic regression algorithms. Time-dimensional features were calculated based on six consecutive SOFA scores collected every 12 h within the first three days of admission. The predictive performance was assessed with the area under the receiver operating characteristic curves (AUROC) and calibration plot.

RESULTS

A total of 82,132 patients from the real-world datasets were included in this study, and 7,494 patients (9.12%) died during their ICU stay. The T-SOFA M3 that incorporated the time-dimension features and age, using the XGBoost algorithm, significantly outperformed the original SOFA score in the validation set (AUROC 0.800 95% CI [0.787-0.813] vs. 0.693 95% CI [0.678-0.709], p < 0.01). Good discrimination and calibration were maintained in the test set A and B, with AUROC of 0.803, 95% CI [0.791-0.815] and 0.830, 95% CI [0.789-0.870], respectively.

CONCLUSIONS

The time-incorporated T-SOFA model could significantly improve the prediction performance of the original SOFA score and is of potential for identifying high-risk patients in future clinical application.

Data Science Trends Relevant to Nursing Practice: A Rapid Review of the 2020 Literature

BACKGROUND

The term "data science" encompasses several methods, many of which are considered cutting edge and are being used to influence care processes across the world. Nursing is an applied science and a key discipline in health care systems in both clinical and administrative areas, making the profession increasingly influenced by the latest advances in data science. The greater informatics community should be aware of current trends regarding the intersection of nursing and data science, as developments in nursing practice have cross-professional implications.

OBJECTIVES

This study aimed to summarize the latest (calendar year 2020) research and applications of nursing-relevant patient outcomes and clinical processes in the data science literature.

METHODS

We conducted a rapid review of the literature to identify relevant research published during the year 2020. We explored the following 16 topics: (1) artificial intelligence/machine learning credibility and acceptance, (2) burnout, (3) complex care (outpatient), (4) emergency department visits, (5) falls, (6) health care-acquired infections, (7) health care utilization and costs, (8) hospitalization, (9) in-hospital mortality, (10) length of stay, (11) pain, (12) patient safety, (13) pressure injuries, (14) readmissions, (15) staffing, and (16) unit culture.

RESULTS

Of 16,589 articles, 244 were included in the review. All topics were represented by literature published in 2020, ranging from 1 article to 59 articles. Numerous contemporary data science methods were represented in the literature including the use of machine learning, neural networks, and natural language processing.

CONCLUSION

This review provides an overview of the data science trends that were relevant to nursing practice in 2020. Examinations of such literature are important to monitor the status of data science's influence in nursing practice.

Predictive Model for High Coronary Artery Calcium Score in Young Patients with Non-Dialysis Chronic Kidney Disease

Cardiovascular disease is a major complication of chronic kidney disease. The coronary artery calcium (CAC) score is a surrogate marker for the risk of coronary artery disease. The purpose of this study is to predict outcomes for non-dialysis chronic kidney disease patients under the age of 60 with high CAC scores using machine learning techniques. We developed the predictive models with a chronic kidney disease representative cohort, the Korean Cohort Study for Outcomes in Patients with Chronic Kidney Disease (KNOW-CKD). We divided the cohort into a training dataset (70%) and a validation dataset (30%). The test dataset incorporated an external dataset of patients that were not included in the KNOW-CKD cohort. Support vector machine, random forest, XGboost, logistic regression, and multi-perceptron neural network models were used in the predictive models. We evaluated the model’s performance using the area under the receiver operating characteristic (AUROC) curve. Shapley additive explanation values were applied to select the important features. The random forest model showed the best predictive performance (AUROC 0.87) and there was a statistically significant difference between the traditional logistic regression model and the test dataset. This study will help identify patients at high risk of cardiovascular complications in young chronic kidney disease and establish individualized treatment strategies.

Comparison of Machine Learning Techniques for Mortality Prediction in a Prospective Cohort of Older Adults

As global demographics change, ageing is a global phenomenon which is increasingly of interest in our modern and rapidly changing society. Thus, the application of proper prognostic indices in clinical decisions regarding mortality prediction has assumed a significant importance for personalized risk management (i.e., identifying patients who are at high or low risk of death) and to help ensure effective healthcare services to patients. Consequently, prognostic modelling expressed as all-cause mortality prediction is an important step for effective patient management. Machine learning has the potential to transform prognostic modelling. In this paper, results on the development of machine learning models for all-cause mortality prediction in a cohort of healthy older adults are reported. The models are based on features covering anthropometric variables, physical and lab examinations, questionnaires, and lifestyles, as well as wearable data collected in free-living settings, obtained for the "Healthy Ageing Initiative" study conducted on 2291 recruited participants. Several machine learning techniques including feature engineering, feature selection, data augmentation and resampling were investigated for this purpose. A detailed empirical comparison of the impact of the different techniques is presented and discussed. The achieved performances were also compared with a standard epidemiological model. This investigation showed that, for the dataset under consideration, the best results were achieved with Random UnderSampling in conjunction with Random Forest (either with or without probability calibration). However, while including probability calibration slightly reduced the average performance, it increased the model robustness, as indicated by the lower 95% confidence intervals. The analysis showed that machine learning models could provide comparable results to standard epidemiological models while being completely data-driven and disease-agnostic, thus demonstrating the opportunity for building machine learning models on health records data for research and clinical practice. However, further testing is required to significantly improve the model performance and its robustness.

Outcomes of Continuous Renal Replacement Therapy in a Community Health System

OBJECTIVE

Continuous renal replacement therapy (CRRT) is commonly used in critically ill, hemodynamically unstable patients with acute kidney injury (AKI). This procedure is resource intensive with reported high in-hospital mortality. We evaluated mortality with CRRT in our healthcare system and markers associated with decreased survival.

METHODS

A retrospective cohort study collected data on patients 18 years or older, without prior history of end stage kidney disease (ESKD), who received CRRT in the intensive care units at one of three hospitals in our health system in Columbus, OH from July 1, 2016 to July 1, 2019. Data included demographics, presenting diagnosis, comorbidities, laboratory markers, and patient disposition. In-hospital mortality rates and sequential organ failure assessment (SOFA) scores were calculated. We then compared information between two groups (patients who died during hospitalization and survivors) using univariate comparisons and multivariate logistic regression models.

RESULTS

In-hospital mortality was 56.8% (95%CI: 53.4-60.1) among patients who received CRRT. Mean SOFA scores did not differ between survival and mortality groups. The odds for in-patient mortality were increased for patients age ≥60 (OR = 1.74, 95%CI: 1.23-2.44), first bilirubin >2 mg/dL (OR = 1.73, 95%CI: 1.12-2.69), first creatinine < 2 mg/dL (OR = 1.57, 95%CI: 1.04-2.37), first lactate > 2 mmol/L (OR = 2.08, 95%CI: 1.43-3.04). The odds for in-patient mortality were decreased for patients with cardiogenic shock (OR = .32, 95%CI: .17-.58) and hemorrhagic shock (OR = .29, 95%CI: .13-.63).

CONCLUSIONS

We report in-hospital mortality rates of 56.8% with CRRT. Unlike prior studies, higher mean SOFA scores were not predictive of higher in-hospital mortality in patients utilizing CRRT.

Machine learning for early discrimination between transient and persistent acute kidney injury in critically ill patients with sepsis

Acute kidney injury (AKI) is commonly present in critically ill patients with sepsis. Early prediction of short-term reversibility of AKI is beneficial to risk stratification and clinical treatment decision. The study sought to use machine learning methods to discriminate between transient and persistent sepsis-associated AKI. Septic patients who developed AKI within the first 48 h after ICU admission were identified from the Medical Information Mart for Intensive Care III database. AKI was classified as transient or persistent according to the Acute Disease Quality Initiative workgroup consensus. Five prediction models using logistic regression, random forest, support vector machine, artificial neural network and extreme gradient boosting were constructed, and their performance was evaluated by out-of-sample testing. A simplified risk prediction model was also derived based on logistic regression and features selected by machine learning algorithms. A total of 5984 septic patients with AKI were included, 3805 (63.6%) of whom developed persistent AKI. The artificial neural network and logistic regression models achieved the highest area under the receiver operating characteristic curve (AUC) among the five machine learning models (0.76, 95% confidence interval [CI] 0.74-0.78). The simplified 14-variable model showed adequate discrimination, with the AUC being 0.76 (95% CI 0.73-0.78). At the optimal cutoff of 0.63, the sensitivity and specificity of the simplified model were 63% and 76% respectively. In conclusion, a machine learning-based simplified prediction model including routine clinical variables could be used to differentiate between transient and persistent AKI in critically ill septic patients. An easy-to-use risk calculator can promote its widespread application in daily clinical practice.

Machine Learning Algorithms to Predict Mortality of Neonates on Mechanical Intubation for Respiratory Failure

BACKGROUND

Early identification of critically ill neonates with poor outcomes can optimize therapeutic strategies. We aimed to examine whether machine learning (ML) methods can improve mortality prediction for neonatal intensive care unit (NICU) patients on intubation for respiratory failure.

METHODS

A total of 1734 neonates with respiratory failure were randomly divided into training (70%, n = 1214) and test (30%, n = 520) sets. The primary outcome was the probability of NICU mortality. The areas under the receiver operating characteristic curves (AUCs) of several ML algorithms were compared with those of the conventional neonatal illness severity scoring systems including the NTISS and SNAPPE-II.

RESULTS

For NICU mortality, the random forest (RF) model showed the highest AUC (0.939 (0.921-0.958)) for the prediction of neonates with respiratory failure, and the bagged classification and regression tree model demonstrated the next best results (0.915 (0.891-0.939)). The AUCs of both models were significantly better than the traditional NTISS (0.836 (0.800-0.871)) and SNAPPE-II scores (0.805 (0.766-0.843)). The superior performances were confirmed by higher accuracy and F1 score and better calibration, and the superior and net benefit was confirmed by decision curve analysis. In addition, Shapley additive explanation (SHAP) values were utilized to explain the RF prediction model.

CONCLUSIONS

Machine learning algorithms increase the accuracy and predictive ability for mortality of neonates with respiratory failure compared with conventional neonatal illness severity scores. The RF model is suitable for clinical use in the NICU, and clinicians can gain insights and have better communication with families in advance.

Machine learning model to predict hypotension after starting continuous renal replacement therapy

Hypotension after starting continuous renal replacement therapy (CRRT) is associated with worse outcomes compared with normotension, but it is difficult to predict because several factors have interactive and complex effects on the risk. The present study applied machine learning algorithms to develop models to predict hypotension after initiating CRRT. Among 2349 adult patients who started CRRT due to acute kidney injury, 70% and 30% were randomly assigned into the training and testing sets, respectively. Hypotension was defined as a reduction in mean arterial pressure (MAP) ≥ 20 mmHg from the initial value within 6 h. The area under the receiver operating characteristic curves (AUROCs) in machine learning models, such as support vector machine (SVM), deep neural network (DNN), light gradient boosting machine (LGBM), and extreme gradient boosting machine (XGB) were compared with those in disease-severity scores such as the Sequential Organ Failure Assessment and Acute Physiology and Chronic Health Evaluation II. The XGB model showed the highest AUROC (0.828 [0.796-0.861]), and the DNN and LGBM models followed with AUROCs of 0.822 (0.789-0.856) and 0.813 (0.780-0.847), respectively; all machine learning AUROC values were higher than those obtained from disease-severity scores (AUROCs < 0.6). Although other definitions of hypotension were used such as a reduction of MAP ≥ 30 mmHg or a reduction occurring within 1 h, the AUROCs of machine learning models were higher than those of disease-severity scores. Machine learning models successfully predict hypotension after starting CRRT and can serve as the basis of systems to predict hypotension before starting CRRT.

GDF-15 Predicts In-Hospital Mortality of Critically Ill Patients with Acute Kidney Injury Requiring Continuous Renal Replacement Therapy: A Multicenter Prospective Study

Growth differentiation factor-15 (GDF-15) is a stress-responsive cytokine. This study evaluated the association between GDF-15 and in-hospital mortality among patients with severe acute kidney injury (AKI) requiring continuous renal replacement therapy (CRRT). Among the multicenter prospective CRRT cohort between 2017 and 2019, 66 patients whose blood sample was available were analyzed. Patients were divided into three groups according to the GDF-15 concentrations. The median GDF-15 level was 7865.5 pg/mL (496.9 pg/mL in the healthy control patients). Baseline characteristics were not different among tertile groups except the severity scores and serum lactate level, which were higher in the third tertile. After adjusting for confounding factors, the patients with higher GDF-15 had significantly increased risk of mortality (second tertile: adjusted hazards ratio [aHR], 3.67; 95% confidence interval [CI], 1.05-12.76; p = 0.041; third tertile: aHR, 6.81; 95% CI, 1.98-23.44; p = 0.002). Furthermore, GDF-15 predicted in-hospital mortality (area under the curve, 0.710; 95% CI, 0.585-0.815) better than APACHE II and SOFA scores. Serum GDF-15 concentration was elevated in AKI patients requiring CRRT, higher in more severe patients. GDF-15 is a better independent predictor for in-hospital mortality of critically ill AKI patients than the traditional risk scoring system such as APACHE II and SOFA scores.

Improvement of APACHE II score system for disease severity based on XGBoost algorithm

BACKGROUND

Prognostication is an essential tool for risk adjustment and decision making in the intensive care units (ICUs). In order to improve patient outcomes, we have been trying to develop a more effective model than Acute Physiology and Chronic Health Evaluation (APACHE) II to measure the severity of the patients in ICUs. The aim of the present study was to provide a mortality prediction model for ICUs patients, and to assess its performance relative to prediction based on the APACHE II scoring system.

METHODS

We used the Medical Information Mart for Intensive Care version III (MIMIC-III) database to build our model. After comparing the APACHE II with 6 typical machine learning (ML) methods, the best performing model was screened for external validation on anther independent dataset. Performance measures were calculated using cross-validation to avoid making biased assessments. The primary outcome was hospital mortality. Finally, we used TreeSHAP algorithm to explain the variable relationships in the extreme gradient boosting algorithm (XGBoost) model.

RESULTS

We picked out 14 variables with 24,777 cases to form our basic data set. When the variables were the same as those contained in the APACHE II, the accuracy of XGBoost (accuracy: 0.858) was higher than that of APACHE II (accuracy: 0.742) and other algorithms. In addition, it exhibited better calibration properties than other methods, the result in the area under the ROC curve (AUC: 0.76). we then expand the variable set by adding five new variables to improve the performance of our model. The accuracy, precision, recall, F1, and AUC of the XGBoost model increased, and were still higher than other models (0.866, 0.853, 0.870, 0.845, and 0.81, respectively). On the external validation dataset, the AUC was 0.79 and calibration properties were good.

CONCLUSIONS

As compared to conventional severity scores APACHE II, our XGBoost proposal offers improved performance for predicting hospital mortality in ICUs patients. Furthermore, the TreeSHAP can help to enhance the understanding of our model by providing detailed insights into the impact of different features on the disease risk. In sum, our model could help clinicians determine prognosis and improve patient outcomes.

Machine Learning Approaches to Predict In-Hospital Mortality among Neonates with Clinically Suspected Sepsis in the Neonatal Intensive Care Unit

Background: preterm and critically ill neonates often experience clinically suspected sepsis during their prolonged hospitalization in the neonatal intensive care unit (NICU), which can be the initial sign of final adverse outcomes. Therefore, we aimed to utilize machine learning approaches to predict neonatal in-hospital mortality through data-driven learning. Methods: a total of 1095 neonates who experienced clinically suspected sepsis in a tertiary-level NICU in Taiwan between August 2017 and July 2020 were enrolled. Clinically suspected sepsis was defined based on clinical features and laboratory criteria and the administration of empiric antibiotics by clinicians. The variables used for analysis included patient demographics, clinical features, laboratory data, and medications. The machine learning methods used included deep neural network (DNN), k-nearest neighbors, support vector machine, random forest, and extreme gradient boost. The performance of these models was evaluated using the area under the receiver operating characteristic curve (AUC). Results: the final in-hospital mortality of this cohort was 8.2% (90 neonates died). A total of 765 (69.8%) and 330 (30.2%) patients were randomly assigned to the training and test sets, respectively. Regarding the efficacy of the single model that most accurately predicted the outcome, DNN exhibited the greatest AUC (0.923, 95% confidence interval [CI] 0.953–0.893) and the best accuracy (95.64%, 95% CI 96.76–94.52%), Cohen’s kappa coefficient value (0.74, 95% CI 0.79–0.69) and Matthews correlation coefficient value (0.75, 95% CI 0.80–0.70). The top three most influential variables in the DNN importance matrix plot were the requirement of ventilator support at the onset of suspected sepsis, the feeding conditions, and intravascular volume expansion. The model performance was indistinguishable between the training and test sets. Conclusions: the DNN model was successfully established to predict in-hospital mortality in neonates with clinically suspected sepsis, and the machine learning algorithm is applicable for clinicians to gain insights and have better communication with families in advance.

Machine Learning Models to Predict 30-Day Mortality in Mechanically Ventilated Patients

Previous scoring models, such as the Acute Physiologic Assessment and Chronic Health Evaluation II (APACHE II) score, do not adequately predict the mortality of patients receiving mechanical ventilation in the intensive care unit. Therefore, this study aimed to apply machine learning algorithms to improve the prediction accuracy for 30-day mortality of mechanically ventilated patients. The data of 16,940 mechanically ventilated patients were divided into the training-validation (83%, n = 13,988) and test (17%, n = 2952) sets. Machine learning algorithms including balanced random forest, light gradient boosting machine, extreme gradient boost, multilayer perceptron, and logistic regression were used. We compared the area under the receiver operating characteristic curves (AUCs) of machine learning algorithms with those of the APACHE II and ProVent score results. The extreme gradient boost model showed the highest AUC (0.79 (0.77–0.80)) for the 30-day mortality prediction, followed by the balanced random forest model (0.78 (0.76–0.80)). The AUCs of these machine learning models as achieved by APACHE II and ProVent scores were higher than 0.67 (0.65–0.69), and 0.69 (0.67–0.71)), respectively. The most important variables in developing each machine learning model were APACHE II score, Charlson comorbidity index, and norepinephrine. The machine learning models have a higher AUC than conventional scoring systems, and can thus better predict the 30-day mortality of mechanically ventilated patients.

The prediction of mortality influential variables in an intensive care unit: a case study

The intensive care units (ICUs) are among the most expensive and essential parts of all hospitals for extremely ill patients. This study aims to predict mortality and explore the crucial factors affecting it. Generally, in the health care systems, having a fast and precise ICU mortality prediction for patients plays a key role in care quality, resulting in reduced costs and improved survival chances of the patients. In this study, we used a medical dataset, including patients' demographic details, underlying diseases, laboratory disorder, and LOS. Since accurate estimates are required to have optimal results, various data pre-processings as the initial steps are used here. Besides, machine learning models are employed to predict the risk of mortality ICU discharge. For AdaBoost model, these measures are considered AUC= 0.966, sensitivity (recall) = 87.88%, Kappa=0.859, F-measure = 89.23% making it, AdaBoost, accounts for the highest rate. Our model outperforms other comparison models by using various scenarios of data processing. The obtained results demonstrate that the high mortality can be caused by underlying diseases such as diabetes mellitus and high blood pressure, moderate Pulmonary Embolism Wells Score risk, platelet blood count less than 100000 (mcl), hypertension (HTN), high level of Bilirubin, smoking, and GCS level between 6 and 9.

Comparison of Approaches for Prediction of Renal Replacement Therapy-Free Survival in Patients with Acute Kidney Injury

BACKGROUND/AIMS

Acute kidney injury (AKI) in critically ill patients is common, and continuous renal replacement therapy (CRRT) is a preferred mode of renal replacement therapy (RRT) in hemodynamically unstable patients. Prediction of clinical outcomes in patients on CRRT is challenging. We utilized several approaches to predict RRT-free survival (RRTFS) in critically ill patients with AKI requiring CRRT.

METHODS

We used the Medical Information Mart for Intensive Care (MIMIC-III) database to identify patients ≥18 years old with AKI on CRRT, after excluding patients who had ESRD on chronic dialysis, and kidney transplantation. We defined RRTFS as patients who were discharged alive and did not require RRT ≥7 days prior to hospital discharge. We utilized all available biomedical data up to CRRT initiation. We evaluated 7 approaches, including logistic regression (LR), random forest (RF), support vector machine (SVM), adaptive boosting (AdaBoost), extreme gradient boosting (XGBoost), multilayer perceptron (MLP), and MLP with long short-term memory (MLP + LSTM). We evaluated model performance by using area under the receiver operating characteristic (AUROC) curves.

RESULTS

Out of 684 patients with AKI on CRRT, 205 (30%) patients had RRTFS. The median age of patients was 63 years and their median Simplified Acute Physiology Score (SAPS) II was 67 (interquartile range 52-84). The MLP + LSTM showed the highest AUROC (95% CI) of 0.70 (0.67-0.73), followed by MLP 0.59 (0.54-0.64), LR 0.57 (0.52-0.62), SVM 0.51 (0.46-0.56), AdaBoost 0.51 (0.46-0.55), RF 0.44 (0.39-0.48), and XGBoost 0.43 (CI 0.38-0.47).

CONCLUSIONS

A MLP + LSTM model outperformed other approaches for predicting RRTFS. Performance could be further improved by incorporating other data types.

Perioperative Renoprotection: General Mechanisms and Treatment Approaches

In the perioperative setting, acute kidney injury (AKI) is a frequent complication, and AKI itself is associated with adverse outcomes such as higher risk of chronic kidney disease and mortality. Various risk factors are associated with perioperative AKI, and identifying them is crucial to early interventions addressing modifiable risk and increasing monitoring for nonmodifiable risk. Different mechanisms are involved in the development of postoperative AKI, frequently picturing a multifactorial etiology. For these reasons, no single renoprotective strategy will be effective for all surgical patients, and efforts have been attempted to prevent kidney injury in different ways. Some renoprotective strategies and treatments have proven to be useful, some are no longer recommended because they are ineffective or even harmful, and some strategies are still under investigation to identify the best timing, setting, and patients for whom they could be beneficial. With this review, we aim to provide an overview of recent findings from studies examining epidemiology, risk factors, and mechanisms of perioperative AKI, as well as different renoprotective strategies and treatments presented in the literature.

Promises of Big Data and Artificial Intelligence in Nephrology and Transplantation

Kidney diseases form part of the major health burdens experienced all over the world. Kidney diseases are linked to high economic burden, deaths, and morbidity rates. The great importance of collecting a large quantity of health-related data among human cohorts, what scholars refer to as “big data”, has increasingly been identified, with the establishment of a large group of cohorts and the usage of electronic health records (EHRs) in nephrology and transplantation. These data are valuable, and can potentially be utilized by researchers to advance knowledge in the field. Furthermore, progress in big data is stimulating the flourishing of artificial intelligence (AI), which is an excellent tool for handling, and subsequently processing, a great amount of data and may be applied to highlight more information on the effectiveness of medicine in kidney-related complications for the purpose of more precise phenotype and outcome prediction. In this article, we discuss the advances and challenges in big data, the use of EHRs and AI, with great emphasis on the usage of nephrology and transplantation.