1
|
Tran TT, Yun G, Kim S. Artificial intelligence and predictive models for early detection of acute kidney injury: transforming clinical practice. BMC Nephrol 2024; 25:353. [PMID: 39415082 PMCID: PMC11484428 DOI: 10.1186/s12882-024-03793-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2024] [Accepted: 10/04/2024] [Indexed: 10/18/2024] Open
Abstract
Acute kidney injury (AKI) presents a significant clinical challenge due to its rapid progression to kidney failure, resulting in serious complications such as electrolyte imbalances, fluid overload, and the potential need for renal replacement therapy. Early detection and prediction of AKI can improve patient outcomes through timely interventions. This review was conducted as a narrative literature review, aiming to explore state-of-the-art models for early detection and prediction of AKI. We conducted a comprehensive review of findings from various studies, highlighting their strengths, limitations, and practical considerations for implementation in healthcare settings. We highlight the potential benefits and challenges of their integration into routine clinical care and emphasize the importance of establishing robust early-detection systems before the introduction of artificial intelligence (AI)-assisted prediction models. Advances in AI for AKI detection and prediction are examined, addressing their clinical applicability, challenges, and opportunities for routine implementation.
Collapse
Affiliation(s)
- Tu T Tran
- Department of Internal Medicine, Thai Nguyen University of Medicine and Pharmacy, Thai Nguyen, Vietnam
- Department of Nephro-Urology and Dialysis, Thai Nguyen National Hospital, Thai Nguyen, Vietnam
| | - Giae Yun
- Department of Internal Medicine, Seoul National University College of Medicine, Seoul, Republic of Korea
- Department of Internal Medicine, Hallym University Dongtan Sacred Heart Hospital, Hwaseong, Republic of Korea
| | - Sejoong Kim
- Department of Internal Medicine, Seoul National University College of Medicine, Seoul, Republic of Korea.
- Department of Internal Medicine, Seoul National University Bundang Hospital, Seongnam, Republic of Korea.
- Center for Artificial Intelligence in Healthcare, Seoul National University Bundang Hospital, Seongnam, Republic of Korea.
| |
Collapse
|
2
|
Wendler JJ, Albert C, Cash H, Meyer F, Pech M, Schostak M, Mertens PR, Porsch M. Interdisciplinary Management of Traumatic Injuries to the Kidneys and Urinary Tract Caused by Blunt Abdominopelvic Trauma. J Clin Med 2024; 13:5765. [PMID: 39407825 PMCID: PMC11476503 DOI: 10.3390/jcm13195765] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2024] [Revised: 09/18/2024] [Accepted: 09/24/2024] [Indexed: 10/20/2024] Open
Abstract
Purpose: Blunt abdominopelvic trauma frequently results in injuries to the urinary organs, especially in polytrauma. The urotrauma is rarely an acute life-threatening event; however, it may lead to severe complications. Methods: This review addresses the under-representation of urological trauma management in interdisciplinary medical training and its impact on patient outcomes. It compiles evidence-based recommendations and guidelines from multiple specialties, focusing on common challenges in managing these injuries. The resource is tailored for primary care physicians in radiology, trauma surgery, internal medicine, urology, and nephrology. Results: Urinary tract injuries can occur even if the patient's condition initially appears normal. An exclusion diagnosis is obligatory by contrast medium tomography of the entire urinary tract and, if suspected, an additional uroendoscopic examination. Interventional therapy by catheterisation of the urinary tract is often required. Urosurgical treatment is not commonly needed, but when there is a demand, it must be administered via an interdisciplinary approach with visceral and trauma surgery. Over 90% of life-threatening kidney injuries (usually up to grade 4-5 AAST) are presently treated by interventional radiologists. Acute kidney injury (AKI) as a complication in trauma patients may complicate clinical management and often worsens the outcome. The incidence of trauma-associated AKI in patients admitted to an intensive care unit is high. Conclusions: Patients suffering from blunt abdominopelvic trauma should ideally be referred to certified trauma centres with subspecialised or fully specialised care provided by visceral/vascular surgery, trauma surgery, interventional radiology, urology, and nephrology. This recommendation is based on the complex nature of most damage patterns.
Collapse
Affiliation(s)
- Johann J. Wendler
- University Clinic for Urology, Urooncology, Robot-Assisted and Focal Therapy, University Hospital Magdeburg A.ö.R., Medical Faculty of the Otto-von-Guericke-University Magdeburg, Leipziger Str. 44, 39120 Magdeburg, Germany; (H.C.); (M.S.); (M.P.)
- Urology Practice, 39104 Magdeburg, Germany
| | - Christian Albert
- University Clinic for Cardiology and Angiology, University Hospital Magdeburg A.ö.R., Medical Faculty of the Otto-von-Guericke University Magdeburg, Leipziger Straße 44, 39120 Magdeburg, Germany
- Department of Nephrology, Central Clinic Bad Berka, Robert-Koch-Allee 9, 99438 Bad Berka, Germany
| | - Hannes Cash
- University Clinic for Urology, Urooncology, Robot-Assisted and Focal Therapy, University Hospital Magdeburg A.ö.R., Medical Faculty of the Otto-von-Guericke-University Magdeburg, Leipziger Str. 44, 39120 Magdeburg, Germany; (H.C.); (M.S.); (M.P.)
- Urology Practice, 10117 Berlin, Germany
| | - Frank Meyer
- University Clinic for General, Visceral, Vascular and Transplantation Surgery, University Hospital A.ö.R., Medical Faculty of Otto-von-Guericke-University Magdeburg, Leipziger Straße 44, 39120 Magdeburg, Germany;
| | - Maciej Pech
- University Clinic for Radiology and Nuclear Medicine, University Hospital A.ö.R., Medical Faculty of Otto-von-Guericke-University Magdeburg, Leipziger Straße 44, 39120 Magdeburg, Germany;
| | - Martin Schostak
- University Clinic for Urology, Urooncology, Robot-Assisted and Focal Therapy, University Hospital Magdeburg A.ö.R., Medical Faculty of the Otto-von-Guericke-University Magdeburg, Leipziger Str. 44, 39120 Magdeburg, Germany; (H.C.); (M.S.); (M.P.)
| | - Peter R. Mertens
- University Clinic for Nephrology and Hypertension, Diabetes and Endocrinology, University Hospital A.ö.R., Medical Faculty of Otto-von-Guericke-University Magdeburg, Leipziger Straße 44, 39120 Magdeburg, Germany;
| | - Markus Porsch
- University Clinic for Urology, Urooncology, Robot-Assisted and Focal Therapy, University Hospital Magdeburg A.ö.R., Medical Faculty of the Otto-von-Guericke-University Magdeburg, Leipziger Str. 44, 39120 Magdeburg, Germany; (H.C.); (M.S.); (M.P.)
- Urology Practice, 39104 Magdeburg, Germany
| |
Collapse
|
3
|
Li L, Guan J, Peng X, Zhou L, Zhang Z, Ding L, Zheng L, Wu L, Hu Z, Liu L, Yao Y. Machine learning for the prediction of 1-year mortality in patients with sepsis-associated acute kidney injury. BMC Med Inform Decis Mak 2024; 24:208. [PMID: 39054463 PMCID: PMC11271185 DOI: 10.1186/s12911-024-02583-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Accepted: 06/21/2024] [Indexed: 07/27/2024] Open
Abstract
INTRODUCTION Sepsis-associated acute kidney injury (SA-AKI) is strongly associated with poor prognosis. We aimed to build a machine learning (ML)-based clinical model to predict 1-year mortality in patients with SA-AKI. METHODS Six ML algorithms were included to perform model fitting. Feature selection was based on the feature importance evaluated by the SHapley Additive exPlanations (SHAP) values. Area under the receiver operating characteristic curve (AUROC) was used to evaluate the discriminatory ability of the prediction model. Calibration curve and Brier score were employed to assess the calibrated ability. Our ML-based prediction models were validated both internally and externally. RESULTS A total of 12,750 patients with SA-AKI and 55 features were included to build the prediction models. We identified the top 10 predictors including age, ICU stay and GCS score based on the feature importance. Among the six ML algorithms, the CatBoost showed the best prediction performance with an AUROC of 0.813 and Brier score of 0.119. In the external validation set, the predictive value remained favorable (AUROC = 0.784). CONCLUSION In this study, we developed and validated a ML-based prediction model based on 10 commonly used clinical features which could accurately and early identify the individuals at high-risk of long-term mortality in patients with SA-AKI.
Collapse
Affiliation(s)
- Le Li
- Fuwai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, 100730, China
| | - Jingyuan Guan
- Fuwai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, 100730, China
| | - Xi Peng
- Fuwai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, 100730, China
| | - Likun Zhou
- Fuwai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, 100730, China
| | - Zhuxin Zhang
- Fuwai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, 100730, China
| | - Ligang Ding
- Fuwai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, 100730, China
| | - Lihui Zheng
- Fuwai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, 100730, China
| | - Lingmin Wu
- Fuwai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, 100730, China
| | - Zhicheng Hu
- Fuwai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, 100730, China
| | - Limin Liu
- Fuwai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, 100730, China
| | - Yan Yao
- Fuwai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, 100730, China.
| |
Collapse
|
4
|
Cheungpasitporn W, Thongprayoon C, Kashani KB. Artificial intelligence and machine learning's role in sepsis-associated acute kidney injury. Kidney Res Clin Pract 2024; 43:417-432. [PMID: 38934028 PMCID: PMC11237333 DOI: 10.23876/j.krcp.23.298] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Accepted: 05/08/2024] [Indexed: 06/28/2024] Open
Abstract
Sepsis-associated acute kidney injury (SA-AKI) is a serious complication in critically ill patients, resulting in higher mortality, morbidity, and cost. The intricate pathophysiology of SA-AKI requires vigilant clinical monitoring and appropriate, prompt intervention. While traditional statistical analyses have identified severe risk factors for SA-AKI, the results have been inconsistent across studies. This has led to growing interest in leveraging artificial intelligence (AI) and machine learning (ML) to predict SA-AKI better. ML can uncover complex patterns beyond human discernment by analyzing vast datasets. Supervised learning models like XGBoost and RNN-LSTM have proven remarkably accurate at predicting SA-AKI onset and subsequent mortality, often surpassing traditional risk scores. Meanwhile, unsupervised learning reveals clinically relevant sub-phenotypes among diverse SA-AKI patients, enabling more tailored care. In addition, it potentially optimizes sepsis treatment to prevent SA-AKI through continual refinement based on patient outcomes. However, utilizing AI/ML presents ethical and practical challenges regarding data privacy, algorithmic biases, and regulatory compliance. AI/ML allows early risk detection, personalized management, optimal treatment strategies, and collaborative learning for SA-AKI management. Future directions include real-time patient monitoring, simulated data generation, and predictive algorithms for timely interventions. However, a smooth transition to clinical practice demands continuous model enhancements and rigorous regulatory oversight. In this article, we outlined the conventional methods used to address SA-AKI and explore how AI and ML can be applied to diagnose and manage SA-AKI, highlighting their potential to revolutionize SA-AKI care.
Collapse
Affiliation(s)
- Wisit Cheungpasitporn
- Division of Nephrology and Hypertension, Department of Medicine, Mayo Clinic, Rochester, MN, USA
| | - Charat Thongprayoon
- Division of Nephrology and Hypertension, Department of Medicine, Mayo Clinic, Rochester, MN, USA
| | - Kianoush B Kashani
- Division of Nephrology and Hypertension, Department of Medicine, Mayo Clinic, Rochester, MN, USA
- Division of Pulmonary and Critical Care Medicine, Department of Medicine, Mayo Clinic, Rochester, MN, USA
| |
Collapse
|
5
|
Abin AA, Molla A, Ejmalian A, Nabavi S, Memari B, Fani K, Dabbagh A. Anesthetic Management Recommendations Using a Machine Learning Algorithm to Reduce the Risk of Acute Kidney Injury After Cardiac Surgeries. Anesth Pain Med 2024; 14:e143853. [PMID: 39416805 PMCID: PMC11474233 DOI: 10.5812/aapm-143853] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2023] [Revised: 04/03/2024] [Accepted: 04/07/2024] [Indexed: 10/19/2024] Open
Abstract
Background Open heart surgeries are a common surgical approach among patients with heart disease. Acute kidney injury (AKI) is one of the most common postoperative complications following cardiac surgeries, with an average incidence of 6 - 10%. Additionally, AKI has a mortality rate of 5 - 10%. One of the challenges of cardiac surgeries is selecting the appropriate anesthetic approaches to reduce the risk of AKI. Objectives This study presents a machine learning-based method that consists of two regression models. These models can inform the anesthesiologist about the risk of AKI resulting from the improper selection of anesthetic parameters. Methods In this cohort study, the medical records of 998 patients who underwent cardiac surgery were collected. The proposed method includes two regression models. The first regression model recommends optimal anesthesia parameters to minimize the risk of AKI. The second model provides the anesthesiologist with the safest margin for deciding on anesthetic parameters during surgery, including cardiopulmonary bypass (CPB) time, anesthesia time, crystalloid dose, diuretic dose, and transfusion of packed red cells (PC) and fresh frozen plasma (FFP). Using this method, the specialist can evaluate the anesthetic parameters and assess the potential AKI risk. Additionally, the proposed method can also provide the treatment team with anesthetic parameters that carry the lowest risk of AKI. Results This method was evaluated using data from 526 patients who suffered from postoperative AKI (AKI+) and 472 who did not suffer any injury (AKI-). The accuracy of the proposed method is 80.6%. Additionally, the evaluation of the proposed method by three experienced cardiac anesthesiologists shows a high correlation between the results of the proposed method and the opinions of the anesthesiologists. Conclusions The results indicated that the outputs of the proposed models and the designed software could help reduce the risk of postoperative AKI.
Collapse
Affiliation(s)
- Ahmad Ali Abin
- Faculty of Computer Science and Engineering, Shahid Beheshti University, Tehran, Iran
- LIFAT, Universite de Tours, Tours, France
| | - Ahmad Molla
- Faculty of Computer Science and Engineering, Shahid Beheshti University, Tehran, Iran
| | - Azar Ejmalian
- Department of Anesthesiology, School of Medicine, Iran University of Medical Sciences, Tehran, Iran
| | - Shahabedin Nabavi
- Faculty of Computer Science and Engineering, Shahid Beheshti University, Tehran, Iran
| | - Behnaz Memari
- Anesthesiology Research Center, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Kamal Fani
- Department of Anesthesiology, School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Ali Dabbagh
- Anesthesiology Research Center, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| |
Collapse
|
6
|
Musiał K, Stojanowski J, Augustynowicz M, Miśkiewicz-Migoń I, Kałwak K, Ussowicz M. Assessment of Risk Factors for Acute Kidney Injury with Machine Learning Tools in Children Undergoing Hematopoietic Stem Cell Transplantation. J Clin Med 2024; 13:2266. [PMID: 38673539 PMCID: PMC11050842 DOI: 10.3390/jcm13082266] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2024] [Revised: 04/08/2024] [Accepted: 04/10/2024] [Indexed: 04/28/2024] Open
Abstract
Background: Although acute kidney injury (AKI) is a common complication in patients undergoing hematopoietic stem cell transplantation (HSCT), its prophylaxis remains a clinical challenge. Attempts at prevention or early diagnosis focus on various methods for the identification of factors influencing the incidence of AKI. Our aim was to test the artificial intelligence (AI) potential in the construction of a model defining parameters predicting AKI development. Methods: The analysis covered the clinical data of children followed up for 6 months after HSCT. Kidney function was assessed before conditioning therapy, 24 h after HSCT, 1, 2, 3, 4, and 8 weeks after transplantation, and, finally, 3 and 6 months post-transplant. The type of donor, conditioning protocol, and complications were incorporated into the model. Results: A random forest classifier (RFC) labeled the 93 patients according to presence or absence of AKI. The RFC model revealed that the values of the estimated glomerular filtration rate (eGFR) before and just after HSCT, as well as methotrexate use, acute graft versus host disease (GvHD), and viral infection occurrence, were the major determinants of AKI incidence within the 6-month post-transplant observation period. Conclusions: Artificial intelligence seems a promising tool in predicting the potential risk of developing AKI, even before HSCT or just after the procedure.
Collapse
Affiliation(s)
- Kinga Musiał
- Department of Pediatric Nephrology, Wrocław Medical University, Borowska 213, 50-556 Wrocław, Poland
| | - Jakub Stojanowski
- Department of Nephrology and Transplantation Medicine, Wrocław Medical University, 50-556 Wrocław, Poland;
| | - Monika Augustynowicz
- Clinic of Pediatric Nephrology, University Clinical Hospital, Borowska 213, 50-556 Wroclaw, Poland
| | - Izabella Miśkiewicz-Migoń
- Clinical Department of Pediatric Oncology and Hematology, Mother and Child Health Center, Karol Marcinkowski University Hospital, 65-046 Zielona Góra, Poland
| | - Krzysztof Kałwak
- Department of Pediatric Bone Marrow Transplantation, Oncology and Hematology, Wrocław Medical University, 50-556 Wrocław, Poland; (K.K.); (M.U.)
| | - Marek Ussowicz
- Department of Pediatric Bone Marrow Transplantation, Oncology and Hematology, Wrocław Medical University, 50-556 Wrocław, Poland; (K.K.); (M.U.)
| |
Collapse
|
7
|
Musiał K, Stojanowski J, Miśkiewicz-Bujna J, Kałwak K, Ussowicz M. KIM-1, IL-18, and NGAL, in the Machine Learning Prediction of Kidney Injury among Children Undergoing Hematopoietic Stem Cell Transplantation-A Pilot Study. Int J Mol Sci 2023; 24:15791. [PMID: 37958774 PMCID: PMC10648899 DOI: 10.3390/ijms242115791] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2023] [Revised: 10/26/2023] [Accepted: 10/26/2023] [Indexed: 11/15/2023] Open
Abstract
Children undergoing allogeneic hematopoietic stem cell transplantation (HSCT) are prone to developing acute kidney injury (AKI). Markers of kidney damage: kidney injury molecule (KIM)-1, interleukin (IL)-18, and neutrophil gelatinase-associated lipocalin (NGAL) may ease early diagnosis of AKI. The aim of this study was to assess serum concentrations of KIM-1, IL-18, and NGAL in children undergoing HSCT in relation to classical markers of kidney function (creatinine, cystatin C, estimated glomerular filtration rate (eGFR)) and to analyze their usefulness as predictors of kidney damage with the use of artificial intelligence tools. Serum concentrations of KIM-1, IL-18, NGAL, and cystatin C were assessed by ELISA in 27 children undergoing HSCT before transplantation and up to 4 weeks after the procedure. The data was used to build a Random Forest Classifier (RFC) model of renal injury prediction. The RFC model established on the basis of 3 input variables, KIM-1, IL-18, and NGAL concentrations in the serum of children before HSCT, was able to effectively assess the rate of patients with hyperfiltration, a surrogate marker of kidney injury 4 weeks after the procedure. With the use of the RFC model, serum KIM-1, IL-18, and NGAL may serve as markers of incipient renal dysfunction in children after HSCT.
Collapse
Affiliation(s)
- Kinga Musiał
- Department of Pediatric Nephrology, Wrocław Medical University, Borowska 213, 50-556 Wrocław, Poland
| | - Jakub Stojanowski
- Department of Nephrology and Transplantation Medicine, Wrocław Medical University, 50-556 Wrocław, Poland
| | - Justyna Miśkiewicz-Bujna
- Clinical Department of Pediatric Oncology and Hematology, Mother and Child Health Center, Karol Marcinkowski University Hospital, 65-046 Zielona Góra, Poland
| | - Krzysztof Kałwak
- Department of Pediatric Bone Marrow Transplantation, Oncology and Hematology, Wrocław Medical University, 50-556 Wrocław, Poland
| | - Marek Ussowicz
- Department of Pediatric Bone Marrow Transplantation, Oncology and Hematology, Wrocław Medical University, 50-556 Wrocław, Poland
| |
Collapse
|
8
|
Kamel Rahimi A, Ghadimi M, van der Vegt AH, Canfell OJ, Pole JD, Sullivan C, Shrapnel S. Machine learning clinical prediction models for acute kidney injury: the impact of baseline creatinine on prediction efficacy. BMC Med Inform Decis Mak 2023; 23:207. [PMID: 37814311 PMCID: PMC10563357 DOI: 10.1186/s12911-023-02306-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 09/22/2023] [Indexed: 10/11/2023] Open
Abstract
BACKGROUND There are many Machine Learning (ML) models which predict acute kidney injury (AKI) for hospitalised patients. While a primary goal of these models is to support clinical decision-making, the adoption of inconsistent methods of estimating baseline serum creatinine (sCr) may result in a poor understanding of these models' effectiveness in clinical practice. Until now, the performance of such models with different baselines has not been compared on a single dataset. Additionally, AKI prediction models are known to have a high rate of false positive (FP) events regardless of baseline methods. This warrants further exploration of FP events to provide insight into potential underlying reasons. OBJECTIVE The first aim of this study was to assess the variance in performance of ML models using three methods of baseline sCr on a retrospective dataset. The second aim was to conduct an error analysis to gain insight into the underlying factors contributing to FP events. MATERIALS AND METHODS The Intensive Care Unit (ICU) patients of the Medical Information Mart for Intensive Care (MIMIC)-IV dataset was used with the KDIGO (Kidney Disease Improving Global Outcome) definition to identify AKI episodes. Three different methods of estimating baseline sCr were defined as (1) the minimum sCr, (2) the Modification of Diet in Renal Disease (MDRD) equation and the minimum sCr and (3) the MDRD equation and the mean of preadmission sCr. For the first aim of this study, a suite of ML models was developed for each baseline and the performance of the models was assessed. An analysis of variance was performed to assess the significant difference between eXtreme Gradient Boosting (XGB) models across all baselines. To address the second aim, Explainable AI (XAI) methods were used to analyse the XGB errors with Baseline 3. RESULTS Regarding the first aim, we observed variances in discriminative metrics and calibration errors of ML models when different baseline methods were adopted. Using Baseline 1 resulted in a 14% reduction in the f1 score for both Baseline 2 and Baseline 3. There was no significant difference observed in the results between Baseline 2 and Baseline 3. For the second aim, the FP cohort was analysed using the XAI methods which led to relabelling data with the mean of sCr in 180 to 0 days pre-ICU as the preferred sCr baseline method. The XGB model using this relabelled data achieved an AUC of 0.85, recall of 0.63, precision of 0.54 and f1 score of 0.58. The cohort size was 31,586 admissions, of which 5,473 (17.32%) had AKI. CONCLUSION In the absence of a widely accepted method of baseline sCr, AKI prediction studies need to consider the impact of different baseline methods on the effectiveness of ML models and their potential implications in real-world implementations. The utilisation of XAI methods can be effective in providing insight into the occurrence of prediction errors. This can potentially augment the success rate of ML implementation in routine care.
Collapse
Affiliation(s)
- Amir Kamel Rahimi
- Queensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Herston, Brisbane, 4006, Australia.
- Digital Health Cooperative Research Centre, Australian Government, Sydney, NSW, Australia.
| | - Moji Ghadimi
- The School of Mathematics and Physics, The University of Queensland, St Lucia, Brisbane, 4072, Australia
| | - Anton H van der Vegt
- Queensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Herston, Brisbane, 4006, Australia
| | - Oliver J Canfell
- Queensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Herston, Brisbane, 4006, Australia
- Digital Health Cooperative Research Centre, Australian Government, Sydney, NSW, Australia
- UQ Business School, The University of Queensland, St Lucia, Brisbane, 4072, Australia
| | - Jason D Pole
- Queensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Herston, Brisbane, 4006, Australia
- Dalla Lana School of Public Health, The University of Toronto, Toronto, Canada
- ICES, Toronto, Canada
| | - Clair Sullivan
- Queensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Herston, Brisbane, 4006, Australia
- Metro North Hospital and Health Service, Department of Health, Queensland Government, Herston, Brisbane, 4006, Australia
| | - Sally Shrapnel
- Queensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Herston, Brisbane, 4006, Australia
- The School of Mathematics and Physics, The University of Queensland, St Lucia, Brisbane, 4072, Australia
| |
Collapse
|
9
|
Jiang X, Hu Y, Guo S, Du C, Cheng X. Prediction of persistent acute kidney injury in postoperative intensive care unit patients using integrated machine learning: a retrospective cohort study. Sci Rep 2022; 12:17134. [PMID: 36224308 PMCID: PMC9556643 DOI: 10.1038/s41598-022-21428-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Accepted: 09/27/2022] [Indexed: 01/04/2023] Open
Abstract
Acute kidney injury (AKI) often occurs in patients in the intensive care unit (ICU). AKI duration is closely related to the prognosis of critically ill patients. Identifying the disease course length in AKI is critical for developing effective individualised treatment. To predict persistent AKI at an early stage based on a machine learning algorithm and integrated models. Overall, 955 patients admitted to the ICU after surgery complicated by AKI were retrospectively evaluated. The occurrence of persistent AKI was predicted using three machine learning methods: a support vector machine (SVM), decision tree, and extreme gradient boosting and with an integrated model. External validation was also performed. The incidence of persistent AKI was 39.4-45.1%. In the internal validation, SVM exhibited the highest area under the receiver operating characteristic curve (AUC) value, followed by the integrated model. In the external validation, the AUC values of the SVM and integrated models were 0.69 and 0.68, respectively, and the model calibration chart revealed that all models had good performance. Critically ill patients with AKI after surgery had high incidence of persistent AKI. Our machine learning model could effectively predict the occurrence of persistent AKI at an early stage.
Collapse
Affiliation(s)
- Xuandong Jiang
- grid.268099.c0000 0001 0348 3990Intensive Care Unit, Affiliated Dongyang Hospital of Wenzhou Medical University, No. 60 Wuning West Road, Jinhua, Dongyang, Zhejiang People’s Republic of China
| | - Yongxia Hu
- grid.268099.c0000 0001 0348 3990Intensive Care Unit, Affiliated Dongyang Hospital of Wenzhou Medical University, No. 60 Wuning West Road, Jinhua, Dongyang, Zhejiang People’s Republic of China
| | - Shan Guo
- grid.268099.c0000 0001 0348 3990Intensive Care Unit, Affiliated Dongyang Hospital of Wenzhou Medical University, No. 60 Wuning West Road, Jinhua, Dongyang, Zhejiang People’s Republic of China
| | - Chaojian Du
- grid.268099.c0000 0001 0348 3990Intensive Care Unit, Affiliated Dongyang Hospital of Wenzhou Medical University, No. 60 Wuning West Road, Jinhua, Dongyang, Zhejiang People’s Republic of China
| | - Xuping Cheng
- grid.268099.c0000 0001 0348 3990Intensive Care Unit, Affiliated Dongyang Hospital of Wenzhou Medical University, No. 60 Wuning West Road, Jinhua, Dongyang, Zhejiang People’s Republic of China
| |
Collapse
|
10
|
Lazebnik T, Bahouth Z, Bunimovich-Mendrazitsky S, Halachmi S. Predicting acute kidney injury following open partial nephrectomy treatment using SAT-pruned explainable machine learning model. BMC Med Inform Decis Mak 2022; 22:133. [PMID: 35578278 PMCID: PMC9112450 DOI: 10.1186/s12911-022-01877-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2021] [Accepted: 05/10/2022] [Indexed: 11/22/2022] Open
Abstract
Background One of the most prevalent complications of Partial Nephrectomy (PN) is Acute Kidney Injury (AKI), which could have a negative impact on subsequent renal function and occurs in up to 24.3% of patients undergoing PN. The aim of this study was to predict the occurrence of AKI following PN using preoperative parameters by applying machine learning algorithms. Methods We included all adult patients (n = 723) who underwent open PN in our department since 1995 and on whom we have data on the pre-operative renal function. We developed a random forest (RF) model with Boolean satisfaction-based pruned decision trees for binary classification (AKI or non-AKI). Hyper-parameter grid search was performed to optimize the model's performance. Fivefold cross-validation was applied to evaluate the model. We implemented a RF model with greedy feature selection to binary classify AKI and non-AKI cases based on pre-operative data. Results The best model obtained a 0.69 precision and 0.69 recall in classifying the AKI and non-AKI groups on average (k = 5). In addition, the model's probability to correctly classify a new prediction is 0.75. The proposed model is available as an online calculator. Conclusions Our model predicts the occurrence of AKI following open PN with (75%) accuracy. We plan to externally validate this model and modify it to minimally-invasive PN. Supplementary Information The online version contains supplementary material available at 10.1186/s12911-022-01877-8.
Collapse
Affiliation(s)
- Teddy Lazebnik
- Department of Cancer Biology, Cancer Institute, University College London, London, UK.
| | - Zaher Bahouth
- Department of Urology, Bnai Zion Medical Center, Haifa, Israel
| | | | - Sarel Halachmi
- Department of Urology, Bnai Zion Medical Center, Haifa, Israel
| |
Collapse
|