Prediction of chronic allograft nephropathy using classification trees

Predicting long-term outcomes of kidney transplantation in the era of artificial intelligence

The ability to accurately predict long-term kidney transplant survival can assist nephrologists in making therapeutic decisions. However, predicting kidney transplantation (KT) outcomes is challenging due to the complexity of the factors involved. Artificial intelligence (AI) has become an increasingly important tool in the prediction of medical outcomes. Our goal was to utilize both conventional and AI-based methods to predict long-term kidney transplant survival. Our study included 407 KTs divided into two groups (group A: with a graft lifespan greater than 5 years and group B: with poor graft survival). We first performed a traditional statistical analysis and then developed predictive models using machine learning (ML) techniques. Donors in group A were significantly younger. The use of Mycophenolate Mofetil (MMF) was the only immunosuppressive drug that was significantly associated with improved graft survival. The average estimated glomerular filtration rate (eGFR) in the 3rd month post-KT was significantly higher in group A. The number of hospital readmissions during the 1st year post-KT was a predictor of graft survival. In terms of early post-transplant complications, delayed graft function (DGF), acute kidney injury (AKI), and acute rejection (AR) were significantly associated with poor graft survival. Among the 35 AI models developed, the best model had an AUC of 89.7% (Se: 91.9%; Sp: 87.5%). It was based on ten variables selected by an ML algorithm, with the most important being hypertension and a history of red-blood-cell transfusion. The use of AI provided us with a robust model enabling fast and precise prediction of 5-year graft survival using early and easily collectible variables. Our model can be used as a decision-support tool to early detect graft status.

Toward generalizing the use of artificial intelligence in nephrology and kidney transplantation

With its robust ability to integrate and learn from large sets of clinical data, artificial intelligence (AI) can now play a role in diagnosis, clinical decision making, and personalized medicine. It is probably the natural progression of traditional statistical techniques. Currently, there are many unmet needs in nephrology and, more particularly, in the kidney transplantation (KT) field. The complexity and increase in the amount of data, and the multitude of nephrology registries worldwide have enabled the explosive use of AI within the field. Nephrologists in many countries are already at the center of experiments and advances in this cutting-edge technology and our aim is to generalize the use of AI among nephrologists worldwide. In this paper, we provide an overview of AI from a medical perspective. We cover the core concepts of AI relevant to the practicing nephrologist in a consistent and simple way to help them get started, and we discuss the technical challenges. Finally, we focus on the KT field: the unmet needs and the potential role that AI can play to fill these gaps, then we summarize the published KT-related studies, including predictive factors used in each study, which will allow researchers to quickly focus on the most relevant issues.

Predicting the survival of kidney transplantation: design and evaluation of a smartphone-based application

Background

Prediction of graft survival for Kidney Transplantation (KT) is considered a risky task due to the scarcity of donating organs and the use of health care resources. The present study aimed to design and evaluate a smartphone-based application to predict the survival of KT in patients with End-Stage Renal Disease (ESRD).

Method

Based on the initial review, a researcher-made questionnaire was developed to assess the information needs of the application through urologists and nephrologists. By using information obtained from the questionnaire, a checklist was prepared, and the information of 513 patients with kidney failure was collected from their records at Sina Urological Research Center. Then, three data mining algorithms were applied to them. The smartphone-based application for the prediction of kidney transplant survival was designed, and a standard usability assessment questionnaire was used to evaluate the designed application.

Results

Three information elements related to the required data in different sections of demographic information, sixteen information elements related to patient clinical information, and four critical capabilities were determined for the design of the smartphone-based application. C5.0 algorithm with the highest accuracy (87.21%) was modeled as the application inference engine. The application was developed based on the PhoneGap framework. According to the participants’ scores (urologists and nephrologists) regarding the usability evaluation of the application, it can be concluded that both groups participating in the study could use the program, and they rated the application at a "good" level.

Conclusion

Since the overall performance or usability of the smartphone-based app was evaluated at a reasonable level, it can be used with certainty to predict kidney transplant survival.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12882-022-02841-4.

Machine learning support for decision making in kidney transplantation: step-by-step development of a technological solution (Preprint)

Background

Kidney transplantation is the preferred treatment option for patients with end-stage renal disease. To maximize patient and graft survival, the allocation of donor organs to potential recipients requires careful consideration.

Objective

This study aimed to develop an innovative technological solution to enable better prediction of kidney transplant survival for each potential donor-recipient pair.

Methods

We used deidentified data on past organ donors, recipients, and transplant outcomes in the United States from the Scientific Registry of Transplant Recipients. To predict transplant outcomes for potential donor-recipient pairs, we used several survival analysis models, including regression analysis (Cox proportional hazards), random survival forests, and several artificial neural networks (DeepSurv, DeepHit, and recurrent neural network [RNN]). We evaluated the performance of each model in terms of its ability to predict the probability of graft survival after kidney transplantation from deceased donors. Three metrics were used: the C-index, integrated Brier score, and integrated calibration index, along with calibration plots.

Results

On the basis of the C-index metrics, the neural network–based models (DeepSurv, DeepHit, and RNN) had better discriminative ability than the Cox model and random survival forest model (0.650, 0.661, and 0.659 vs 0.646 and 0.644, respectively). The proposed RNN model offered a compromise between the good discriminative ability and calibration and was implemented in a technological solution of technology readiness level 4.

Conclusions

Our technological solution based on the RNN model can effectively predict kidney transplant survival and provide support for medical professionals and candidate recipients in determining the most optimal donor-recipient pair.

Predicting Kidney Graft Survival Using Machine Learning Methods: Prediction Model Development and Feature Significance Analysis Study

BACKGROUND

Kidney transplantation is the optimal treatment for patients with end-stage renal disease. Short- and long-term kidney graft survival is influenced by a number of donor and recipient factors. Predicting the success of kidney transplantation is important for optimizing kidney allocation.

OBJECTIVE

The aim of this study was to predict the risk of kidney graft failure across three temporal cohorts (within 1 year, within 5 years, and after 5 years following a transplant) based on donor and recipient characteristics. We analyzed a large data set comprising over 50,000 kidney transplants covering an approximate 20-year period.

METHODS

We applied machine learning-based classification algorithms to develop prediction models for the risk of graft failure for three different temporal cohorts. Deep learning-based autoencoders were applied for data dimensionality reduction, which improved the prediction performance. The influence of features on graft survival for each cohort was studied by investigating a new nonoverlapping patient stratification approach.

RESULTS

Our models predicted graft survival with area under the curve scores of 82% within 1 year, 69% within 5 years, and 81% within 17 years. The feature importance analysis elucidated the varying influence of clinical features on graft survival across the three different temporal cohorts.

CONCLUSIONS

In this study, we applied machine learning to develop risk prediction models for graft failure that demonstrated a high level of prediction performance. Acknowledging that these models performed better than those reported in the literature for existing risk prediction tools, future studies will focus on how best to incorporate these prediction models into clinical care algorithms to optimize the long-term health of kidney recipients.

The Future Role of Machine Learning in Clinical Transplantation

The use of artificial intelligence and machine learning (ML) has revolutionized our daily lives and will soon be instrumental in healthcare delivery. The rise of ML is due to multiple factors: increasing access to massive datasets, exponential increases in processing power, and key algorithmic developments that allow ML models to tackle increasingly challenging questions. Progressively more transplantation research is exploring the potential utility of ML models throughout the patient journey, although this has not yet widely transitioned into the clinical domain. In this review, we explore common approaches used in ML in solid organ clinical transplantation and consider opportunities for ML to help clinicians and patients. We discuss ways in which ML can aid leverage of large complex datasets, generate cutting-edge prediction models, perform clinical image analysis, discover novel markers in molecular data, and fuse datasets to generate novel insights in modern transplantation practice. We focus on key areas in transplantation in which ML is driving progress, explore the future potential roles of ML, and discuss the challenges and limitations of these powerful tools.

Artificial intelligence and kidney transplantation

Artificial intelligence and its primary subfield, machine learning, have started to gain widespread use in medicine, including the field of kidney transplantation. We made a review of the literature that used artificial intelligence techniques in kidney transplantation. We located six main areas of kidney transplantation that artificial intelligence studies are focused on: Radiological evaluation of the allograft, pathological evaluation including molecular evaluation of the tissue, prediction of graft survival, optimizing the dose of immunosuppression, diagnosis of rejection, and prediction of early graft function. Machine learning techniques provide increased automation leading to faster evaluation and standardization, and show better performance compared to traditional statistical analysis. Artificial intelligence leads to improved computer-aided diagnostics and quantifiable personalized predictions that will improve personalized patient care.

Toward Advancing Long-Term Outcomes of Kidney Transplantation with Artificial Intelligence

After decades of pioneering advances and improvements, kidney transplantation is now the renal replacement therapy of choice for most patients with end-stage kidney disease (ESKD). Despite this success, the high risk of premature death and frequent occurrence of graft failure remain important clinical and research challenges. The current burst of studies and other innovative initiatives using artificial intelligence (AI) for a wide range of analytical and practical applications in biomedical areas seems to correlate with the same trend observed in publications in the kidney transplantation field, and points toward the potential of such novel approaches to address the aforementioned aim of improving long-term outcomes of kidney transplant recipients (KTR). However, at the same time, this trend underscores now more than ever the old methodological challenges and potential threats that the research and clinical community needs to be aware of and actively look after with regard to AI-driven evidence. The purpose of this narrative mini-review is to explore challenges for obtaining applicable and adequate kidney transplant data for analyses using AI techniques to develop prediction models, and to propose next steps in the field. We make a call to act toward establishing the strong collaborations needed to bring innovative synergies further augmented by AI, which have the potential to impact the long-term care of KTR. We encourage researchers and clinicians to submit their invaluable research, including original clinical and imaging studies, database studies from registries, meta-analyses, and AI research in the kidney transplantation field.

Machine learning for predicting long-term kidney allograft survival: a scoping review

Supervised machine learning (ML) is a class of algorithms that "learn" from existing input-output pairs, which is gaining popularity in pattern recognition for classification and prediction problems. In this scoping review, we examined the use of supervised ML algorithms for the prediction of long-term allograft survival in kidney transplant recipients. Data sources included PubMed, the Cumulative Index to Nursing and Allied Health Literature, and the Institute for Electrical and Electronics Engineers (IEEE) Xplore libraries from inception to November 2019. We screened titles and abstracts and potentially eligible full-text reports to select studies and subsequently abstracted the data. Eleven studies were identified. Decision trees were the most commonly used method (n = 8), followed by artificial neural networks (ANN) (n = 4) and Bayesian belief networks (n = 2). The area under receiver operating curve (AUC) was the most common measure of discrimination (n = 7), followed by sensitivity (n = 5) and specificity (n = 4). Model calibration examining the reliability in risk prediction was performed using either the Pearson r or the Hosmer-Lemeshow test in four studies. One study showed that logistic regression had comparable performance to ANN, while another study demonstrated that ANN performed better in terms of sensitivity, specificity, and accuracy, as compared with a Cox proportional hazards model. We synthesized the evidence related to the comparison of ML techniques with traditional statistical approaches for prediction of long-term allograft survival in patients with a kidney transplant. The methodological and reporting quality of included studies was poor. Our study also demonstrated mixed results in terms of the predictive potential of the models.

Role of Artificial Intelligence in Kidney Disease

Artificial intelligence (AI), as an advanced science technology, has been widely used in medical fields to promote medical development, mainly applied to early detections, disease diagnoses, and management. Owing to the huge number of patients, kidney disease remains a global health problem. Challenges remain in its diagnosis and treatment. AI could take individual conditions into account, produce suitable decisions and promise to make great strides in kidney disease management. Here, we review the current studies of AI applications in kidney disease in alerting systems, diagnostic assistance, guiding treatment and evaluating prognosis. Although the number of studies related to AI applications in kidney disease is small, the potential of AI in the management of kidney disease is well recognized by clinicians; AI will greatly enhance clinicians' capacity in their clinical practice in the future.

Machine learning in predicting graft failure following kidney transplantation: A systematic review of published predictive models

INTRODUCTION

Machine learning has been increasingly used to develop predictive models to diagnose different disease conditions. The heterogeneity of the kidney transplant population makes predicting graft outcomes extremely challenging. Several kidney graft outcome prediction models have been developed using machine learning, and are available in the literature. However, a systematic review of machine learning based prediction methods applied to kidney transplant has not been done to date. The main aim of our study was to perform an in-depth systematic analysis of different machine learning methods used to predict graft outcomes among kidney transplant patients, and assess their usefulness as an aid to decision-making.

METHODS

A systemic review of machine learning methods used to predict graft outcomes among kidney transplant patients was carried out using a search of the Medline, the Cumulative Index to Nursing and Allied Health Literature, EMBASE, PsycINFO and Cochrane databases.

RESULTS

A total of 295 articles were identified and extracted. Of these, 18 met the inclusion criteria. Most of the studies were published in the United States after 2010. The population size used to develop the models varied from 80 to 92,844, and the number of features in the models ranged from 6 to 71. The most common machine learning methods used were artificial neural networks, decision trees and Bayesian belief networks. Most of the machine learning based predictive models predicted graft failure with high sensitivity and specificity. Only one machine learning based prediction model had modelled time-to-event (survival) information. Seven studies compared the predictive performance of machine learning models with traditional regression methods and the performance of machine learning methods was found to be mixed, when compared with traditional regression methods.

CONCLUSION

There was a wide variation in the size of the study population and the input variables used. However, the prediction accuracy provided mixed results when machine learning and traditional predictive methods are compared. Based on reported gains in predictive performance, machine learning has the potential to improve kidney transplant outcome prediction and aid medical decision making.

Comparing Three Data Mining Methods to Predict Kidney Transplant Survival

INTRODUCTION

One of the most important complications of post-transplant is rejection. Analyzing survival is one of the areas of medical prognosis and data mining, as an effective approach, has the capacity of analyzing and estimating outcomes in advance through discovering appropriate models among data. The present study aims at comparing the effectiveness of C5.0 algorithms, neural network and C&RTree to predict kidney transplant survival before transplant.

METHOD

To detect factors effective in predicting transplant survival, information needs analysis was performed via a researcher-made questionnaire. A checklist was prepared and data of 513 kidney disease patient files were extracted from Sina Urology Research Center. Following CRISP methodology for data mining, IBM SPSS Modeler 14.2, C5.0, C&RTree algorithms and neural network were used.

RESULTS

Body Mass Index (BMI), cause of renal dysfunction and duration of dialysis were evaluated in all three models as the most effective factors in transplant survival. C5.0 algorithm with the highest validity (96.77%) was the first in estimating kidney transplant survival in patients followed by C&RTree (83.7%) and neural network (79.5%) models.

CONCLUSION

Among the three models, C5.0 algorithm was the top model with high validity that confirms its strength in predicting survival. The most effective kidney transplant survival factors were detected in this study; therefore, duration of transplant survival (year) can be determined considering the regulations set for a new sample with specific characteristics.

Increasing levels of hemoglobin improve renal transplantation outcomes

INTRODUCTION

Several studies have reported various data on prevalence of posttransplant anemia (PTA). We have little information about its impact on long-term graft outcomes and few studies of the optimal hemoglobin (Hb) target in kidney transplantation.

METHODS

We examined retrospectively 144 kidney transplant recipients of mean age 44.4 ± 12.3 years and follow-up of 40.5 ± 4.6 months. Exclusion criteria were age below 18 years, multiorgan transplantation, and graft failure in the first year. Using simple and multiple linear regression models, we evaluated the potential prediction of a serum concentration of Hb at 1 year after renal transplantation on allograft outcome as measured by Δ% estimated glomerular filtration rate (eGFR), the difference between eGFR, measured with the Modification of Diet in Renal Disease (MDRD) formula, at the end of follow-up, and at 1 year. Multiple models were adjusted for recipient sex, recipient age, donor age, ESA therapy, acute rejection episodes (ARE), days of delayed graft function, human leukocyte antigen mismatches and cold ischemia time.

RESULTS

At 1 year after transplantation, the mean Hb level was 13.77 ± 1.87 g/dL in males and 12.52 ± 1.53 g/dL in females. The average eGFR at 1 year was 63.07 ± 25.88 mL/min. At the end of follow-up, the mean Δ% eGFR was -5.73% ± 27.30%. Blood concentration of Hb correlated with donor, recipient sex, ARE, and eGFR at 1 year. There was a close correlation between the Δ% Hb and eGFR upon univariate analysis and the multiple linear regression model. Hb was the only predictor of transplant outcome.

CONCLUSIONS

Many factors are involved in kidney allograft function. Among these, Hb is important. In this work we demonstrated that increasing levels of Hb at 1 year after transplantation seemed to predict better preservation of graft function, representing a marker of a good quality graft.