1
|
Zhou F, Gillespie A, Gligorijevic D, Gligorijevic J, Obradovic Z. Use of disease embedding technique to predict the risk of progression to end-stage renal disease. J Biomed Inform 2020; 105:103409. [PMID: 32304869 PMCID: PMC9885429 DOI: 10.1016/j.jbi.2020.103409] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2019] [Revised: 03/18/2020] [Accepted: 03/19/2020] [Indexed: 02/01/2023]
Abstract
The accurate prediction of progression of Chronic Kidney Disease (CKD) to End Stage Renal Disease (ESRD) is of great importance to clinicians and a challenge to researchers as there are many causes and even more comorbidities that are ignored by the traditional prediction models. We examine whether utilizing a novel low-dimensional embedding model disease2disease (D2D) learned from a large-scale electronic health records (EHRs) could well clusters the causes of kidney diseases and comorbidities and further improve prediction of progression of CKD to ESRD compared to traditional risk factors. The study cohort consists of 2,507 hospitalized Stage 3 CKD patients of which 1,375 (54.8%) progressed to ESRD within 3 years. We evaluated the proposed unsupervised learning framework by applying a regularized logistic regression model and a cox proportional hazard model respectively, and compared the accuracies with the ones obtained by four alternative models. The results demonstrate that the learned low-dimensional disease representations from EHRs can capture the relationship between vast arrays of diseases, and can outperform traditional risk factors in a CKD progression prediction model. These results can be used both by clinicians in patient care and researchers to develop new prediction methods.
Collapse
Affiliation(s)
- Fang Zhou
- School of Data Science & Engineering, East China Normal University, Shanghai, China
| | - Avrum Gillespie
- Division of Nephrology, Hypertension, and Kidney Transplantation, Department of Medicine, Lewis Katz School of Medicine, Temple University, Philadelphia, PA
| | - Djordje Gligorijevic
- Center for Data Analytics and Biomedical Informatics, Temple University, Philadelphia, PA
| | - Jelena Gligorijevic
- Center for Data Analytics and Biomedical Informatics, Temple University, Philadelphia, PA
| | - Zoran Obradovic
- Center for Data Analytics and Biomedical Informatics, Temple University, Philadelphia, PA
| |
Collapse
|
2
|
Lee EJ, Jeon J, Lee KW, Yoo H, Jang HR, Park JB, Lee JE, Kim K, Huh W. The combination of area under the curve and percentage change in estimated glomerular filtration rate predicts long-term outcome of kidney transplants. Am J Transplant 2020; 20:1056-1062. [PMID: 31733034 DOI: 10.1111/ajt.15711] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2019] [Revised: 11/04/2019] [Accepted: 11/10/2019] [Indexed: 01/25/2023]
Abstract
The development of surrogate markers for long-term outcomes of kidney transplant (KT) is a focus of attention. We examined the possibility of using a combination of the area under the curve of estimated glomerular filtration rate (eGFR) for 2 years (AUCeGFR2yrs ) and percent change in eGFR between 1 and 2 years after KT (% changeeGFR1/2yr ) as a surrogate marker. We compared the predictive power of death-censored graft failure with various combinations. The combination of >2% vs ≤2% for % changeeGFR1/2yr and >1300 vs ≤1300 mL/min/month for AUCeGFR2yr had the highest Harrell C-index (0.647; 95% confidence interval [95% CI], 0.604-0.690). The death-censored graft survival rate of the group with ≤2% changeeGFR1/2yr and ≤1300 mL/min/month AUCeGFR2yr was significantly lower than those of other groups. The AUC/% change eGFR had comparable predictive power to the previously identified marker ≥30% decline in eGFR between years 1 and 3 after KT (≤-30% changeeGFR1/3yr ) (Harrell's C-index = 0.645 [95% CI 0.628-0.662] for ≤-30% changeeGFR1/3yr ). The proposed combination might be useful as a surrogate marker in KT trials because it requires a shorter surveillance period than the established marker while having comparable predictive power.
Collapse
Affiliation(s)
- Eun Jeong Lee
- Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea
| | - Junseok Jeon
- Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea
| | - Kyo Won Lee
- Department of Surgery, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea
| | - Heejin Yoo
- Statistics and Data Center, Samsung Medical Center, Research Institute for Future Medicine, Seoul, Korea
| | - Hye Ryoun Jang
- Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea
| | - Jae Berm Park
- Department of Surgery, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea
| | - Jung Eun Lee
- Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea
| | - Kyunga Kim
- Statistics and Data Center, Samsung Medical Center, Research Institute for Future Medicine, Seoul, Korea
| | - Wooseong Huh
- Department of Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea
| |
Collapse
|
3
|
Phillips BL, Kassimatis T, Atalar K, Wilkinson H, Kessaris N, Simmonds N, Hilton R, Horsfield C, Callaghan CJ. Chronic histological changes in deceased donor kidneys at implantation do not predict graft survival: a single‐centre retrospective analysis. Transpl Int 2019; 32:523-534. [DOI: 10.1111/tri.13398] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2018] [Revised: 11/13/2018] [Accepted: 01/04/2019] [Indexed: 11/30/2022]
Affiliation(s)
- Benedict L. Phillips
- Department of Nephrology and Transplantation Guy's and St Thomas’ NHS Foundation Trust London UK
| | - Theodoros Kassimatis
- Department of Nephrology and Transplantation Guy's and St Thomas’ NHS Foundation Trust London UK
| | - Kerem Atalar
- Department of Nephrology and Transplantation Guy's and St Thomas’ NHS Foundation Trust London UK
| | - Hannah Wilkinson
- Department of Nephrology and Transplantation Guy's and St Thomas’ NHS Foundation Trust London UK
| | - Nicos Kessaris
- Department of Nephrology and Transplantation Guy's and St Thomas’ NHS Foundation Trust London UK
| | - Naomi Simmonds
- Department of Histopathology Guy's and St Thomas’ NHS Foundation Trust London UK
| | - Rachel Hilton
- Department of Nephrology and Transplantation Guy's and St Thomas’ NHS Foundation Trust London UK
| | - Catherine Horsfield
- Department of Histopathology Guy's and St Thomas’ NHS Foundation Trust London UK
| | - Chris J. Callaghan
- Department of Nephrology and Transplantation Guy's and St Thomas’ NHS Foundation Trust London UK
| |
Collapse
|
4
|
Rashidi Khazaee P, Bagherzadeh J, Niazkhani Z, Pirnejad H. A dynamic model for predicting graft function in kidney recipients' upcoming follow up visits: A clinical application of artificial neural network. Int J Med Inform 2018; 119:125-133. [PMID: 30342680 DOI: 10.1016/j.ijmedinf.2018.09.012] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2018] [Revised: 08/14/2018] [Accepted: 09/10/2018] [Indexed: 01/15/2023]
Abstract
BACKGROUND Predicting the function of transplanted kidneys would help clinicians in individualized medical interventions. We aimed to develop and validate a predictive tool for a future value of estimated glomerular filtration rate (eGFR) at upcoming visits. METHODS We used static and time-dependent covariates as inputs of artificial neural network based prediction models for predicting an eGFR value for an upcoming visit. We included 675 kidney recipients, who received transplant in the Urmia kidney transplant center in 2001-2013 and were longitudinally cared for in 2001-2017. The first 75% of records of longitudinal data of each patient were used to develop the prediction models and the remaining last 25% for evaluating its performance. Models' performances were evaluated by Mean Square Error (MSE) and Mean Absolute Error (MAE). RESULTS The development and validation datasets included 18,773 and 7038 records of historical data, respectively. The most accurate model included 3 static covariates of recipients' gender and donors' age and gender as well as 11 dynamic covariates of recipients including current age, time since transplant, serum creatinine, fasting blood sugar, weight and blood pressures available at each visit time. The performance of prediction models in the validation cohort was improved when history window of time dependent variables' recent values was increased from 1 to 10 (an MSE decline from 161 to 99). CONCLUSIONS Our best performed model is able to dynamically predict a future eGFR value for kidney recipients' upcoming visits. Integrating such a clinical tool into daily workflow of outpatient clinics can potentially support clinicians in optimal and individualized decision makings.
Collapse
Affiliation(s)
| | - Jamshid Bagherzadeh
- Electrical and Computer Engineering Department, Urmia University, Urmia, Iran
| | - Zahra Niazkhani
- Nephrology and Kidney Transplant Research Center, Urmia University of Medical Sciences, Urmia, Iran; Department of Health Information Technology, Urmia University of Medical Sciences, Urmia, Iran.
| | - Habibollah Pirnejad
- Department of Health Information Technology, Urmia University of Medical Sciences, Urmia, Iran; Patient Safety Research Center, Urmia University of Medical Sciences, Urmia, Iran; Erasmus School of Health Policy & Management (ESHPM), Erasmus University Rotterdam, Rotterdam, the Netherlands
| |
Collapse
|
5
|
Yoo KD, Noh J, Lee H, Kim DK, Lim CS, Kim YH, Lee JP, Kim G, Kim YS. A Machine Learning Approach Using Survival Statistics to Predict Graft Survival in Kidney Transplant Recipients: A Multicenter Cohort Study. Sci Rep 2017; 7:8904. [PMID: 28827646 PMCID: PMC5567098 DOI: 10.1038/s41598-017-08008-8] [Citation(s) in RCA: 71] [Impact Index Per Article: 8.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2017] [Accepted: 07/07/2017] [Indexed: 01/20/2023] Open
Abstract
Accurate prediction of graft survival after kidney transplant is limited by the complexity and heterogeneity of risk factors influencing allograft survival. In this study, we applied machine learning methods, in combination with survival statistics, to build new prediction models of graft survival that included immunological factors, as well as known recipient and donor variables. Graft survival was estimated from a retrospective analysis of the data from a multicenter cohort of 3,117 kidney transplant recipients. We evaluated the predictive power of ensemble learning algorithms (survival decision tree, bagging, random forest, and ridge and lasso) and compared outcomes to those of conventional models (decision tree and Cox regression). Using a conventional decision tree model, the 3-month serum creatinine level post-transplant (cut-off, 1.65 mg/dl) predicted a graft failure rate of 77.8% (index of concordance, 0.71). Using a survival decision tree model increased the index of concordance to 0.80, with the episode of acute rejection during the first year post-transplant being associated with a 4.27-fold increase in the risk of graft failure. Our study revealed that early acute rejection in the first year is associated with a substantially increased risk of graft failure. Machine learning methods may provide versatile and feasible tools for forecasting graft survival.
Collapse
Affiliation(s)
- Kyung Don Yoo
- Department of Internal Medicine, Dongguk University College of Medicine, Gyeongju, Korea
| | - Junhyug Noh
- Department of Computer Science and Engineering, College of Engineering, Seoul National University, Seoul, Korea
| | - Hajeong Lee
- Department of Internal Medicine, Seoul National University College of Medicine, Seoul, Korea
| | - Dong Ki Kim
- Department of Internal Medicine, Seoul National University College of Medicine, Seoul, Korea
| | - Chun Soo Lim
- Department of Internal Medicine, Seoul National University Boramae Medical Center, Seoul, Korea
| | - Young Hoon Kim
- Department of Surgery, College of Medicine, Ulsan University, Asan Medical Center, Seoul, Korea
| | - Jung Pyo Lee
- Department of Internal Medicine, Seoul National University Boramae Medical Center, Seoul, Korea
| | - Gunhee Kim
- Department of Computer Science and Engineering, College of Engineering, Seoul National University, Seoul, Korea.
| | - Yon Su Kim
- Department of Internal Medicine, Seoul National University College of Medicine, Seoul, Korea.
| |
Collapse
|
6
|
Tabibzadeh N, Glowacki F, Frimat M, Elsermans V, Provôt F, Lionet A, Gnemmi V, Hertig A, Noël C, Hazzan M. Long-term outcome after early cyclosporine withdrawal in kidney transplantation: ten years after. Clin Transplant 2016; 30:1480-1487. [DOI: 10.1111/ctr.12843] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/07/2016] [Indexed: 11/29/2022]
Affiliation(s)
- Nahid Tabibzadeh
- CHU Lille - Service de Néphrologie - F-59000 Lille France
- Université de Lille - UMR 995, F-59000 Lille France
| | - François Glowacki
- CHU Lille - Service de Néphrologie - F-59000 Lille France
- Université de Lille - UMR 995, F-59000 Lille France
| | - Marie Frimat
- CHU Lille - Service de Néphrologie - F-59000 Lille France
- Université de Lille - UMR 995, F-59000 Lille France
| | - Vincent Elsermans
- Université de Lille - UMR 995, F-59000 Lille France
- CHU Lille - Laboratoire d'Immunologie - F-59000 Lille France
| | | | - Arnaud Lionet
- CHU Lille - Service de Néphrologie - F-59000 Lille France
| | - Viviane Gnemmi
- Université de Lille - UMR 995, F-59000 Lille France
- CHU Lille - Laboratoire d'Anatomopathologie - F-59000 Lille France
| | - Alexandre Hertig
- Urgences Néphrologiques et Transplantation Rénale; Hôpital Tenon, APHP; Paris France
- UPMC Sorbonne Université Paris 06, UMR S 1155, F-75020; Paris France
| | - Christian Noël
- CHU Lille - Service de Néphrologie - F-59000 Lille France
- Université de Lille - UMR 995, F-59000 Lille France
| | - Marc Hazzan
- CHU Lille - Service de Néphrologie - F-59000 Lille France
- Université de Lille - UMR 995, F-59000 Lille France
| |
Collapse
|
7
|
Gonzales MM, Bentall A, Kremers WK, Stegall MD, Borrows R. Predicting Individual Renal Allograft Outcomes Using Risk Models with 1-Year Surveillance Biopsy and Alloantibody Data. J Am Soc Nephrol 2016; 27:3165-3174. [PMID: 26961348 DOI: 10.1681/asn.2015070811] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2015] [Accepted: 01/11/2016] [Indexed: 11/03/2022] Open
Abstract
The ability to predict outcomes for individual patients would be a significant advance for not only counseling, but also identifying those for whom interventions may be needed. The goals of this study were to validate an existing risk prediction score that incorporates easily obtainable clinical factors and determine if histologic findings at 1-year surveillance biopsy and/or serum donor-specific alloantibody status could improve predictability of graft loss by 5 years. We retrospectively studied 1465 adults who received a solitary kidney transplant between January of 1999 and December of 2008 and had sufficiently detailed 5-year follow-up data for modeling. In this cohort, the Birmingham risk model (incorporating recipient factors at 1 year, including age, sex, ethnicity, renal function, proteinuria, and prior acute rejection) predicted death-censored and overall graft survival (c statistics =0.84 and 0.78, respectively). The presence of glomerulitis or chronic interstitial fibrosis (g and ci scores by Banff, respectively) on 1-year biopsy specimens independently correlated with graft loss by 5 years. Adding these variables to the model for death-censored graft loss increased predictability (c statistic =0.90), improved calibration (ability to stratify risk from high to low), and reclassified risk of failure in 29% of patients. Adding the presence of donor-specific alloantibody at 1 year did not improve predictability or reclassification but did improve calibration marginally. We conclude that, at 1 year after kidney transplant, a risk model of graft survival that incorporates clinical factors and histologic findings at surveillance biopsy is highly predictive of individual risk and well calibrated.
Collapse
Affiliation(s)
- Manuel Moreno Gonzales
- Division of Transplantation Surgery, William J. von Liebig Transplant Center, Mayo Clinic, Rochester, Minnesota
| | - Andrew Bentall
- Department of Renal Medicine, Queen Elizabeth Hospital, Birmingham, United Kingdom; and.,School of Immunity and Infection, University of Birmingham, Birmingham, United Kingdom
| | - Walter K Kremers
- Division of Transplantation Surgery, William J. von Liebig Transplant Center, Mayo Clinic, Rochester, Minnesota
| | - Mark D Stegall
- Division of Transplantation Surgery, William J. von Liebig Transplant Center, Mayo Clinic, Rochester, Minnesota;
| | - Richard Borrows
- Department of Renal Medicine, Queen Elizabeth Hospital, Birmingham, United Kingdom; and.,School of Immunity and Infection, University of Birmingham, Birmingham, United Kingdom
| |
Collapse
|