1
|
Ng DK, Patel A, Schwartz GJ, Seegmiller JC, Warady BA, Furth SL, Cox C. A comparison of neural networks and regression-based approaches for estimating kidney function in pediatric chronic kidney disease: Practical predictive epidemiology for clinical management of a progressive disease. Ann Epidemiol 2025; 105:75-79. [PMID: 40209838 DOI: 10.1016/j.annepidem.2025.04.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2024] [Revised: 04/06/2025] [Accepted: 04/07/2025] [Indexed: 04/12/2025]
Abstract
PURPOSE Clinical management of pediatric chronic kidney disease requires estimation of glomerular filtration rate (eGFR). Currently, eGFR is determined by two endogenous markers measured in blood: serum creatine (SCr) and cystatin C (CysC). Machine learning methods show promise to potentially improve eGFR, but it is unclear if they can outperform regression-based approaches under clinical constraining requiring real time measurement and only two predictors. We constructed a neural network for eGFR (NNeGFR) and compared it to the clinical standard Under 25 (U25eGFR) equations using the same data for training and validation. METHODS The U25eGFR data comprised 1683 training and 843 validation observations that included iohexol measured GFR (mGFR), SCr and CysC. Sex-stratified feed forward NNs included the same predictors as U25eGFR (i.e., age, height/SCr, CysC) with additional nonlinear transformations. Performance was evaluated by bias (for calibration), proportions within 10 % and 30 % of mGFR (P10 and P30, for accuracy), root mean square error (RMSE, for precision) and R2 (for discrimination). RESULTS NNeGFR performed comparably to the U25eGFR equations on all metrics. Biases were minimal, slightly favoring U25eGFR. NNeGFR and U25eGFR had similar P10 (>37 %), P30 (>86 %) and RMSE. CONCLUSIONS NNeGFR performed as well as established equations to estimate GFR. Without additional biomarkers related to kidney function, which are not currently clinically available in real time, NN methods are unlikely to substantially outperform regression derived GFR estimating equations. Implications for translation of these advanced epidemiologic methods to clinical practice are discussed.
Collapse
Affiliation(s)
- Derek K Ng
- Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA.
| | - Ankur Patel
- Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| | - George J Schwartz
- Department of Pediatrics, University of Rochester Medical Center, Rochester, NY, USA
| | - Jesse C Seegmiller
- Department of Laboratory Medicine and Pathology, School of Medicine, University of Minnesota, Minneapolis, MN, USA
| | - Bradley A Warady
- Division of Pediatric Nephrology, Children's Mercy Kansas City, Kansas City, MO, USA
| | - Susan L Furth
- Children's Hospital of Philadelphia, Philadelphia, PA, USA; Department of Pediatrics, Division of Nephrology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Christopher Cox
- Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| |
Collapse
|
2
|
Houlind M, Nielsen A, Walls A, Christensen L, Nielsen R, Andersen A, Jawad B, Andersen O, Damgaard M, Iversen E, Tavenier J, Juul‐Larsen H. Plasma NGAL, suPAR, KIM-1 and GDF-15 for Improving Glomerular Filtration Rate Estimation in Older Hospitalized Patients. Basic Clin Pharmacol Toxicol 2025; 136:e70002. [PMID: 39865371 PMCID: PMC11771596 DOI: 10.1111/bcpt.70002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2024] [Revised: 01/13/2025] [Accepted: 01/15/2025] [Indexed: 01/28/2025]
Affiliation(s)
- Morten Baltzer Houlind
- Department of Clinical ResearchCopenhagen University Hospital, Amager and HvidovreHvidovreDenmark
- The Capital Region PharmacyHerlevDenmark
- Department of Drug Design and PharmacologyUniversity of CopenhagenCopenhagenDenmark
- Department of NephrologyCopenhagen University Hospital, RigshospitaletCopenhagenDenmark
| | - Alberte Linnet Nielsen
- Department of Clinical ResearchCopenhagen University Hospital, Amager and HvidovreHvidovreDenmark
- Department of Drug Design and PharmacologyUniversity of CopenhagenCopenhagenDenmark
| | - Anne Byriel Walls
- The Capital Region PharmacyHerlevDenmark
- Department of Drug Design and PharmacologyUniversity of CopenhagenCopenhagenDenmark
| | - Louise Westberg Strejby Christensen
- Department of Clinical ResearchCopenhagen University Hospital, Amager and HvidovreHvidovreDenmark
- The Capital Region PharmacyHerlevDenmark
- Department of Clinical MedicineUniversity of CopenhagenCopenhagenDenmark
| | - Rikke Lundsgaard Nielsen
- Department of Clinical ResearchCopenhagen University Hospital, Amager and HvidovreHvidovreDenmark
- Department of Clinical MedicineUniversity of CopenhagenCopenhagenDenmark
| | - Aino Andersen
- Department of Clinical ResearchCopenhagen University Hospital, Amager and HvidovreHvidovreDenmark
| | - Baker Nawfal Jawad
- Department of Clinical ResearchCopenhagen University Hospital, Amager and HvidovreHvidovreDenmark
| | - Ove Andersen
- Department of Clinical ResearchCopenhagen University Hospital, Amager and HvidovreHvidovreDenmark
- Department of Clinical MedicineUniversity of CopenhagenCopenhagenDenmark
- Emergency DepartmentCopenhagen University Hospital, Amager and HvidovreHvidovreDenmark
| | - Morten Damgaard
- Department of Clinical Physiology and Nuclear Medicine, Centre for Functional and Diagnostic Imaging and ResearchCopenhagen University Hospital, Amager & HvidovreHvidovreDenmark
| | - Esben Iversen
- Department of Clinical ResearchCopenhagen University Hospital, Amager and HvidovreHvidovreDenmark
| | - Juliette Tavenier
- Department of Clinical ResearchCopenhagen University Hospital, Amager and HvidovreHvidovreDenmark
| | - Helle Gybel Juul‐Larsen
- Department of Clinical ResearchCopenhagen University Hospital, Amager and HvidovreHvidovreDenmark
| |
Collapse
|
3
|
Fino NF, Inker LA, Greene T, Adingwupu OM, Coresh J, Seegmiller J, Shlipak MG, Jafar TH, Kalil R, Costa E Silva VT, Gudnason V, Levey AS, Haaland B. Panel estimated Glomerular Filtration Rate (GFR): Statistical considerations for maximizing accuracy in diverse clinical populations. PLoS One 2024; 19:e0313154. [PMID: 39621675 PMCID: PMC11611103 DOI: 10.1371/journal.pone.0313154] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2024] [Accepted: 10/20/2024] [Indexed: 02/20/2025] Open
Abstract
Assessing glomerular filtration rate (GFR) is critical for diagnosis, staging, and management of kidney disease. However, accuracy of estimated GFR (eGFR) is limited by large errors (>30% error present in >10-50% of patients), adversely impacting patient care. Errors often result from variation across populations of non-GFR determinants affecting the filtration markers used to estimate GFR. We hypothesized that combining multiple filtration markers with non-overlapping non-GFR determinants into a panel GFR could improve eGFR accuracy, extending current recognition that adding cystatin C to serum creatinine improves accuracy. Non-GFR determinants of markers can affect the accuracy of eGFR in two ways: first, increased variability in the non-GFR determinants of some filtration markers among application populations compared to the development population may result in outlying values for those markers. Second, systematic differences in the non-GFR determinants of some markers between application and development populations can lead to biased estimates in the application populations. Here, we propose and evaluate methods for estimating GFR based on multiple markers in applications with potentially higher rates of outlying predictors than in development data. We apply transfer learning to address systematic differences between application and development populations. We evaluated a panel of 8 markers (5 metabolites and 3 low molecular weight proteins) in 3,554 participants from 9 studies. Results show that contamination in two strongly predictive markers can increase imprecision by more than two-fold, but outlier identification with robust estimation can restore precision nearly fully to uncontaminated data. Furthermore, transfer learning can yield similar results with even modest training set sample size. Combining both approaches addresses both sources of error in GFR estimates. Once the laboratory challenge of developing a validated targeted assay for additional metabolites is overcome, these methods can inform the use of a panel eGFR across diverse clinical settings, ensuring accuracy despite differing non-GFR determinants.
Collapse
Affiliation(s)
- Nora F Fino
- Division of Biostatistics, Department of Population Health Sciences, University of Utah Health, Salt Lake City, Utah, United States of America
| | - Lesley A Inker
- Division of Nephrology, Department of Medicine, Tufts Medical Center, Boston, Massachusetts, United States of America
| | - Tom Greene
- Division of Biostatistics, Department of Population Health Sciences, University of Utah Health, Salt Lake City, Utah, United States of America
| | - Ogechi M Adingwupu
- Division of Nephrology, Department of Medicine, Tufts Medical Center, Boston, Massachusetts, United States of America
| | - Josef Coresh
- Department of Epidemiology, John Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States of America
| | - Jesse Seegmiller
- Department of Laboratory Medicine and Pathology, University of Minnesota, Minneapolis, Minnesota, United States of America
| | - Michael G Shlipak
- Kidney Health Research Collaborative, San Francisco Veterans Affair Medical Center and University of California, San Francisco, California, United States of America
| | - Tazeen H Jafar
- Program in Health Services and Systems Research, Duke-NUS Medical School, Singapore, Singapore
- Department of Medicine, Aga Khan University, Karachi, Pakistan
| | - Roberto Kalil
- Division of Nephrology, Department of Medicine, University of Maryland School of Medicine, Baltimore, Maryland, United States of America
| | - Veronica T Costa E Silva
- Serviço de Nefrologia, Instituto do Câncer do Estado de São Paulo, Faculdade de Medicina, Universidade de São Paulo, São Paulo, Brazil
- Laboratório de Investigação Médica (LIM) 16, Faculdade de Medicina da Universidade de São Paulo, São Paulo, SP, Brazil
| | - Vilmundur Gudnason
- Faculty of Medicine, University of Iceland, Reykjavik, and the Icelandic Heart Association, Kopavogur, Iceland
| | - Andrew S Levey
- Division of Nephrology, Department of Medicine, Tufts Medical Center, Boston, Massachusetts, United States of America
| | - Ben Haaland
- Division of Biostatistics, Department of Population Health Sciences, University of Utah Health, Salt Lake City, Utah, United States of America
| |
Collapse
|
4
|
Shafi T. Refining GFR estimation: a quest for the unobservable truth? Kidney Int 2024; 105:435-437. [PMID: 38388142 DOI: 10.1016/j.kint.2023.12.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2023] [Accepted: 12/12/2023] [Indexed: 02/24/2024]
Abstract
Assessing glomerular filtration rate (GFR), which is central to evaluating kidney health, remains challenging. Measured GFR is not widely available and lacks standardization. Estimated GFR can be highly inaccurate for some patients and has limited applicability to many patient populations, such as those who are acutely ill. Recent metabolomic advances show promise for identifying new filtration markers that might enhance GFR estimation. Improving GFR assessment will require refinement in both GFR measurement and estimation methods.
Collapse
Affiliation(s)
- Tariq Shafi
- Division of Nephrology, Department of Medicine, Houston Methodist Hospital and Houston Methodist Research Institute, Houston, Texas, USA.
| |
Collapse
|