Response: DonorNet and the potential effects on organ utilization

An experiment on the impact of predictive analytics on kidney offer acceptance decisions

Due to the breadth of factors that might affect kidney transplant decisions to accept an organ or wait for another, presumably "better" offer, a high degree of heterogeneity in decision-making exists among transplant surgeons and hospitals. These decisions do not typically include objective predictions regarding the future availability of equivalent or better-quality organs, nor the likelihood of patient death while waiting for another organ. To investigate the impact of displaying such predictions on organ donation decision making, we conducted a statistically designed experiment involving 53 kidney transplant professionals, where kidney organ offers were presented via an online application and systematically altered to observe effects on decision making. We found that providing predictive analytics for time-to-better offer and patient mortality improves decision consensus and decision maker confidence in their decision. Providing a visual display of the patient's mortality slope under accept/reject conditions shortened the time to decide, but did not have an impact on the decision itself. Presenting risk of death in a loss frame as opposed to a gain frame improved decision consensus and decision confidence. Patient-specific predictions surrounding future organ offers and mortality may improve decision quality, confidence, and expediency while improving organ utilization and patient outcomes.

Can Behavioral Research Improve Transplant Decision-Making? A Mock Offer Study on the Role of Kidney Procurement Biopsies

Background

The use of procurement biopsies for assessing kidney quality has been implicated as a driver of the nearly 20% kidney discard rate in the United States. Yet in some contexts, biopsies may boost clinical confidence, enabling acceptance of kidneys that would otherwise be discarded. We leveraged a novel organ offer simulation platform to conduct a controlled experiment isolating biopsy effects on offer acceptance decisions.

Methods

Between November 26 and December 14, 2018, 41 kidney transplant surgeons and 27 transplant nephrologists each received the same 20 hypothetical kidney offers using a crossover design with weekend "washout" periods. Mini-study 1 included four, low serum creatinine (<1.5 mg/dl) donor offers with arguably "poor" biopsy findings that were based on real offers that were accepted with successful 3-year recipient outcome. For each of the four offers, two experimental variants-no biopsy and "good" biopsy-were also sent. Mini-study 2 included four AKI offers with no biopsy, each having an offer variant with "good" biopsy findings.

Results

Among low serum creatinine donor offers, we found approximately threefold higher odds of acceptance when arguably poor biopsy findings were hidden or replaced with good biopsy findings. Among AKI donor offers, we found nearly fourfold higher odds of acceptance with good biopsy findings compared with no biopsy. Biopsy information had profound but variable effects on decision making: more participants appeared to have been influenced by biopsies to rule out, versus rule in, transplantable kidneys.

Conclusions

The current use of biopsies in the United States appears skewed toward inducing kidney discard. Several areas for improvement, including reducing variation in offer acceptance decisions and more accurate interpretation of findings, have the potential to make better use of scarce, donated organs. Offer simulation studies are a viable research tool for understanding decision making and identifying ways to improve the transplant system.