Eligible Death Statistic: Not a True Measure of OPO Performance nor the Potential to Increase Transplantation

Results of a data-driven performance improvement initiative in organ donation

New metrics for organ procurement organization (OPO) performance utilize National Center for Health Statistics data to measure cause, age, and location consistent (CALC) deaths. We used this denominator to identify opportunities for improved donor conversion at one OPO, Indiana Donor Network (INOP). We sought to determine whether such analyses are immediately actionable for quality improvement (QI) initiatives directed at increased donor conversion. CALC-based assessment of INOP's performance revealed an opportunity to improve conversion of older donors. Following the QI initiative, INOP donor yield rose by 44%, while organs transplanted rose by 29%. These changes tolerated temporary disruption around the COVID-19 pandemic. Improved donor yield was primarily seen in older groups identified by CALC-based methods. Process changes in resource allocation and monitoring were associated with a 57% increase in the number of potential donors approached in the QI period and a subsequent rise in the number of potential donor referrals, suggesting positive feedback at area hospitals. Post-intervention, INOP's projected donation performance rose from 51st to 18th among all OPOs. OPOs can use CALC death data to accurately assess donor conversion by categories including age and race/ethnicity. These data can be used in real time to inform OPO-level processes to maximize donor recovery.

Systematic review of hospital-level metrics and interventions to increase deceased organ donation

BACKGROUND

Efforts to ameliorate the organ shortage have predominantly focused on improving processes and interventions at multiple levels in the organ donation process, but no comprehensive review of hospital-level features contributing to organ donation exists. We undertook a systematic review of the literature to better understand current knowledge and knowledge gaps about hospital-level metrics and interventions associated with successful organ donation.

METHODS

We searched six electronic databases (PubMed, Embase, CINAHL, Web of Science, Health Business Elite, and Google scholar) and conference abstracts for articles on hospital-level features associated with the final outcome of organ donation (PROSPERO CRD42020187080). Editorials, letters to the editor, and reviews without original data were excluded. Our main outcomes were conversion rate, donation rate, number of organs recovered, number of donors, and authorization rate.

RESULTS

Our search yielded 2177 studies, and after a thorough assessment, 72 articles were included in this systematic review. Studies were thematically categorized into 1) Hospital-level interventions associated with metrics of organ donation; these included patient- and family-centric measures (i.e. standardized interviews, collaborative requesting and decoupling, and dedicated in-house coordinators), and donor management goals that significantly increased conversion rates by up to 64%; 2) Hospital-level multi-stage programs/policies; which increased authorization rates between 30 and 50%; and 3) Hospital characteristics and qualities; being an academic center, trauma center and larger hospital correlated with higher authorization and conversion rates. Most studies had considerable risk of bias and were of low quality.

CONCLUSIONS

There is a lack of well-designed studies on hospital-level metrics and interventions associated with organ donation. The use of thoughtful, patient- and family-centric approaches to authorization generally is associated with more organ donors. Future work can build on what is known about the hospital role in organ donation to improve the entire organ donation process.

A three-tier system for evaluation of organ procurement organizations' willingness to pursue and utilize nonideal donor lungs

Lungs from "nonideal," but acceptable donors are underutilized; however, organ procurement organization (OPO) metrics do not reflect the extent to which OPO-specific practices contribute to these trends. We developed a comprehensive system to evaluate nonideal lung donor avoidance, or risk aversion among OPOs. Adult donors in the UNOS registry who donated ≥1 organ for transplantation between 2007 and 2018 were included. Nonideal donors had any of age>50, smoking history ≥20 pack-years, PaO₂ /FiO₂ ratio ≤350, donation after circulatory death, or increased risk status. OPO-level risk aversion in donor pursuit, consent attainment, lung recovery, and transplantation was assessed. Among 83916 donors, 70372 (83.9%) were nonideal. Unadjusted OPO-level rates of nonideal donor pursuit ranged from 81 to 100%. In a three-tier system of overall risk aversion, tier 3 OPOs (least risk-averse) had the highest rates of nonideal donor pursuit, consent attainment, lung recovery, and transplantation. Tier 1 OPOs (most risk-averse) had the lowest rates of donor pursuit, consent attainment, and lung recovery, but higher rates of transplantation compared to tier 2 OPOs (moderately risk-averse). Risk aversion varies among OPOs and across the donation process. OPO evaluations should reflect early donation process stages to best differentiate over- and underperforming OPOs and encourage optimal OPO-specific performance.

Evaluating Spatial Associations in Inpatient Deaths Between Organ Procurement Organizations

To improve the measurement of organ procurement organization (OPO) performance, the Center for Medicare and Medicaid Services recently proposed using inpatient deaths defined as the eligible pool of organ donors within an OPO as patients 75 years or younger that died from any cause that would not preclude donation.

METHODS

To account for the geographic variation in OPO performance and organ availability across the United States, we utilized spatial analysis to appraise the newly proposed metric of inpatient deaths.

RESULTS

Using spatial clustering that accounts for geographic relationships between Organ Procurement Organizations, the top 5 causes of donation-eligible death, and inpatient deaths, we identified 4 unique OPO clusters. Each group had a distinct demographic composition, cause of death, and inpatient death pattern. In multivariate analysis accounting for these geographic relationships, the spatial clusters remained significantly associated with the outcome of inpatient deaths (P < 0.001) and were the best-fitting model compared with models without the spatial clusters; this suggests that further risk adjustment of inpatient deaths should include these geographic considerations.

CONCLUSIONS

This approach provides not only a manner to assess donor potential by improving risk adjustment but also an opportunity to further explore geographic and spatial relationships in the practice of organ transplantation and OPO performance.

Rejecting bias: The case against race adjustment for OPO performance in communities of color

In December of 2019, the Centers for Medicare and Medicaid Services (CMS) put out a notice of proposed rule-making for 42 CFR Part 486, specifically the section that covers the organ procurement organization (OPO) Conditions for Coverage. Most crucially, the proposed rule included two new OPO performance metrics using objective, standardized data from the Centers for Disease Control and Prevention (CDC). These new metrics would employ a denominator that included inpatient deaths from certain causes that could lead to organ donation, rather than the current unverifiable eligible death metric. Although there has been near-uniform support for replacing the eligible death denominator with CDC data, a source of contention is CMS's proposal not to adjust risk for race in their OPO outcome. Nonetheless, there have been calls for race and ethnicity to be included as risk-adjusted variables in the CMS donation metric. Herein, we lay out an argument as to why inclusion of race and ethnicity as risk adjustment variables in an OPO performance metric is not only statistically suspect but also will hide the inequities that are detrimental to optimal system performance and assurance that all patients have timely access to donation.

Addressing Critiques of the Proposed CMS Metric of Organ Procurement Organ Performance: More Data Isn't Better

BACKGROUND

Centers for Medicare and Medicaid Services (CMS) has proposed a rule change to redefine the metric by which organ procurement organizations (OPOs) are evaluated. The metric relies on Centers for Disease Control and Prevention (CDC) data on inpatient deaths from causes consistent with donation among patients <75 years of age. Concerns have been raised that this metric does not account for rates of ventilation, and prevalence of cancer and severe sepsis, without objective data to substantiate or refute such concerns.

METHODS

We estimated OPO-level donation rates using CDC data, and used Agency for Healthcare Research and Quality/Healthcare Cost and Utilization Project data from 43 State Inpatient Databases to calculate "adjusted" donation rates.

RESULTS

The CMS metric and the ventilation-adjusted CMS metric were highly concordant in absolute terms (Spearman and Pearson correlation coefficients ≥0.95). In the Bland-Altman plot, 100% (48/48) of paired values (standard deviations [SDs] of the CMS and "ventilation adjusted" metrics) were within 1.96 SDs of the mean difference, with near-perfect correlation in Passing and Bablok regression (Lin's concordance correlation coefficient: 0.97). The CMS metric and the ventilation/cancer/sepsis-adjusted metric were highly concordant in absolute terms (Spearman and Pearson correlation coefficients ≥0.94). In the Bland-Altman plot, 97.9% (47/48) of paired values (SDs of the CMS and "ventilation/cancer/sepsis adjusted" metrics) were within 1.96 SDs of the mean difference, with near-perfect correlation in the Passing and Bablok regression (Lin's concordance correlation coefficient: 0.97).

CONCLUSIONS

These conclusions should provide CMS, and the transplant community, with comfort that the proposed CMS metric using CDC inpatient death data as a tool to compare OPO is not compromised by its lack of inclusion of ventilation or other comorbidity data.

Importance of incorporating standardized, verifiable, objective metrics of organ procurement organization performance into discussions about organ allocation

Identifying and supporting specific organ procurement organizations (OPOs) with the greatest opportunity to increase donation rates could significantly increase the number of organs available for transplant. Accomplishing this is complicated by current Scientific Registry of Transplant Recipients/Centers for Medicare & Medicaid Services metrics of donation rates and OPO performance that rely on eligible deaths. These data are self-reported and unverifiable and have been shown to underestimate potential organ donors. We examine the limitations of current OPO performance/donation metrics to inform discussions related to strategies to increase donation. We propose changing to a simple, verifiable, and uniformly applied donation metric. This would allow the transplant community to (1) better understand inherent differences in donor availability based on geography and (2) identify underperforming areas that would benefit from systems improvement agreements to increase donation rates.

How Inaccurate Metrics Hide the True Potential for Organ Donation in the United States

BACKGROUND

There is a discrepancy between the reported increase in donor conversion rates and the number of organs available for transplant.

METHODS

Secondary analysis of data obtained from the Scientific Registry of Transplant Recipients from January 2003 through December 2015 was performed. The primary outcomes were the (1) number of brain-dead donors from whom solid organs were recovered and (2) number of the organs transplanted. Descriptive statistics and growth plots were used to examine the trajectory of organ donation, recovery, and transplantation outcomes over the 11-year period.

RESULTS

From 2003 to 2006, the number of brain-dead donors increased from 6187 to 7375, remaining relatively stable at approximately 7200 thereafter. The average eligible deaths per organ procurement organization dropped from 182.7 (standard deviation [SD]: 131.3) in 2003 to 149.3 (SD: 111.4) in 2015. This suggests a total of 12 493 unrealized potential donors (2006-2015).

CONCLUSIONS

Since 2006, a steady decline in the number of donor-eligible deaths was reported. In 2003, the reported eligible deaths was 11 326. This number peaked in 2004 at 11 346, tumbling to 9781 eligible donors in 2015, despite a 9% increase in the US population. From 2006 to 2015, the data indicate an artificial depression and underestimation of the true potential of brain-dead donors in the United States of conservatively 12 493 donors or 39 728 missing organs. New metrics providing objective but verifiable counts of the donor pool are needed.

Patterns of geographic variability in mortality and eligible deaths between organ procurement organizations

Eligible deaths are currently used as the denominator of the donor conversion ratio to mitigate the effect of varying mortality patterns in the populations served by different organ procurement organizations (OPOs). Eligible death is an OPO-reported metric rather than a product of formal epidemiological analysis, however, and may be confounded with OPO performance. Using Scientific Registry of Transplant Recipients and Centers for Disease Control and Prevention data, patterns of mortality and eligible deaths within each OPO were analyzed with the use of formal geostatistical analysis to determine whether eligible deaths truly reflect the geographic patterns they are intended to mitigate. There was a 2.1-fold difference in mortality between the OPOs with the highest and lowest rates, with significant positive spatial autocorrelation evident in mortality rates (Moran I = .110; P < .001), meaning geographically proximate OPOs tended to have similar mortality rates. The eligible death ratio demonstrated greater variability, with a 4.5-fold difference between the OPOs with the highest and lowest rates. Contrary to the pattern of mortality rates, the geographic distribution of eligible deaths among OPOs was random (Moran I = -.002; P = .410). This finding suggests geographic patterns do not play a significant role in eligible deaths, thus questioning its continuing use in OPO performance comparisons.

Changing Metrics of Organ Procurement Organization Performance in Order to Increase Organ Donation Rates in the United States

The shortage of deceased-donor organs is compounded by donation metrics that fail to account for the total pool of possible donors, leading to ambiguous donor statistics. We sought to assess potential metrics of organ procurement organizations (OPOs) utilizing data from the Nationwide Inpatient Sample (NIS) from 2009-2012 and State Inpatient Databases (SIDs) from 2008-2014. A possible donor was defined as a ventilated inpatient death ≤75 years of age, without multi-organ system failure, sepsis, or cancer, whose cause of death was consistent with organ donation. These estimates were compared to patient-level data from chart review from two large OPOs. Among 2,907,658 inpatient deaths from 2009-2012, 96,028 (3.3%) were a "possible deceased-organ donor." The two proposed metrics of OPO performance were: (1) donation percentage (percentage of possible deceased-donors who become actual donors; range: 20.0-57.0%); and (2) organs transplanted per possible donor (range: 0.52-1.74). These metrics allow for comparisons of OPO performance and geographic-level donation rates, and identify areas in greatest need of interventions to improve donation rates. We demonstrate that administrative data can be used to identify possible deceased donors in the US and could be a data source for CMS to implement new OPO performance metrics in a standardized fashion.

Expanding the donor pool: regional variation in pediatric organ donation rates

There are limited published data on pediatric organ donation rates. The aim of this study was to describe the trends in pediatric organ donation over time and to assess the regional variation in pediatric deceased organ donation. OPTN data were utilized to assess the trends in pediatric organ donation over time. The number of deceased pediatric organ donors was indexed using regional mortality data obtained from the National Center for Health Statistics and compared across UNOS regions and two different eras. The number of pediatric deceased organ donors has declined in the recent era, largely driven by fewer adolescent donors. For all age groups, there is significant regional variation in organ donation rates, with identifiable high- and low-performing regions. Expansion of the donor pool may be possible by optimizing organ donation in regions demonstrating lower recruitment of pediatric donors. Using the region with the highest donation rate for each age group as the gold standard, we estimate a potential 24% increase in the number of donors if all regions performed comparably, equating to 215 new pediatric donors annually.