A Bayesian approach to risk-adjusted outcome monitoring in healthcare

Modeling the patient mix for risk-adjusted CUmulative SUM charts

The improvement of surgical quality and the corresponding early detection of its changes is of increasing importance. To this end, sequential monitoring procedures such as the risk-adjusted CUmulative SUM chart are frequently applied. The patient risk score population (patient mix), which considers the patients’ perioperative risk, is a core component for this type of quality control chart. Consequently, it is important to be able to adapt different shapes of patient mixes and determine their impact on the monitoring scheme. This article proposes a framework for modeling the patient mix by a discrete beta-binomial and a continuous beta distribution for risk-adjusted CUSUM charts. Since the model-based approach is not limited by data availability, any patient mix can be analyzed. We examine the effects on the control chart’s false alarm behavior for more than 100,000 different scenarios for a cardiac surgery data set. Our study finds a negative relationship between the average risk score and the number of false alarms. The results indicate that a changing patient mix has a considerable impact and, in some cases, almost doubles the number of expected false alarms.

Medical device active surveillance of spontaneous reports: A literature review of signal detection methods

PURPOSE

The collection and analysis of real-world data for the active monitoring of medical device performance and safety has become increasingly important. Spontaneous reports, such as those in the Food & Drug Administration's (FDA's) Manufacturer and User Facility Device Experience (MAUDE), provide early warning of potential issues with marketed devices. This review synthesizes the current literature on medical device surveillance signal detection and provides a framework for application of methods to active surveillance of spontaneous reports.

METHODS

Ovid MEDLINE, Ovid Embase, Scopus, and PubMed databases were systematically searched up to January 2019. Additionally, five methods articles from pharmacovigilance were added that had potential applications to medical devices.

RESULTS

Among 105 articles included, the most common source of data (84%) was registries; median time between data collection and publication was 8 years. Surgical procedure outcome signal detection articles comprised 83% while 14% were on device outcome signal detection. The most common family of methods cited (70%) was Sequential Probability Ratio.

CONCLUSION

Application of any signal detection algorithm requires careful consideration of influential factors, data limitations, and algorithmic assumptions. We recommend approaches using disproportionality, statistical process control, and sequential probability tests and provide R packages to further development efforts. The small number of published examples suggest that further development of statistical methods and technological solutions to analyze large amounts of data for device safety and performance is needed. Fundamental differences in products, data infrastructure, and the regulatory landscape suggest that medical device vigilance requires its own body of research distinct from pharmacovigilance.

Risk-adjusted monitoring of surgical performance

We propose a nonparametric risk-adjusted cumulative sum chart to monitor surgical outcomes for patients with different risks of post-operative mortality due to risk factors that exist before the surgery. Using varying-coefficient logistic regression models, we accomplish the risk adjustment. Unknown coefficient functions are estimated by global polynomial spline approximation based on the maximum likelihood principle. We suggest a bisection minimization approach and a bootstrap method to determine the chart testing limit value. Compared with the previous (parametric) risk-adjusted cumulative sum chart, a major advantage of our method is that the morality rate can be modeled more flexibly by related covariates, which significantly enhances the monitoring efficiency. Simulations demonstrate nice performance of our proposed procedure. An application to a UK cardiac surgery dataset illustrates the use of our methodology.