• Reference Citation Analysis
  • v
  • v
  • Find an Article
  • Find an Author
Download

The use of standardized mortality rates (SMRs) to profile hospitals presumes differences in preventable deaths, and at least one health system has suggested measuring preventable death rates of hospitals for comparison across time or in league tables. The influence of reliability on the optimal review number per case note or hospital for such a program has not been explored.

Estimates for preventable death rates using implicit case note reviews by clinicians are quite low, suggesting that SMRs will not work well to rank hospitals, and any misspecification of the risk‐adjustment models will produce a high risk of mislabelling outliers.

Most studies achieve only fair to moderate reliability of the direct assessment of whether a death is preventable, and thus it is likely that substantial numbers of reviews of deaths would be required to distinguish preventable from nonpreventable deaths as part of learning from individual cases, or for profiling hospitals.

Furthermore, population‐ and hospital system–specific data on the variation in preventable deaths or adverse events across the hospitals and providers to be compared are required in order to design a measurement procedure and the number of reviews needed to distinguish between the patients or hospitals.

Context

There is interest in monitoring avoidable or preventable deaths measured directly or indirectly through standardized mortality rates (SMRs). While there have been numerous studies in recent years on adverse events, including preventable deaths, using implicit case note reviews by clinicians, no systematic reviews have aimed to summarize the estimates or the variations in methodologies used to derive these estimates. We reviewed studies that use implicit case note reviews to estimate the range of preventable death rates observed, the measurement characteristics of those estimates, and the measurement procedures used to generate them. We comment on the implications for monitoring SMRs and illustrate a way to calculate the number of reviews needed to establish a reliable estimate of the preventability of one death or the hospital preventable death rate.

Methods

We conducted a systematic review of the literature supplemented by a reanalysis of authors’ previously published and unpublished data and measurement design calculations. We conducted initial searches in PubMed, MEDLINE (OvidSP), and ISI Web of Knowledge in June 2010 and updated them in June 2012 and December 2017. Eligibility criteria included studies of hospital‐wide admissions from general and acute medical wards where preventable death rates are provided or can be estimated and that can provide interobserver variations.

Findings

Twenty‐three studies were included from 1985 to 2017. Recent larger studies suggest consistently low rates of preventable deaths (interquartile range of 3.0%‐6.0% since 2008). Reliability of a single review for distinguishing between individual cases with regard to the preventability of death had a Kappa statistic of 0.10‐0.50 for deaths and 0.21‐0.76 for adverse events. A Kappa of 0.35 would require an average of 8 to 17 reviews of a single case to be precise enough to have confidence in high‐stakes decisions to change care procedures or impose sanctions within a hospital as a result. No study estimated the variation in preventable deaths across hospitals, although we were able to reanalyze one study to obtain an estimate. Based on this estimate, 200 to 300 total case note reviews per hospital could be required to reliably distinguish between hospitals.

The studies displayed considerable heterogeneity: 13/23 studies defined preventable death with a threshold of greater than or equal to four in a six‐category Likert scale and 11/24 involved a two‐stage screening process with nurses at the first stage and physicians at the second. Fifteen studies provided expert clinical review support for reviewer disagreements, advice, and quality control. A “generalist/internist” was the modal physician specialty for reviewers and they received one to three days of generic tools orientation and case note review practice. Methods did not consider the influence of human or environmental factors.

Conclusions

The literature provides limited information about the measurement characteristics of preventable deaths, suggesting that substantial numbers of reviews may be needed to create reliable estimates of preventable deaths at the individual or hospital level. Any operational program would require population‐specific estimates of reliability. Preventable death rates are low, which is likely to make it difficult to use SMRs based on all deaths to validly profile hospitals. The literature provides little information to guide improvements in the measurement procedures.

Collapse
Number Citation Analysis
1
Rebeiz MC, El-Kak F, van den Akker T, Hamadeh R, McCall SJ. Maternal mortality is preventable in Lebanon: A case series of maternal deaths to identify lessons learned using the "Three Delays" model. Int J Gynaecol Obstet 2023;162:922-930. [PMID: 37102363 DOI: 10.1002/ijgo.14770] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2022] [Revised: 02/20/2023] [Accepted: 03/15/2023] [Indexed: 04/28/2023]
2
Ridge A, Peterson GM, Seidel BM, Anderson V, Nash R. Healthcare Providers' Perceptions of Potentially Preventable Rural Hospitalisations: A Qualitative Study. Int J Environ Res Public Health 2021;18:ijerph182312767. [PMID: 34886491 PMCID: PMC8656793 DOI: 10.3390/ijerph182312767] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Revised: 11/30/2021] [Accepted: 12/02/2021] [Indexed: 11/17/2022]
3
Parkinson B, Meacock R, Checkland K, Sutton M. Clarifying the concept of avoidable emergency department attendance. J Health Serv Res Policy 2020;26:68-73. [PMID: 32517553 PMCID: PMC7734604 DOI: 10.1177/1355819620921894] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
4
Gupta AK, Stewart SK, Cottell K, McCulloch GAJ, Miller J, Babidge WJ, Maddern GJ. Potentially avoidable issues in urology mortality cases in Australia: identification and improvements. ANZ J Surg 2020;90:719-724. [PMID: 32106356 DOI: 10.1111/ans.15765] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2019] [Revised: 12/29/2019] [Accepted: 01/29/2020] [Indexed: 12/25/2022]
5
Manaseki-Holland S, Lilford RJ, Te AP, Chen YF, Gupta KK, Chilton PJ, Hofer TP. Ranking Hospitals Based on Preventable Hospital Death Rates: A Systematic Review With Implications for Both Direct Measurement and Indirect Measurement Through Standardized Mortality Rates. Milbank Q 2019;97:228-284. [PMID: 30883952 PMCID: PMC6422606 DOI: 10.1111/1468-0009.12375] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/05/2022]  Open
Policy Points
  • Yen-Fu Chen
    • Warwick Medical School, University of Warwick
  • Timothy P Hofer
    • Institute for Healthcare Policy & Innovation, University of Michigan
Collapse
6
Hsia RY, Niedzwiecki M. Avoidable emergency department visits: a starting point. Int J Qual Health Care 2018;29:642-645. [PMID: 28992158 DOI: 10.1093/intqhc/mzx081] [Citation(s) in RCA: 47] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2016] [Accepted: 08/14/2017] [Indexed: 11/14/2022]  Open
7
Mathew AT, Rosen L, Pekmezaris R, Kozikowski A, Ross DW, McGinn T, Kalantar-Zadeh K, Fishbane S. Potentially Avoidable Readmissions in United States Hemodialysis Patients. Kidney Int Rep 2017;3:343-355. [PMID: 29725638 PMCID: PMC5932139 DOI: 10.1016/j.ekir.2017.10.014] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2017] [Revised: 10/22/2017] [Accepted: 10/30/2017] [Indexed: 11/22/2022]  Open
8
Slovis BH, Lowry T, Delman BN, Beitia AO, Kuperman G, DiMaggio C, Shapiro JS. Patient crossover and potentially avoidable repeat computed tomography exams across a health information exchange. J Am Med Inform Assoc 2017;24:30-38. [PMID: 27178985 PMCID: PMC5201178 DOI: 10.1093/jamia/ocw035] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2015] [Revised: 02/02/2016] [Accepted: 02/17/2016] [Indexed: 12/18/2022]  Open
9
Ollandezos M, Constantinidis T, Athanasakis K, Lionis C, Kyriopoulos J. Trends of mortality in Greece 1980-2007: a focus on avoidable mortality. Hippokratia 2011;15:330-334. [PMID: 24391415 PMCID: PMC3876849] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
PrevPage 1 of 1 1Next
© 2004-2024 Baishideng Publishing Group Inc. All rights reserved. 7041 Koll Center Parkway, Suite 160, Pleasanton, CA 94566, USA