51
|
Badgery-Parker T, Pearson SA, Elshaug AG. Estimating misclassification error in a binary performance indicator: case study of low value care in Australian hospitals. BMJ Qual Saf 2020; 29:992-999. [PMID: 32165412 DOI: 10.1136/bmjqs-2019-010564] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2019] [Revised: 02/17/2020] [Accepted: 02/23/2020] [Indexed: 12/15/2022]
Abstract
OBJECTIVE Indicators based on hospital administrative data have potential for misclassification error, especially if they rely on clinical detail that may not be well recorded in the data. We applied an approach using modified logistic regression models to assess the misclassification (false-positive and false-negative) rates of low-value care indicators. DESIGN AND SETTING We applied indicators involving 19 procedures to an extract from the New South Wales Admitted Patient Data Collection (1 January 2012 to 30 June 2015) to label episodes as low value. We fit four models (no misclassification, false-positive only, false-negative only, both false-positive and false-negative) for each indicator to estimate misclassification rates and used the posterior probabilities of the models to assess which model fit best. RESULTS False-positive rates were low for most indicators-if the indicator labels care as low value, the care is most likely truly low value according to the relevant recommendation. False-negative rates were much higher but were poorly estimated (wide credible intervals). For most indicators, the models allowing no misclassification or allowing false-negatives but no false-positives had the highest posterior probability. The overall low-value care rate from the indicators was 12%. After adjusting for the estimated misclassification rates from the highest probability models, this increased to 35%. CONCLUSION Binary performance indicators have a potential for misclassification error, especially if they depend on clinical information extracted from administrative data. Indicators should be validated by chart review, but this is resource-intensive and costly. The modelling approach presented here can be used as an initial validation step to identify and revise indicators that may have issues before continuing to a full chart review validation.
Collapse
Affiliation(s)
- Tim Badgery-Parker
- Faculty of Medicine and Health, School of Public Health, Menzies Centre for Health Policy, Charles Perkins Centre, The University of Sydney, Sydney, New South Wales, Australia
| | - Sallie-Anne Pearson
- Faculty of Medicine and Health, School of Public Health, Menzies Centre for Health Policy, Charles Perkins Centre, The University of Sydney, Sydney, New South Wales, Australia.,Centre for Big Data Research in Health, University of New South Wales, Sydney, New South Wales, Australia
| | - Adam G Elshaug
- Faculty of Medicine and Health, School of Public Health, Menzies Centre for Health Policy, Charles Perkins Centre, The University of Sydney, Sydney, New South Wales, Australia.,The Brookings Institution, Washington, DC, USA
| |
Collapse
|
52
|
Stevens JP, Hatfield LA, Nyweide DJ, Landon B. Association of Variation in Consultant Use Among Hospitalist Physicians With Outcomes Among Medicare Beneficiaries. JAMA Netw Open 2020; 3:e1921750. [PMID: 32083694 PMCID: PMC7043199 DOI: 10.1001/jamanetworkopen.2019.21750] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/04/2022] Open
Abstract
IMPORTANCE Evidence is lacking on the consequences of high rates of inpatient consultation. OBJECTIVE To examine outcomes and resource use of patients cared for by hospitalists who use more inpatient consultation than their colleagues. DESIGN, SETTING, AND PARTICIPANTS A retrospective cohort study of medical admissions to hospitalists among fee-for-service Medicare beneficiaries was conducted. Hospitalist consultation tendency was identified from January 1, 2013, to December 31, 2014; admissions were calculated in 2013; and outcomes were measured in 2014. Data were analyzed from January 31, 2017, to May 9, 2019. A total of 711 654 admissions with patients receiving care from 14 584 hospitalists at 737 hospitals were included. EXPOSURE Admission to high-consulting hospitalists, considered to be those who were in the top 25% of the distribution of consulting frequency at their own hospital (adjusted for patient case mix). MAIN OUTCOMES AND MEASURES Outcomes included length of stay, Medicare Part B inpatient charges, discharge destination, all-cause 7- and 30-day readmissions, 90-day outpatient specialist visits, and 30-day mortality. RESULTS The 711 654 hospital admissions included 408 489 women (57.4%); mean (SD) age of the population was 80 (8.5) years. Length of stay of patients cared for by high-consulting hospitalists was longer compared with other hospitalists (adjusted incidence rate ratio, 1.04; 95% CI, 1.03-1.05). The admissions resulted in a mean of $137.91 (95% CI, $118.89-$156.93) more in Medicare Part B charges and were less likely to end with the patient going home (adjusted odds ratio [aOR], 0.96; 95% CI, 0.94-0.98) compared with patients cared for by other hospitalists in the cohort. Patients cared for by high-consulting hospitalists also were 7% more likely than patients cared for by other hospitalists to see an outpatient specialist at 90 days (aOR 1.07; 95% CI, 1.05-1.09), with no significant differences in 30-day mortality (aOR 1.01, 95% CI, 0.98-1.03) or readmissions (7-day readmissions: aOR 1.01; 95% CI, 0.98-1.03; 30-day readmissions: aOR, 1.01; 95% CI, 0.99-1.03). CONCLUSIONS AND RELEVANCE Hospitalists who obtain consultations more than their colleagues at the same institution were associated with greater use of health care resources without apparent mortality benefit. Further investigation should identify whether reducing high rates of consultation can reduce resource use without harming patients.
Collapse
Affiliation(s)
- Jennifer P. Stevens
- Center for Healthcare Delivery Science, Beth Israel Deaconess Medical Center, Boston, Massachusetts
- Division for Pulmonary, Critical Care, and Sleep Medicine, Department of Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts
| | - Laura A. Hatfield
- Department of Health Care Policy, Harvard Medical School, Boston, Massachusetts
| | - David J. Nyweide
- Center for Medicare & Medicaid Innovation, Centers for Medicare & Medicaid Services, Baltimore, Maryland
| | - Bruce Landon
- Center for Healthcare Delivery Science, Beth Israel Deaconess Medical Center, Boston, Massachusetts
- Department of Health Care Policy, Harvard Medical School, Boston, Massachusetts
- Division of General Medicine, Department of Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts
| |
Collapse
|
53
|
Gupta A, Meddings J, Houchens N. Quality and safety in the literature: November 2019. BMJ Qual Saf 2019; 28:949-953. [PMID: 31537630 DOI: 10.1136/bmjqs-2019-010327] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2019] [Accepted: 09/09/2019] [Indexed: 11/04/2022]
Affiliation(s)
- Ashwin Gupta
- Medicine Service, Veterans Affairs Ann Arbor Healthcare System, Ann Arbor, Michigan, USA .,Department of Internal Medicine, University of Michigan Medical School, Ann Arbor, Michigan, USA
| | - Jennifer Meddings
- Medicine Service, Veterans Affairs Ann Arbor Healthcare System, Ann Arbor, Michigan, USA.,Department of Internal Medicine, University of Michigan Medical School, Ann Arbor, Michigan, USA.,Departments of Pediatrics and Communicable Diseases, University of Michigan Medical School, Ann Arbor, Michigan, USA
| | - Nathan Houchens
- Medicine Service, Veterans Affairs Ann Arbor Healthcare System, Ann Arbor, Michigan, USA.,Department of Internal Medicine, University of Michigan Medical School, Ann Arbor, Michigan, USA
| |
Collapse
|
54
|
Stelfox HT, Bourgault AM, Niven DJ. De-implementing low value care in critically ill patients: a call for action-less is more. Intensive Care Med 2019; 45:1443-1446. [PMID: 31396643 DOI: 10.1007/s00134-019-05694-y] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2019] [Accepted: 07/11/2019] [Indexed: 12/12/2022]
Affiliation(s)
- Henry T Stelfox
- Department of Critical Care Medicine, Cumming School of Medicine, McCaig Tower, University of Calgary, 3134 Hospital Drive NW, Calgary, AB, T2N 5A1, Canada.
- Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, Canada.
- O'Brien Institute for Public Health, Cumming School of Medicine, University of Calgary, Calgary, Canada.
- Alberta Health Services, Alberta, Canada.
| | - Annette M Bourgault
- College of Nursing, Academic Health Sciences Center, University of Central Florida, Orlando, FL, USA
- Orlando Health, Orlando, FL, USA
| | - Daniel J Niven
- Department of Critical Care Medicine, Cumming School of Medicine, McCaig Tower, University of Calgary, 3134 Hospital Drive NW, Calgary, AB, T2N 5A1, Canada
- Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, Canada
- O'Brien Institute for Public Health, Cumming School of Medicine, University of Calgary, Calgary, Canada
- Alberta Health Services, Alberta, Canada
| |
Collapse
|
55
|
Corral-Gudino L, Rivas-Lamazares A, González-Fernández A, Rodríguez-María M, Aguilera-Sanz C, Tierra-Rodríguez A, Runza-Buznego P, Hernández-Martín E, Ortega-Gil M, Bahamonde-Carrasco A. Does my patient really need this at admission? Seven opportunities for improving value in patient care during their hospitalization. Eur J Intern Med 2019; 66:92-98. [PMID: 31230851 DOI: 10.1016/j.ejim.2019.06.007] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/03/2019] [Revised: 06/10/2019] [Accepted: 06/11/2019] [Indexed: 11/15/2022]
Abstract
INTRODUCTION Besides the main treatment for their disease, hospital patients receive multiple care measures which include venous lines (VL), urinary catheters (UC), dietary restrictions (DR), mandatory bed rest (BR), deep venous thrombosis prophylaxis (VTP), stress ulcer prophylaxis (SUP) and anticoagulation bridge therapy for atrial fibrillation (BAF). In many cases these practices are of low value. METHODS We analysed patients admitted to Internal Medicine wards throughout 2018 (2714 inpatients). We used different methodologies to identify low-value clinical practices. RESULTS BR or DR at admission were recommended in 37% (32-44) and 24% (19-30) of the patients respectively. In 81% (71-87) and 33% (21-45) of the cases this restriction was deemed unnecessary. Ninety-six percent (92-98) had VL and 25% (19-32) UC. VL were not used in 10% (6-12), UC had no indications for insertion in 21% (11-35) and for maintenance in 31% (12-46) patients. Fifty-seven percent (49-64) of the patients were administered VTP and 69% (62-76) were prescribed SUP. Twenty-two percent (15-31) of patients with VTP and 52% (43-60) with SUP had no indication. Chronic anticoagulation for AF was interrupted in 65% (53-75) with BAF was prescribed in 38% (25-52) of them. An intervention to reduce low-value care supporting clinical practices addressed only to the Internal Medicine Wards showed very poor results. CONCLUSION These results demonstrate that there is ample room for reduction of low-value care. Interventions to implement clinical guidelines at admissions should be addressed to cover the entire admission process, from the emergency room to the ward. Partial approaches are discouraged.
Collapse
Affiliation(s)
- Luis Corral-Gudino
- Internal Medicine Department, Hospital El Bierzo, GASBI (Gerencia de Asistencia Sanitaria del Bierzo), Calle Médicos sin Fronteras, 7, 24004 Ponferrada, Leon, Spain; Internal Medicine Department, Hospital Universitario Río Hortega, Calle Dulzaina n°2, 47012 Valladolid, Spain.
| | - Alicia Rivas-Lamazares
- Internal Medicine Department, Hospital El Bierzo, GASBI (Gerencia de Asistencia Sanitaria del Bierzo), Calle Médicos sin Fronteras, 7, 24004 Ponferrada, Leon, Spain.
| | - Ana González-Fernández
- Internal Medicine Department, Hospital El Bierzo, GASBI (Gerencia de Asistencia Sanitaria del Bierzo), Calle Médicos sin Fronteras, 7, 24004 Ponferrada, Leon, Spain.
| | - Miriam Rodríguez-María
- Hospital Pharmacy Department, Hospital El Bierzo, GASBI (Gerencia de Asistencia Sanitaria del Bierzo), Calle Médicos sin Fronteras, 7, 24004 Ponferrada, Leon, Spain.
| | - Carmen Aguilera-Sanz
- Haematology Department, Hospital El Bierzo, GASBI (Gerencia de Asistencia Sanitaria del Bierzo), Calle Médicos sin Fronteras, 7, 24004 Ponferrada, Leon, Spain.
| | - Ana Tierra-Rodríguez
- Internal Medicine Department, Hospital El Bierzo, GASBI (Gerencia de Asistencia Sanitaria del Bierzo), Calle Médicos sin Fronteras, 7, 24004 Ponferrada, Leon, Spain.
| | - Paula Runza-Buznego
- Internal Medicine Department, Hospital El Bierzo, GASBI (Gerencia de Asistencia Sanitaria del Bierzo), Calle Médicos sin Fronteras, 7, 24004 Ponferrada, Leon, Spain.
| | - Ester Hernández-Martín
- Internal Medicine Department, Hospital El Bierzo, GASBI (Gerencia de Asistencia Sanitaria del Bierzo), Calle Médicos sin Fronteras, 7, 24004 Ponferrada, Leon, Spain.
| | - Martín Ortega-Gil
- Nurse Supervisor of Quality Improvement, Nurse Division, Hospital El Bierzo, GASBI (Gerencia de Asistencia Sanitaria del Bierzo), Calle Médicos sin Fronteras, 7, 24004 Ponferrada, Leon, Spain.
| | - Alberto Bahamonde-Carrasco
- Internal Medicine Department, Hospital El Bierzo, GASBI (Gerencia de Asistencia Sanitaria del Bierzo), Calle Médicos sin Fronteras, 7, 24004 Ponferrada, Leon, Spain.
| |
Collapse
|
56
|
Forbes TL. In Low-Value Care, Less Is (Not Always) More. JAMA Intern Med 2019; 179:1147. [PMID: 31380947 DOI: 10.1001/jamainternmed.2019.1881] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Affiliation(s)
- Thomas L Forbes
- Division of Vascular Surgery, Peter Munk Cardiac Centre, University Health Network, Toronto, Ontario, Canada.,Division of Vascular Surgery, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
57
|
Badgery-Parker T, Elshaug AG. In Low-Value Care, Less Is (Not Always) More-Reply. JAMA Intern Med 2019; 179:1148. [PMID: 31380951 DOI: 10.1001/jamainternmed.2019.1659] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Affiliation(s)
- Tim Badgery-Parker
- The University of Sydney, Faculty of Medicine and Health, School of Public Health, Menzies Centre for Health Policy, Charles Perkins Centre, Sydney, Australia
| | - Adam G Elshaug
- The University of Sydney, Faculty of Medicine and Health, School of Public Health, Menzies Centre for Health Policy, Charles Perkins Centre, Sydney, Australia
| |
Collapse
|
58
|
Schulman JM, Palchaudhuri S, Lau BD, O'Rourke P. Infusing High Value Care Education Directly into Patient Care on the Medicine Wards. MEDEDPUBLISH 2019; 8:136. [PMID: 38089387 PMCID: PMC10712453 DOI: 10.15694/mep.2019.000136.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/06/2024] Open
Abstract
This article was migrated. The article was marked as recommended. Background: Multiple national initiatives have been implemented to promote cost-conscious care. Yet, there remains a deficiency of formal high value care (HVC) curricula among internal medicine residency programs.We aimedto develop a curriculum that teaches HVC material that can be utilized at the point of care and to assess the curriculum's impact on the participants' attitudes, knowledge, and practice patterns pertaining to HVC. Methods: We conducted our study on the inpatient internal medicine service over two-week rotations at Johns Hopkins Bayview Medical Center. Internal medicine residentsparticipated in two collaborative educational sessions that incorporated an introduction of important concepts in HVC, Bayesian thinking, clinical cases, and a review of a hospital bill of one of the patients under the team's care. Participants were also encouraged to reflect on their practice patterns and incorporate the HVC principles taught into their daily clinical work. We administered pre- and post-curriculum surveys to assess change in reported HVC-related practice behaviors, knowledge, and attitudes. Results: Forty-seven residents participated in the study. We included the twenty participants who completed both a pre- and post-curriculum survey in the data analysis. After participation in the curriculum, there was a significant increase in the use of pre-test probabilities in clinical decision making ( p=0.005). There was also a trend toward improvement in HVC knowledge and practice patterns after the rotation. Conclusion: We implemented a curriculum that may have improved high-value practice patterns through point-of-care education on the inpatient medicine wards.
Collapse
|