1
|
Nguyen KH, Comans T, Nguyen TT, Simpson D, Woods L, Wright C, Green D, McNeil K, Sullivan C. Cashing in: cost-benefit analysis framework for digital hospitals. BMC Health Serv Res 2024; 24:694. [PMID: 38822341 PMCID: PMC11143650 DOI: 10.1186/s12913-024-11132-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Accepted: 05/21/2024] [Indexed: 06/02/2024] Open
Abstract
BACKGROUND For many countries, especially those outside the USA without incentive payments, implementing and maintaining electronic medical records (EMR) is expensive and can be controversial given the large amounts of investment. Evaluating the value of EMR implementation is necessary to understand whether or not, such investment, especially when it comes from the public source, is an efficient allocation of healthcare resources. Nonetheless, most countries have struggled to measure the return on EMR investment due to the lack of appropriate evaluation frameworks. METHODS This paper outlines the development of an evidence-based digital health cost-benefit analysis (eHealth-CBA) framework to calculate the total economic value of the EMR implementation over time. A net positive benefit indicates such investment represents improved efficiency, and a net negative is considered a wasteful use of public resources. RESULTS We developed a three-stage process that takes into account the complexity of the healthcare system and its stakeholders, the investment appraisal and evaluation practice, and the existing knowledge of EMR implementation. The three stages include (1) literature review, (2) stakeholder consultation, and (3) CBA framework development. The framework maps the impacts of the EMR to the quadruple aim of healthcare and clearly creates a method for value assessment. CONCLUSIONS The proposed framework is the first step toward developing a comprehensive evaluation framework for EMRs to inform health decision-makers about the economic value of digital investments rather than just the financial value.
Collapse
Affiliation(s)
- Kim-Huong Nguyen
- Faculty of Medicine, The University of Queensland, Brisbane, Australia
- Global Brain Health Institute, Trinity College Dublin, Dublin, Ireland
- Brain and Mind Centre, Faculty of Medicine and Health, University of Sydney, Sydney, Australia
| | - Tracy Comans
- Faculty of Medicine, The University of Queensland, Brisbane, Australia
- National Ageing Research Institute, Parkville, Victoria, Australia
| | - Thi Thao Nguyen
- Faculty of Medicine, The University of Queensland, Brisbane, Australia.
- School of the Environment, The University of Queensland, Brisbane, Australia.
| | - Digby Simpson
- Faculty of Medicine, The University of Queensland, Brisbane, Australia
| | - Leanna Woods
- Faculty of Medicine, The University of Queensland, Brisbane, Australia
- Queensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Brisbane, Australia
| | - Chad Wright
- Faculty of Medicine, The University of Queensland, Brisbane, Australia
| | | | - Keith McNeil
- Queensland Department of Health, Brisbane, Australia
| | - Clair Sullivan
- Faculty of Medicine, The University of Queensland, Brisbane, Australia
- Queensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Brisbane, Australia
- Metro North Hospital and Health Service, Herston, Australia
| |
Collapse
|
2
|
Sznol JA, Becher R, Maung AA, Bhattacharya B, Davis K, Schuster KM. Routine post-operative labs and healthcare system burden in acute appendicitis. Am J Surg 2023; 226:571-577. [PMID: 37291012 DOI: 10.1016/j.amjsurg.2023.06.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Revised: 05/16/2023] [Accepted: 06/01/2023] [Indexed: 06/10/2023]
Abstract
BACKGROUND Data from the National Health Expenditure Accounts have shown a steady increase in healthcare cost paralleled by availability of laboratory tests. Resource utilization is a top priority for reducing health care costs. We hypothesized that routine post-operative laboratory utilization unnecessarily increases costs and healthcare system burden in acute appendicitis (AA) management. METHODS A retrospective cohort of patients with uncomplicated AA 2016-2020 were identified. Clinical variables, demographics, lab usage, interventions, and costs were collected. RESULTS A total of 3711 patients with uncomplicated AA were identified. Total costs of labs ($289,505, 99.56%) and repletions ($1287.63, 0.44%) were $290,792.63. Increased LOS was associated with lab utilization in multivariable modeling, increasing costs by $837,602 or 472.12 per patient. CONCLUSIONS In our patient population, post-operative labs resulted in increased costs without discernible impact on clinical course. Routine post-operative laboratory testing should be re-evaluated in patients with minimal comorbidities as this likely increases cost without adding value.
Collapse
Affiliation(s)
- Joshua A Sznol
- Department of Surgery, P.O. Box 208062, Yale School of Medicine, New Haven, CT 06520, USA.
| | - Robert Becher
- Department of Surgery, P.O. Box 208062, Yale School of Medicine, New Haven, CT 06520, USA.
| | - Adrian A Maung
- Department of Surgery, P.O. Box 208062, Yale School of Medicine, New Haven, CT 06520, USA.
| | - Bishwajit Bhattacharya
- Department of Surgery, P.O. Box 208062, Yale School of Medicine, New Haven, CT 06520, USA.
| | - Kimberly Davis
- Department of Surgery, P.O. Box 208062, Yale School of Medicine, New Haven, CT 06520, USA.
| | - Kevin M Schuster
- Department of Surgery, P.O. Box 208062, Yale School of Medicine, New Haven, CT 06520, USA.
| |
Collapse
|
3
|
Moriates C. How can we finally reduce repetitive routine laboratory tests for hospitalised patients? BMJ Qual Saf 2023; 32:498-501. [PMID: 37328268 DOI: 10.1136/bmjqs-2023-016315] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/02/2023] [Indexed: 06/18/2023]
Affiliation(s)
- Christopher Moriates
- Department of Internal Medicine, Dell Medical School at The University of Texas at Austin, Austin, Texas, USA
- Executive Director, Costs of Care, Boston, Massachusetts, USA
| |
Collapse
|
4
|
Raban MZ, Gates PJ, Gamboa S, Gonzalez G, Westbrook JI. Effectiveness of non-interruptive nudge interventions in electronic health records to improve the delivery of care in hospitals: a systematic review. J Am Med Inform Assoc 2023:7163187. [PMID: 37187160 DOI: 10.1093/jamia/ocad083] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Revised: 03/31/2023] [Accepted: 05/08/2023] [Indexed: 05/17/2023] Open
Abstract
OBJECTIVES To describe the application of nudges within electronic health records (EHRs) and their effects on inpatient care delivery, and identify design features that support effective decision-making without the use of interruptive alerts. MATERIALS AND METHODS We searched Medline, Embase, and PsychInfo (in January 2022) for randomized controlled trials, interrupted time-series and before-after studies reporting effects of nudge interventions embedded in hospital EHRs to improve care. Nudge interventions were identified at full-text review, using a pre-existing classification. Interventions using interruptive alerts were excluded. Risk of bias was assessed using the ROBINS-I tool (Risk of Bias in Non-randomized Studies of Interventions) for non-randomized studies or the Cochrane Effective Practice and Organization of Care Group methodology for randomized trials. Study results were summarized narratively. RESULTS We included 18 studies evaluating 24 EHR nudges. An improvement in care delivery was reported for 79.2% (n = 19; 95% CI, 59.5-90.8) of nudges. Nudges applied were from 5 of 9 possible nudge categories: change choice defaults (n = 9), make information visible (n = 6), change range or composition of options (n = 5), provide reminders (n = 2), and change option-related effort (n = 2). Only one study had a low risk of bias. Nudges targeted ordering of medications, laboratory tests, imaging, and appropriateness of care. Few studies evaluated long-term effects. DISCUSSION Nudges in EHRs can improve care delivery. Future work could explore a wider range of nudges and evaluate long-term effects. CONCLUSION Nudges can be implemented in EHRs to improve care delivery within current system capabilities; however, as with all digital interventions, careful consideration of the sociotechnical system is crucial to enhance their effectiveness.
Collapse
Affiliation(s)
- Magdalena Z Raban
- Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| | - Peter J Gates
- Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
- National Drug and Alcohol Research Centre, University of New South Wales, Sydney, Australia
| | - Sarah Gamboa
- Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| | - Gabriela Gonzalez
- Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| | - Johanna I Westbrook
- Centre for Health Systems and Safety Research, Australian Institute of Health Innovation, Macquarie University, Sydney, Australia
| |
Collapse
|
5
|
Yeshoua B, Bowman C, Dullea J, Ditkowsky J, Shyu M, Lam H, Zhao W, Shin JY, Dunn A, Tsega S, S Linker A, Shah M. Interventions to reduce repetitive ordering of low-value inpatient laboratory tests: a systematic review. BMJ Open Qual 2023; 12:bmjoq-2022-002128. [PMID: 36958791 PMCID: PMC10040017 DOI: 10.1136/bmjoq-2022-002128] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2022] [Accepted: 02/05/2023] [Indexed: 03/25/2023] Open
Abstract
BACKGROUND Over-ordering of daily laboratory tests adversely affects patient care through hospital-acquired anaemia, patient discomfort, burden on front-line staff and unnecessary downstream testing. This remains a prevalent issue despite the 2013 Choosing Wisely recommendation to minimise unnecessary daily labs. We conducted a systematic review of the literature to identify interventions targeting unnecessary laboratory testing. METHODS We systematically searched MEDLINE, EMBASE, Cochrane Central and SCOPUS databases to identify interventions focused on reducing daily complete blood count, complete metabolic panel and basic metabolic panel labs. We defined interventions as 'effective' if a statistically significant reduction was attained and 'highly effective' if a reduction of ≥25% was attained. RESULTS The search yielded 5646 studies with 41 articles that met inclusion criteria. We grouped interventions into one or more categories: audit and feedback, cost display, education, electronic medical record (EMR) change, and policy change. Most interventions lasted less than a year and used a multipronged approach. All five strategies were effective in most studies with EMR change being the most commonly used independent strategy. EMR change and policy change were the strategies most frequently reported as effective. EMR change was the strategy most frequently reported as highly effective. CONCLUSION Our analysis identified five categories of interventions targeting daily laboratory testing. All categories were effective in most studies, with EMR change being most frequently highly effective. PROSPERO REGISTRATION NUMBER CRD42021254076.
Collapse
Affiliation(s)
- Brandon Yeshoua
- Icahn School of Medicine, Mount Sinai, New York, New York, USA
| | - Chip Bowman
- Department of Medicine, Mount Sinai, New York, New York, USA
| | - Jonathan Dullea
- Icahn School of Medicine, Mount Sinai, New York, New York, USA
| | - Jared Ditkowsky
- Emergency Medicine, Hackensack Meridian Hackensack University Medical Center, Hackensack, New Jersey, USA
| | - Margaret Shyu
- Department of Medicine, Mount Sinai, New York, New York, USA
| | - Hansen Lam
- Department of Pathology and Laboratory Medicine, Icahn School of Medicine at Mount Sinai Lillian and Henry M Stratton-Hans Popper, New York, New York, USA
| | - William Zhao
- Icahn School of Medicine, Mount Sinai, New York, New York, USA
| | - Joo Yeon Shin
- Icahn School of Medicine, Mount Sinai, New York, New York, USA
| | - Andrew Dunn
- Hospital Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Surafel Tsega
- Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Anne S Linker
- Department of Medicine, Mount Sinai, New York, New York, USA
| | - Manan Shah
- Department of Medicine, Mount Sinai, New York, New York, USA
| |
Collapse
|
6
|
Pankhurst T, Lucas L, Ryan S, Ragdale C, Gyves H, Denner L, Young I, Rathbone L, Shah A, McKee D, Coleman JJ, Evison F, Atia J, Rosser D, Garrick M, Baker R, Gallier S, Ball S. Benefits of electronic charts in intensive care and during a world health pandemic: advantages of the technology age. BMJ Open Qual 2023; 12:bmjoq-2021-001704. [PMID: 36649943 PMCID: PMC9853220 DOI: 10.1136/bmjoq-2021-001704] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2021] [Accepted: 03/25/2022] [Indexed: 01/19/2023] Open
Abstract
AIMS AND OBJECTIVES This study sets out to describe benefits from the implementation of electronic observation charting in intensive care units (ICU). This was an extension to the existing hospital wide digital health system. We evaluated error reduction, time-savings and the costs associated with conversion from paper to digital records. The world health emergency of COVID-19 placed extraordinary strain on ICU and staff opinion was evaluated to test how well the electronic system performed. METHODS A clinically led project group working directly with programmers developed an electronic patient record for intensive care. Data error rates, time to add data and to make calculations were studied before and after the introduction of electronic charts. User feedback was sought pre and post go-live (during the COVID-19 pandemic) and financial implications were calculated by the hospital finance teams. RESULTS Error rates equating to 219 000/year were avoided by conversion to electronic charts. Time saved was the equivalent of a nursing shift each day. Recurrent cost savings per year were estimated to be £257k. Staff were overwhelmingly positive about electronic charts in ICU, even during a health pandemic and despite redeployment into intensive care where they were using the electronic charts for the first time. DISCUSSION Electronic ICU charts have been successfully introduced into our institution with benefits in terms of patient safety through error reduction and improved care through release of nursing time. Costs have been reduced. Staff feel supported by the digital system and report it to be helpful even during redeployment and in the unfamiliar environment of intensive care.
Collapse
Affiliation(s)
- Tanya Pankhurst
- Renal Medicine, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Laurie Lucas
- IT Services, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Steve Ryan
- IT Services, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Chris Ragdale
- IT Services, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Helen Gyves
- IT Services, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Louise Denner
- University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Ian Young
- IT Services, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Laura Rathbone
- IT Services, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Anwar Shah
- Anaesthetics, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Deborah McKee
- IT Services, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Jamie J Coleman
- University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK,School of Medicine, College of Medical and Dental Sciences, University of Birmingham, Birmingham, UK
| | - Felicity Evison
- Health Informatics, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Jolene Atia
- Health Informatics, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - David Rosser
- University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Mark Garrick
- University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Richard Baker
- Finance, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Suzy Gallier
- Health Informatics, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK,PIONEER: HDR-UK Health Data Research Hub in Acute care, University of Birmingham, Birmingham, UK
| | - Simon Ball
- University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK,Institute of Infection and Immunity, University of Birmingham, Birmingham, UK,Better Care, Health Data Research, London, UK
| |
Collapse
|
7
|
Shin D, Krouss M, Alaiev D, Mestari N, Talledo J, Zaurova M, Chandra K, Manchego PA, Tsega S, Uppal A, Faillace RT, Moskovitz J, Ford K, Bouton M, Cho HJ. Reducing unnecessary routine laboratory testing for noncritically ill patients with COVID-19. J Hosp Med 2022; 17:961-966. [PMID: 36330542 PMCID: PMC9878235 DOI: 10.1002/jhm.12993] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Revised: 09/05/2022] [Accepted: 09/11/2022] [Indexed: 11/06/2022]
Abstract
BACKGROUND Reducing unnecessary routine laboratory testing is a Choosing Wisely® recommendation, and new areas of overuse were noted during the COVID-19 pandemic. OBJECTIVE To reduce unnecessary repetitive routine laboratory testing for patients with COVID-19 during the pandemic across a large safety net health system. DESIGNS, SETTINGS AND PARTICIPANTS This quality improvement initiative was initiated by the System High-Value Care Council at New York City Health + Hospitals (H + H), the largest public healthcare system in the United States consisting of 11 acute care hospitals. INTERVENTION four overused laboratory tests in noncritically ill hospitalized patients with COVID-19 were identified: C-reactive protein (CRP), ferritin, lactate dehydrogenase (LDH), and procalcitonin. A two-pronged electronic health record intervention was implemented consisting of (1) nonintrusive, informational nudge statements placed on selected order sets, and (2) a forcing function of one consecutive day limit on ordering. MAIN OUTCOME AND MEASURES The average of excess tests per encounter days (ETPED) for each of four target laboratory testing only in patients with COVID-19. OBJECTIVE Interdisciplinary System High-Value Care Council identified four overused laboratory tests (inflammatory markers) in noncritically ill hospitalized patients with COVID-19: C-reactive protein (CRP), ferritin, lactate dehydrogenase (LDH), and procalcitonin. Within an 11-hospital safety net health system, a two-pronged electronic health record intervention was implemented consisting of (1) nonintrusive, informational nudge statements placed on selected order sets, and (2) a forcing function of one consecutive day limit on ordering. The preintervention period (March 16, 2020 to January 24, 2021) was compared to the postintervention period (January 25, 2021 to March 22, 2022). RESULTS Time series linear regression showed decreases in CRP (-17.9%, p < .05), ferritin (-37.6%, p < .001), and LDH (-30.1%, p < .001). Slope differences were significant (CRP, ferritin, and LDH p < 0.001; procalcitonin p < 0.05). Decreases were observed across weekly averages: CRP (-19%, p < .01), ferritin (-37.9%, p < .001), LDH (-28.7%, p < .001), and procalcitonin (-18.4%, p < .05). CONCLUSION This intervention was associated with reduced routine inflammatory marker testing in non-intensive care unit COVID-19 hospitalized patients across 11 hospitals. Variation was high among individual hospitals.
Collapse
Affiliation(s)
- Dawi Shin
- Department of Quality and SafetyNew York City Health + HospitalsNew York CityNew YorkUSA
- Department of MedicineIcahn School of MedicineNew York CityNew YorkUSA
| | - Mona Krouss
- Department of Quality and SafetyNew York City Health + HospitalsNew York CityNew YorkUSA
- Department of MedicineIcahn School of MedicineNew York CityNew YorkUSA
| | - Daniel Alaiev
- Department of Quality and SafetyNew York City Health + HospitalsNew York CityNew YorkUSA
| | - Nessreen Mestari
- Department of Quality and SafetyNew York City Health + HospitalsNew York CityNew YorkUSA
| | - Joseph Talledo
- Department of Quality and SafetyNew York City Health + HospitalsNew York CityNew YorkUSA
| | - Milana Zaurova
- Department of Quality and SafetyNew York City Health + HospitalsNew York CityNew YorkUSA
| | - Komal Chandra
- Department of Quality and SafetyNew York City Health + HospitalsNew York CityNew YorkUSA
| | - Peter A. Manchego
- Department of Quality and SafetyNew York City Health + HospitalsNew York CityNew YorkUSA
| | - Surafel Tsega
- Department of Quality and SafetyNew York City Health + HospitalsNew York CityNew YorkUSA
- Department of MedicineNYC Health + Hospitals/Kings County Hospital CenterNew York CityNew YorkUSA
| | - Amit Uppal
- Department of Medicine, Division of Pulmonary Disease and Critical Care MedicineBellevue Hospital Center and NYU Langone HealthNew York CityNew YorkUSA
| | - Robert T. Faillace
- Department of Emergency MedicineNYC Health + Hospitals/JacobiNew YorkThe BronxUSA
| | - Joshua Moskovitz
- Department of Emergency MedicineNYC Health + Hospitals/JacobiNew YorkThe BronxUSA
| | - Kenra Ford
- Office of Medical and Professional AffairsNew York City Health + HospitalsNew York CityNew YorkUSA
| | - Michael Bouton
- Enterprise Information Technology ServicesNYC Health + HospitalsNew York CityNew YorkUSA
| | - Hyung J. Cho
- Department of Quality and SafetyNew York City Health + HospitalsNew York CityNew YorkUSA
- Department of MedicineNew York University Grossman School of MedicineNew York CityNew YorkUSA
| |
Collapse
|
8
|
Lin DC, Parakati I, Haymond S. The Impact of COVID-19 on Laboratory Test Utilization at a Pediatric Medical Center. J Appl Lab Med 2022; 7:1076-1087. [PMID: 35723285 PMCID: PMC9384293 DOI: 10.1093/jalm/jfac048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2022] [Accepted: 05/17/2022] [Indexed: 11/13/2022]
Abstract
Abstract
Background
The epidemiology and clinical manifestation of coronavirus disease 2019 (COVID-19) in the pediatric population is different from the adult population. The purpose of this study is to identify effects of the COVID-19 pandemic on laboratory test utilization in a pediatric hospital.
Methods
We performed retrospective analysis on test utilization data from Ann & Robert H. Lurie Children’s Hospital of Chicago, an academic pediatric medical center. Data between two 100-day periods prior to (prepandemic) and during the pandemic (mid-pandemic) were analyzed to evaluate changes in test volume, lab utilization, and test positivity rate. We also evaluated these metrics based on in- vs outpatient testing and performed modeling to determine what variables significantly impact the test positivity rate.
Results
During the pandemic period, there was an expected surge in COVID-19 testing, while over 84% of lab tests studied decreased in ordering volume. The average number of tests ordered per patient was not significantly different during the pandemic for any of the laboratories (adjusted P value > 0.05). Thirty-three studied tests showed significant change in positivity rate during the pandemic. Linear modeling revealed test volume and inpatient status as the key variables associated with change in test positivity rate.
Conclusions
Excluding severe acute respiratory syndrome coronavirus 2 tests, the COVID-19 pandemic has generally led to decreased test ordering volume and laboratory utilization. However, at this pediatric hospital, the average number of tests performed per patient and test positivity rates were comparable between pre- and mid-pandemic periods. These results suggest that, overall, clinical test utilization at this site remained consistent during the pandemic.
Collapse
Affiliation(s)
- David C Lin
- Department of Pathology and Laboratory Medicine, Ann & Robert H. Lurie Children's Hospital of Chicago , Chicago, IL , USA
- Northwestern University, Feinberg School of Medicine, Department of Pathology , Chicago, IL , USA
| | - Isaac Parakati
- Data Analytics and Reporting, Ann & Robert H. Lurie Children's Hospital of Chicago , Chicago, IL , USA
| | - Shannon Haymond
- Department of Pathology and Laboratory Medicine, Ann & Robert H. Lurie Children's Hospital of Chicago , Chicago, IL , USA
- Northwestern University, Feinberg School of Medicine, Department of Pathology , Chicago, IL , USA
| |
Collapse
|
9
|
Serum Ammonia in Cirrhosis: Clinical Impact of Hyperammonemia, Utility of Testing, and National Testing Trends. Clin Ther 2022; 44:e45-e57. [DOI: 10.1016/j.clinthera.2022.01.008] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 01/10/2022] [Accepted: 01/10/2022] [Indexed: 02/07/2023]
|
10
|
Ito H, Okamoto K, Yamamoto S, Yamashita M, Kanno Y, Jubishi D, Ikeda M, Harada S, Okugawa S, Moriya K. Incidence and Risk Factors for Inappropriate Use of Non-Culture-Based Fungal Assays: Implication for Diagnostic Stewardship. Open Forum Infect Dis 2022; 9:ofab601. [PMID: 35024373 PMCID: PMC8743121 DOI: 10.1093/ofid/ofab601] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2021] [Accepted: 11/30/2021] [Indexed: 11/23/2022] Open
Abstract
Background Non-culture-based fungal assays (NCBFAs) have been used increasingly to help diagnose invasive fungal diseases. However, little is known about inappropriate use of NCBFAs. We aimed to investigate inappropriate use of NCBFAs in a tertiary academic hospital. Methods This retrospective cohort study included patients who underwent testing with beta-D glucan (BDG) between January and March 2018 or with galactomannan antigen (GMA) or cryptococcal antigen (CRAG) between January and June 2018. Testing was deemed appropriate if the clinical presentation was compatible with a fungal infection and there was a predisposing host factor at the time of ordering. We compared patients with appropriate and inappropriate use of NCBFAs using multivariate logistic regression analysis. Results Four hundred seventy patients (BDG, 394; GMA, 138; CRAG, 164) met inclusion criteria and were evaluated. About 80% of NCBFAs were deemed inappropriate. Ordering by transplant medicine physicians, repetitions of the test, the absence of predisposing factors for fungal infections, and the absence of recommendations from infectious diseases consultants were associated with an increased risk of inappropriate NCBFA use. Conclusions We found that a large proportion of NCBFAs were deemed inappropriate. There is an opportunity for diagnostic stewardship to reduce avoidable fungal testing among patients at low risk for fungal infection.
Collapse
Affiliation(s)
- Hiroshi Ito
- Department of Infectious Diseases, The University of Tokyo Hospital, Tokyo, Japan.,Division of Hospital Medicine, University of Tsukuba Hospital, Ibaraki, Japan
| | - Koh Okamoto
- Department of Infectious Diseases, The University of Tokyo Hospital, Tokyo, Japan
| | - Shinya Yamamoto
- Department of Infectious Diseases, The University of Tokyo Hospital, Tokyo, Japan
| | - Marie Yamashita
- Department of Infectious Diseases, The University of Tokyo Hospital, Tokyo, Japan
| | - Yoshiaki Kanno
- Department of Infectious Diseases, The University of Tokyo Hospital, Tokyo, Japan
| | - Daisuke Jubishi
- Department of Infectious Diseases, The University of Tokyo Hospital, Tokyo, Japan
| | - Mahoko Ikeda
- Department of Infectious Diseases, The University of Tokyo Hospital, Tokyo, Japan
| | - Sohei Harada
- Department of Infectious Diseases, The University of Tokyo Hospital, Tokyo, Japan.,Department of Infection Control and Prevention, The University of Tokyo Hospital, Tokyo, Japan
| | - Shu Okugawa
- Department of Infectious Diseases, The University of Tokyo Hospital, Tokyo, Japan
| | - Kyoji Moriya
- Department of Infectious Diseases, The University of Tokyo Hospital, Tokyo, Japan
| |
Collapse
|
11
|
Rajendran R, Salazar JH, Seymour RL, Laposata M, Zahner CJ. Overutilization and underutilization of autoantibody tests in patients with suspected autoimmune disorders. ACTA ACUST UNITED AC 2021; 8:497-503. [PMID: 33675217 DOI: 10.1515/dx-2020-0139] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Accepted: 02/05/2021] [Indexed: 11/15/2022]
Abstract
OBJECTIVES Diagnostic Management Teams (DMTs) are one strategy for reducing diagnostic errors. This study examined errors in serology test selection after a positive antinuclear antibody (ANA) test in patients with suspected systemic autoimmune rheumatic disorder (SARD). METHODS This retrospective study included 246 patient cases reviewed by our ANA DMT from March to August 2019. The DMT evaluated the appropriateness of tests beyond ANA screening tests (overutilization, underutilization, or both) based on American College of Rheumatology recommendations and classified cases into diagnostic error or no error groups. Errors were quantified, and patient and provider characteristics associated with diagnostic errors were assessed. RESULTS Among 246 cases, 60.6% had at least one diagnostic error in test selection. The number of sub-serology tests ordered was 2.4 times higher in the diagnostic error group than in the no error group. The likelihood of at least one diagnostic error was higher in males and African American/Black patients, although the differences were not statistically significant. Providers from general internal medicine, primary care, and non-rheumatology specialties were approximately two times more likely to make diagnostic errors than rheumatology specialists. CONCLUSIONS Diagnostic errors in test selection after a positive ANA for patients with suspected SARD were common, although there were fewer errors when ordered by rheumatology specialists. These findings support the need to develop strategies to reduce diagnostic errors in test selection for autoimmunity evaluation and suggest that implementation of a DMT can be useful for providing guidance to clinicians to reduce overutilization and underutilization of laboratory tests.
Collapse
Affiliation(s)
- Rajkumar Rajendran
- Department of Clinical Laboratory Sciences, University of Texas Medical Branch, Galveston, TX, USA.,Department of Pathology, University of Texas Medical Branch, Galveston, TX, USA
| | - Jose H Salazar
- Department of Clinical Laboratory Sciences, University of Texas Medical Branch, Galveston, TX, USA.,Department of Pathology, University of Texas Medical Branch, Galveston, TX, USA
| | - Robert L Seymour
- Formerly of Department of Pathology, University of Texas Medical Branch, Galveston, TX, USA
| | - Michael Laposata
- Department of Clinical Laboratory Sciences, University of Texas Medical Branch, Galveston, TX, USA.,Department of Pathology, University of Texas Medical Branch, Galveston, TX, USA
| | - Christopher J Zahner
- Department of Clinical Laboratory Sciences, University of Texas Medical Branch, Galveston, TX, USA.,Department of Pathology, University of Texas Medical Branch, Galveston, TX, USA
| |
Collapse
|
12
|
Bai L, Gao S, Burstein F, Kerr D, Buntine P, Law N. A systematic literature review on unnecessary diagnostic testing: The role of ICT use. Int J Med Inform 2020; 143:104269. [PMID: 32927268 DOI: 10.1016/j.ijmedinf.2020.104269] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2020] [Revised: 08/10/2020] [Accepted: 09/02/2020] [Indexed: 12/19/2022]
Abstract
BACKGROUND The negative impact of unnecessary diagnostic tests on healthcare systems and patients has been widely recognized. Medical researchers in various countries have been devoting effort to reduce unnecessary diagnostic tests by using different types of interventions, including information and communications technology-based (ICT-based) intervention, educational intervention, audit and feedback, the introduction of guidelines or protocols, and the reward and punishment of staff. We conducted a review of ICT based interventions and a comparative analysis of their relative effectiveness in reducing unnecessary tests. METHOD A systematic Boolean search in PubMed, EMBase and EBSCOhost research databases was performed. Keyword search and citation analysis were also conducted. Empirical studies reporting ICT based interventions, and their implications on relative effectiveness in reducing unnecessary diagnostic tests (pathology tests or medical imaging) were evaluated independently by two reviewers based on a rigorously developed coding protocol. RESULTS 92 research articles from peer-reviewed journals were identified as eligible. 47 studies involved a single-method intervention and 45 involved multi-method interventions. Regardless of the number of interventions involved in the studies, ICT-based interventions were utilized by 71 studies and 59 of them were shown to be effective in reducing unnecessary testing. A clinical decision support (CDS) tool appeared to be the most adopted ICT approach, with 46 out of 71 studies using CDS tools. The CDS tool showed effectiveness in reducing test volume in 38 studies and reducing cost in 24 studies. CONCLUSIONS This review investigated five frequently utilized intervention methods, ICT-based, education, introduction of guidelines or protocols, audit and feedback, and reward and punishment. It provides in-depth analysis of the efficacy of different types of interventions and sheds insights about the benefits of ICT based interventions, especially those utilising CDS tools, to reduce unnecessary diagnostic testing. The replicability of the studies is limited due to the heterogeneity of the studies in terms of context, study design, and targeted types of tests.
Collapse
Affiliation(s)
- Lu Bai
- Faculty of Information Technology, Monash University, Melbourne, VIC, Australia
| | - Shijia Gao
- Faculty of Information Technology, Monash University, Melbourne, VIC, Australia
| | - Frada Burstein
- Faculty of Information Technology, Monash University, Melbourne, VIC, Australia.
| | - Donald Kerr
- USC Business School, University of the Sunshine Coast, Sippy Downs, QLD, Australia
| | - Paul Buntine
- Emergency Department, Box Hill Hospital, Melbourne, VIC, Australia; Eastern Health Clinical School, Faculty of Medicine, Nursing and Health Sciences, Monash University, Melbourne, VIC, Australia
| | | |
Collapse
|
13
|
Tamburrano A, Vallone D, Carrozza C, Urbani A, Sanguinetti M, Nicolotti N, Cambieri A, Laurenti P. Evaluation and cost estimation of laboratory test overuse in 43 commonly ordered parameters through a Computerized Clinical Decision Support System (CCDSS) in a large university hospital. PLoS One 2020; 15:e0237159. [PMID: 32760101 PMCID: PMC7410244 DOI: 10.1371/journal.pone.0237159] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2020] [Accepted: 07/21/2020] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Computerized Clinical Decision Support Systems (CCDSS) have become increasingly important in ensuring patient safety and supporting all phases of clinical decision making. The aim of this study is to evaluate, through a CCDSS, the rate of the laboratory tests overuse and to estimate the cost of the inappropriate requests in a large university hospital. METHOD In this observational study, hospital physicians submitted the examination requests for the inpatients through a Computerized Physician Order Entry. Violations of the rules in tests requests were intercepted and counted by a CCDSS, over a period of 20 months. Descriptive and inferential statistics (Student's t-test and ANOVA) were made. Finally, the monthly comprehensive cost of the laboratory tests was calculated. RESULTS During the observation period a total of 5,716,370 requests were analyzed and 809,245 violations were counted. The global rate of overuse was 14.2% ± 3.0%. The most inappropriate exams were Alpha Fetoprotein (85.8% ± 30.5%), Chlamydia trachomatis Nucleic Acid Amplification (48.7% ± 8.8%) and Alkaline Phosphatase (20.3% ± 6.5%). The monthly cost of over-utilization was 56,534€ for basic panel, 14,421€ for coagulation, 4,758€ for microbiology, 432€ for immunology exams. All the exams, generated an estimated avoidable cost of 1,719,337€ (85,967€ per month) for the hospital. CONCLUSIONS The study confirms the wide variability in over-utilization rates of laboratory tests. For these reasons, the real impact of inappropriateness is difficult to assess, but the generated costs for patients, hospitals and health systems are certainly high and not negligible. It would be desirable for international medical communities to produce a complete panel of prescriptive rules for all the most common laboratory exams that is useful not only to reduce costs, but also to ensure standardization and high-quality care.
Collapse
Affiliation(s)
- Andrea Tamburrano
- Section of Hygiene - Institute of Public Health, Università Cattolica del Sacro Cuore, Roma, Italia
| | - Doriana Vallone
- Section of Hygiene - Institute of Public Health, Università Cattolica del Sacro Cuore, Roma, Italia
| | - Cinzia Carrozza
- Unit of Biochemical Chemistry and Clinical Molecular Biology, Fondazione Policlinico Universitario A. Gemelli IRCCS, Roma, Italia
| | - Andrea Urbani
- Unit of Biochemical Chemistry and Clinical Molecular Biology, Fondazione Policlinico Universitario A. Gemelli IRCCS, Roma, Italia
| | - Maurizio Sanguinetti
- Department of Laboratory Sciences and Infectious Diseases, Fondazione Policlinico Universitario A. Gemelli IRCCS, Roma, Italia
| | - Nicola Nicolotti
- Hospital Health Management, Fondazione Policlinico Universitario A. Gemelli IRCCS, Roma, Italia
| | - Andrea Cambieri
- Hospital Health Management, Fondazione Policlinico Universitario A. Gemelli IRCCS, Roma, Italia
| | - Patrizia Laurenti
- Section of Hygiene - Institute of Public Health, Università Cattolica del Sacro Cuore, Roma, Italia
| |
Collapse
|
14
|
Choosing Daily Labs Wisely in the Hospital: A Novel Tool for Assessing Laboratory Testing Appropriateness. Qual Manag Health Care 2020; 29:169-172. [PMID: 32590493 DOI: 10.1097/qmh.0000000000000258] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
BACKGROUND The Minnesota Lab Appropriateness (MLAB) criteria were developed for assessing appropriateness of complete blood counts (CBCs) and serum electrolyte panels (SEPs) ordered for adult inpatients. METHODS Two independent raters used the MLAB criteria to rate appropriateness of labs ordered during 50 hospitalizations through retrospective medical record review. RESULTS Evaluation of 208 CBCs and 253 SEPs on a 2-category scale (appropriate/inappropriate) resulted in an inappropriate lab rate of 24% and 25% for CBCs and SEPs, respectively. Using a 3-category Likert scale that included an "equivocal" rating to allow for clinical uncertainty, 17% of CBCs and 20% of SEPs were considered inappropriate. Interrater reliability was "substantial" using the dichotomous scale for both CBCs and SEPs. Using the 3-category Likert scale, reliability was "substantial" for CBCs and "moderate" for SEPs. CONCLUSION The MLAB criteria identified inappropriate labs at a rate consistent with published figures, with good interrater reliability.
Collapse
|
15
|
Breen C, Maguire K, Bansal A, Russin S, West S, Dayal A, Berger A, Olson J, Hohmuth B. Reducing Phlebotomy Utilization With Education and Changes to Computerized Provider Order Entry. J Healthc Qual 2020; 41:154-159. [PMID: 31094948 DOI: 10.1097/jhq.0000000000000150] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
INTRODUCTION Daily phlebotomy is often a standard procedure in hospitalized patients. Recently, this practice has begun receiving attention as a potential target for efforts focused on eliminating overuse. Several organizations have published their efforts in this arena. Interventions have included education, feedback, and changes to computerized provider order entry (CPOE) but have yielded mixed results. METHODS A quality improvement initiative to reduce the utilization of daily phlebotomy was conducted at a 505-bed Academic Medical Center. This project involved a combination of educational interventions and changes to CPOE. The primary end point evaluated was the daily performance of complete blood counts (CBCs) and basic metabolic profiles (BMPs) on medical and surgery units relative to the corresponding hospital census. RESULTS Over the course of this project from August 1, 2013, to September 23, 2016, there was a 15.2% reduction in CBCs (p < .001 for linear trend) and 13.1% reduction in BMPs. DISCUSSION Our results suggest that layering multimodal interventions that involve both "hard-wired" changes to CPOE and education and performance feedback can result in decreased utilization of phlebotomy.
Collapse
|
16
|
Shinwa M, Bossert A, Chen I, Cushing A, Dunn AS, Poeran J, Weinstein S, Cho HJ. "THINK" Before You Order: Multidisciplinary Initiative to Reduce Unnecessary Lab Testing. J Healthc Qual 2020; 41:165-171. [PMID: 31094950 DOI: 10.1097/jhq.0000000000000157] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
Inappropriate daily lab testing can have adverse effects on patients, including anemia, pain, and interruption of sleep. We implemented a student-led, multifaceted intervention featuring clinician education, publicity campaign, gamification, and system changes, including a novel nurse-driven protocol to reduce unnecessary daily lab testing in a teaching hospital. We applied a quasi-experimental interrupted time series design with a segmented regression analysis to estimate changes before and after our 14-month intervention with a comparison to a control surgical unit. There was an increasing trend in the baseline period, which was mitigated by the intervention (postintervention effect estimate -0.04 labs per patient day/month, p < .05), which was not seen in the control unit. Estimated cost savings was $94,269 ($6,734/month). A student-led, multidisciplinary campaign involving nurse-driven pathway, education, publicity, gamification, and system changes was effective in reducing daily lab testing.
Collapse
|
17
|
Chin KK, Krishnamurthy A, Zubair T, Ramaswamy T, Hom J, Maggio P, Shieh L. A minimalist electronic health record-based intervention to reduce standing lab utilisation. Postgrad Med J 2020; 97:97-102. [PMID: 32051280 DOI: 10.1136/postgradmedj-2019-136992] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2019] [Revised: 01/13/2020] [Accepted: 01/19/2020] [Indexed: 11/03/2022]
Abstract
BACKGROUND Repetitive laboratory testing in stable patients is low-value care. Electronic health record (EHR)-based interventions are easy to disseminate but can be restrictive. OBJECTIVE To evaluate the effect of a minimally restrictive EHR-based intervention on utilisation. SETTING One year before and after intervention at a 600-bed tertiary care hospital. 18 000 patients admitted to General Medicine, General Surgery and the Intensive Care Unit (ICU). INTERVENTION Providers were required to specify the number of times each test should occur instead of being able to order them indefinitely. MEASUREMENTS For eight tests, utilisation (number of labs performed per patient day) and number of associated orders were measured. RESULTS Utilisation decreased for some tests on all services. Notably, complete blood count with differential decreased 9% (p<0.001) on General Medicine and 21% (p<0.001) in the ICU. CONCLUSIONS Requiring providers to specify the number of occurrences of labs changes significantly reduces utilisation in some cases.
Collapse
Affiliation(s)
- Kuo-Kai Chin
- Stanford University School of Medicine, Stanford, California, USA
| | | | - Talhah Zubair
- Stanford University School of Medicine, Stanford, California, USA
| | - Tara Ramaswamy
- Department of Medicine, Stanford University, Stanford, California, USA
| | - Jason Hom
- Department of Medicine, Stanford University, Stanford, California, USA
| | - Paul Maggio
- Department of Surgery, Stanford University, Stanford, California, USA
| | - Lisa Shieh
- Department of Medicine, Stanford University, Stanford, California, USA
| |
Collapse
|
18
|
Lee B, Hershey D, Patel A, Pierce H, Rhee KE, Fisher E. Reducing Unnecessary Testing in Uncomplicated Skin and Soft Tissue Infections: A Quality Improvement Approach. Hosp Pediatr 2020; 10:129-137. [PMID: 31941651 DOI: 10.1542/hpeds.2019-0179] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
OBJECTIVES Skin and soft tissue infections are common pediatric diagnoses with substantial costs. Recent studies suggest blood cultures are not useful in management of uncomplicated skin and soft tissue infections (uSSTIs). Complete blood cell count, erythrocyte sedimentation rate, and C-reactive protein are also of questionable value. We aimed to decrease these tests by 25% for patients with uSSTIs admitted to the pediatric hospital medicine service within 3 months. METHODS An interdisciplinary team led a quality improvement (QI) project. Baseline assessment included review of the literature and 12 months of medical records. Key stakeholders identified drivers that informed the creation of an electronic order set and development of a pediatric hospital medicine-emergency department collaborative QI project. The primary outcome measure was mean number of tests per patient encounter. Balancing measures included unplanned readmissions and missed diagnoses. RESULTS Our baseline-year rate was 3.4 tests per patient encounter (573 tests and 169 patient encounters). During the intervention year, the rate decreased by 35% to 2.2 tests per patient encounter (286 tests and 130 patient encounters) and was sustained for 14 months postintervention. There were no unplanned readmissions or missed diagnoses for the study period. Order set adherence was 80% (83 out of 104) during the intervention period and sustained at 87% postintervention. CONCLUSIONS Our interdisciplinary team achieved our aim, reducing unnecessary laboratory testing in patients with an uSSTI without patient harm. Awareness of local culture, creation of an order set, defining appropriate patient selection and testing indications, and implementation of a collaborative QI project helped us achieve our aim.
Collapse
Affiliation(s)
- Begem Lee
- Rady Children's Hospital-San Diego, San Diego, California; and
- Department of Pediatrics, University of California, San Diego, San Diego, California
| | - Daniel Hershey
- Rady Children's Hospital-San Diego, San Diego, California; and
- Department of Pediatrics, University of California, San Diego, San Diego, California
| | - Aarti Patel
- Rady Children's Hospital-San Diego, San Diego, California; and
- Department of Pediatrics, University of California, San Diego, San Diego, California
| | - Heather Pierce
- Rady Children's Hospital-San Diego, San Diego, California; and
- Department of Pediatrics, University of California, San Diego, San Diego, California
| | - Kyung E Rhee
- Rady Children's Hospital-San Diego, San Diego, California; and
- Department of Pediatrics, University of California, San Diego, San Diego, California
| | - Erin Fisher
- Rady Children's Hospital-San Diego, San Diego, California; and
- Department of Pediatrics, University of California, San Diego, San Diego, California
| |
Collapse
|
19
|
Mummadi SR, Mishra R. Effectiveness of provider price display in computerized physician order entry (CPOE) on healthcare quality: a systematic review. J Am Med Inform Assoc 2019; 25:1228-1239. [PMID: 29982523 DOI: 10.1093/jamia/ocy076] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2018] [Accepted: 05/24/2018] [Indexed: 11/12/2022] Open
Abstract
Objective To study the association between Electronic Health Record (EHR)/Computerized Physician Order Entry (CPOE) provider price display, and domains of healthcare quality (efficiency, effective care, patient centered care, patient safety, equitable care, and timeliness of care). Methods Randomized and non-randomized studies assessing the relationship between healthcare quality domains and EHR/CPOE provider price display published between 1/1/1980 to 2/1/2018 were included. MEDLINE, Web of Science, and Embase were searched. Assessment of internal validity of the included studies was performed with a modified Downs-Black checklist. Results Screening of 1118 abstracts was performed resulting in selection of 41 manuscripts for full length review. A total of 13 studies were included in the final analysis. Thirteen studies reported on efficiency domain, one on effectiveness and one on patient safety. Studies assessing relationship between provider price display and patient centered, equitable and timely care domains were not retrieved. Quality of the studies varied widely (Range 6-12 out of a maximum possible score of 13). Provider price display in electronic health record environment did not consistently influence domains of healthcare quality such as efficiency, effectiveness and patient safety. Conclusions Published evidence suggests that price display tools aimed at ordering providers in EHR/CPOE do not influence the efficiency domain of healthcare quality. Scant published evidence suggests that they do not influence the effectiveness and patient safety domains of healthcare quality. Future studies are needed to assess the relationship between provider price display and unexplored domains of healthcare quality (patient centered, equitable, and timely care). Registration PROSPERO registration: CRD42018082227.
Collapse
Affiliation(s)
- Srinivas R Mummadi
- Department of Pulmonary and Critical Care Medicine, Metro Health-University of Michigan Health, Wyoming, MI, USA.,Department of Clinical Informatics, Metro Health-University of Michigan Health Innovation Center, Wyoming, MI, USA
| | - Raghavendra Mishra
- Department of Hospital Medicine & Clinical Informatics, SCL Good Samaritan Hospital, Lafayette, CO, USA.,Department of Hospital Medicine & Clinical Informatics, Kaiser Permanente, Englewood, CO, USA
| |
Collapse
|
20
|
Maratt JK, Kerr EA, Klamerus ML, Lohman SE, Froehlich W, Bhatia RS, Saini SD. Measures Used to Assess the Impact of Interventions to Reduce Low-Value Care: a Systematic Review. J Gen Intern Med 2019; 34:1857-1864. [PMID: 31250366 PMCID: PMC6712188 DOI: 10.1007/s11606-019-05069-5] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/10/2018] [Revised: 01/02/2019] [Accepted: 04/23/2019] [Indexed: 10/26/2022]
Abstract
IMPORTANCE Studies of interventions to reduce low-value care are increasingly common. However, little is known about how the effects of such interventions are measured. OBJECTIVE To characterize measures used to assess interventions to reduce low-value care. EVIDENCE REVIEW We searched PubMed and Web of Science to identify studies published between 2010 and 2016 that examined the effects of interventions to reduce low-value care. We also searched ClinicalTrials.gov to identify ongoing studies. We extracted data on characteristics of studies, interventions, and measures. We then developed a framework to classify measures into the following categories: utilization (e.g., number of tests ordered), outcome (e.g., mortality), appropriateness (e.g., overuse of antibiotics), patient-reported (e.g., satisfaction), provider-reported (e.g., satisfaction), patient-provider interaction (e.g., informed decision-making elements), value, and cost. We also determined whether each measure was designed to assess unintended consequences. FINDINGS A total of 1805 studies were identified, of which 101 published and 16 ongoing studies were included. Of published studies (N = 101), 68% included at least one measure of utilization, 41% of an outcome, 52% of appropriateness, 36% of cost, 8% patient-reported, and 3% provider-reported. Funded studies were more likely to use patient-reported measures (17% vs 0%). Of ongoing studies (registered trials) (N = 16), 69% included at least one measure of utilization, 75% of an outcome, 50% of appropriateness, 19% of cost, 50% patient-reported, 13% provider-reported, and 6% patient-provider interaction. Of published studies, 34% included at least one measure of an unintended consequence as compared to 63% of ongoing studies. CONCLUSIONS AND RELEVANCE Most published studies focused on reductions in utilization rather than on clinically meaningful measures (e.g., improvements in appropriateness, patient-reported outcomes) or unintended consequences. Investigators should systematically incorporate more clinically meaningful measures into their study designs, and sponsors should develop standardized guidance for the evaluation of interventions to reduce low-value care.
Collapse
Affiliation(s)
- Jennifer K Maratt
- Department of Internal Medicine and Institute for Healthcare Policy and Innovation, University of Michigan, Ann Arbor, MI, USA. .,Veterans Affairs Ann Arbor Healthcare System, Ann Arbor, MI, USA.
| | - Eve A Kerr
- Department of Internal Medicine and Institute for Healthcare Policy and Innovation, University of Michigan, Ann Arbor, MI, USA.,Veterans Affairs Ann Arbor Healthcare System, Ann Arbor, MI, USA.,Veterans Affairs Center for Clinical Management Research, Ann Arbor, MI, USA
| | - Mandi L Klamerus
- Veterans Affairs Center for Clinical Management Research, Ann Arbor, MI, USA
| | | | - Whit Froehlich
- University of Michigan Medical School, Ann Arbor, MI, USA
| | - R Sacha Bhatia
- Department of Internal Medicine and Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, USA
| | - Sameer D Saini
- Department of Internal Medicine and Institute for Healthcare Policy and Innovation, University of Michigan, Ann Arbor, MI, USA.,Veterans Affairs Ann Arbor Healthcare System, Ann Arbor, MI, USA.,Veterans Affairs Center for Clinical Management Research, Ann Arbor, MI, USA
| |
Collapse
|
21
|
Jalbert R, Gob A, Chin-Yee I. Decreasing daily blood work in hospitals: What works and what doesn't. Int J Lab Hematol 2019; 41 Suppl 1:151-161. [PMID: 31069984 DOI: 10.1111/ijlh.13015] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2018] [Revised: 02/27/2019] [Accepted: 03/01/2019] [Indexed: 12/19/2022]
Abstract
Recurrent, inappropriate laboratory testing is a costly and wasteful use of healthcare resources. Recognizing this problem, the American Board of Internal Medicine, Canadian Society of Internal Medicine, and the Canadian Association of Pathologist all supported the Choosing Wisely campaign to reduce laboratory investigations in patients who demonstrate clinical and laboratory stability. In this narrative, we review studies looking at a variety of approaches to reduce excessive testing including education, audit and feedback, computerized physician order entry system changes, and forcing functions. Each type of intervention has its own unique advantages and disadvantages, varying in complexity, disruptiveness, effectiveness, and sustainability. Before implementing any quality improvement project, it is important to analyze the local context to identify the root causes for the practice behavior and aim to use the minimal amount of intervention to achieve the desired result. Change is often incremental and will seldom occur with a single intervention or Plan-Do-Study-Act cycle. Garnering the support of opinion leaders and a quality improvement team will help make the process and intervention a success.
Collapse
Affiliation(s)
- Rochelle Jalbert
- Division of Hematology, Department of Medicine, Schulich School of Medicine, Western University, London, Ontario, Canada
| | - Alan Gob
- Division of Hematology, Department of Medicine, Schulich School of Medicine, Western University, London, Ontario, Canada
| | - Ian Chin-Yee
- Division of Hematology, Department of Medicine, Schulich School of Medicine, Western University, London, Ontario, Canada.,Department of Pathology and Laboratory Medicine, Schulich School of Medicine, Western University, London, Ontario, Canada
| |
Collapse
|
22
|
Abstract
Laboratory tests are an integral part of the electronic health record (EHR). Providing clinical decision support (CDS) for the ordering, collection, reporting, viewing, and interpretation of laboratory testing is a fundamental function of the EHR. The implementation of a sustainable, effective laboratory CDS program requires a commitment to standardization and harmonization of the laboratory dictionaries that are the foundation of laboratory-based CDS. In this review, the authors provide an overview of the tools available within the EHR to improve decision making throughout the entire laboratory testing process, from test order to clinical action.
Collapse
Affiliation(s)
- Joseph W Rudolf
- Department of Laboratory Medicine and Pathology, University of Minnesota Medical School, 420 Delaware Street Southeast, MMC 609 Mayo, Minneapolis, MN 55455, USA
| | - Anand S Dighe
- Department of Pathology, Massachusetts General Hospital, Harvard Medical School, 55 Fruit Street, Boston, MA 02114-2696, USA.
| |
Collapse
|
23
|
AI-Driven Pathology Laboratory Utilization Management via Data- and Knowledge-Based Analytics. Artif Intell Med 2019. [DOI: 10.1007/978-3-030-21642-9_30] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
24
|
Ryskina K, Jessica Dine C, Gitelman Y, Leri D, Patel M, Kurtzman G, Lin LY, Epstein AJ. Effect of Social Comparison Feedback on Laboratory Test Ordering for Hospitalized Patients: A Randomized Controlled Trial. J Gen Intern Med 2018; 33:1639-1645. [PMID: 29790072 PMCID: PMC6153251 DOI: 10.1007/s11606-018-4482-y] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/05/2017] [Revised: 02/14/2018] [Accepted: 05/04/2018] [Indexed: 10/16/2022]
Abstract
BACKGROUND Social comparison feedback is an increasingly popular strategy that uses performance report cards to modify physician behavior. Our objective was to test the effect of such feedback on the ordering of routine laboratory tests for hospitalized patients, a practice considered overused. METHODS This was a single-blinded randomized controlled trial. Between January and June 2016, physicians on six general medicine teams at the Hospital of the University of Pennsylvania were cluster randomized with equal allocation to two arms: (1) those e-mailed a summary of their routine laboratory test ordering vs. the service average for the prior week, linked to a continuously updated personalized dashboard containing patient-level details, and snapshot of the dashboard and (2) those who did not receive the intervention. The primary outcome was the count of routine laboratory test orders placed by a physician per patient-day. We modeled the count of orders by each physician per patient-day after the intervention as a function of trial arm and the physician's order count before the intervention. The count outcome was modeled using negative binomial models with adjustment for clustering within teams. RESULTS One hundred and fourteen interns and residents participated. We did not observe a statistically significant difference in adjusted reduction in routine laboratory ordering between the intervention and control physicians (physicians in the intervention group ordered 0.14 fewer tests per patient-day than physicians in the control group, 95% CI - 0.56 to 0.27, p = 0.50). Physicians whose absolute ordering rate deviated from the peer rate by more than 1.0 laboratory test per patient-day reduced their laboratory ordering by 0.80 orders per patient-day (95% CI - 1.58 to - 0.02, p = 0.04). CONCLUSIONS Personalized social comparison feedback on routine laboratory ordering did not change targeted behavior among physicians, although there was a significant decrease in orders among participants who deviated more from the peer rate. TRIAL REGISTRATION Clinicaltrials.gov registration: #NCT02330289.
Collapse
Affiliation(s)
- Kira Ryskina
- Division of General Internal Medicine, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA.
- Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, USA.
| | - C Jessica Dine
- Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, USA
- Division of Pulmonary and Critical Care, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| | - Yevgeniy Gitelman
- Penn Medicine Center for Health Care Innovation, Philadelphia, PA, USA
- Corporal Michael J. Crescenz VA Medical Center, Philadelphia, PA, USA
| | - Damien Leri
- Penn Medicine Center for Health Care Innovation, Philadelphia, PA, USA
| | - Mitesh Patel
- Division of General Internal Medicine, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
- Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, USA
- Penn Medicine Center for Health Care Innovation, Philadelphia, PA, USA
- Corporal Michael J. Crescenz VA Medical Center, Philadelphia, PA, USA
| | - Gregory Kurtzman
- Division of General Internal Medicine, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| | - Lisa Y Lin
- Division of General Internal Medicine, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
| | - Andrew J Epstein
- Division of General Internal Medicine, Department of Medicine, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA, USA
- Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, USA
- Corporal Michael J. Crescenz VA Medical Center, Philadelphia, PA, USA
| |
Collapse
|
25
|
Bindraban RS, Ten Berg MJ, Naaktgeboren CA, Kramer MHH, Van Solinge WW, Nanayakkara PWB. Reducing Test Utilization in Hospital Settings: A Narrative Review. Ann Lab Med 2018; 38:402-412. [PMID: 29797809 PMCID: PMC5973913 DOI: 10.3343/alm.2018.38.5.402] [Citation(s) in RCA: 45] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2017] [Revised: 01/23/2018] [Accepted: 05/06/2018] [Indexed: 11/19/2022] Open
Abstract
Background Studies addressing the appropriateness of laboratory testing have revealed approximately 20% overutilization. We conducted a narrative review to (1) describe current interventions aimed at reducing unnecessary laboratory testing, specifically in hospital settings, and (2) provide estimates of their efficacy in reducing test order volume and improving patient-related clinical outcomes. Methods The PubMed, Embase, Scopus, Web of Science, and Canadian Agency for Drugs and Technologies in Health-Health Technology Assessment databases were searched for studies describing the effects of interventions aimed at reducing unnecessary laboratory tests. Data on test order volume and clinical outcomes were extracted by one reviewer, while uncertainties were discussed with two other reviewers. Because of the heterogeneity of interventions and outcomes, no meta-analysis was performed. Results Eighty-four studies were included. Interventions were categorized into educational, (computerized) provider order entry [(C)POE], audit and feedback, or other interventions. Nearly all studies reported a reduction in test order volume. Only 15 assessed sustainability up to two years. Patient-related clinical outcomes were reported in 45 studies, two of which found negative effects. Conclusions Interventions from all categories have the potential to reduce unnecessary laboratory testing, although long-term sustainability is questionable. Owing to the heterogeneity of the interventions studied, it is difficult to conclude which approach was most successful, and for which tests. Most studies had methodological limitations, such as the absence of a control arm. Therefore, well-designed, controlled trials using clearly described interventions and relevant clinical outcomes are needed.
Collapse
Affiliation(s)
- Renuka S Bindraban
- Departments of Clinical Chemistry and Haematology, University Medical Center Utrecht, Utrecht, The Netherlands.,Section Acute Medicine, Department of Internal Medicine, VU University Medical Center, Amsterdam, The Netherlands
| | - Maarten J Ten Berg
- Departments of Clinical Chemistry and Haematology, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Christiana A Naaktgeboren
- Departments of Clinical Chemistry and Haematology, University Medical Center Utrecht, Utrecht, The Netherlands.,Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Mark H H Kramer
- Section Acute Medicine, Department of Internal Medicine, VU University Medical Center, Amsterdam, The Netherlands
| | - Wouter W Van Solinge
- Departments of Clinical Chemistry and Haematology, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Prabath W B Nanayakkara
- Section Acute Medicine, Department of Internal Medicine, VU University Medical Center, Amsterdam, The Netherlands.
| |
Collapse
|
26
|
Lane AB, Robinson SL, Maddy NCE, Shimeall WT, Sadowski BW. Optimizing Order Entry Automaticity Reduces Inpatient Laboratory Utilization. Am J Med 2018; 131:908-912. [PMID: 29730355 DOI: 10.1016/j.amjmed.2018.04.016] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/14/2017] [Revised: 04/17/2018] [Accepted: 04/18/2018] [Indexed: 11/18/2022]
Affiliation(s)
- Alison B Lane
- Division of Internal Medicine, Department of Medicine, Walter Reed National Military Medical Center, Bethesda, Md; Division of Infectious Diseases, Department of Medicine, Walter Reed National Military Medical Center, Bethesda, Md.
| | - Sara L Robinson
- Division of Internal Medicine, Department of Medicine, Walter Reed National Military Medical Center, Bethesda, Md
| | - Nora C E Maddy
- Division of Internal Medicine, Department of Medicine, Walter Reed National Military Medical Center, Bethesda, Md
| | - William T Shimeall
- Division of Internal Medicine, Department of Medicine, Walter Reed National Military Medical Center, Bethesda, Md
| | - Brett W Sadowski
- Division of Internal Medicine, Department of Medicine, Walter Reed National Military Medical Center, Bethesda, Md; Division of Gastroenterology, Department of Medicine, Walter Reed National Military Medical Center, Bethesda, Md
| |
Collapse
|
27
|
Tsega S, O'Connor M, Poeran J, Iberti C, Cho HJ. Bedside Assessment of the Necessity of Daily Lab Testing for Patients Nearing Discharge. J Hosp Med 2018; 13:38-40. [PMID: 29073318 DOI: 10.12788/jhm.2869] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
As part of the Choosing Wisely® campaign, the Society of Hospital Medicine recommends against performing "repetitive complete blood count chemistry testing in the face of clinical and lab stability." With this recommendation as a framework, we targeted 2 hospitalist-run inpatient medicine units that employed bedside, scripted, interdisciplinary rounds. Our multifaceted intervention included prompting the hospitalist to identify clinically stable patients for next-day discharge and to discontinue labs when appropriate. It was coupled with the education of the clinicians and a regular data review for the hospitalists and unit staff. Among 2877 discharges included in a 1-year period, there was a significantly decreasing trend after the intervention in the percentage of patients getting labs in the 24, 48, and 72 hours before discharge (-1.87%, -1.47%, and -0.74% decrease per month, respectively; P < 0.05). Our structured, multifaceted approach effectively reduced daily lab testing in the 24 to 48 hours prior to discharge.
Collapse
Affiliation(s)
- Surafel Tsega
- Department of Medicine, Mount Sinai Hospital, New York, New York, USA.
| | | | - Jashvant Poeran
- Department of Medicine, Mount Sinai Hospital, New York, New York, USA
- Institute for Healthcare Delivery Science, Department of Population Health Science & Policy, New York, New York, USA
| | - Colin Iberti
- Department of Medicine, Mount Sinai Hospital, New York, New York, USA
| | - Hyung J Cho
- Department of Medicine, Mount Sinai Hospital, New York, New York, USA
| |
Collapse
|
28
|
Sedrak MS, Myers JS, Small DS, Nachamkin I, Ziemba JB, Murray D, Kurtzman GW, Zhu J, Wang W, Mincarelli D, Danoski D, Wells BP, Berns JS, Brennan PJ, Hanson CW, Dine CJ, Patel MS. Effect of a Price Transparency Intervention in the Electronic Health Record on Clinician Ordering of Inpatient Laboratory Tests: The PRICE Randomized Clinical Trial. JAMA Intern Med 2017; 177:939-945. [PMID: 28430829 PMCID: PMC5543323 DOI: 10.1001/jamainternmed.2017.1144] [Citation(s) in RCA: 56] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
IMPORTANCE Many health systems are considering increasing price transparency at the time of order entry. However, evidence of its impact on clinician ordering behavior is inconsistent and limited to single-site evaluations of shorter duration. OBJECTIVE To test the effect of displaying Medicare allowable fees for inpatient laboratory tests on clinician ordering behavior over 1 year. DESIGN, SETTING, AND PARTICIPANTS The Pragmatic Randomized Introduction of Cost data through the electronic health record (PRICE) trial was a randomized clinical trial comparing a 1-year intervention to a 1-year preintervention period, and adjusting for time trends and patient characteristics. The trial took place at 3 hospitals in Philadelphia between April 2014 and April 2016 and included 98 529 patients comprising 142 921 hospital admissions. INTERVENTIONS Inpatient laboratory test groups were randomly assigned to display Medicare allowable fees (30 in intervention) or not (30 in control) in the electronic health record. MAIN OUTCOMES AND MEASURES Primary outcome was the number of tests ordered per patient-day. Secondary outcomes were tests performed per patient-day and Medicare associated fees. RESULTS The sample included 142 921 hospital admissions representing patients who were 51.9% white (74 165), 38.9% black (55 526), and 56.9% female (81 291) with a mean (SD) age of 54.7 (19.0) years. Preintervention trends of order rates among the intervention and control groups were similar. In adjusted analyses of the intervention group compared with the control group over time, there were no significant changes in overall test ordering behavior (0.05 tests ordered per patient-day; 95% CI, -0.002 to 0.09; P = .06) or associated fees ($0.24 per patient-day; 95% CI, -$0.42 to $0.91; P = .47). Exploratory subset analyses found small but significant differences in tests ordered per patient-day based on patient intensive care unit (ICU) stay (patients with ICU stay: -0.16; 95% CI, -0.31 to -0.01; P = .04; patients without ICU stay: 0.13; 95% CI, 0.08-0.17; P < .001) and the magnitude of associated fees (top quartile of tests based on fee value: -0.01; 95% CI, -0.02 to -0.01; P = .04; bottom quartile: 0.03; 95% CI, 0.002-0.06; P = .04). Adjusted analyses of tests that were performed found a small but significant overall increase in the intervention group relative to the control group over time (0.08 tests performed per patient day, 95% CI, 0.03-0.12; P < .001). CONCLUSIONS AND RELEVANCE Displaying Medicare allowable fees for inpatient laboratory tests did not lead to a significant change in overall clinician ordering behavior or associated fees. TRIAL REGISTRATION clinicaltrials.gov Identifier: NCT02355496.
Collapse
Affiliation(s)
- Mina S Sedrak
- City of Hope Comprehensive Cancer Center, Duarte, California
| | - Jennifer S Myers
- Center for Healthcare Improvement & Patient Safety, University of Pennsylvania Health System, Philadelphia3University of Pennsylvania Health System, Philadelphia4Perelman School of Medicine, University of Pennsylvania, Philadelphia
| | - Dylan S Small
- The Wharton School, University of Pennsylvania, Philadelphia
| | - Irving Nachamkin
- University of Pennsylvania Health System, Philadelphia4Perelman School of Medicine, University of Pennsylvania, Philadelphia
| | - Justin B Ziemba
- Brady Urological Institute, Johns Hopkins School of Medicine, Baltimore, Maryland
| | - Dana Murray
- University of Pennsylvania Health System, Philadelphia
| | - Gregory W Kurtzman
- Perelman School of Medicine, University of Pennsylvania, Philadelphia 7The Penn Medicine Nudge Unit, University of Pennsylvania Health System, Philadelphia
| | - Jingsan Zhu
- Perelman School of Medicine, University of Pennsylvania, Philadelphia
| | - Wenli Wang
- Perelman School of Medicine, University of Pennsylvania, Philadelphia
| | | | | | - Brian P Wells
- University of Pennsylvania Health System, Philadelphia
| | - Jeffrey S Berns
- University of Pennsylvania Health System, Philadelphia4Perelman School of Medicine, University of Pennsylvania, Philadelphia
| | - Patrick J Brennan
- University of Pennsylvania Health System, Philadelphia4Perelman School of Medicine, University of Pennsylvania, Philadelphia
| | - C William Hanson
- University of Pennsylvania Health System, Philadelphia4Perelman School of Medicine, University of Pennsylvania, Philadelphia
| | - C Jessica Dine
- University of Pennsylvania Health System, Philadelphia4Perelman School of Medicine, University of Pennsylvania, Philadelphia
| | - Mitesh S Patel
- University of Pennsylvania Health System, Philadelphia4Perelman School of Medicine, University of Pennsylvania, Philadelphia 5The Wharton School, University of Pennsylvania, Philadelphia 7The Penn Medicine Nudge Unit, University of Pennsylvania Health System, Philadelphia 8Crescenz Veterans Affairs Medical Center, Philadelphia, Pennsylvania
| |
Collapse
|