Standardising practice in cardiology: reducing clinical variation and cost at Ochsner Health System

Identification and classification of principal features for analyzing unwarranted clinical variation

RATIONALE, AIMS, AND OBJECTIVE

Unwarranted clinical variation (UCV) is an undesirable aspect of a healthcare system, but analyzing for UCV can be difficult and time-consuming. No analytic feature guidelines currently exist to aid researchers. We performed a systematic review of UCV literature to identify and classify the features researchers have identified as necessary for the analysis of UCV.

METHODS

The literature search followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses. We looked for articles with the terms 'medical practice variation' and 'unwarranted clinical variation' from four databases: Medline, Web of Science, EMBASE and CINAHL. The search was performed on 24 March 2023. The articles selected were original research articles in the English language reporting on UCV analysis in adult populations. Most of the studies were retrospective cohort analyses. We excluded studies reporting geographic variation based on the Atlas of Variation or small-area analysis methods. We used ASReview Lab software to assist in identifying articles for abstract review. We also conducted subsequent reference searches of the primary articles to retrieve additional articles.

RESULTS

The search yielded 499 articles, and we reviewed 46. We identified 28 principal analytic features utilized to analyze for unwarranted variation, categorised under patient-related or local healthcare context factors. Within the patient-related factors, we identified three subcategories: patient sociodemographics, clinical characteristics, and preferences, and classified 17 features into seven subcategories. In the local context category, 11 features are classified under two subcategories. Examples are provided on the usage of each feature for analysis.

CONCLUSION

Twenty-eight analytic features have been identified, and a categorisation has been established showing the relationships between features. Identifying and classifying features provides guidelines for known confounders during analysis and reduces the steps required when performing UCV analysis; there is no longer a need for a UCV researcher to engage in time-consuming feature engineering activities.

A Randomized Controlled Study on Clinical Adherence to Evidence-Based Guidelines in the Management of Simulated Patients With Barrett's Esophagus and the Clinical Utility of a Tissue Systems Pathology Test: Results From Q-TAB

INTRODUCTION

Barrett's esophagus (BE) is a precursor to esophageal adenocarcinoma. Physicians infrequently adhere to guidelines for managing BE, leading to either reduced detection of dysplasia or inappropriate re-evaluation.

METHODS

We conducted a three-arm randomized controlled trial with 2 intervention arms to determine the impact of a tissue systems pathology (TSP-9) test on the adherence to evidence-based guidelines for simulated patients with BE. Intervention 1 received TSP-9 results, and intervention 2 had the option to order TSP-9 results. We collected data from 259 practicing gastroenterologists and gastrointestinal surgeons who evaluated and made management decisions for 3 types of simulated patients with BE: nondysplastic BE, indefinite for dysplasia, and low-grade dysplasia.

RESULTS

Intervention 1 was significantly more likely to correctly assess risk of progression to high-grade dysplasia/esophageal adenocarcinoma and offer treatment in accordance with US society guidelines compared with the control group (+6.9%, 95% confidence interval +1.4% to +12.3%). There was no significant difference in ordering guideline-recommended endoscopic eradication therapy. However, for cases requiring annual endoscopic surveillance, we found significant improvement in adherence for intervention 1, with a difference-in-difference of +18.5% ( P = 0.019). Intervention 2 ordered the TSP-9 test in 21.9% of their cases. Those who ordered the test performed similarly to intervention 1; those who did not, performed similarly to the control group.

DISCUSSION

The TSP-9 test optimized adherence to clinical guidelines for surveillance and treatment of both patients with BE at high and low risk of disease progression. Use of the TSP-9 test can enable physicians to make risk-aligned management decisions, leading to improved patient health outcomes.

Clinical utility of a novel test for assessing cardiovascular disease risk in type 2 diabetes: a randomized controlled trial

BACKGROUND

The risk for and treatment of cardiovascular disease (CVD) in type 2 diabetes (T2DM) is often incorrect and delayed. We wished to determine if a novel test improved physicians' ability to risk stratify, diagnose, and treat patients with T2DM.

METHODS

In a 2-phase randomized controlled trial comparing the clinical workup, diagnosis, and management of online, simulated patients with T2DM in a nationwide sample of cardiologists and primary care physicians, participants were randomly assigned to control or one of two intervention groups. Intervention participants had access to standard of care diagnostic tools plus a novel diagnostic CVD risk stratification test.

RESULTS

In control, there was no change in CV risk stratification of simulated patients between baseline and round 2 (37.1 to 38.3%, p = 0.778). Pre-post analysis showed significant improvements in risk stratification in both Intervention 1 (38.7 to 65.3%) and Intervention 2 (41.9 to 65.8%) (p < 0.01) compared to controls. Both intervention groups significantly increased prescribing SGLT2 inhibitors/GLP1 receptor agonists versus control, + 18.9% for Intervention 1 (p = 0.020) and 1 + 9.4% for Intervention 2 (p = 0.014). Non-pharmacologic treatment improved significantly compared to control (+ 30.0% in Intervention 1 (p < 0.001) and + 22.8% in Intervention 2 (p = 0.001). Finally, monitoring HgbA1C, blood pressure, and follow-up visit frequency improved by + 20.3% (p = 0.004) in Intervention 1 and + 29.8% (p < 0.001) in Intervention 2 compared with control.

CONCLUSION

Use of the novel test significantly improved CV risk stratification among T2DM patients. Statistically significant increases treatments were demonstrated, specifically SGLT2 inhibitors and GLP1 receptor antagonists and recommendations of evidence-based non-pharmacologic treatments. Trial registration ClinicalTrials.gov, NCT05237271.

Measuring and Improving Evidence-Based Patient Care Using a Web-Based Gamified Approach in Primary Care (QualityIQ): Randomized Controlled Trial

BACKGROUND

Unwarranted variability in clinical practice is a challenging problem in practice today, leading to poor outcomes for patients and low-value care for providers, payers, and patients.

OBJECTIVE

In this study, we introduced a novel tool, QualityIQ, and determined the extent to which it helps primary care physicians to align care decisions with the latest best practices included in the Merit-Based Incentive Payment System (MIPS).

METHODS

We developed the fully automated QualityIQ patient simulation platform with real-time evidence-based feedback and gamified peer benchmarking. Each case included workup, diagnosis, and management questions with explicit evidence-based scoring criteria. We recruited practicing primary care physicians across the United States into the study via the web and conducted a cross-sectional study of clinical decisions among a national sample of primary care physicians, randomized to continuing medical education (CME) and non-CME study arms. Physicians "cared" for 8 weekly cases that covered typical primary care scenarios. We measured participation rates, changes in quality scores (including MIPS scores), self-reported practice change, and physician satisfaction with the tool. The primary outcomes for this study were evidence-based care scores within each case, adherence to MIPS measures, and variation in clinical decision-making among the primary care providers caring for the same patient.

RESULTS

We found strong, scalable engagement with the tool, with 75% of participants (61 non-CME and 59 CME) completing at least 6 of 8 total cases. We saw significant improvement in evidence-based clinical decisions across multiple conditions, such as diabetes (+8.3%, P<.001) and osteoarthritis (+7.6%, P=.003) and with MIPS-related quality measures, such as diabetes eye examinations (+22%, P<.001), depression screening (+11%, P<.001), and asthma medications (+33%, P<.001). Although the CME availability did not increase enrollment in the study, participants who were offered CME credits were more likely to complete at least 6 of the 8 cases.

CONCLUSIONS

Although CME availability did not prove to be important, the short, clinically detailed case simulations with real-time feedback and gamified peer benchmarking did lead to significant improvements in evidence-based care decisions among all practicing physicians.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03800901; https://clinicaltrials.gov/ct2/show/NCT03800901.

A nationwide program to improve clinical care quality in the Kyrgyz Republic

Background

To assess baseline quality of care in the Kyrgyz Republic in 2019 and determine the effect of online simulated patients in changing doctors’ practice in three specific disease areas: non-communicable disease, neonatal/child health, and maternal health.

Methods

Over 2000 family health, pediatric, neonatology, therapy, and obstetric-gynecologic doctors from every rayon (district) hospital and at least one associated family health (Primary) care clinic participated. To adequately scale the project, the Ministry of Health used online simulated Clinical Performance and Value (CPV) vignettes. All doctors cared for the same set of patients in their clinical area. Over eight months in 2019, we gathered three rounds of CPV data in seven oblasts.

Results

Overall quality scores were highly variable at baseline (59.2% + 13.5%). After three rounds the average score increased 6.5% (P < 0.001). By the end of round three, the lowest scoring oblast was providing higher quality care compared to the highest scoring oblast in the initial round (64.2% in round 3 vs 62.4% in round 1), indicating greater adherence to the evidence base. Additionally, family health doctors ordered 26% fewer unnecessary tests (P < 0.05), while specialists ordered 39% fewer unnecessary tests (P < 0.05). If trends continue, this translates into a net annual savings of 63 million Kyrgyz som.

Conclusions

This study demonstrates serial measurement of care provided by over 2000 physicians in the Kyrgyz Republic can be improved as measured by CPVs. This project may be a useful template to improve health care quality at a national level in other low- and middle-income country settings.

Virtual Patient Simulation in Continuing Education: Improving the Use of Guideline-Directed Care in Venous Thromboembolism Treatment

Results of a CME-certified activity completed by a total of 986 cardiologists and 783 haematologists-oncologists (haem-oncs) from around the world were examined to determine whether virtual patient simulation could improve decision-making and performance within the simulation related to patient evaluation, tailoring anticoagulant therapy, and patient management to improve adherence using patient-centred care strategies. Results showed a significant overall impact of education from pre- to post-clinical guidance (CG) on correct decisions made in both cases for cardiologists, with a relative improvement of 22% for Case 1 (45% pre- to 55% post-CG, n = 475, t(474) = 14.12, P<.001, Cohen’s d =.46) and 19% for Case 2 (62% pre- to 74% post-CG, n = 245, t(244) = 11.95, P<.001, Cohen’s d =.59). Impact also was seen for haem-oncs, with a relative improvement of 27% for Case 1 (45% pre- to 57% post-CG, n = 280, t(279) = 11.91, P <.001, Cohen’s d =.60) and 19% for Case 2 (63% pre- to 75% post-CG, n = 147, t(146) = 9.52, P <.001, Cohen’s d =.58). Virtual patient simulation improved cardiologists’ and haem-oncs management of patients with pulmonary embolism in a simulated environment.

Novel quality improvement method to reduce cost while improving the quality of patient care: retrospective observational study

Background

Healthcare cost management strategies are limited in number and resource intensive. Budget constraints in the National Health Service Scotland (NHS Scotland) apply pressure on regional health boards to improve efficiency while preserving quality.

Methods

We developed a technical method to assist health systems to reduce operating costs, called continuous value management (CVM). Derived from lean accounting and employing quality improvement (QI) methods, the approach allows for management to reduce or repurpose resources to improve efficiency. The primary outcome measure was the cost per patient admitted to the ward in British pounds (£).

Interventions

The first step of CVM is developing a standard care model. Teams then track system performance weekly using a tool called the ‘box score’, and improve performance using QI methods with results displayed on a visual management board. A 29-bed inpatient respiratory ward in a mid-sized hospital in NHS Scotland pilot tested the method.

Results

We included 5806 patients between October 2016 and May 2018. During the 18-month pilot, the ward realised a 21.8% reduction in cost per patient admitted to the ward (from an initial average level of £807.70 to £631.50 as a new average applying Shewhart control chart rules, p<0.0001), and agency nursing spend decreased by 30.8%. The ward realised a 28.9% increase in the number of patients admitted to the ward per week. Other quality measures (eg, staff satisfaction) were sustained or improved.

Conclusion

CVM methods reduced the cost of care while improving quality. Most of the reduction came by way of reduced bank nursing spend. Work is under way to further test CVM and understand leadership behaviours supporting scale-up.

Reducing Unwarranted Oncology Care Variation Across a Clinically Integrated Network: A Collaborative Physician Engagement Strategy

PURPOSE:

Addressing unwarranted clinical variation in oncology is a high priority for health systems that aspire to ensure consistent levels of high-quality and cost-effective care. Efforts to improve clinical practice and standardize care have proven challenging. Advocate Physician Partners undertook a patient simulation-based practice measurement and feedback project that was focused on breast and lung cancer to engage oncologists in the care standardization process.

METHODS:

One hundred three medical oncologists cared for online simulated patients using the Clinical Performance and Value platform, receiving feedback on how their care decisions compared with evidence-based guidelines and their peers. We repeated this process every 4 months over six rounds, measuring changes in quality-of-care scores. We then compared simulated patient results with available patient-level claims data.

RESULTS:

Over the course of the project, overall quality-of-care scores improved 11.9% ( P < .001). Diagnostic accuracy increased 6.7% ( P < .001) and correlated with improved treatment scores, including a nearly 10-percentage point increase in evidence-based chemotherapy regimens ( P = .009) and a 56% increase in addressing palliative needs for patients with late-stage disease ( P < .001). Unnecessary test ordering declined 25% ( P < .001). We compared these results with available patient data and observed concordance with the metastatic imaging workup order rate for early-stage breast cancer. As unnecessary workups declined in the simulations and became more closely aligned with evidence-based guidelines, we saw similar rates of decline in the patient-level data.

CONCLUSION:

This study demonstrates that an oncology care standardization system that combines simulated patients with serial feedback increases evidence-based and cost-effective clinical decisions in patient simulations and patient-level data.

A Direct Comparison of the Clinical Practice Patterns of Advanced Practice Providers and Doctors

BACKGROUND

Rising health care costs, physician shortages, and an aging patient population have increased the demand and utilization of advanced practice providers (APPs). Despite their expanding role in care delivery, little research has evaluated the care delivered by APPs compared with physicians.

METHODS

We used clinical patient simulations to measure and compare the clinical care offered by APPs and physicians, collecting data from 4 distinct health care systems/hospitals in the United States between 2013 and 2017. Specialties ranged from primary care to hospital medicine and oncology. Primary study outcomes were to 1) measure any differences in practice patterns between APPs and physicians, and 2) determine whether the use of serial measurement and feedback could mitigate any such differences.

RESULTS

At baseline, we found no major differences in overall performance of APPs compared with physicians (P = .337). APPs performed 3.2% better in history taking (P = .013) and made 10.5% fewer unnecessary referrals (P = .025), whereas physicians ordered 17.6% fewer low-value tests per case (P = .042). Regardless of specialty or site, after 4 rounds of serial measurement and provider-specific feedback, APPs and physicians had similar increases in average overall scores-7.4% and 7.6%, respectively (P < .001 for both). Not only did both groups improve, but practice differences between the groups disappeared, leading to a 9.1% decrease in overall practice variation.

CONCLUSIONS

We found only modest differences in quality of care provided by APPs and physicians. Importantly, both groups improved their performance with serial measurement and feedback so that after 4 rounds, the original differences were mitigated entirely and overall variation significantly reduced. Our data suggest that APPs can provide high quality care in multiple clinical settings.