An Evaluation of Guideline-Discordant Ordering Behavior for CT Pulmonary Angiography in the Emergency Department

Efficacy and Impact of a Multimodal Intervention on CT Pulmonary Angiography Ordering Behavior in the Emergency Department

OBJECTIVE

To evaluate the efficacy of a multimodal intervention in reducing CT pulmonary angiography (CTPA) overutilization in the evaluation of suspected pulmonary embolism in the emergency department (ED).

METHODS

Previous mixed-methods analysis of barriers to guideline-concordant CTPA ordering results was used to develop a provider-focused behavioral intervention consisting of a clinical decision support tool and an audit and feedback system at a multisite, tertiary academic network. The primary outcome (guideline concordance) and secondary outcomes (yield and CTPA and D-dimer order rates) were compared using a pre- and postintervention design. ED encounters for adult patients from July 5, 2017, to January 3, 2019, were included. Fisher's exact tests and statistical process control charts were used to compare the pre- and postintervention groups for each outcome.

RESULTS

Of the 201,912 ED patient visits evaluated, 3,587 included CTPA. Guideline concordance increased significantly after the intervention, from 66.9% to 77.5% (P < .001). CTPA order rate and D-dimer order rate also increased significantly, from 17.1 to 18.4 per 1,000 patients (P = .035) and 30.6 to 37.3 per 1,000 patients (P < .001), respectively. Percent yield showed no significant change (12.3% pre- versus 10.8% postintervention; P = .173). Statistical process control analysis showed sustained special-cause variation in the postintervention period for guideline concordance and D-dimer order rates, temporary special-cause variation for CTPA order rates, and no special-cause variation for percent yield.

CONCLUSION

Our success in increasing guideline concordance demonstrates the efficacy of a mixed-methods, human-centered approach to behavior change. Given that neither of the secondary outcomes improved, our results may demonstrate potential limitations to the guidelines directing the ordering of CTPA studies and D-dimer ordering.

How Tasmanian Emergency Departments 'Choose Wisely' When Investigating Suspected Pulmonary Embolism

Overuse of computed tomography pulmonary angiograms (CTPAs) for diagnosis of pulmonary embolism (PE) has been recognised as an issue for over ten years, with Choosing Wisely Australia recommending that CTPAs only be ordered if indicated by a clinical practice guideline (CPG). This study aimed to explore the use of evidence-based practice within regional Tasmanian emergency departments in relation to CTPA orders by determining whether CTPAs were ordered in accordance with validated CPGs. We conducted a retrospective medical record review of all patients who underwent CTPA across all public emergency departments in Tasmania between 1 August 2018 and 31 December 2019 inclusive. Data from 2758 CTPAs across four emergency departments were included. PE was reported in 343 (12.4%) of CTPAs conducted, with yield ranging from 8.2% to 16.1% between the four sites. Overall, 52.1% of participants had neither a CPG documented, nor a D-dimer conducted before their scan. A CPG was documented before 11.8% of scans, while D-dimer was conducted before 43% of CTPAs. The findings presented in this study indicate that Tasmanian emergency departments are not consistently 'Choosing Wisely' when investigating PE. Further research is required to identify explanations for these findings.

Comparing ‘clinical hunch’ against clinical decision support systems (PERC rule, wells score, revised Geneva score and YEARS criteria) in the diagnosis of acute pulmonary embolism

Background

Pulmonary embolism (PE) is a common and potentially life-threatening condition. Since it is considered a ‘do not miss’ diagnosis, PE tends to be over-investigated beyond the evidence-based clinical decision support systems (CDSS), which in turn subjects patients to unnecessary radiation and contrast agent exposure with no apparent benefits in terms of outcome.

The purpose of this study was to evaluate the yield of ‘clinical hunch’ (gestalt) and four CDSS: the PERC Rule, Wells score, revised Geneva score, and Years criteria.

Methods

A review was conducted on the Electronic Medical Records (EMR) of 1566 patients from the Emergency Department at a tertiary teaching hospital who underwent CTPA from the 1st of January 2018 to the 31st of December 2019. The scores for the four CDSS were calculated retrospectively from the EMR data. We considered that a CTPA had been ordered on a clinical hunch when there was no mention of CDSS in the EMR, and no D-dimer test. A bypass of CDSS was confirmed when any step of the diagnostic algorithms was not followed.

Results

Of the total 1566 patients who underwent CTPA, 265 (17%) were positive for PE. The diagnosis yield from the five decision groups (clinical hunch and four CDSS) was as follows—clinical hunch, 15%; PERC rule, 18% (6% when bypassed); Wells score, 19% (11% when bypassed); revised Geneva score, 26% (13% when bypassed); and YEARS criteria, 18% (6% when bypassed).

Conclusion

Clinicians should trust the evidence-based clinical decision support systems in line with the international guidelines to diagnose PE.

Low-value pharmaceutical care among Dutch GPs: a retrospective cohort study

BACKGROUND

Low-value pharmaceutical care exists in general practice. However, the extent among Dutch GPs remains unknown.

AIM

To assess the prevalence of low-value pharmaceutical care among Dutch GPs.

DESIGN AND SETTING

Retrospective cohort study using data from patient records.

METHOD

The prevalence of three types of pharmaceutical care prescribed by GPs between 2016 and 2019 were examined: topical antibiotics for conjunctivitis, benzodiazepines for non-specific lower back pain, and chronic acid-reducing medication (ARM) prescriptions. Multilevel logistic regression analysis was performed to assess prescribing variation and the influence of patient characteristics on receiving a low-value prescription.

RESULTS

Large variation in prevalence as well as practice variation was observed among the types of low-value pharmaceutical GP care examined. Between 53% and 61% of patients received an inappropriate antibiotics prescription for conjunctivitis, around 3% of patients with lower back pain received an inappropriate benzodiazepine prescription, and 88% received an inappropriate chronic ARM prescription during the years examined. The odds of receiving an inappropriate antibiotic or benzodiazepine prescription increased with age (P<0.001), but decreased for chronic inappropriate ARM prescriptions (P<0.001). Sex affected only the odds of receiving a non-indicated chronic ARM, with males being at higher risk (P<0.001). The odds of receiving an inappropriate ARM increased with increasing neighbourhood socioeconomic status (P<0.05). Increasing practice size decreased the odds of inappropriate antibiotic and benzodiazepine prescriptions (P<0.001).

CONCLUSION

The results show that the prevalence of low-value pharmaceutical GP care varies among these three clinical problems. Significant variation in inappropriate prescribing exists between different types of pharmaceutical care - and GP practices.

Use of Computed Tomography Pulmonary Angiography in Emergency Departments: A Literature Review

Computed tomography pulmonary angiography (CTPA) has become the most widely used technique for diagnosis or exclusion of a pulmonary embolism (PE). It has been suggested that overuse of this imaging type may be prevalent, especially in emergency departments (EDs). The purpose of this literature review was to explore the use of CTPAs in EDs worldwide. A review following PRISMA guidelines was completed, with research published between September 2010 and August 2020 included. Five key topics emerged: use of CTPAs; explanations for overuse; use of D-dimer; variability in ordering practices between clinicians; and strategies to reduce overuse. This review found that CTPAs continue to be overused in EDs, leading to superfluous risks to patients. Published studies identify that while clinical practice guidelines (CPGs) have a strong effect on reducing unnecessary CTPAs with no significantly increased risk of missed diagnosis, the adoption of these tools by ED clinicians has remained low. This literature review highlights the need for further research into why CTPAs continue to be overused within EDs and why clinicians are hesitant to use CPGs in the clinical setting. Moreover, investigations into other potential strategies that may combat the overuse of this diagnostic tool are essential to reduce potential harm.

Barriers to the Use of Clinical Decision Support for the Evaluation of Pulmonary Embolism: Qualitative Interview Study

BACKGROUND

Clinicians often disregard potentially beneficial clinical decision support (CDS).

OBJECTIVE

In this study, we sought to explore the psychological and behavioral barriers to the use of a CDS tool.

METHODS

We conducted a qualitative study involving emergency medicine physicians and physician assistants. A semistructured interview guide was created based on the Capability, Opportunity, and Motivation-Behavior model. Interviews focused on the barriers to the use of a CDS tool built based on Wells' criteria for pulmonary embolism to assist clinicians in establishing pretest probability of pulmonary embolism before imaging.

RESULTS

Interviews were conducted with 12 clinicians. Six barriers were identified, including (1) Bayesian reasoning, (2) fear of missing a pulmonary embolism, (3) time pressure or cognitive load, (4) gestalt includes Wells' criteria, (5) missed risk factors, and (6) social pressure.

CONCLUSIONS

Clinicians highlighted several important psychological and behavioral barriers to CDS use. Addressing these barriers will be paramount in developing CDS that can meet its potential to transform clinical care.

Effectiveness of Clinical Decision Tools in Predicting Pulmonary Embolism

Objective

The Wells criteria and revised Geneva score are two commonly used clinical decision tools (CDTs) developed to assist physicians in determining when computed tomographic angiograms (CTAs) should be performed to evaluate the high index of suspicion for pulmonary embolism (PE). Studies have shown varied accuracy in these CDTs in identifying PE, and we sought to determine their accuracy within our patient population.

Methods

Patients admitted to the Emergency Department (ED) who received a CTA for suspected PE from 2019 Jun 1 to 2019 Aug 31 were identified. Two CDTSs, the Wells criteria and revised Geneva score, were calculated based on data available prior to CTA and using the common D-Dimer cutoff of >500 μg/L. We determined the association between confirmed PE and CDT values and determined the association between the D-Dimer result and PE.

Results

392 CTAs were identified with 48 (12.1%) positive PE cases. The Wells criteria and revised Geneva score were significantly associated with PE but failed to identify 12.5% and 70.4% of positive PE cases, respectively. Within our cohort, a D-Dimer cutoff of >300 μg/L was significantly associated with PE and captured 95.2% of PE cases.

Conclusions

Both CDTs were significantly associated with PE but failed to identify PE in a significant number of cases, particularly the revised Geneva score. Alternative D-Dimer cutoffs may provide better accuracy in identifying PE cases.

Physician choices in pulmonary embolism testing

BACKGROUND

Evidence-based guidelines advise excluding pulmonary embolism (PE) diagnosis using d-dimer in patients with a lower probability of PE. Emergency physicians frequently order computed tomography (CT) pulmonary angiography without d-dimer testing or when d-dimer is negative, which exposes patients to more risk than benefit. Our objective was to develop a conceptual framework explaining emergency physicians' test choices for PE.

METHODS

We conducted a qualitative study using in-depth interviews of emergency physicians in Canada. A nonmedical researcher conducted in-person interviews. Participants described how they would test simulated patients with symptoms of possible PE, answered a knowledge test and were interviewed on barriers to using evidence-based PE tests.

RESULTS

We interviewed 63 emergency physicians from 9 hospitals in 5 cities, across 3 provinces. We identified 8 domains: anxiety with PE, barriers to using the evidence (time, knowledge and patient), divergent views on evidence-based PE testing, inherent Wells score problems, the drive to obtain CT rather than to diagnose PE, gestalt estimation artificially inflating PE probability, subjective reasoning and cognitive biases supporting deviation from evidence-based tests and use of evidence-based testing to rule out PE in patients who are very unlikely to have PE. Choices for PE testing were influenced by the disease, environment, test qualities, physician and probability of PE.

INTERPRETATION

Analysis of structured interviews with emergency physicians provided a conceptual framework to explain how these physicians use tests for suspected PE. The data suggest 8 domains to address when implementing an evidence-based protocol to investigate PE.

Higher Imaging Yield When Clinical Decision Support Is Used

OBJECTIVE

Increased utilization of CT pulmonary angiography (CTPA) for the evaluation of pulmonary embolism has been associated with decreasing diagnostic yields and rising concerns about the harms of unnecessary testing. The objective of this study was to determine whether clinical decision support (CDS) use would be associated with increased imaging yields after controlling for selection bias.

METHODS

We performed a retrospective cohort study in the emergency departments of two tertiary care hospitals of all CTPAs performed between August 2015 and September 2018. Providers ordering a CTPA are routed to an optional CDS tool, which allows them to use Wells' Criteria for pulmonary embolism. After propensity score matching, CTPA yield was calculated for the CDS-use and CDS-dismissal groups and stratified by provider type.

RESULTS

A total of 7,367 CTPAs were ordered during the study period. Of those, providers used the CDS tool in 2,568 (35%) cases and did not use the tool in 4,799 (65%) of cases. After propensity score matching, CTPA yield was 11.99% in the CDS-use group and 8.70% in the CDS-dismissal group (P < .001). Attending physicians, residents, and physician assistant CDS users demonstrated a 56.5% (P = .006), 38.7% (P = .01), and 16.7% (P = .03) increased yield compared with those who dismissed the tool, respectively.

DISCUSSION

Diagnostic yield was 38% higher for CTPAs when the provider used the CDS tool, after controlling for selection bias. Yields were higher for every provider type. Further research is needed to discover successful strategies to increase provider use of these important tools.