Provider Perspectives on the Use of Evidence-based Risk Stratification Tools in the Evaluation of Pulmonary Embolism: A Qualitative Study

Sex differences in guideline-consistent diagnostic testing for acute pulmonary embolism among adult emergency department patients aged 18-49

BACKGROUND

Pulmonary embolism (PE) is a frequent diagnostic consideration in emergency department (ED) patients, yet diagnosis is challenging because symptoms of PE are nonspecific. Guidelines recommend the use of clinical decision tools to increase efficiency and avoid harms from overtesting, including D-dimer screening in patients not at high risk for PE. Women undergo testing for PE more often than men yet have a lower yield from testing. Our study objective was to determine whether patient sex influenced the odds of received guideline-consistent care.

METHODS

We performed a retrospective cohort study at two large U.S. academic EDs from January 1, 2016, to December 31, 2018. Nonpregnant patients aged 18-49 years were included if they presented with chest pain, shortness of breath, hemoptysis, or syncope and underwent testing for PE with D-dimer or imaging. Demographic and clinical data were exported from the electronic medical record (EMR). Pretest risk scores were calculated using manually abstracted EMR data. Diagnostic testing was then compared with recommended testing based on pretest risk. The primary outcome was receipt of guideline-consistent care, which required an elevated screening D-dimer prior to imaging in all non-high-risk patients.

RESULTS

We studied 1991 discrete patient encounters; 37% (735) of patients were male and 63% (1256) were female. Baseline characteristics, including revised Geneva scores, were similar between sexes. Female patients were more likely to receive guideline-consistent care (70% [874/1256] female vs. 63% [463/735] male, p < 0.01) and less likely to be diagnosed with PE (3.1% [39/1256] female vs. 5.3% [39/735] male, p < 0.05). The most common guideline deviation in both sexes was obtaining imaging without a screening D-dimer in a non-high-risk patient (75% [287/382] female vs. 75% [205/272] male).

CONCLUSIONS

In this cohort, females were more likely than males to receive care consistent with current guidelines and less likely to be diagnosed with PE.

Identifying barriers and facilitators to successful implementation of computerized clinical decision support systems in hospitals: a NASSS framework-informed scoping review

BACKGROUND

Successful implementation and utilization of Computerized Clinical Decision Support Systems (CDSS) in hospitals is complex and challenging. Implementation science, and in particular the Nonadoption, Abandonment, Scale-up, Spread and Sustainability (NASSS) framework, may offer a systematic approach for identifying and addressing these challenges. This review aimed to identify, categorize, and describe barriers and facilitators to CDSS implementation in hospital settings and map them to the NASSS framework. Exploring the applicability of the NASSS framework to CDSS implementation was a secondary aim.

METHODS

Electronic database searches were conducted (21 July 2020; updated 5 April 2022) in Ovid MEDLINE, Embase, Scopus, PyscInfo, and CINAHL. Original research studies reporting on measured or perceived barriers and/or facilitators to implementation and adoption of CDSS in hospital settings, or attitudes of healthcare professionals towards CDSS were included. Articles with a primary focus on CDSS development were excluded. No language or date restrictions were applied. We used qualitative content analysis to identify determinants and organize them into higher-order themes, which were then reflexively mapped to the NASSS framework.

RESULTS

Forty-four publications were included. These comprised a range of study designs, geographic locations, participants, technology types, CDSS functions, and clinical contexts of implementation. A total of 227 individual barriers and 130 individual facilitators were identified across the included studies. The most commonly reported influences on implementation were fit of CDSS with workflows (19 studies), the usefulness of the CDSS output in practice (17 studies), CDSS technical dependencies and design (16 studies), trust of users in the CDSS input data and evidence base (15 studies), and the contextual fit of the CDSS with the user's role or clinical setting (14 studies). Most determinants could be appropriately categorized into domains of the NASSS framework with barriers and facilitators in the "Technology," "Organization," and "Adopters" domains most frequently reported. No determinants were assigned to the "Embedding and Adaptation Over Time" domain.

CONCLUSIONS

This review identified the most common determinants which could be targeted for modification to either remove barriers or facilitate the adoption and use of CDSS within hospitals. Greater adoption of implementation theory should be encouraged to support CDSS implementation.

Developing Implementation Strategies to Support the Uptake of a Risk Tool to Aid Physicians in the Clinical Management of Patients With Syncope: Systematic Theoretical and User-Centered Design Approach

BACKGROUND

The Canadian Syncope Risk Score (CSRS) was developed to improve syncope management in emergency department settings. Evidence-based tools often fail to have the intended impact because of suboptimal uptake or poor implementation.

OBJECTIVE

In this paper, we aimed to describe the process of developing evidence-based implementation strategies to support the deployment and use of the CSRS in real-world emergency department settings to improve syncope management among physicians.

METHODS

We followed a systematic approach for intervention development, including identifying who needs to do what differently, identifying the barriers and enablers to be addressed, and identifying the intervention components and modes of delivery to overcome the identified barriers. We used the Behaviour Change Wheel to guide the selection of implementation strategies. We engaged CSRS end users (ie, emergency medicine physicians) in a user-centered design approach to generate and refine strategies. This was achieved over a series of 3 qualitative user-centered design workshops lasting 90 minutes each with 3 groups of emergency medicine physicians.

RESULTS

A total of 14 physicians participated in the workshops. The themes were organized according to the following intervention development steps: theme 1-identifying and refining barriers and theme 2-identifying the intervention components and modes of delivery. Theme 2 was subdivided into two subthemes: (1) generating high-level strategies and developing strategies prototypes and (2) refining and testing strategies. The main strategies identified to overcome barriers included education in the format of meetings, videos, journal clubs, and posters (to address uncertainty around when and how to apply the CSRS); the development of a web-based calculator and integration into the electronic medical record (to address uncertainty in how to apply the CSRS); a local champion (to address the lack of team buy-in); and the dissemination of evidence summaries and feedback through email communications (to address a lack of evidence about impact).

CONCLUSIONS

The ability of the CSRS to effectively improve patient safety and syncope management relies on broad buy-in and uptake across physicians. To ensure that the CSRS is well positioned for impact, a comprehensive suite of strategies was identified to address known barriers.

Use of predictive scales for pulmonary thromboembolism in an emergency department

BACKGROUND AND OBJECTIVE

Diagnosing pulmonary thromboembolism (PTE) is difficult. Clinical probability scales (CPS) can help. The aim is to find out which one is the best.

PATIENTS AND METHODS

A retrospective cross-sectional single-center study was conducted. It evaluated four CPS (Pulmonary Embolism Rule Out Criteria [PERC], Wells, Geneva, and YEARS criteria) validity in 200 patients who underwent computerized tomography angiography of the pulmonary arteries. Their degree of use was estimated, as well as the possible correlation between them and DD (D dimer).

RESULTS

The four CPS have a high sensitivity, close to 1 and without differences between them. The YEARS scale is between 2 and 4 times more specific than the others. The degree of use of the scales was estimated at 14% (95% CI: 9.19-18.81). A weak positive correlation was found between the scores on the Wells and Geneva scales and the DD.

CONCLUSIONS

The YEARS scale is shown to be better than the others due to its potential greater number of imaging tests avoided and the degree of application of the CPS could be improved.

Patient values and preferences in pulmonary embolism testing in the emergency department

INTRODUCTION

Patient-centered care is concordant with patient values and preferences. There is a lack of research on patient values and preferences for pulmonary embolism (PE) testing in the emergency department (ED), and a poor physician understanding of patient-specific goals. Our aim was to map patient-specific values, preferences, and expectations regarding PE testing in the ED.

METHOD

This qualitative study used constructivist grounded theory to identify patient values and expectations around PE testing in the ED. We conducted semi-structured interviews with ED patients who were being tested for PE in two EDs. Patients who were waiting for PE imaging or D-dimer results were approached and consented to take part in a 30-minute audio-recorded interview. Each interview was transcribed verbatim and analyzed using constant comparative coding. The interview script was modified to maximize information on emerging themes. Major themes and subthemes were derived, each representing an opportunity, barrier, or value to address with patient-centered PE testing.

RESULTS

From 30 patient interviews, we mapped four major themes: patient satisfaction comes from addressing the patient's primary concern (for example, their pain); patients expect individualized care; patients prefer imaging over clinical examination for PE testing; and patients expect 100% confidence from their emergency physician when given a diagnosis. Subthemes included symptomatic relief, finding a diagnosis, receiving tests, rapid progression through their care, perception of highly accurate CT scans, willingness to seek a second opinion, direct physician communication, and expectation of case-specific testing with cognitive reassurance.

CONCLUSION

Addressing each of these four themes by realigning ED processes could provide patient-centered PE testing.

Ways to improve guideline adherence in the emergency department: an interview study on the management of traumatic brain injuries

PURPOSE

The aim was to explore factors affecting guideline adherence among doctors in the emergency department and to explore the general perception about local guidelines for traumatic brain injuries.

METHODS

Thirty semi-structured interviews were conducted with doctors with experience working in the emergency department regarding different aspects of guideline use, with emphasis on the management of traumatic brain injuries. Twenty-eight interviews were included for analysis. The interviews were recorded, transcribed, and analysed iteratively. Emergent codes were identified and organised into themes and subthemes.

RESULTS

Eight themes were identified. Barriers were centred on low availability of local guidelines and guideline document design. Facilitating factors included a concise document, appropriate visual aids, high accessibility, and encouragement by management and senior peers. The local guidelines on traumatic brain injuries were regarded as distinct, but it was occasionally difficult to determine when they were applicable. Mandatory admission of patients on anticoagulants was sometimes perceived as excessive. Biomarker S100b was believed to sometimes lead to delayed care.

CONCLUSION

The participants believed that guideline adherence would increase by facilitating guideline availability, by providing concise, easy-to-understand, and well-illustrated guidelines available in printed form, as well as establishing a culture that promotes guideline use. The local guidelines for traumatic brain injuries were appreciated, but could be improved.

Clinicians' perspectives on the implementation of patient decision aids in the emergency department: A qualitative interview study

OBJECTIVE

Decision aids (DAs) are tools to facilitate and standardize shared decision making (SDM). Although most emergency clinicians (ECs) perceive SDM appropriate for emergency care, there is limited uptake of DAs in clinical practice. The objective of this study was to explore barriers and facilitators identified by ECs regarding the implementation of DAs in the emergency department (ED).

METHODS

We conducted a qualitative interview study guided by implementation science frameworks. ECs participated in interviews focused on the implementation of DAs for the disposition of patients with low-risk chest pain and unexplained syncope in the ED. Interviews were recorded and transcribed verbatim. We then iteratively developed a codebook with directed qualitative content analysis.

RESULTS

We approached 25 ECs working in urban New York, of whom 20 agreed to be interviewed (mean age, 41 years; 25% women). The following 6 main barriers were identified: (1) poor DA accessibility, (2) concern for increased medicolegal risk, (3) lack of perceived need for a DA, (4) patient factors including lack of capacity and limited health literacy, (5) skepticism about validity of DAs, and (6) lack of time to use DAs. The 6 main facilitators identified were (1) positive attitudes toward SDM, (2) patient access to follow-up care, (3) potential for improved patient satisfaction, (4) potential for improved risk communication, (5) strategic integration of DAs into the clinical workflow, and (6) institutional support of DAs.

CONCLUSIONS

ECs identified multiple barriers and facilitators to the implementation of DAs into clinical practice. These findings could guide implementation efforts targeting the uptake of DA use in the ED.

A Prospective Evaluation of Clinical HEART Score Agreement, Accuracy, and Adherence in Emergency Department Chest Pain Patients

STUDY OBJECTIVE

The HEART score is a risk stratification aid that may safely reduce chest pain admissions for emergency department patients. However, differences in interpretation of subjective components potentially alters the performance of the score. We compared agreement between HEART scores determined during clinical practice with research-generated scores and estimated their accuracy in predicting 30-day major adverse cardiac events.

METHODS

We prospectively enrolled adult ED patients with symptoms concerning for acute coronary syndrome at a single tertiary center. ED clinicians submitted their clinical HEART scores during the patient encounter. Researchers then independently interviewed patients to generate a research HEART score. Patients were followed by phone and chart review for major adverse cardiac events. Weighted kappa; unweighted Cohen's kappa; prevalence-adjusted, bias-adjusted kappa (PABAK); and test probabilities were calculated.

RESULTS

From November 2016 to June 2019, 336 patients were enrolled, 261 (77.7%) were admitted, and 30 (8.9%) had major adverse cardiac events. Dichotomized HEART score agreement was 78% (kappa 0.48, 95% confidence interval [CI] 0.37 to 0.58; PABAK 0.57, 95% CI 0.48 to 0.65) with the lowest agreement in the history (72%; WK 0.14, 95% CI 0.06 to 0.22) and electrocardiogram (85%; WK 0.4, 95% CI 0.3 to 0.49) components. Compared with researchers, clinicians had 100% sensitivity (95% CI 88.4% to 100%) (versus 86.7%, 95% CI 69.3% to 96.2%) and 27.8% specificity (95% CI 22.8% to 33.2%) (versus 34.6%, 95% CI 29.3% to 40.3%) for major adverse cardiac events. Four participants with low research HEART scores had major adverse cardiac events.

CONCLUSION

ED clinicians had only moderate agreement with research HEART scores. Combined with uncertainties regarding accuracy in predicting major adverse cardiac events, we urge caution in the widespread use of the HEART score as the sole determinant of ED disposition.

Crucial considerations: Sex differences in the epidemiology, diagnosis, treatment, and outcomes of acute pulmonary embolism in non-pregnant adult patients

Acute pulmonary embolism (PE) affects over 600,000 Americans per year and is a common diagnostic consideration among emergency department patients. Although there are well-documented differences in the diagnosis, treatment, and outcomes of cardiovascular conditions, such as ischemic heart disease and stroke, the influence of sex and gender on PE remains poorly understood. The overall age-adjusted incidence of PE is similar in women and men, but women have higher relative rates of PE during early and mid-adulthood (ages 20-40 years); whereas, men have higher rates of PE after age 60 years. Women are tested for PE at far higher rates than men, yet women who undergo computed tomography pulmonary angiography are ultimately diagnosed with PE 35%-55% less often than men. Among those diagnosed with PE, women are more likely to have severe clinical features, such as hypotension and signs of right ventricular dysfunction. When controlled for PE severity, women are less likely to receive reperfusion therapies, such as thrombolysis. Finally, women have more bleeding complications for all types of anticoagulation. Further investigation of possible sex-specific diagnostic and treatment algorithms is necessary in order to more accurately detect and treat acute PE in non-pregnant adults.

Physician choices in pulmonary embolism testing

BACKGROUND

Evidence-based guidelines advise excluding pulmonary embolism (PE) diagnosis using d-dimer in patients with a lower probability of PE. Emergency physicians frequently order computed tomography (CT) pulmonary angiography without d-dimer testing or when d-dimer is negative, which exposes patients to more risk than benefit. Our objective was to develop a conceptual framework explaining emergency physicians' test choices for PE.

METHODS

We conducted a qualitative study using in-depth interviews of emergency physicians in Canada. A nonmedical researcher conducted in-person interviews. Participants described how they would test simulated patients with symptoms of possible PE, answered a knowledge test and were interviewed on barriers to using evidence-based PE tests.

RESULTS

We interviewed 63 emergency physicians from 9 hospitals in 5 cities, across 3 provinces. We identified 8 domains: anxiety with PE, barriers to using the evidence (time, knowledge and patient), divergent views on evidence-based PE testing, inherent Wells score problems, the drive to obtain CT rather than to diagnose PE, gestalt estimation artificially inflating PE probability, subjective reasoning and cognitive biases supporting deviation from evidence-based tests and use of evidence-based testing to rule out PE in patients who are very unlikely to have PE. Choices for PE testing were influenced by the disease, environment, test qualities, physician and probability of PE.

INTERPRETATION

Analysis of structured interviews with emergency physicians provided a conceptual framework to explain how these physicians use tests for suspected PE. The data suggest 8 domains to address when implementing an evidence-based protocol to investigate PE.