An Introductory Guide to Artificial Intelligence in Interventional Radiology: Part 2: Implementation Considerations and Harms

The introduction of artificial intelligence (AI) in interventional radiology (IR) will bring about new challenges and opportunities for patients and clinicians. AI may comprise software as a medical device or AI-integrated hardware and will require a rigorous evaluation that should be guided based on the level of risk of the implementation. A hierarchy of risk of harm and possible harms are described herein. A checklist to guide deployment of an AI in a clinical IR environment is provided. As AI continues to evolve, regulation and evaluation of the AI medical devices will need to continue to evolve to keep pace and ensure patient safety.

An Exploration of the Interplay Between Well-being and Quality and Safety

PURPOSE

Quality improvement and patient safety (QIPS) and clinician well-being work are interconnected and impact each other. Well-being is of increased importance in the current state of workforce shortages and high levels of burnout. The Canadian Association of Emergency Physicians (CAEP) Academic Symposium sought to understand the interplay between QIPS and clinician well-being and to provide practical recommendations to clinicians and institutions on ensuring that clinician well-being is integrated into QIPS efforts.

METHODS

A team of emergency physicians with expertise in well-being and QIPS performed a literature review, drafted goals and recommendations, and presented at the CAEP Academic Symposium in 2023 for feedback. Goals and recommendations were then further refined.

RESULTS

Three goals and recommendations were developed as follows: QIPS leaders and practitioners must (1) understand the potential intersection of well-being and QIPS, (2) consider a well-being lens for all QIPS work, and (3) incorporate QIPS methodology in efforts to improve clinician well-being.

CONCLUSION

QIPS and clinician well-being are often closely linked. By incorporating these recommendations, QIPS strategies can enhance clinician well-being.

Transitions of care for older adults discharged home from the emergency department: an inductive thematic content analysis of patient comments

OBJECTIVE

Improving care transitions for older adults can reduce emergency department (ED) visits, adverse events, and empower community autonomy. We conducted an inductive qualitative content analysis to identify themes emerging from comments to better understand ED care transitions.

METHODS

The LEARNING WISDOM prospective longitudinal observational cohort includes older adults (≥ 65 years) who experienced a care transition after an ED visit from both before and during COVID-19. Their comments on this transition were collected via phone interview and transcribed. We conducted an inductive qualitative content analysis with randomly selected comments until saturation. Themes that arose from comments were coded and organized into frequencies and proportions. We followed the Standards for Reporting Qualitative Research (SRQR).

RESULTS

Comments from 690 patients (339 pre-COVID, 351 during COVID) composed of 351 women (50.9%) and 339 men (49.1%) were analyzed. Patients were satisfied with acute emergency care, and the proportion of patients with positive acute care experiences increased with the COVID-19 pandemic. Negative patient comments were most often related to communication between health providers across the care continuum and the professionalism of personnel in the ED. Comments concerning home care became more neutral with the COVID-19 pandemic.

CONCLUSION

Patients were satisfied overall with acute care but reported gaps in professionalism and follow-up communication between providers. Comments may have changed in tone from positive to neutral regarding home care over the COVID-19 pandemic due to service slowdowns. Addressing these concerns may improve the quality of care transitions and provide future pandemic mitigation strategies.

Missing occlusions: Quality gaps for ED patients with occlusion MI

BACKGROUND

ST-elevation Myocardial Infarction (STEMI) guidelines encourage monitoring of false positives (Code STEMI without culprit) but ignore false negatives (non-STEMI with occlusion myocardial infarction [OMI]). We evaluated the hospital course of emergency department (ED) patients with acute coronary syndrome (ACS) using STEMI vs OMI paradigms.

METHODS

This retrospective chart review examined all ACS patients admitted through two academic EDs, from June 2021 to May 2022, categorized as 1) OMI (acute culprit lesion with TIMI 0-2 flow, or acute culprit lesion with TIMI 3 flow and peak troponin I >10,000 ng/L; or, if no angiogram, peak troponin >10,000 ng/L with new regional wall motion abnormality), 2) NOMI (Non-OMI, i.e. MI without OMI) or 3) MIRO (MI ruled out: no troponin elevation). Patients were stratified by admission for STEMI. Initial ECGs were reviewed for automated interpretation of "STEMI", and admission/discharge diagnoses were compared.

RESULTS

Among 382 patients, there were 141 OMIs, 181 NOMIs, and 60 MIROs. Only 40.4% of OMIs were admitted as STEMI: 60.0% had "STEMI" on ECG, and median door-to-cath time was 103 min (IQR 71-149). But 59.6% of OMIs were not admitted as STEMI: 1.3% had "STEMI" on ECG (p < 0.001) and median door-to-cath time was 1712 min (IQR 1043-3960; p < 0.001). While 13.9% of STEMIs were false positive and had a different discharge diagnosis, 32.0% of Non-STEMIs had OMI but were still discharged as "Non-STEMI."

CONCLUSIONS

STEMI criteria miss a majority of OMI, and discharge diagnoses highlight false positive STEMI but never false negative STEMI. The OMI paradigm reveals quality gaps and opportunities for improvement.

Hospital admission from the emergency department for selected emergent diagnoses during the first year of the COVID-19 pandemic in Ontario: a retrospective population-based study

BACKGROUND

Avoidance of care during the pandemic may have contributed to delays in care, and as a result, worse patient outcomes. We evaluated markers of illness acuity on presentation to the emergency department among patients with non-COVID-19-related emergent diagnoses and associated outcomes.

METHODS

We conducted a retrospective study using linked administrative data from Ontario. We selected 4 emergent diagnoses, namely appendicitis, ectopic pregnancy, renal failure and diabetic ketoacidosis. We used the nonemergent diagnosis of cellulitis as a control. Our primary outcome of interest was hospital admission. Secondary outcomes were ambulance arrival, surgical intervention, subsequent hospital admission within 30 days of discharge from the emergency department or hospital and 30-day mortality. We compared outcomes during the first year of the COVID-19 pandemic (Mar. 15-Dec. 31, 2020) with a control period (Mar. 15-Dec. 31, 2018, and Mar. 15-Dec. 31, 2019).

RESULTS

Emergency department visits for all conditions initially decreased during the pandemic. During this period, patients across all study diagnoses were more likely to arrive to the emergency department via ambulance. Patients with an ectopic pregnancy had higher odds of surgery in the pandemic period (odds ratio [OR] 1.27, 95% confidence interval [CI] 1.04-1.55) but this was not observed among patients with appendicitis. Patients with renal failure had increased odds of hospital admission (OR 1.14, 95% CI 1.04-1.24) and 30-day mortality (OR 1.17, 95% CI 1.04-1.31) during the pandemic period.

INTERPRETATION

The pandemic period was associated with increased arrival to the emergency department via ambulance across all study diagnoses. Although patients with renal failure had increased hospital admission and death, and patients with ectopic pregnancy had an increased risk of surgery, there were no differences in outcomes for other populations, suggesting the health care system was able to care for these patients effectively.

Learning From a Regional Approach: Integration to Scale, Spread, and Sustain Virtual Urgent Care

While new offerings of virtual urgent care services from peer hospitals faltered after initial provincial pilot funding lapsed, our 3 regional academic health sciences centers decided to partner to enhance patient access, achieve efficiencies, and support long-term sustainability. Utilizing the Development Model for Integrated Care framework, we progressed through the 4 phases to ensure joint success and high-quality care: (1) initiative and design phase-individual parallel projects but with strong collaborations and broad stakeholder engagement; (2) experimental and execution phase-continuous quality improvement approach for governance, policies, and processes; (3) expansion and monitoring phase-weekly leadership touchpoints on key performance indicators; and (4) consolidation and transformation phase-sustainability through ongoing funding.

Improving safety and communication for healthcare providers caring for SARS-COV-2 patients

Background

Decreasing healthcare provider (HCP) exposure to the severe acute respiratory syndrome coronavirus 2 (SARS-COV-2) virus in emergency departments (EDs) is crucial. Approaches include limiting the HCP presence and ensuring sealed isolation rooms, which can result in communication difficulties. This quality improvement (QI) initiative aimed to decrease by 50% duration of isolation room door opening and increasing HCP-perceived communication clarity by one point on a five-point Likert scale.

Methods

This was a prospective, multi-stage project with three Plan-Do-Study-Act (PDSA) cycles between May and July 2020: (1) an educational intervention, (2) the introduction of a novel transceiver communication device, and (3) utilizing a clinical champion. Statistical Process Control XbarR charts were used to assess for special cause variation, and two-tailed Mann-Whitney U tests were used for statistical significance between Likert survey means. Qualitative responses underwent thematic analysis.

Results

Observation of 174 patient encounters was completed over 33 days, with 95 meeting the inclusion criteria. Door opening decreased from baseline (n=40; mean 72.97%) to PDSA 3 (n=21; mean 1.58%; p<0.0001). HCP-perceived communication clarity improved from baseline (n=36; mean 3.36) to PDSA-3 (n=49; mean 4.21; p<0.001). Survey themes included positive effects on communication and workflow, with some challenges on the integration of the new device into the clinical workflow. HCP-perceived errors, workarounds, and workflow pauses showed significant improvements.

Conclusion

This QI initiative with a novel transceiver showed significant decreases in isolation room door opening and increases in communication clarity. Future work will expand to operating rooms and intensive care units.

A blueprint for building an emergency department quality improvement and patient safety committee

The field of quality improvement and patient safety (QIPS) has matured significantly in emergency medicine over the past decade. From standalone, strategically misaligned, and incoherently designed QIPS projects years ago, emergency department (ED) leaders have now recognized that developing a more robust QIPS infrastructure helps prioritize and organize projects for a greater likelihood of success and impact for patients and the system. This process includes the development of a well-defined, accountable, and supported departmental QIPS committee. This can be achieved effectively using a deliberate and structured approach, such as the one described by Harvard Business School Professor John Kotter in his seminal work, “Leading Change.” Herein, we present a blueprint using this framework and include practical examples from our experience developing a robust and successful ED QIPS committee and infrastructure. The steps include how to develop a “burning platform,” select a guiding coalition of leaders, develop a strategic vision and initiatives, recruit a volunteer army of members, enable actions for the committee, generate short-term successes, sustain the pace of change, and, finally, enable the infrastructure to support ongoing improvements. This road map can be replicated by ED teams of variable sizes and settings to structure, prioritize, and operationalize their QIPS activities and ultimately improve the outcomes of their patients.

Experiences of healthcare providers with a novel emergency response intubation team during COVID-19

Objectives

In the early stages of the COVID-19 pandemic, there were significant concerns about the infectious risks of intubation to healthcare providers. In response, a dedicated emergency response intubation team (ERIT) consisting of anesthesiologists and allied health providers was instituted for our emergency department (ED). Given the high-risk nature of intubations and the new interprofessional team dynamics, we sought to assess health-care provider experiences and potential areas of improvement.

Methods

Surveys were distributed to healthcare providers at the University Health Network, a quaternary healthcare centre in Toronto, Canada, which includes two urban EDs seeing over 128,000 patients per year. Participants included ED physicians and nurses, anesthesiologists, anesthesia assistants, and operating room nurses. The survey included free-text questions. Responses underwent thematic analysis using grounded theory and were independently coded by two authors to generate descriptive themes. Discrepancies were resolved with a third author. Descriptive themes were distilled through an inductive, iterative process until fewer main themes emerged.

Results

A total of 178 surveys were collected (68.2% response rate). Of these, 123 (69%) participated in one or more ERIT activations. Positive aspects included increased numbers of staff to assist, increased intubation expertise, improved safety, and good team dynamics within the ERIT team. Challenges included a loss of scope (primarily ED physicians and nurses) and unfamiliar workflows, perceived delays to ERIT team arrival or patient intubation, role confusion, handover concerns, and communication challenges between ED and ERIT teams. Perceived opportunities for improvement included interprofessional training, developing clear guidelines on activation, inter-team role clarification, and guidelines on handover processes post-intubation.

Conclusions

Healthcare providers perceived that a novel interprofessional collaboration for intubations of COVID-19 patients presented both benefits and challenges. Opportunities for improvement centred around interprofessional training, shared decision making between teams, and structured handoff processes.

Recurrent acute pancreatitis during a ketogenic diet-a case report and literature review

BACKGROUND

The ketogenic ("keto") diet has been gaining more attention lately in the medical literature and the lay media as a potentially effective method for weight control and management of type 2 diabetes. Though rare, there have been case reports of serious side effects. Here, we present a peculiar case of pancreatitis presumably associated with the ketogenic diet.

CASE PRESENTATION

A 35-year-old man on a calorie-restricted ketogenic diet presented to the emergency department with weekly abdominal pain on Monday mornings, each time after dietary indiscretions ("cheat days") on the weekend. It was found that he had a clinical presentation consistent with acute pancreatitis with no associated alcohol use, hypertriglyceridemia, pancreatic obstruction, or other anatomic abnormalities. The patient's symptoms resolved with conservative management and progressive reintroduction of a standard diet.

CONCLUSION

This case indicates that the ketogenic diet could lower the threshold for acute pancreatitis, and that an episodic stressor may trigger an acute attack in the absence of traditional risk factors.

The Impact of COVID-19 on a Large, Canadian Community Emergency Department

INTRODUCTION

As the COVID-19 pandemic unfolded, emergency departments (EDs) across the world braced for surges in volume and demand. However, many EDs experienced decreased demand even for higher acuity illnesses. In this study we sought to examine the change in utilization at a large Canadian community ED, including changes in patient demographics and presentations, as well as structural and administrative changes made in response to the pandemic.

METHODS

This retrospective observational study took place in Ontario, Canada, from March 17-June 30, 2020, during province-wide lockdowns in response to COVID-19. We used a control period of March 17-June 30 in 2018-2019. Differences between observed and expected values were calculated for total visits, Canadian Triage and Acuity Scale (CTAS) groups, and age groups using Fisher's exact test. Length of stay (LOS), physician initial assessment time (PIA), and top primary and admission diagnoses were also examined.

RESULTS

Patient visits fell to 66.3% of expected volume in the exposure period (20,901 vs 31,525, P<0.0001). CTAS-1 (highest acuity) patient volumes dropped to 86.8% of expected (P = 0.1964) while CTAS-5 (lowest acuity) patient volumes dropped to 32.4% of expected (P <0.0001). Youth (0-17), adult (18-64), and senior (65+) visits all decreased to 37.4%, 71.7%, and 72.9% of expected volumes, respectively (P <0.0001). Median PIA and median ED LOS both decreased (1.1 to 0.6 hours and 3.3 to 3.0 hours, respectively). The most common primary diagnosis in both periods was "other chest pain." Viral syndromes were more prevalent in the exposure period. The top admission diagnoses were congestive heart failure in the control period (4.8%) and COVID-19 in the study period (3.5%).

CONCLUSION

ED utilization changed drastically during COVID-19. Our ED responded with wide stakeholder engagement, spatial reorganization, and human resources changes informed by real-time data. Our experiences can help prepare for potential subsequent "waves" of COVID-19 and future pandemics.

Qualitative evaluation of a mandatory provincial programme auditing emergency department return visits

OBJECTIVE

The objective of this qualitative study was to evaluate the perceived impact and value of the Return Visit Quality Programme (RVQP), a mandatory province-wide emergency department audit programme.

DESIGN

We employed an interpretive descriptive qualitative approach with maximum variation sampling to ensure diverse representation across several geographical and institutional factors. RVQP programme leads were invited to participate in semistructured interviews and snowball sampling was used to reach non-lead physicians to capture the perspectives of those working within the programme.

SETTING

In Ontario's RVQP, participating emergency departments must audit their return visits resulting in admission to identify issues that can be addressed through quality improvement initiatives.

PARTICIPANTS

Between June and August 2018, we interviewed 32 participants (local programme leads and non-lead physicians) from 23 out of the 86 participating centres.

RESULTS

Participants' perceived impact and value of the programme was associated with the existence (or absence) and nature of the local quality improvement culture, the implementation approach of the programme within their emergency departments, and key aspects of the programme pertaining to medicolegal concerns and resource availability.

CONCLUSIONS

This study of an innovative, large-scale programme aimed at promoting continuous quality improvement in emergency departments showed that while its perceived impact has been meaningful, there are key structural and operational elements that support and hinder this aim. Healthcare leaders should consider these findings when looking to implement large-scale audit or quality improvement programmes.

Sharing and Teaching Electrocardiograms to Minimize Infarction (STEMI): reducing diagnostic time for acute coronary occlusion in the emergency department

BACKGROUND

Limits to ST-Elevation Myocardial Infarction (STEMI) criteria may lead to prolonged diagnostic time for acute coronary occlusion. We aimed to reduce ECG-to-Activation (ETA) time through audit and feedback on STEMI-equivalents and subtle occlusions, without increasing Code STEMIs without culprit lesions.

METHODS

This multi-centre, quality improvement initiative reviewed all Code STEMI patients from the emergency department (ED) over a one-year baseline and one-year intervention period. We measured ETA time, from the first ED ECG to the time a Code STEMI was activated. Our intervention strategy involved a grand rounds presentation and an internal website presenting weekly local challenging cases, along with literature on STEMI-equivalents and subtle occlusions. Our outcome measure was ETA time for culprit lesions, our process measure was website views/visits, and our balancing measure was the percentage of Code STEMIs without culprit lesions.

RESULTS

There were 51 culprit lesions in the baseline period, and 64 in the intervention period. Median ETA declined from 28.0 min (95% confidence interval [CI] 15.0-45.0) to 8.0 min (95%CI 6.0-15.0). The website garnered 70.4 views/week and 27.7 visitors/week in a group of 80 physicians. There was no change in percentage of Code STEMIs without culprit lesions: 28.2% (95%CI 17.8-38.6) to 20.0% (95%CI 11.2-28.8%). Conclusions Our novel weekly web-based feedback to all emergency physicians was associated with a reduction in ETA time by 20 min, without increasing Code STEMIs without culprit lesions. Local ECG audit and feedback, guided by ETA as a quality metric for acute coronary occlusion, could be replicated in other settings to improve care.

The clock is ticking: using in situ simulation to improve time to blood administration for bleeding trauma patients

INTRODUCTION

Massive hemorrhage protocols are widely used to facilitate the administration of blood components to bleeding trauma patients. Delays in this process are associated with worse patient outcomes. We used in situ simulation as a novel and iterative quality improvement technique to reduce the mean time between massive hemorrhage protocol activation and blood administration during actual trauma resuscitations.

METHODS

We completed monthly, risk-informed unannounced in situ trauma simulations at a Canadian Level 1 trauma centre. We identified three major latent safety threats: (1) massive hemorrhage protocol activation; (2) transport of blood components; and (3) situational awareness of team members. Process improvements for each latent safety threats were tested and implemented during subsequent in situ simulation sessions. We evaluated the effect of this simulation-based intervention on the care of patients before, during and after the intervention. Demographic, clinical and massive hemorrhage protocol data were collected. The primary outcome was mean time between massive hemorrhage protocol activation and blood administration during actual trauma resuscitations as analyzed using a two-sample t test.

RESULTS

Each group was similar in demographic and injury characteristics. The time from massive hemorrhage protocol activation to blood administration decreased from 11.6 min pre-intervention to 9.1 min post-intervention. This represented a significant reduction (2.5 min, 95% confidence interval, 0.03-5.08) following the in situ simulation-based quality improvement intervention.

CONCLUSIONS

A comprehensive, in situ simulation-based quality improvement project was associated with a significant reduction in the mean time between massive hemorrhage protocol activation and blood administration among injured patients. In situ simulation represents a novel approach to the identification and mitigation of latent safety threats during massive hemorrhage protocol activation.

Recurring Critical Results and Their Impact on the Volume of Critical Calls at a Tertiary Care Center

BACKGROUND

When a test result is critically abnormal, laboratories notify the responsible caregivers immediately, usually with a phone call. If the same test was ordered repeatedly, our institution has a policy of not notifying the caregiver if the previous result was also critical and within 24 h. We compared our policy with those of several different laboratories in North America and estimated the impact of changing our current policy to calling for all critical results, regardless of the time interval.

METHODS

Several North American laboratories (n = 15) were surveyed regarding their critical result notification policy. For our institution, we performed a retrospective analysis focusing on critical values in a 5-month period for common chemistry tests. We estimated the effect on volume of calls and the impact on workload with regard to changing the critical result notification policy and critical thresholds.

RESULTS

A majority of surveyed laboratories had some form of restriction for calling about recurring critical results. In our institution, removing the restrictions would increase the average number of daily calls by 11%-155%, depending on the analyte. The choice of critical thresholds also has an effect on the number of calls, and the effect depends on the analyte and the threshold chosen.

CONCLUSIONS

Guidelines do not specify how recurring critical results should be communicated. Depending on the institutional resources, some laboratories call only the first critical result for one or more tests if certain criteria are met. Modification of these policies can lead to significant changes in the volume of calls made by the laboratory and can have numerous impacts related to workload, logistics, and patient care.

Improving Quality of Care Through a Mandatory Provincial Audit Program: Ontario's Emergency Department Return Visit Quality Program

The Emergency Department Return Visit Quality Program was launched in Ontario, Canada, to promote a culture of quality. It mandates the province's largest-volume emergency departments (EDs) to audit charts of patients who had a return visit leading to hospital admission, including some of their 72-hour all-cause return visits with admission and all of their 7-day ones with sentinel diagnoses (ie, acute myocardial infarction, subarachnoid hemorrhage, and pediatric sepsis), and submit their findings to a governmental agency. This provides an opportunity to identify possible adverse events and quality issues, which hospitals can then address through quality improvement initiatives. A group of emergency physicians with quality improvement expertise analyzed the submitted audits and accompanying narrative templates, using a general inductive approach to develop a novel classification of recurrent quality themes. Since the Return Visit Quality Program launched in 2016, 125,698 return visits with admission have been identified, representing 0.93% of the 86 participating EDs' 13,559,664 visits. Overall, participating hospitals have conducted 12,852 detailed chart audits, uncovering 3,010 (23.4%) adverse events/quality issues and undertaking hundreds of quality improvement provincewide projects as a result. The inductive analysis revealed 11 recurrent themes, classified into 3 groupings: patient characteristics (ie, patient risk profile and elder care), ED team actions or processes (ie, physician cognitive lapses, documentation, handover/communication between providers, radiology, vital signs, and high-risk medications or medication interactions), and health care system issues (ie, discharge planning/community follow-up, left against medical advice/left without being seen, and imaging/testing availability). The Return Visit Quality Program is the largest mandatory audit program for EDs and provides a novel approach to identify local adverse events/quality issues to target for improved patient safety and quality of care. It provides a blueprint for health system leaders to enable clinicians to develop an approach to organizational quality, as well as for teams to construct an audit system that yields defined issues amenable to improvement.

Improving timely analgesia administration for musculoskeletal pain in the emergency department

Delays to adequate analgesia result in worse patient care, decreased patient and provider satisfaction and increased patient complaints. The leading presenting symptom to emergency departments (EDs) is pain, with approximately 34 000 such patients per year in our academic hospital ED and 3300 visits specific for musculoskeletal (MSK) injuries. Our aim was to reduce the time-to-analgesia (TTA; time from patient triage to receipt of analgesia) for patients with MSK pain in our ED by 55% (to under 60 min) in 9 months' time (May 2018). Our outcome measures included mean TTA and ED length of stay (LOS). Process measures included rates of analgesia administration and of use of medical directives. We obtained weekly data capture for Statistical Process Control (SPC) charts, as well as Mann-Whitney U tests for before-and-after evaluation. We performed wide stakeholder engagement, root cause analyses and created a Pareto Diagram to inform Plan-Do-Study-Act (PDSA) cycles, which included: (1) nurse-initiated analgesia at triage; (2) a new triage documentation aid for medication administration; (3) a quick reference medical directive badge for nurses; and (4) weekly targeted feedback of the project's progress at clinical team huddle. TTA decreased from 129 min (n=153) to 100 min (22.5%; n=87, p<0.05). Special cause variation was identified on the ED LOS SPC chart with nine values below the midline after the first PDSA. The number of patients that received any analgesia increased from 42% (n=372) to 47% (n=192; p=0.13) and those that received them via medical directives increased from 22% (n=154) to 44% (n=87; p<0.001). We achieved a significant reduction of TTA and an increased use of medical directives through front-line focused improvements.

Quality improvement initiative for improved patient communication in an ED rapid assessment zone

INTRODUCTION

Patient-clinician communication in the Emergency Department (ED) faces challenges of time and interruptions, resulting in negative effects on patient satisfaction with communication and failure to relieve anxiety. Our aim was to improve patient satisfaction with communication and to decrease related patient anxiety.

METHODS

A multistage quality improvement (QI) initiative was conducted in the ED of Toronto General Hospital, a quaternary care centre in Ontario, Canada, from January to May 2018. We engaged stakeholders widely including clinicians, allied health and patients. We developed a 5-point Likert scale survey to measure patient and clinician rating of their communication experience, along with open-ended questions, and a patient focus group. Inductive analyses yielded interventions that were introduced through three Plan-Do-Study-Act (PDSA) cycles: (1) a clinician communication tool called Acknowledge-Empathize-Inform; (2) patient information pamphlets; and (3) a multimedia solution displaying patient-directed material. Our primary outcome was to improve patient satisfaction with communication and decrease anxiety by at least one Likert scale point over 6 months. Our secondary outcome was clinician-perceived interruptions by patients. We used statistical process control (SPC) charts to identify special cause variation and two-tailed Mann-Whitney U tests to compare means (statistical significance p<0.05).

RESULTS

A total of 232 patients and 104 clinicians were surveyed over baseline and three PDSA cycles. Communication about wait times, ED process, timing of next steps and directions to patient areas were the most frequently identified gaps, which informed our interventions. Measurements at baseline and during PDSA 3 showed: patient satisfaction increased from 3.28 (5 being best; n=65) to 4.15 (n=59, p<0.0001). Patient anxiety decreased from 2.96 (1 being best; n=65) to 2.31 (n=59, p<0.001). Clinician-perceived interruptions by patients changed from 4.33 (5 being highest; n=30) to 4.18 (n=11, p=0.98) and did not meet significance. SPC charts showed special cause variation temporally associated with our interventions.

CONCLUSIONS

Our pragmatic low-cost QI initiative led to statistically significant improvement in patient satisfaction with communication and decreased patient anxiety while narrowly missing our a priori improvement aim of one full Likert scale point.

Enhancing departmental preparedness for COVID-19 using rapid-cycle in-situ simulation

In response to coronavirus disease 2019 (COVID-19), a rapid-cycle in-situ simulation (ISS) programme was developed to facilitate identification and resolution of systems-based latent safety threats. The simulation involved a possible COVID-19 case in respiratory failure, using a mannequin modified to aerosolize phosphorescent secretions. Thirty-six individuals participated in five ISS sessions over 6 weeks, and a further 20 individuals observed these sessions. Debriefing identified latent safety threats from four domains: personnel, personal protective equipment, supply/environment and communication. These threats were addressed and resolved in later iterations. Ninety-four percent of participants felt more prepared to care for a potential case of COVID-19 after the ISS.

Updated framework on quality and safety in emergency medicine

OBJECTIVES

Quality and safety of emergency care is critical. Patients rely on emergency medicine (EM) for accessible, timely and high-quality care in addition to providing a 'safety-net' function. Demand is increasing, creating resource challenges in all settings. Where EM is well established, this is recognised through the implementation of quality standards and staff training for patient safety. In settings where EM is developing, immense system and patient pressures exist, thereby necessitating the availability of tiered standards appropriate to the local context.

METHODS

The original quality framework arose from expert consensus at the International Federation of Emergency Medicine (IFEM) Symposium for Quality and Safety in Emergency Care (UK, 2011). The IFEM Quality and Safety Special Interest Group members have subsequently refined it to achieve a consensus in 2018.

RESULTS

Patients should expect EDs to provide effective acute care. To do this, trained emergency personnel should make patient-centred, timely and expert decisions to provide care, supported by systems, processes, diagnostics, appropriate equipment and facilities. Enablers to high-quality care include appropriate staff, access to care (including financial), coordinated emergency care through the whole patient journey and monitoring of outcomes. Crowding directly impacts on patient quality of care, morbidity and mortality. Quality indicators should be pragmatic, measurable and prioritised as components of an improvement strategy which should be developed, tailored and implemented in each setting.

CONCLUSION

EDs globally have a remit to deliver the best care possible. IFEM has defined and updated an international consensus framework for quality and safety.

Checklist for Head Injury Management Evaluation Study (CHIMES): a quality improvement initiative to reduce imaging utilisation for head injuries in the emergency department

Over 90% of patients with head trauma seen in emergency departments (EDs) are diagnosed with minor head injuries. Over-utilisation of CT scans results in unnecessary exposure to radiation and increases healthcare utilisation. Using recommendations from the Choosing Wisely Canada (CWC) campaign and quality improvement (QI) methodology, we aimed to reduce the CT scan rate for head injuries by 10% over a 6-month period.

Baseline CT scan rates were determined through a 27-month retrospective cohort review. We used stakeholder engagement and provider surveys to develop our driver diagram and Plan-Do-Study-Act (PDSA) cycles, which included (1) improving provider knowledge about the CWC campaign recommendations; (2) testing, refining and implementing a modified Canadian CT Head Rule checklist; (3) developing CWC-themed head injury–specific patient handouts; and (4) feedback on CT scan group ordering rates to providers. Our primary outcome measure was the number of CT scans performed for patients with head injuries. Process measures included the number of checklists completed and ED length of stay (LOS). Our balancing measure was return ED visits within 72 hours (with or without admission).

Baseline CT scan rates prior to our interventions was 46.1%. Our QI initiative resulted in a ‘shift’ in the Statistical Process Control chart of the weekly CT scan rates, associated with the first and second PDSA cycles, resulting in a 13.9% reduction in CT rates during the initial 3 months, and a sustained reduction of 8% at 16 months (p<0.05). Mean ED LOS for all patients with head injuries decreased by 1.5 min (p=0.74). 33% of checklists were completed. 72-hour return visits did not change significantly (p=0.68).

Through provider and patient education, and the creation of a user-friendly evidence-based tool, our local QI initiative was successful in achieving long-term reduction in CT rates for patients presenting to EDs with head injuries.

Application of the Informatics Stack framework to describe a population-level emergency department return visit continuous quality improvement program

INTRODUCTION

Population health programs are increasingly reliant on Health Information Technology (HIT). Program HIT architecture description is a necessary step prior to evaluation. Several sociotechnical frameworks have been used previously with HIT programs. The Informatics Stack is a novel framework that provides a thorough description of HIT program architecture. The Emergency Department Return Visit Quality Program (EDRVQP) is a population-level continuous quality improvement (QI) program connecting EDs across Ontario. The objectives of the study were to utilize the Informatics Stack to provide a description of the EDRVQP HIT architecture and to delineate population health program factors that are enablers or barriers.

MATERIALS AND METHODS

The Informatics Stack was used to describe the HIT architecture. A qualitative study was completed with semi-structured interviews of key informants across stakeholder organizations. Emergency departments were selected randomly. Purposive sampling identified key informants. Interviews were conducted until saturation. An inductive qualitative analysis using grounded theory was completed. A literature review of peer-reviewed background literature, and stakeholder organization reports was also conducted.

RESULTS

23 business actors from 15 organizations were interviewed. The EDRVQP architecture description is presented across the Informatics Stack levels. The levels from most comprehensive to most basic are world, organization, perspectives/roles, goals/functions, workflow/behaviour/adoption, information systems, modules, data/information/knowledge/wisdom/algorithms, and technology. Enabling factors were the high rate of electronic health record adoption, legislative mandate for data collection, use of functional data standards, implementation flexibility, leveraging validated algorithms, and leveraging existing local health networks. Barriers were privacy legislation and a high turn-around time.

DISCUSSION

The Informatics Stack provides a robust approach to thoroughly describe the HIT architecture of population health programs prior to program replication. The EDRVQP is a population health program that illustrates the pragmatic use of continuous QI methodology across a population (provincial) level.