An Operational Framework to Study Diagnostic Errors in Emergency Departments: Findings From A Consensus Panel

"Everything is electronic health record-driven": the role of the electronic health record in the emergency department diagnostic process

Objectives

There is limited knowledge on how providers and patients in the emergency department (ED) use electronic health records (EHRs) to facilitate the diagnostic process. While EHRs can support diagnostic decision-making, EHR features that are not user-centered may increase the likelihood of diagnostic error. We aimed to identify how EHRs facilitate or impede the diagnostic process in the ED and to identify opportunities to reduce diagnostic errors and improve care quality.

Materials and Methods

We conducted semistructured interviews with 10 physicians, 15 nurses, and 8 patients across 4 EDs. Data were analyzed using a hybrid thematic analysis approach, which blends deductive (ie, using multiple conceptual frameworks) and inductive coding strategies. A team of 4 coders performed coding.

Results

We identified 4 themes, 3 at the care team level and 1 at the patient level. At the care team level, the benefits of the EHR in the diagnostic process included (1) customizing features to facilitate diagnostic workup and (2) aiding in communication. However, (3) EHR-driven protocols were found to potentially burden the care process and reliance on asynchronous communication could impede team dynamics. At the patient-level, we found that (4) patient portals facilitated meaningful patient engagement through timely delivery of results.

Discussion

While EHRs can improve the diagnostic process, they can also impair communication and increase workload. Electronic health record design should leverage provider-created tools to improve usability and enhance diagnostic safety.

Conclusions

Our findings have important implications for health information technology design and policy. Further work should assess optimal ways to release patient results via the EHR portal.

Epidemiology of diagnostic errors in pediatric emergency departments using electronic triggers

OBJECTIVES

We applied three electronic triggers to study frequency and contributory factors of missed opportunities for improving diagnosis (MOIDs) in pediatric emergency departments (EDs): return visits within 10 days resulting in admission (Trigger 1), care escalation within 24 h of ED presentation (Trigger 2), and death within 24 h of ED visit (Trigger 3).

METHODS

We created an electronic query and reporting template for the triggers and applied them to electronic health record systems of five pediatric EDs for visits from 2019. Clinician reviewers manually screened identified charts and initially categorized them as "unlikely for MOIDs" or "unable to rule out MOIDs" without a detailed chart review. For the latter category, reviewers performed a detailed chart review using the Revised Safer Dx Instrument to determine the presence of a MOID.

RESULTS

A total of 2937 ED records met trigger criteria (Trigger 1 1996 [68%], Trigger 2 829 [28%], Trigger 3 112 [4%]), of which 2786 (95%) were categorized as unlikely for MOIDs. The Revised Safer Dx Instrument was applied to 151 (5%) records and 76 (50%) had MOIDs. The overall frequency of MOIDs was 2.6% for the entire cohort, 3.0% for Trigger 1, 1.9% for Trigger 2, and 0% for Trigger 3. Brain lesions, infections, or hemorrhage; pneumonias and lung abscess; and appendicitis were the top three missed diagnoses. The majority (54%) of MOIDs cases resulted in patient harm. Contributory factors were related to patient-provider (52.6%), followed by patient factors (21.1%), system factors (13.2%), and provider factors (10.5%).

CONCLUSIONS

Using electronic triggers with selective record review is an effective process to screen for harmful diagnostic errors in EDs: detailed review of 5% of charts revealed MOIDs in half, of which half were harmful to the patient. With further refining, triggers can be used as effective patient safety tools to monitor diagnostic quality.

Designing Patient-Centered Interventions for Emergency Care: Participatory Design Study

BACKGROUND

Emergency departments (EDs) are high-pressure environments where clinicians diagnose patients under significant constraints, including limited medical histories, severe time pressures, and frequent interruptions. Current ED care practices often inadequately support meaningful patient participation. Most interventions prioritize clinical workflow and health care provider communication, inadvertently overlooking patients' needs. Additionally, patient-facing technologies in EDs are typically developed without meaningful patient input, leading to solutions that may not effectively address patients' specific challenges. To enhance both patient-centered care practices and the diagnosis process in EDs, patient involvement in technology design is essential to ensure their needs during emergency care are understood and addressed.

OBJECTIVE

This study aimed to invite ED patients to participatory design sessions, identify their needs during ED visits, and present potential design guidelines for technological interventions to address these needs.

METHODS

We conducted 8 design sessions with 36 ED patients and caregivers to validate their needs and identify considerations for designing patient-centered interventions to improve diagnostic safety. We used 10 technological intervention ideas as probes for a needs evaluation of the study participants. Participants discussed the use cases of each intervention idea to assess their needs during the ED care process. We facilitated co-design activities with the participants to improve the technological intervention designs. We audio- and video-recorded the design sessions. We then analyzed session transcripts, field notes, and design sketches.

RESULTS

On the basis of ED patients' feedback and evaluation of our intervention designs, we found the 3 most preferred intervention ideas that addressed the common challenges ED patients experience. We also identified 4 themes of ED patients' needs: a feeling of inclusion in the ED care process, access to sources of medical information to enhance patient comprehension, addressing patient anxiety related to information overload and privacy concerns, and ensuring continuity in care and information. We interpreted these as insights for designing technological interventions for ED patients. Therefore, on the basis of the findings, we present five considerations for designing better patient-centered interventions in the ED care process: technology-based interventions should (1) address patients' dynamic needs to promote continuity in care; (2) consider the amount and timing of information that patients receive; (3) empower patients to be more active for better patient safety and care quality; (4) optimize human resources, depending on patients' needs; and (5) be designed with the consideration of patients' perspectives on implementation.

CONCLUSIONS

This study provides unique insights for designing technological interventions to support ED diagnostic processes. By inviting ED patients into the design process, we present unique insights into the diagnostic process and design considerations for designing novel technological interventions to enhance patient safety.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/55357.

Pediatric Triage Accuracy in Pediatric and General Emergency Departments

BACKGROUND AND OBJECTIVES

Accurate triage at the time of emergency department (ED) presentation is critical for timely acuity assessment and anticipating resource requirements. Commonly, triage is conducted using the Emergency Severity Index (ESI); however, the accuracy of this approach for children in general EDs is uncertain. The purpose of this study was to quantify pediatric triage accuracy in a national sample of ED visits and evaluate whether presentation to a pediatric vs general ED is associated with mistriage.

METHODS

This was a cross-sectional study of the 2017-2021 National Hospital Ambulatory Medical Care Survey of pediatric (aged <18 years) ED visits with an ESI score from 3 to 5. The outcome was mistriage (resource utilization discordant with ESI prediction). Standardized ESI definitions were applied to count resources. We used multivariable logistic regression to evaluate whether presentation to a pediatric or general ED was associated with triage accuracy.

RESULTS

Of 149 million visits, mistriage occurred in 53.7% of ESI 3, 57.7% of ESI 4, and 22.9% of ESI 5 visits. Children in general EDs were more likely to be mistriaged than children in pediatric EDs (adjusted odds ratio [OR], 1.29; 95% CI, 1.11-1.50). Young age was associated with mistriage (aged <1 year vs aged 13-17: adjusted OR [95% CI], 2.42 [2.00-2.94], 1-5 years: 1.79 [1.53-2.10], 6-12 years: 1.38 [1.16-1.64]).

CONCLUSION

Mistriage was common among children with an initial ESI of 3 to 5 and more common among children visiting general EDs. Our findings highlight the need for improved resource prediction at the time of triage.

Characterizing Acute Pulmonary Embolism Cases Diagnosed at an Emergency Department Revisit Using a Statewide Clinical Registry

STUDY OBJECTIVE

To assess the rate and characteristics of acute pulmonary embolism (PE) cases diagnosed in the emergency department (ED) following an ED discharge visit within 10 days.

METHODS

This is a retrospective analysis of 40 EDs in a statewide clinical registry from 2017 to 2022. We identified adult patients with acute PEs diagnosed in the ED. We assessed PE cases wherein a prior ED visit for the same patient resulting in discharge had taken place within 10 days without interval hospitalization. We then characterized the overall rate of revisit PE cases per overall acute PE cases and per 10,000 ED discharges. We also reported on subgroups of revisit cases where the preceding visit resulted in diagnosis of COVID-19, other cardiopulmonary conditions, and cardiopulmonary symptom codes (eg, chest pain, unspecified).

RESULTS

Of 24,525 acute PEs, 1,202 (4.9%, 95% confidence interval [CI] 4.6% to 5.2%) had an ED discharge within the preceding 10 days (2.0 per 10,000 ED discharges, 95% CI 1.9 to 2.1). Two hundred thirty-three (19.4%) were originally discharged with a COVID-19 diagnosis, 107 (8.9%) were originally discharged with another cardiopulmonary condition, and 201 (16.7%) were cases discharged with a nonspecific cardiopulmonary symptom code. Discharges with diagnoses of COVID-19, pneumonia, and pleural effusion had higher rates of revisits with acute PE.

CONCLUSION

In this retrospective analysis, about 1 in 20 acute PEs and 2 in 10,000 ED discharges were associated with an ED revisit for acute PE. Some cases may represent potential diagnostic opportunities, whereas others may be progression of disease, risk factors for PE, or unrelated.

Frontline Providers' and Patients' Perspectives on Improving Diagnostic Safety in the Emergency Department: A Qualitative Study

BACKGROUND

Few studies have described the insights of frontline health care providers and patients on how the diagnostic process can be improved in the emergency department (ED), a setting at high risk for diagnostic errors. The authors aimed to identify the perspectives of providers and patients on the diagnostic process and identify potential interventions to improve diagnostic safety.

METHODS

Semistructured interviews were conducted with 10 ED physicians, 15 ED nurses, and 9 patients/caregivers at two separate health systems. Interview questions were guided by the ED-Adapted National Academies of Sciences, Engineering, and Medicine Diagnostic Process Framework and explored participant perspectives on the ED diagnostic process, identified vulnerabilities, and solicited interventions to improve diagnostic safety. The authors performed qualitative thematic analysis on transcribed interviews.

RESULTS

The research team categorized vulnerabilities in the diagnostic process and intervention opportunities based on the ED-Adapted Framework into five domains: (1) team dynamics and communication (for example, suboptimal communication between referring physicians and the ED team); (2) information gathering related to patient presentation (for example, obtaining the history from the patients or their caregivers; (3) ED organization, system, and processes (for example, staff schedules and handoffs); (4) patient education and self-management (for example, patient education at discharge from the ED); and (5) electronic health record and patient portal use (for example, automatic release of test results into the patient portal). The authors identified 33 potential interventions, of which 17 were provider focused and 16 were patient focused.

CONCLUSION

Frontline providers and patients identified several vulnerabilities and potential interventions to improve ED diagnostic safety. Refining, implementing, and evaluating the efficacy of these interventions are required.

Identifying Interventions to Improve Diagnostic Safety in Emergency Departments: Protocol for a Participatory Design Study

BACKGROUND

Emergency departments (EDs) are complex and fast-paced clinical settings where a diagnosis is made in a time-, information-, and resource-constrained context. Thus, it is predisposed to suboptimal diagnostic outcomes, leading to errors and subsequent patient harm. Arriving at a timely and accurate diagnosis is an activity that occurs after an effective collaboration between the patient or caregiver and the clinical team within the ED. Interventions such as novel sociotechnical solutions are needed to mitigate errors and risks.

OBJECTIVE

This study aims to identify challenges that frontline ED health care providers and patients face in the ED diagnostic process and involve them in co-designing technological interventions to enhance diagnostic excellence.

METHODS

We will conduct separate sessions with ED health care providers and patients, respectively, to assess various design ideas and use a participatory design (PD) approach for technological interventions to improve ED diagnostic safety. In the sessions, various intervention ideas will be presented to participants through storyboards. Based on a preliminary interview study with ED patients and health care providers, we created intervention storyboards that illustrate different care contexts in which ED health care providers or patients experience challenges and show how each intervention would address the specific challenge. By facilitating participant group discussion, we will reveal the overlap between the needs of the design research team observed during fieldwork and the needs perceived by target users (ie, participants) in their own experience to gain their perspectives and assessment on each idea. After the group discussions, participants will rank the ideas and co-design to improve our interventions. Data sources will include audio and video recordings, design sketches, and ratings of intervention design ideas from PD sessions. The University of Michigan Institutional Review Board approved this study. This foundational work will help identify the needs and challenges of key stakeholders in the ED diagnostic process and develop initial design ideas, specifically focusing on sociotechnological ideas for patient-, health care provider-, and system-level interventions for improving patient safety in EDs.

RESULTS

The recruitment of participants for ED health care providers and patients is complete. We are currently preparing for PD sessions. The first results from design sessions with health care providers will be reported in fall 2024.

CONCLUSIONS

The study findings will provide unique insights for designing sociotechnological interventions to support ED diagnostic processes. By inviting frontline health care providers and patients into the design process, we anticipate obtaining unique insights into the ED diagnostic process and designing novel sociotechnical interventions to enhance patient safety. Based on this study's collected data and intervention ideas, we will develop prototypes of multilevel interventions that can be tested and subsequently implemented for patients, health care providers, or hospitals as a system.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/55357.

Refining a Framework to Enhance Communication in the Emergency Department During the Diagnostic Process: An eDelphi Approach

BACKGROUND

Emergency departments (EDs) are susceptible to diagnostic error. Suboptimal communication between the patient and the interdisciplinary care team increases risk to diagnostic safety. The role of communication remains underrepresented in existing diagnostic decision-making conceptual models.

METHODS

The authors used eDelphi methodology, whereby data are collected electronically, to achieve consensus among an expert panel of 18 clinicians, patients, family members, and other participants on a refined ED-based diagnostic decision-making framework that integrates several potential opportunities for communication to enhance diagnostic quality. This study examined the entire diagnostic process in the ED, from prehospital to discharge or transfer to inpatient care, and identified where communication breakdowns could occur. After four iterative rounds of the eDelphi process, including a final validation round by all participants, the project's a priori consensus threshold of 80% agreement was reached.

RESULTS

The authors developed a final framework that positions communication more prominently in the diagnostic process in the ED and enhances the original National Academies of Sciences, Engineering, and Medicine (NASEM) and ED-adapted NASEM frameworks. Specific points in the ED journey were identified where more attention to communication might be helpful. Two specific types of communication-information exchange and shared understanding-were identified as high priority for optimal outcomes. Ideas for communication-focused interventions to prevent diagnostic error in the ED fell into three categories: patient-facing, clinician-facing, and system-facing interventions.

CONCLUSION

This project's refinement of the NASEM framework adapted to the ED can be used to develop communications-focused interventions to reduce diagnostic error in this highly complex and error-prone setting.

Misdiagnosis of Acute Appendicitis Cases in the Emergency Room

Acute appendicitis (AA) is one of the most frequent surgical emergencies, especially in pediatric populations, with its misdiagnosis in emergency settings presenting significant health risks. This misdiagnosis leads to various complications, such as delayed treatment or unnecessary surgeries. Factors such as age, gender, and comorbidities contribute to diagnostic errors, leading to complications such as peritonitis and increased negative appendectomy rates. This underscores the importance of accurate clinical assessment and awareness of common pitfalls, such as cognitive biases and over-reliance on laboratory tests. This review delves into the prevalence of AA misdiagnosis, its health burden, and the challenges inherent in the diagnostic process. It scrutinizes the effectiveness of different diagnostic approaches, including clinical assessment and imaging techniques. The treatment paradigms for AA are also explored, focusing on surgical interventions and the potential of conservative treatments using antibiotics. The review underscores the criticality of precise diagnosis in preventing adverse outcomes and ensuring effective treatment.

Opportunities for Diagnostic Improvement Among Pediatric Hospital Readmissions

OBJECTIVES

Diagnostic errors, termed "missed opportunities for improving diagnosis" (MOIDs), are known sources of harm in children but have not been well characterized in pediatric hospital medicine. Our objectives were to systematically identify and describe MOIDs among general pediatric patients who experienced hospital readmission, outline improvement opportunities, and explore factors associated with increased risk of MOID.

PATIENTS AND METHODS

Our retrospective cohort study included unplanned readmissions within 15 days of discharge from a freestanding children's hospital (October 2018-September 2020). Health records from index admissions and readmissions were independently reviewed and discussed by practicing inpatient physicians to identify MOIDs using an established instrument, SaferDx. MOIDs were evaluated using a diagnostic-specific tool to identify improvement opportunities within the diagnostic process.

RESULTS

MOIDs were identified in 22 (6.3%) of 348 readmissions. Opportunities for improvement included: delay in considering the correct diagnosis (n = 11, 50%) and failure to order needed test(s) (n = 10, 45%). Patients with MOIDs were older (median age: 3.8 [interquartile range 1.5-11.2] vs 1.0 [0.3-4.9] years) than patients without MOIDs but similar in sex, primary language, race, ethnicity, and insurance type. We did not identify conditions associated with higher risk of MOID. Lower respiratory tract infections accounted for 26% of admission diagnoses but only 1 (4.5%) case of MOID.

CONCLUSIONS

Standardized review of pediatric readmissions identified MOIDs and opportunities for improvement within the diagnostic process, particularly in clinician decision-making. We identified conditions with low incidence of MOID. Further work is needed to better understand pediatric populations at highest risk for MOID.

Comparing skin surface temperature to clinical documentation of skin warmth in emergency department patients diagnosed with cellulitis

Objective

To compare clinical documentation of skin warmth to patient report and quantitative skin surface temperatures of patients diagnosed with cellulitis in the emergency department (ED).

Methods

Adult patients (≥18 years) presenting to the ED with an acute complaint involving visible erythema of the lower extremity were prospectively enrolled. Those diagnosed with cellulitis were included in this analysis. Participant report of skin warmth was recorded and skin surface temperature values were obtained from the affected and corresponding unaffected area of skin using thermal cameras. Average temperature (Tavg) was extracted from each image and the difference in Tavg between the affected and unaffected limb was calculated (Tgradient). Clinical documentation of skin warmth was compared to patient report and measured skin warmth (Tgradient >0°C).

Results

Among 126 participants diagnosed with cellulitis, 110 (87%) exhibited objective warmth (Tgradient >0°C) and 58 (53%) of these cases had warmth documented in the physical examination. Of those with objective warmth, 86 (78%) self-reported warmth and 7 (6%) had warmth documented in their history of present illness (HPI) (difference = 72%, 95% confidence interval [CI]: 62%-82%; P < 0.001). A significant difference was observed for Tavg affected when warmth was documented (32.1°C) versus not documented (31.0°C) in the physical examination (difference = 1.1°C, 95% CI: 0.29-1.94; P = 0.0083). No association was found between Tgradient and patient-reported or HPI-documented warmth.

Conclusions

The majority of ED-diagnosed cellulitis exhibited objective warmth, yet significant discordance was observed between patient-reported, clinician-documented, and measured warmth. This raises concerns over inadequate documentation practices and/or the poor sensitivity of touch as a reliable means to assess skin surface temperature. Introduction of objective temperature measurement tools could reduce subjectivity in the assessment of warmth in patients with suspected cellulitis.

Emergency medicine physicians' perspectives on diagnostic accuracy in neurology: a qualitative study

OBJECTIVES

We sought to understand the knowledge, attitudes, and beliefs of emergency medicine (EM) physicians towards non-specific neurological conditions and the use of clinical decision support (CDS) to improve diagnostic accuracy.

METHODS

We conducted semi-structured interviews of EM physicians at four emergency departments (EDs) affiliated with a single US healthcare system. Interviews were conducted until thematic saturation was achieved. Conventional content analysis was used to identify themes related to EM physicians' perspectives on acute diagnostic neurology; directed content analysis was used to explore views regarding CDS. Each interview transcript was independently coded by two researchers using an iteratively refined codebook with consensus-based resolution of coding differences.

RESULTS

We identified two domains regarding diagnostic safety: (1) challenges unique to neurological complaints and (2) challenges in EM more broadly. Themes relevant to neurology included: (1) knowledge gaps and uncertainty, (2) skepticism about neurology, (3) comfort with basic as opposed to detailed neurological examination, and (4) comfort with non-neurological diseases. Themes relevant to diagnostic decision making in the ED included: (1) cognitive biases, (2) ED system/environmental issues, (3) patient barriers, (4) comfort with diagnostic uncertainty, and (5) concerns regarding diagnostic error identification and measurement. Most participating EM physicians were enthusiastic about the potential for well-designed CDS to improve diagnostic accuracy for non-specific neurological complaints.

CONCLUSIONS

Physicians identified diagnostic challenges unique to neurological diseases as well as issues related more generally to diagnostic accuracy in EM. These physician-reported issues should be accounted for when designing interventions to improve ED diagnostic accuracy.

Understanding diagnostic processes in emergency departments: a mixed methods case study protocol

INTRODUCTION

Diagnostic processes in the emergency department (ED) involve multiple interactions among individuals who interface with information systems to access and record information. A better understanding of diagnostic processes is needed to mitigate errors. This paper describes a study protocol to map diagnostic processes in the ED as a foundation for developing future error mitigation strategies.

METHODS AND ANALYSIS

This study of an adult and a paediatric academic ED uses a prospective mixed methods case study design informed by an ED-specific diagnostic decision-making model (the modified ED-National Academies of Sciences, Engineering and Medicine (NASEM) model) and two cognitive theories (dual process theory and distributed cognition). Data sources include audio recordings of patient and care team interactions, electronic health record data, observer field notes and stakeholder interviews. Multiple qualitative analysis methods will be used to explore diagnostic processes in situ, including systems information flow, human-human and human-system interactions and contextual factors influencing cognition. The study has three parts. Part 1 involves prospective field observations of patients with undifferentiated symptoms at high risk for diagnostic error, where each patient is followed throughout the entire care delivery process. Part 2 involves observing individual care team providers over a 4-hour window to capture their diagnostic workflow, team coordination and communication across multiple patients. Part 3 uses interviews with key stakeholders to understand different perspectives on the diagnostic process, as well as perceived strengths and vulnerabilities, in order to enrich the ED-NASEM diagnostic model.

ETHICS AND DISSEMINATION

The University of Michigan Institutional Review Board approved this study, HUM00156261. This foundational work will help identify strengths and vulnerabilities in diagnostic processes. Further, it will inform the future development and testing of patient, provider and systems-level interventions for mitigating error and improving patient safety in these and other EDs. The work will be disseminated through journal publications and presentations at national and international meetings.

Development of a rubric for assessing delayed diagnosis of appendicitis, diabetic ketoacidosis and sepsis

OBJECTIVES

Using case review to determine whether a patient experienced a delayed diagnosis is challenging. Measurement would be more accurate if case reviewers had access to multi-expert consensus on grading the likelihood of delayed diagnosis. Our objective was to use expert consensus to create a guide for objectively grading the likelihood of delayed diagnosis of appendicitis, new-onset diabetic ketoacidosis (DKA), and sepsis.

METHODS

Case vignettes were constructed for each condition. In each vignette, a patient has the condition and had a previous emergency department (ED) visit within 7 days. Condition-specific multi-specialty expert Delphi panels reviewed the case vignettes and graded the likelihood of a delayed diagnosis on a five-point scale. Delayed diagnosis was defined as the condition being present during the previous ED visit. Consensus was defined as ≥75% agreement. In each Delphi round, panelists were given the scores from the previous round and asked to rescore. A case scoring guide was created from the consensus scores.

RESULTS

Eighteen expert panelists participated. Consensus was achieved within three Delphi rounds for all appendicitis and sepsis vignettes. We reached consensus on 23/30 (77%) DKA vignettes. A case review guide was created from the consensus scores.

CONCLUSIONS

Multi-specialty expert reviewers can agree on the likelihood of a delayed diagnosis for cases of appendicitis and sepsis, and for most cases of DKA. We created a guide that can be used by researchers and quality improvement specialists to allow for objective case review to determine when delayed diagnoses have occurred for appendicitis, DKA, and sepsis.

Identifying trigger concepts to screen emergency department visits for diagnostic errors

OBJECTIVES

The diagnostic process is a vital component of safe and effective emergency department (ED) care. There are no standardized methods for identifying or reliably monitoring diagnostic errors in the ED, impeding efforts to enhance diagnostic safety. We sought to identify trigger concepts to screen ED records for diagnostic errors and describe how they can be used as a measurement strategy to identify and reduce preventable diagnostic harm.

METHODS

We conducted a literature review and surveyed ED directors to compile a list of potential electronic health record (EHR) trigger (e-triggers) and non-EHR based concepts. We convened a multidisciplinary expert panel to build consensus on trigger concepts to identify and reduce preventable diagnostic harm in the ED.

RESULTS

Six e-trigger and five non-EHR based concepts were selected by the expert panel. E-trigger concepts included: unscheduled ED return to ED resulting in hospital admission, death following ED visit, care escalation, high-risk conditions based on symptom-disease dyads, return visits with new diagnostic/therapeutic interventions, and change of treating service after admission. Non-EHR based signals included: cases from mortality/morbidity conferences, risk management/safety office referrals, ED medical director case referrals, patient complaints, and radiology/laboratory misreads and callbacks. The panel suggested further refinements to aid future research in defining diagnostic error epidemiology in ED settings.

CONCLUSIONS

We identified a set of e-trigger concepts and non-EHR based signals that could be developed further to screen ED visits for diagnostic safety events. With additional evaluation, trigger-based methods can be used as tools to monitor and improve ED diagnostic performance.

Factors Associated With Potentially Missed Diagnosis of Appendicitis in the Emergency Department

IMPORTANCE

Appendicitis may be missed during initial emergency department (ED) presentation.

OBJECTIVE

To compare patients with a potentially missed diagnosis of appendicitis (ie, patients with symptoms associated with appendicitis, including abdominal pain, constipation, nausea and/or vomiting, fever, and diarrhea diagnosed within 1-30 days after initial ED presentation) with patients diagnosed with appendicitis on the same day of ED presentation to identify factors associated with potentially missed appendicitis.

DESIGN, SETTING, AND PARTICIPANTS

In this cohort study, a retrospective analysis of commercially insured claims data was conducted from January 1 to December 15, 2019. Patients who presented to the ED with undifferentiated symptoms associated with appendicitis between January 1, 2010, and December 31, 2017, were identified using the Clinformatics Data Mart administrative database (Optum Insights). The study sample comprised eligible adults (aged ≥18 years) and children (aged <18 years) who had previous ED visits within 30 days of an appendicitis diagnosis.

MAIN OUTCOMES AND MEASURES

Potentially missed diagnosis of appendicitis. Adjusted odds ratios (AORs) for abdominal pain and its combinations with other symptoms associated with appendicitis were compared between patients with a same-day diagnosis of appendicitis and patients with a potentially missed diagnosis of appendicitis.

RESULTS

Of 187 461 patients with a diagnosis of appendicitis, a total of 123 711 (66%; 101 375 adults [81.9%] and 22 336 children [18.1%]) were eligible for analysis. Among adults, 51 923 (51.2%) were women, with a mean (SD) age of 44.3 (18.2) years; among children, 9631 (43.1%) were girls, with a mean (SD) age of 12.2 (18.2) years. The frequency of potentially missed appendicitis was 6060 of 101 375 adults (6.0%) and 973 of 22 336 children (4.4%). Patients with isolated abdominal pain (adults, AOR, 0.65; 95% CI, 0.62-0.69; P < .001; children, AOR, 0.79; 95% CI, 0.69-0.90; P < .001) or with abdominal pain and nausea and/or vomiting (adults, AOR, 0.90; 95% CI, 0.84-0.97; P = .003; children, AOR, 0.84; 95% CI, 0.71-0.98; P = .03) were less likely to have missed appendicitis. Patients with abdominal pain and constipation (adults, AOR, 1.51; 95% CI, 1.31-1.75; P < .001; children, AOR, 2.43; 95% CI, 1.86-3.17; P < .001) were more likely to have missed appendicitis. Stratified by the presence of undifferentiated symptoms, women (abdominal pain, AOR, 1.68; 95% CI, 1.58-1.78; nausea and/or vomiting, AOR, 1.68; 95% CI, 1.52-1.85; fever, AOR, 1.32; 95% CI, 1.10-1.59; diarrhea, AOR, 1.19; 95% CI, 1.01-1.40; and constipation, AOR, 1.50; 95% CI, 1.24-1.82) and girls (abdominal pain, AOR, 1.64; 95% CI, 1.43-1.88; nausea and/or vomiting, AOR, 1.74; 95% CI, 1.42-2.13; fever, AOR, 1.55; 95% CI, 1.14-2.11; diarrhea, AOR, 1.80; 95% CI, 1.19-2.74; and constipation, AOR, 1.25; 95% CI, 0.88-1.78) as well as patients with a comorbidity index of 2 or greater (adults, abdominal pain, AOR, 3.33; 95% CI, 3.09-3.60; nausea and/or vomiting, AOR, 3.66; 95% CI, 3.23-4.14; fever, AOR, 5.00; 95% CI, 3.79-6.60; diarrhea, AOR, 4.27; 95% CI, 3.39-5.38; and constipation, AOR, 4.17; 95% CI, 3.08-5.65; children, abdominal pain, AOR, 2.42; 95% CI, 1.93-3.05; nausea and/or vomiting, AOR, 2.55; 95% CI, 1.89-3.45; fever, AOR, 4.12; 95% CI, 2.71-6.25; diarrhea, AOR, 2.17; 95% CI, 1.18-3.97; and constipation, AOR, 2.19; 95% CI, 1.30-3.70) were more likely to have missed appendicitis. Adult patients who received computed tomographic scans at the initial ED visit (abdominal pain, AOR, 0.58; 95% CI, 0.52-0.65; nausea and/or vomiting, AOR, 0.63; 95% CI, 0.52-0.75; fever, AOR, 0.41; 95% CI, 0.29-0.58; diarrhea, AOR, 0.83; 95% CI, 0.58-1.20; and constipation, AOR, 0.60; 95% CI, 0.39-0.94) were less likely to have missed appendicitis.

CONCLUSIONS AND RELEVANCE

Regardless of age, a missed diagnosis of appendicitis was more likely to occur in women, patients with comorbidities, and patients who experienced abdominal pain accompanied by constipation. Population-based estimates of the rates of potentially missed appendicitis reveal opportunities for improvement and identify factors that may mitigate the risk of a missed diagnosis.