Derivation and validation of a machine learning record linkage algorithm between emergency medical services and the emergency department

Cardiac Arrest and Cardiopulmonary Resuscitation Outcome Reports: 2024 Update of the Utstein Out-of-Hospital Cardiac Arrest Registry Template

The Utstein Out-of-Hospital Cardiac Arrest Resuscitation Registry Template, introduced in 1991 and updated in 2004 and 2015, standardizes data collection to enable research, evaluation, and comparisons of systems of care. The impetus for the current update stemmed from significant advances in the field and insights from registry development and regional comparisons. This 2024 update involved representatives of the International Liaison Committee on Resuscitation and used a modified Delphi process. Every 2015 Utstein data element was reviewed for relevance, priority (core or supplemental), and improvement. New variables were proposed and refined. All changes were voted on for inclusion. The 2015 domains-system, dispatch, patient, process, and outcomes-were retained. Further clarity is provided for the definitions of out-of-hospital cardiac arrest attended resuscitation and attempted resuscitation. Changes reflect advancements in dispatch, early response systems, and resuscitation care, as well as the importance of prehospital outcomes. Time intervals such as emergency medical service response time now emphasize precise reporting of the times used. New flowcharts aid the reporting of system effectiveness for patients with an attempted resuscitation and system efficacy for the Utstein comparator group. Recognizing the varying capacities of emergency systems globally, the writing group provided a minimal dataset for settings with developing emergency medical systems. Supplementary variables are considered useful for research purposes. These revisions aim to elevate data collection and reporting transparency by registries and researchers and to advance international comparisons and collaborations. The overarching objective remains the improvement of outcomes for patients with out-of-hospital cardiac arrest.

Cardiac arrest and cardiopulmonary resuscitation outcome reports: 2024 update of the Utstein Out-of-Hospital Cardiac Arrest Registry template

The Utstein Out-of-Hospital Cardiac Arrest Resuscitation Registry Template, introduced in 1991 and updated in 2004 and 2015, standardizes data collection to enable research, evaluation, and comparisons of systems of care. The impetus for the current update stemmed from significant advances in the field and insights from registry development and regional comparisons. This 2024 update involved representatives of the International Liaison Committee on Resuscitation and used a modified Delphi process. Every 2015 Utstein data element was reviewed for relevance, priority (core or supplemental), and improvement. New variables were proposed and refined. All changes were voted on for inclusion. The 2015 domains-system, dispatch, patient, process, and outcomes-were retained. Further clarity is provided for the definitions of out-of-hospital cardiac arrest attended resuscitation and attempted resuscitation. Changes reflect advancements in dispatch, early response systems, and resuscitation care, as well as the importance of prehospital outcomes. Time intervals such as emergency medical service response time now emphasize precise reporting of the times used. New flowcharts aid the reporting of system effectiveness for patients with an attempted resuscitation and system efficacy for the Utstein comparator group. Recognizing the varying capacities of emergency systems globally, the writing group provided a minimal dataset for settings with developing emergency medical systems. Supplementary variables are considered useful for research purposes. These revisions aim to elevate data collection and reporting transparency by registries and researchers and to advance international comparisons and collaborations. The overarching objective remains the improvement of outcomes for patients with out-of-hospital cardiac arrest.

Database quality assessment in research in paramedicine: a scoping review

BACKGROUND

Research in paramedicine faces challenges in developing research capacity, including access to high-quality data. A variety of unique factors in the paramedic work environment influence data quality. In other fields of healthcare, data quality assessment (DQA) frameworks provide common methods of quality assessment as well as standards of transparent reporting. No similar DQA frameworks exist for paramedicine, and practices related to DQA are sporadically reported. This scoping review aims to describe the range, extent, and nature of DQA practices within research in paramedicine.

METHODS

This review followed a registered and published protocol. In consultation with a professional librarian, a search strategy was developed and applied to MEDLINE (National Library of Medicine), EMBASE (Elsevier), Scopus (Elsevier), and CINAHL (EBSCO) to identify studies published from 2011 through 2021 that assess paramedic data quality as a stated goal. Studies that reported quantitative results of DQA using data that relate primarily to the paramedic practice environment were included. Protocols, commentaries, and similar study types were excluded. Title/abstract screening was conducted by two reviewers; full-text screening was conducted by two, with a third participating to resolve disagreements. Data were extracted using a piloted data-charting form.

RESULTS

Searching yielded 10,105 unique articles. After title and abstract screening, 199 remained for full-text review; 97 were included in the analysis. Included studies varied widely in many characteristics. Majorities were conducted in the United States (51%), assessed data containing between 100 and 9,999 records (61%), or assessed one of three topic areas: data, trauma, or out-of-hospital cardiac arrest (61%). All data-quality domains assessed could be grouped under 5 summary domains: completeness, linkage, accuracy, reliability, and representativeness.

CONCLUSIONS

There are few common standards in terms of variables, domains, methods, or quality thresholds for DQA in paramedic research. Terminology used to describe quality domains varied among included studies and frequently overlapped. The included studies showed no evidence of assessing some domains and emerging topics seen in other areas of healthcare. Research in paramedicine would benefit from a standardized framework for DQA that allows for local variation while establishing common methods, terminology, and reporting standards.

Optimizing Patient Record Linkage in a Master Patient Index Using Machine Learning: Algorithm Development and Validation

BACKGROUND

To provide quality care, modern health care systems must match and link data about the same patient from multiple sources, a function often served by master patient index (MPI) software. Record linkage in the MPI is typically performed manually by health care providers, guided by automated matching algorithms. These matching algorithms must be configured in advance, such as by setting the weights of patient attributes, usually by someone with knowledge of both the matching algorithm and the patient population being served.

OBJECTIVE

We aimed to develop and evaluate a machine learning-based software tool, which automatically configures a patient matching algorithm by learning from pairs of patient records previously linked by humans already present in the database.

METHODS

We built a free and open-source software tool to optimize record linkage algorithm parameters based on historical record linkages. The tool uses Bayesian optimization to identify the set of configuration parameters that lead to optimal matching performance in a given patient population, by learning from prior record linkages by humans. The tool is written assuming only the existence of a minimal HTTP application programming interface (API), and so is agnostic to the choice of MPI software, record linkage algorithm, and patient population. As a proof of concept, we integrated our tool with SantéMPI, an open-source MPI. We validated the tool using several synthetic patient populations in SantéMPI by comparing the performance of the optimized configuration in held-out data to SantéMPI's default matching configuration using sensitivity and specificity.

RESULTS

The machine learning-optimized configurations correctly detect over 90% of true record linkages as definite matches in all data sets, with 100% specificity and positive predictive value in all data sets, whereas the baseline detects none. In the largest data set examined, the baseline matching configuration detects possible record linkages with a sensitivity of 90.2% (95% CI 88.4%-92.0%) and specificity of 100%. By comparison, the machine learning-optimized matching configuration attains a sensitivity of 100%, with a decreased specificity of 95.9% (95% CI 95.9%-96.0%). We report significant gains in sensitivity in all data sets examined, at the cost of only marginally decreased specificity. The configuration optimization tool, data, and data set generator have been made freely available.

CONCLUSIONS

Our machine learning software tool can be used to significantly improve the performance of existing record linkage algorithms, without knowledge of the algorithm being used or specific details of the patient population being served.

The Aspects of Running Artificial Intelligence in Emergency Care; a Scoping Review

Introduction

Artificial Inteligence (AI) application in emergency medicine is subject to ethical and legal inconsistencies. The purposes of this study were to map the extent of AI applications in emergency medicine, to identify ethical issues related to the use of AI, and to propose an ethical framework for its use.

Methods

A comprehensive literature collection was compiled through electronic databases/internet search engines (PubMed, Web of Science Platform, MEDLINE, Scopus, Google Scholar/Academia, and ERIC) and reference lists. We considered studies published between 1 January 2014 and 6 October 2022. Articles that did not self-classify as studies of an AI intervention, those that were not relevant to Emergency Departments (EDs), and articles that did not report outcomes or evaluations were excluded. Descriptive and thematic analyses of data extracted from the included articles were conducted.

Results

A total of 137 out of the 2175 citations in the original database were eligible for full-text evaluation. Of these articles, 47 were included in the scoping review and considered for theme extraction. This review covers seven main areas of AI techniques in emergency medicine: Machine Learning (ML) Algorithms (10.64%), prehospital emergency management (12.76%), triage, patient acuity and disposition of patients (19.15%), disease and condition prediction (23.40%), emergency department management (17.03%), the future impact of AI on Emergency Medical Services (EMS) (8.51%), and ethical issues (8.51%).

Conclusion

There has been a rapid increase in AI research in emergency medicine in recent years. Several studies have demonstrated the potential of AI in diverse contexts, particularly when improving patient outcomes through predictive modelling. According to the synthesis of studies in our review, AI-based decision-making lacks transparency. This feature makes AI decision-making opaque.

Virtual patient identifier (vPID): Improving patient traceability using anonymized identifiers in Japanese healthcare insurance claims database

Objective

Japan's national-level healthcare insurance claims database (NDB) is a collective database that contains the entire information on healthcare services being provided to all citizens. However, existing anonymized identifiers (ID1 and ID2) have a poor capability of tracing patients' claims in the database, hindering longitudinal analyses. This study presents a virtual patient identifier (vPID), which we have developed on top of these existing identifiers, to improve the patient traceability.

Methods

vPID is a new composite identifier that intensively consolidates ID1 and ID2 co-occurring in an identical claim to allow to collect claims of each patient even though its ID1 or ID2 may change due to life events or clerical errors. We conducted a verification test with prefecture-level datasets of healthcare insurance claims and enrollee history records, which allowed us to compare vPID with the ground truth, in terms of an identifiability score (indicating a capability of distinguishing a patient's claims from another patient's claims) and a traceability score (indicating a capability of collecting claims of an identical patient).

Results

The verification test has clarified that vPID offers significantly higher traceability scores (0.994, Mie; 0.997, Gifu) than ID1 (0.863, Mie; 0.884, Gifu) and ID2 (0.602, Mie; 0.839, Gifu), and comparable (0.996, Mie) and lower (0.979, Gifu) identifiability scores.

Discussion

vPID is seemingly useful for a wide spectrum of analytic studies unless they focus on sensitive cases to the design limitation of vPID, such as patients experiencing marriage and job change, simultaneously, and same-sex twin children.

Conclusion

vPID successfully improves patient traceability, providing an opportunity for longitudinal analyses that used to be practically impossible for NDB. Further exploration is also necessary, in particular, for mitigating identification errors.

Building a Machine Learning-based Ambulance Dispatch Triage Model for Emergency Medical Services

Background

In charge of dispatching the ambulances, Emergency Medical Services (EMS) call center specialists often have difficulty deciding the acuity of a case given the information they can gather within a limited time. Although there are protocols to guide their decision-making, observed performance can still lack sensitivity and specificity. Machine learning models have been known to capture complex relationships that are subtle, and well-trained data models can yield accurate predictions in a split of a second.

Methods

In this study, we proposed a proof-of-concept approach to construct a machine learning model to better predict the acuity of emergency cases. We used more than 360,000 structured emergency call center records of cases received by the national emergency call center in Singapore from 2018 to 2020. Features were created using call records, and multiple machine learning models were trained.

Results

A Random Forest model achieved the best performance, reducing the over-triage rate by an absolute margin of 15% compared to the call center specialists while maintaining a similar level of under-triage rate.

Conclusions

The model has the potential to be deployed as a decision support tool for dispatchers alongside current protocols to optimize ambulance dispatch triage and the utilization of emergency ambulance resources.

Influence of artificial intelligence on the work design of emergency department clinicians a systematic literature review

Objective

This systematic literature review aims to demonstrate how Artificial Intelligence (AI) is currently used in emergency departments (ED) and how it alters the work design of ED clinicians. AI is still new and unknown to many healthcare professionals in emergency care, leading to unfamiliarity with its capabilities.

Method

Various criteria were used to establish the suitability of the articles to answer the research question. This study was based on 34 selected peer-reviewed papers on the use of Artificial Intelligence (AI) in the Emergency Department (ED), published in the last five years. Drawing on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, all articles were scanned, read full-text, and analyzed afterward.

Results

The majority of the AI applications consisted of AI-based tools to aid with clinical decisions and to relieve overcrowded EDs of their burden. AI support was mostly offered during triage, the moment that sets the patient trajectory. There is ample evidence that AI-based applications could improve the clinical decision-making process.

Conclusion

The use of AI in EDs is still in its nascent stages. Many studies focus on the question of whether AI has clinical utility, such as decision support, improving resource allocation, reducing diagnostic errors, and promoting proactivity. Some studies suggest that AI-based tools essentially have the ability to outperform human skills. However, it is evident from the literature that current technology does not have the aims or power to do so. Nevertheless, AI-based tools can impact clinician work design in the ED by providing support with clinical decisions, which could ultimately help alleviate a portion of the increasing clinical burden.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-08070-7.

Linking Emergency Medical Services and Emergency Department Data to Improve Overdose Surveillance in North Carolina

INTRODUCTION

Linking emergency medical services (EMS) data to emergency department (ED) data enables assessing the continuum of care and evaluating patient outcomes. We developed novel methods to enhance linkage performance and analysis of EMS and ED data for opioid overdose surveillance in North Carolina.

METHODS

We identified data on all EMS encounters in North Carolina during January 1-November 30, 2017, with documented naloxone administration and transportation to the ED. We linked these data with ED visit data in the North Carolina Disease Event Tracking and Epidemiologic Collection Tool. We manually reviewed a subset of data from 12 counties to create a gold standard that informed developing iterative linkage methods using demographic, time, and destination variables. We calculated the proportion of suspected opioid overdose EMS cases that received International Classification of Diseases, Tenth Revision, Clinical Modification diagnosis codes for opioid overdose in the ED.

RESULTS

We identified 12 088 EMS encounters of patients treated with naloxone and transported to the ED. The 12-county subset included 1781 linkage-eligible EMS encounters, with historical linkage of 65.4% (1165 of 1781) and 1.6% false linkages. Through iterative linkage methods, performance improved to 91.0% (1620 of 1781) with 0.1% false linkages. Among statewide EMS encounters with naloxone administration, the linkage improved from 47.1% to 91.1%. We found diagnosis codes for opioid overdose in the ED among 27.2% of statewide linked records.

PRACTICE IMPLICATIONS

Through an iterative linkage approach, EMS-ED data linkage performance improved greatly while reducing the number of false linkages. Improved EMS-ED data linkage quality can enhance surveillance activities, inform emergency response practices, and improve quality of care through evaluating initial patient presentations, field interventions, and ultimate diagnoses.

Artificial intelligence in emergency medicine: A scoping review

INTRODUCTION

Despite the growing investment in and adoption of artificial intelligence (AI) in medicine, the applications of AI in an emergency setting remain unclear. This scoping review seeks to identify available literature regarding the applications of AI in emergency medicine.

METHODS

The scoping review was conducted according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines for scoping reviews using Medline-OVID, EMBASE, CINAHL, and IEEE, with a double screening and extraction process. The search included articles published until February 28, 2020. Articles were excluded if they did not self-classify as studying an AI intervention, were not relevant to the emergency department (ED), or did not report outcomes or evaluation.

RESULTS

Of the 1483 original database citations, 395 were eligible for full-text evaluation. Of these articles, a total of 150 were included in the scoping review. The majority of included studies were retrospective in nature (n = 124, 82.7%), with only 3 (2.0%) prospective controlled trials. We found 37 (24.7%) interventions aimed at improving diagnosis within the ED. Among the 150 studies, 19 (12.7%) focused on diagnostic imaging within the ED. A total of 16 (10.7%) studies were conducted in the out-of-hospital environment (eg, emergency medical services, paramedics) with the remainder occurring either in the ED or the trauma bay. Of the 24 (16%) studies that had human comparators, there were 12 (8%) studies in which AI interventions outperformed clinicians in at least 1 measured outcome.

CONCLUSION

AI-related research is rapidly increasing in emergency medicine. There are several promising AI interventions that can improve emergency care, particularly for acute radiographic imaging and prediction-based diagnoses. Higher quality evidence is needed to further assess both short- and long-term clinical outcomes.