Machine Learning-Based Text Analysis to Predict Severely Injured Patients in Emergency Medical Dispatch: Model Development and Validation

Taxonomy development methods regarding patient safety in health sciences - A systematic review

BACKGROUND

Taxonomies are needed for automated analysis of clinical data in healthcare. Few reviews of the taxonomy development methods used in health sciences are found. This systematic review aimed to describe the scope of the available taxonomies relative to patient safety, the methods used for taxonomy development, and the strengths and limitations of the methods. The purpose of this systematic review is to guide future taxonomy development projects.

METHODS

The CINAHL, PubMed, Scopus, and Web of Science databases were searched for studies from January 2012 to April 25, 2023. Two authors selected the studies using inclusion and exclusion criteria and critical appraisal checklists. The data were analysed inductively, and the results were reported narratively.

RESULTS

The studies (n = 13) across healthcare concerned mainly taxonomies of adverse events and medication safety but little for specialised fields and information technology. Critical appraisal indicated inadequate reporting of the used taxonomy development methods. Ten phases of taxonomy development were identified: (1) defining purpose and (2) the theory base for development, (3) relevant data sources' identification, (4) main terms' identification and definitions, (5) items' coding and pooling, (6) reliability and validity evaluation of coding and/or codes, (7) development of a hierarchical structure, (8) testing the structure, (9) piloting the taxonomy and (10) reporting application and validation of the final taxonomy. Seventeen statistical tests and seven software systems were utilised, but automated data extraction methods were used rarely. Multimethod and multi-stakeholder approach, code- and hierarchy testing and piloting were strengths and time consumption and small samples in testing limitations.

CONCLUSION

New taxonomies are needed on diverse specialities and information technology related to patient safety. Structured method is needed for taxonomy development, reporting and appraisal to strengthen taxonomies' quality. A new guide was proposed for taxonomy development, for which testing is required. Prospero registration number CRD42023411022.

Clinical decision support system in emergency telephone triage: A scoping review of technical design, implementation and evaluation

OBJECTIVES

Emergency department overcrowding could be improved by upstream telephone triage. Emergency telephone triage aims at managing and orientating adequately patients as early as possible and distributing limited supply of staff and materials. This complex task could be improved with the use of Clinical decision support systems (CDSS). The aim of this scoping review was to identify literature gaps for the future development and evaluation of CDSS for Emergency telephone triage.

MATERIALS AND METHODS

We present here a scoping review of CDSS designed for emergency telephone triage, and compared them in terms of functional characteristics, technical design, health care implementation and methodologies used for evaluation, following the PRISMA-ScR guidelines.

RESULTS

Regarding design, 19 CDSS were retrieved: 12 were knowledge based CDSS (decisional algorithms built according to guidelines or clinical expertise) and 7 were data driven (statistical, machine learning, or deep learning models). Most of them aimed at assisting nurses or non-medical staff by providing patient orientation and/or severity/priority assessment. Eleven were implemented in real life, and only three were connected to the Electronic Health Record. Regarding evaluation, CDSS were assessed through various aspects: intrinsic characteristics, impact on clinical practice or user apprehension. Only one pragmatic trial and one randomized controlled trial were conducted.

CONCLUSION

This review highlights the potential of a hybrid system, user tailored, flexible, connected to the electronic health record, which could work with oral, video and digital data; and the need to evaluate CDSS on intrinsic characteristics and impact on clinical practice, iteratively at each distinct stage of the IT lifecycle.

Advancements in Artificial Intelligence in Emergency Medicine in Taiwan: A Narrative Review

The rapid progression of artificial intelligence (AI) in healthcare has greatly influenced emergency medicine, particularly in Taiwan-a nation celebrated for its technological innovation and advanced public healthcare. This narrative review examines the current status of AI applications in Taiwan's emergency medicine and highlights notable achievements and potential areas for growth. AI has wide capabilities encompass a broad range, including disease prediction, diagnostic imaging interpretation, and workflow enhancement. While the integration of AI presents promising advancements, it is not devoid of challenges. Concerns about the interpretability of AI models, the importance of dataset accuracy, the necessity for external validation, and ethical quandaries emphasize the need for a balanced approach. Regulatory oversight also plays a crucial role in ensuring the safe and effective deployment of AI tools in clinical settings. As its footprint continues to expand in medical education and other areas, addressing these challenges is imperative to harness the full potential of AI for transforming emergency medicine in Taiwan.

Development of early prediction model of in-hospital cardiac arrest based on laboratory parameters

BACKGROUND

In-hospital cardiac arrest (IHCA) is an acute disease with a high fatality rate that burdens individuals, society, and the economy. This study aimed to develop a machine learning (ML) model using routine laboratory parameters to predict the risk of IHCA in rescue-treated patients.

METHODS

This retrospective cohort study examined all rescue-treated patients hospitalized at the First Medical Center of the PLA General Hospital in Beijing, China, from January 2016 to December 2020. Five machine learning algorithms, including support vector machine, random forest, extra trees classifier (ETC), decision tree, and logistic regression algorithms, were trained to develop models for predicting IHCA. We included blood counts, biochemical markers, and coagulation markers in the model development. We validated model performance using fivefold cross-validation and used the SHapley Additive exPlanation (SHAP) for model interpretation.

RESULTS

A total of 11,308 participants were included in the study, of which 7779 patients remained. Among these patients, 1796 (23.09%) cases of IHCA occurred. Among five machine learning models for predicting IHCA, the ETC algorithm exhibited better performance, with an AUC of 0.920, compared with the other four machine learning models in the fivefold cross-validation. The SHAP showed that the top ten factors accounting for cardiac arrest in rescue-treated patients are prothrombin activity, platelets, hemoglobin, N-terminal pro-brain natriuretic peptide, neutrophils, prothrombin time, serum albumin, sodium, activated partial thromboplastin time, and potassium.

CONCLUSIONS

We developed a reliable machine learning-derived model that integrates readily available laboratory parameters to predict IHCA in patients treated with rescue therapy.

Construction of an Early Alert System for Intradialytic Hypotension before Initiating Hemodialysis Based on Machine Learning

Introduction

Intradialytic hypotension (IDH) is prevalent and associated with high hospitalization and mortality rates. The purpose of this study was to explore the risk factors for IDH and use artificial intelligence to establish an early alert system before hemodialysis sessions to identify patients at high risk of IDH.

Materials and Methods

We obtained data on 314,534 hemodialysis sessions conducted at Sichuan Provincial People's Hospital from the renal disease treatment information system. IDH was defined as a systolic blood pressure drop ≥20 mm Hg, a mean arterial pressure drop ≥10 mm Hg during dialysis, or the occurrence of clinical hypotensive events requiring nursing intervention. After pre-processing, the data were randomly divided into training (80%) and testing (20%) sets. Four interpolation methods, three feature selection methods, and 18 machine learning algorithms were used to construct predictive models. The area under the receiver operating characteristic curve (AUC) was the main indicator for evaluating the performance of the models, while Shapley Additive ExPlanation was used to explain the contribution of each variable to the best predictive model.

Results

A total of 3,906 patients and 314,534 dialysis sessions were included, of which 142,237 cases showed IDH (incidence rate, 45.2%). Nineteen parameters were identified through artificial intelligence feature screening. They included age, pre-dialysis weight, dry weight, pre-dialysis blood pressure, heart rate, prescribed ultrafiltration, blood cell counts (neutrophil, lymphocyte, monocyte, eosinophil, lymphocyte, and platelet counts), hematocrit, serum calcium, creatinine, urea, glucose, and uric acid. Random forest, gradient boosting, and logistic regression were the three best models, and the AUCs were 0.812 (95% confidence interval [CI], 0.811-0.813), 0.748 (95% CI, 0.747-0.749), and 0.743 (95% CI, 0.742-0.744), respectively.

Conclusion

Our dialysis software-based artificial intelligence alert system can be used to predict IDH occurrence, enabling the initiation of relevant interventions.

AI and machine learning in resuscitation: Ongoing research, new concepts, and key challenges

Aim

Artificial intelligence (AI) and machine learning (ML) are important areas of computer science that have recently attracted attention for their application to medicine. However, as techniques continue to advance and become more complex, it is increasingly challenging for clinicians to stay abreast of the latest research. This overview aims to translate research concepts and potential concerns to healthcare professionals interested in applying AI and ML to resuscitation research but who are not experts in the field.

Main text

We present various research including prediction models using structured and unstructured data, exploring treatment heterogeneity, reinforcement learning, language processing, and large-scale language models. These studies potentially offer valuable insights for optimizing treatment strategies and clinical workflows. However, implementing AI and ML in clinical settings presents its own set of challenges. The availability of high-quality and reliable data is crucial for developing accurate ML models. A rigorous validation process and the integration of ML into clinical practice is essential for practical implementation. We furthermore highlight the potential risks associated with self-fulfilling prophecies and feedback loops, emphasizing the importance of transparency, interpretability, and trustworthiness in AI and ML models. These issues need to be addressed in order to establish reliable and trustworthy AI and ML models.

Conclusion

In this article, we overview concepts and examples of AI and ML research in the resuscitation field. Moving forward, appropriate understanding of ML and collaboration with relevant experts will be essential for researchers and clinicians to overcome the challenges and harness the full potential of AI and ML in resuscitation.