Needs and expectations for artificial intelligence in emergency medicine according to Canadian physicians

Artificial intelligence-based clinical decision support in the emergency department: A scoping review

OBJECTIVE

Artificial intelligence (AI)-based clinical decision support (CDS) has the potential to augment high-stakes clinical decisions in the emergency department (ED). However, its current usage and translation to implementation remains poorly understood. We asked: (1) What is the current landscape of AI-CDS for individual patient care in the ED? and (2) What phases of development have AI-CDS tools achieved?

METHODS

We performed a scoping review of AI for prognostic, diagnostic, and treatment decisions regarding individual ED patient care. We searched five databases (MEDLINE, EMBASE, Cochrane Central, Scopus, Web of Science) and gray literature sources from January 1, 2010, to December 11, 2023. We adhered to guidelines from the Joanna Briggs Institute and PRISMA Extension for Scoping Reviews. We published our protocol on Open Science Framework (DOI 10.17605/OSF.IO/FDZ3Y).

RESULTS

Of 5168 unique records identified, we selected 605 studies for inclusion. The majority (369, 61%) were published in 2021-2023. The studies ranged over a variety of clinical applications, patient populations, and AI model types. Prognostic outcomes were most commonly assessed (270, 44.6%), followed by diagnostic (193, 31.9%) and disposition (115, 19%). Most studies remained in the earliest phase of preclinical development (572, 94.5%) with few advancing to later phases (33, 5.5%).

CONCLUSIONS

By thoroughly mapping the landscape of AI-CDS in the ED, we demonstrate a rapidly increasing volume of studies covering a breadth of clinical applications, yet few have achieved advanced phases of testing or implementation. A more granular understanding of the barriers and facilitators to implementing AI-CDS in the ED is needed.

Establishing methodological standards for the development of artificial intelligence-based Clinical Decision Support in emergency medicine

OBJECTIVE

Artificial intelligence (AI) offers opportunities for managing the complexities of clinical care in the emergency department (ED), and Clinical Decision Support has been identified as a priority application. However, there is a lack of published guidance on how to rigorously develop and evaluate these tools. We sought to answer the question, "What methodological standards should be applied to the development of AI-based Clinical Decision Support tools in the ED?".

METHODS

We conducted an iterative consensus-establishing activity involving a subcommittee with AI expertise followed by surveys and a live facilitated discussion with participants of the 2024 Canadian Association of Emergency Physicians Research Symposium in Saskatoon. We augmented analysis of participant feedback with large language models.

RESULTS

We established 11 recommendations AI-based Clinical Decision Support development including the selection of a relevant problem and team of experts, standards of data quality and quantity, novel AI-specific reporting guidelines, and adherence to principles of ethics and privacy. We removed the recommendation regarding model interpretability from the final list due to a lack of consensus.

CONCLUSION

These 11 recommendations provide guiding principles and methodological standards for emergency medicine researchers to rigorously develop AI-based Clinical Decision Support tools and for clinicians to gain knowledge and trust in using them.

Assessing Physician Motivation to Engage in Continuing Professional Development on Artificial Intelligence

ABSTRACT

To realize the transformative potential of artificial intelligence (AI) in health care, physicians must learn how to use AI-based tools effectively, safely, and equitably. Continuing professional development (CPD) activities are one way to learn how to do this. The purpose of this article is to describe a theory-based approach for assessing health professionals' motivation to participate in CPD on AI-based tools. An online survey, based on an AI competency framework developed from existing literature and expert consultations, was administered to practicing physicians in Ontario, Canada. Across eight subcompetencies for using AI-based tools (eg, appraise AI-based tools for their regulatory and legal status), the survey measured physicians' perception they could successfully enact the competency, the importance of the competency in meeting their practice needs, and the desirability of participating in CPD activities on the competency. Motivation scores were calculated by multiplying the three scores together. Ninety-five physicians completed the survey. The highest motivation scores were for the subcompetency of identifying AI-based tools based on clinical needs, while the lowest motivation scores were for appraising tools' regulatory and legal status. All AI subcompetencies were generally rated as important, and CPD activities were generally perceived as desirable. This survey demonstrates the utility of a theory-based approach for assessing physicians' motivation to learn. Although the survey results are context specific, the approach may be useful for other CPD providers to support decision making about future AI-related CPD activities.

The AI Future of Emergency Medicine

In the coming years, artificial intelligence (AI) and machine learning will likely give rise to profound changes in the field of emergency medicine, and medicine more broadly. This article discusses these anticipated changes in terms of 3 overlapping yet distinct stages of AI development. It reviews some fundamental concepts in AI and explores their relation to clinical practice, with a focus on emergency medicine. In addition, it describes some of the applications of AI in disease diagnosis, prognosis, and treatment, as well as some of the practical issues that they raise, the barriers to their implementation, and some of the legal and regulatory challenges they create.

Implementation considerations for the adoption of artificial intelligence in the emergency department

OBJECTIVE

Artificial intelligence (AI) has emerged as a potentially transformative force, particularly in the realm of emergency medicine (EM). The implementation of AI in emergency departments (ED) has the potential to improve patient care through various modalities. However, the implementation of AI in the ED presents unique challenges that influence its clinical adoption. This scoping review summarizes the current literature exploring the barriers and facilitators of the clinical implementation of AI in the ED.

METHODS

We systematically searched Embase (Ovid), MEDLINE (Ovid), Web of Science, and Engineering Village. All articles were published in English through November 20th, 2023. Two reviewers screened the search results, with disagreements resolved through third-party adjudication.

RESULTS

A total of 8172 studies were included in the preliminary search, with 22 selected for the final data extraction. 10 studies were reviews and the remaining 12 were primary quantitative, qualitative, and mixed-methods studies. Out of the 22, 13 studies investigated a specific AI tool or application. Common barriers to implementation included a lack of model interpretability and explainability, encroachment on physician autonomy, and medicolegal considerations. Common facilitators to implementation included educating staff on the model, efficient integration into existing workflows, and sound external validation.

CONCLUSION

There is increasing literature on AI implementation in the ED. Our research suggests that the most common barrier facing AI implementation in the ED is model interpretability and explainability. More primary research investigating the implementation of specific AI tools should be undertaken to help facilitate their successful clinical adoption in the ED.

Nursing Students' Attitudes Toward Technology: Multicenter Cross-Sectional Study

BACKGROUND

The growing presence of digital technologies in health care requires the health workforce to have proficiency in subjects such as informatics. This has implications in the education of nursing students, as their preparedness to use these technologies in clinical situations is something that course administrators need to consider. Thus, students' attitudes toward technology could be investigated to assess their needs regarding this proficiency.

OBJECTIVE

This study aims to investigate attitudes (enthusiasm and anxiety) toward technology among nursing students and to identify factors associated with those attitudes.

METHODS

Nursing students at 2 universities in Sweden and 1 university in Poland were invited to answer a questionnaire. Data about attitudes (anxiety and enthusiasm) toward technology, eHealth literacy, electronic device skills, and frequency of using electronic devices and sociodemographic data were collected. Descriptive statistics were used to characterize the data. The Spearman rank correlation coefficient and Mann-Whitney U test were used for statistical inferences.

RESULTS

In total, 646 students answered the questionnaire-342 (52.9%) from the Swedish sites and 304 (47.1%) from the Polish site. It was observed that the students' technology enthusiasm (techEnthusiasm) was on the higher end of the Technophilia instrument (score range 1-5): 3.83 (SD 0.90), 3.62 (SD 0.94), and 4.04 (SD 0.78) for the whole sample, Swedish students, and Polish students, respectively. Technology anxiety (techAnxiety) was on the midrange of the Technophilia instrument: 2.48 (SD 0.96), 2.37 (SD 1), and 2.60 (SD 0.89) for the whole sample, Swedish students, and Polish students, respectively. Regarding techEnthusiasm among the nursing students, a negative correlation with age was found for the Swedish sample (P<.001; ρSwedish=-0.201) who were generally older than the Polish sample, and positive correlations with the eHealth Literacy Scale score (P<.001; ρall=0.265; ρSwedish=0.190; ρPolish=0.352) and with the perceived skill in using computer devices (P<.001; ρall=0.360; ρSwedish=0.341; ρPolish=0.309) were found for the Swedish, Polish, and total samples. Regarding techAnxiety among the nursing students, a positive correlation with age was found in the Swedish sample (P<.001; ρSwedish=0.184), and negative correlations with eHealth Literacy Scale score (P<.001; ρall=-0.196; ρSwedish=-0.262; ρPolish=-0.133) and with the perceived skill in using computer devices (P<.001; ρall=-0.209; ρSwedish=-0.347; ρPolish=-0.134) were found for the Swedish, Polish, and total samples and with the semester only for the Swedish sample (P<.001; ρSwedish=-0.124). Gender differences were found regarding techAnxiety in the Swedish sample, with women exhibiting a higher mean score than men (2.451, SD 1.014 and 1.987, SD 0.854, respectively).

CONCLUSIONS

This study highlights nursing students' techEnthusiasm and techAnxiety, emphasizing correlations with various factors. With health care's increasing reliance on technology, integrating health technology-related topics into education is crucial for future professionals to address health care challenges effectively.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/14643.