1
|
Scott IA, van der Vegt A, Lane P, McPhail S, Magrabi F. Achieving large-scale clinician adoption of AI-enabled decision support. BMJ Health Care Inform 2024; 31:e100971. [PMID: 38816209 PMCID: PMC11141172 DOI: 10.1136/bmjhci-2023-100971] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2023] [Accepted: 05/15/2024] [Indexed: 06/01/2024] Open
Abstract
Computerised decision support (CDS) tools enabled by artificial intelligence (AI) seek to enhance accuracy and efficiency of clinician decision-making at the point of care. Statistical models developed using machine learning (ML) underpin most current tools. However, despite thousands of models and hundreds of regulator-approved tools internationally, large-scale uptake into routine clinical practice has proved elusive. While underdeveloped system readiness and investment in AI/ML within Australia and perhaps other countries are impediments, clinician ambivalence towards adopting these tools at scale could be a major inhibitor. We propose a set of principles and several strategic enablers for obtaining broad clinician acceptance of AI/ML-enabled CDS tools.
Collapse
Affiliation(s)
- Ian A Scott
- Internal Medicine and Clinical Epidemiology, Princess Alexandra Hospital, Brisbane, Queensland, Australia
- Centre for Health Services Research, The University of Queensland Faculty of Medicine and Biomedical Sciences, Brisbane, Queensland, Australia
| | - Anton van der Vegt
- Digital Health Centre, The University of Queensland Faculty of Medicine and Biomedical Sciences, Herston, Queensland, Australia
| | - Paul Lane
- Safety, Quality and Innovation, The Prince Charles Hospital, Brisbane, Queensland, Australia
| | - Steven McPhail
- Australian Centre for Health Services Innovation, Queensland University of Technology Faculty of Health, Brisbane, Queensland, Australia
| | - Farah Magrabi
- Macquarie University, Sydney, New South Wales, Australia
| |
Collapse
|
2
|
van der Vegt A, Campbell V, Zuccon G. Why clinical artificial intelligence is (almost) non-existent in Australian hospitals and how to fix it. Med J Aust 2024; 220:172-175. [PMID: 38146620 DOI: 10.5694/mja2.52195] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Accepted: 10/27/2023] [Indexed: 12/27/2023]
Affiliation(s)
- Anton van der Vegt
- Centre for Health Services Research, University of Queensland, Brisbane, QLD
| | | | | |
Collapse
|
3
|
van der Vegt AH, Campbell V, Mitchell I, Malycha J, Simpson J, Flenady T, Flabouris A, Lane PJ, Mehta N, Kalke VR, Decoyna JA, Es’haghi N, Liu CH, Scott IA. Systematic review and longitudinal analysis of implementing Artificial Intelligence to predict clinical deterioration in adult hospitals: what is known and what remains uncertain. J Am Med Inform Assoc 2024; 31:509-524. [PMID: 37964688 PMCID: PMC10797271 DOI: 10.1093/jamia/ocad220] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2023] [Revised: 10/27/2023] [Accepted: 10/31/2023] [Indexed: 11/16/2023] Open
Abstract
OBJECTIVE To identify factors influencing implementation of machine learning algorithms (MLAs) that predict clinical deterioration in hospitalized adult patients and relate these to a validated implementation framework. MATERIALS AND METHODS A systematic review of studies of implemented or trialed real-time clinical deterioration prediction MLAs was undertaken, which identified: how MLA implementation was measured; impact of MLAs on clinical processes and patient outcomes; and barriers, enablers and uncertainties within the implementation process. Review findings were then mapped to the SALIENT end-to-end implementation framework to identify the implementation stages at which these factors applied. RESULTS Thirty-seven articles relating to 14 groups of MLAs were identified, each trialing or implementing a bespoke algorithm. One hundred and seven distinct implementation evaluation metrics were identified. Four groups reported decreased hospital mortality, 1 significantly. We identified 24 barriers, 40 enablers, and 14 uncertainties and mapped these to the 5 stages of the SALIENT implementation framework. DISCUSSION Algorithm performance across implementation stages decreased between in silico and trial stages. Silent plus pilot trial inclusion was associated with decreased mortality, as was the use of logistic regression algorithms that used less than 39 variables. Mitigation of alert fatigue via alert suppression and threshold configuration was commonly employed across groups. CONCLUSIONS : There is evidence that real-world implementation of clinical deterioration prediction MLAs may improve clinical outcomes. Various factors identified as influencing success or failure of implementation can be mapped to different stages of implementation, thereby providing useful and practical guidance for implementers.
Collapse
Affiliation(s)
- Anton H van der Vegt
- Centre for Health Services Research, The University of Queensland, Brisbane, QLD 4102, Australia
| | - Victoria Campbell
- Intensive Care Unit, Sunshine Coast Hospital and Health Service, Birtynia, QLD 4575, Australia
- School of Medicine and Dentistry, Griffith University, Gold Coast, QLD 4222, Australia
| | - Imogen Mitchell
- Office of Research and Education, Canberra Health Services, Canberra, ACT 2601, Australia
| | - James Malycha
- Department of Critical Care Medicine, The Queen Elizabeth Hospital, Woodville, SA 5011, Australia
| | - Joanna Simpson
- Eastern Health Intensive Care Services, Eastern Health, Box Hill, VIC 3128, Australia
| | - Tracy Flenady
- School of Nursing, Midwifery & Social Sciences, Central Queensland University, Rockhampton, QLD 4701, Australia
| | - Arthas Flabouris
- Intensive Care Department, Royal Adelaide Hospital, Adelaide, SA 5000, Australia
- Adelaide Medical School, University of Adelaide, Adelaide, SA 5005, Australia
| | - Paul J Lane
- Safety Quality & Innovation, The Prince Charles Hospital, Chermside, QLD 4032, Australia
| | - Naitik Mehta
- Patient Safety and Quality, Clinical Excellence Queensland, Brisbane, QLD 4001, Australia
| | - Vikrant R Kalke
- Patient Safety and Quality, Clinical Excellence Queensland, Brisbane, QLD 4001, Australia
| | - Jovie A Decoyna
- School of Medicine and Dentistry, Griffith University, Gold Coast, QLD 4222, Australia
| | - Nicholas Es’haghi
- School of Medicine and Dentistry, Griffith University, Gold Coast, QLD 4222, Australia
| | - Chun-Huei Liu
- School of Medicine and Dentistry, Griffith University, Gold Coast, QLD 4222, Australia
| | - Ian A Scott
- Centre for Health Services Research, The University of Queensland, Brisbane, QLD 4102, Australia
- Department of Internal Medicine and Clinical Epidemiology, Princess Alexandra Hospital, Brisbane, QLD 4102, Australia
| |
Collapse
|