What is needed to mainstream artificial intelligence in health care?

Evolution of Drug Development and Regulatory Affairs: The Demonstrated Power of Artificial Intelligence

PURPOSE

Artificial intelligence (AI) refers to technology capable of mimicking human cognitive functions and has important applications across all sectors and industries, including drug development. This has considerable implications for the regulation of drug development processes, as it is expected to transform both the way drugs are brought to market and the systems through which this process is controlled. There is currently insufficient evidence in published literature of the real-world applications of AI. Therefore, this narrative review investigated, collated, and elucidated the applications of AI in drug development and its regulatory processes.

METHODS

A narrative review was conducted to ascertain the role of AI in streamlining drug development and regulatory processes.

FINDINGS

The findings of this review revealed that machine learning or deep learning, natural language processing, and robotic process automation were favored applications of AI. Each of them had considerable implications on the operations they were intended to support. Overall, the AI tools facilitated access and provided manageability of information for decision-making across the drug development lifecycle. However, the findings also indicate that additional work is required by regulatory authorities to set out appropriate guidance on applications of the technology, which has critical implications for safety, regulatory process workflow and product development costs.

IMPLICATIONS

AI has adequately proven its utility in drug development, prompting further investigations into the translational value of its utility based on cost and time saved for the delivery of essential drugs.

Artificial intelligence in medical referrals triage based on Clinical Prioritization Criteria

The clinical prioritisation criteria (CPC) are a clinical decision support tool that ensures patients referred for public specialist outpatient services to Queensland Health are assessed according to their clinical urgency. Medical referrals are manually triaged and prioritised into three categories by the associated health service before appointments are booked. We have developed a method using artificial intelligence to automate the process of categorizing medical referrals based on clinical prioritization criteria (CPC) guidelines. Using machine learning techniques, we have created a tool that can assist clinicians in sorting through the substantial number of referrals they receive each year, leading to more efficient use of clinical specialists' time and improved access to healthcare for patients. Our research included analyzing 17,378 ENT referrals from two hospitals in Queensland between 2019 and 2022. Our results show a level of agreement between referral categories and generated predictions of 53.8%.

Co-design of human-centered, explainable AI for clinical decision support

eXplainable AI (XAI) involves two intertwined but separate challenges: the development of techniques to extract explanations from black-box AI models, and the way such explanations are presented to users, i.e., the explanation user interface. Despite its importance, the second aspect has received limited attention so far in the literature. Effective AI explanation interfaces are fundamental for allowing human decision-makers to take advantage and oversee high-risk AI systems effectively. Following an iterative design approach, we present the first cycle of prototyping-testing-redesigning of an explainable AI technique, and its explanation user interface for clinical Decision Support Systems (DSS). We first present an XAI technique that meets the technical requirements of the healthcare domain: sequential, ontology-linked patient data, and multi-label classification tasks. We demonstrate its applicability to explain a clinical DSS, and we design a first prototype of an explanation user interface. Next, we test such a prototype with healthcare providers and collect their feedback, with a two-fold outcome: first, we obtain evidence that explanations increase users’ trust in the XAI system, and second, we obtain useful insights on the perceived deficiencies of their interaction with the system, so that we can re-design a better, more human-centered explanation interface.

Influence of nurses in the implementation of artificial intelligence in health care: a scoping review

Objective This scoping review maps the approach undertaken by nurses to influence the implementation of artificial intelligence in health care. It also provides evidence of how frequently nurses drive the implementation of artificial intelligence, and how often nurses collaborate within the technical team. Methods A systematic search using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines was undertaken from 24 July to 22 August 2020 to identify six records that met the inclusion criteria. Results Nurses influenced the implementation of artificial intelligence in health care by: problem solving; articulating contextual needs and priorities; providing real-world insight and solutions; providing examples of implementation; and determining end user satisfaction. There was one instance of nurses driving implementation, and four instances of nurses collaborating with a technical team approach. Conclusion The expertise of nurses must be sought to ensure artificial intelligence can effectively meet the highly context-specific demands of the healthcare environment.

Predicting Therapeutic Response to Unfractionated Heparin Therapy: Machine Learning Approach

Background

Unfractionated heparin (UFH) is an anticoagulant drug that is considered a high-risk medication because an excessive dose can cause bleeding, whereas an insufficient dose can lead to a recurrent embolic event. Therapeutic response to the initiation of intravenous UFH is monitored using activated partial thromboplastin time (aPTT) as a measure of blood clotting time. Clinicians iteratively adjust the dose of UFH toward a target, indication-defined therapeutic aPTT range using nomograms, but this process can be imprecise and can take ≥36 hours to achieve the target range. Thus, a more efficient approach is required.

Objective

In this study, we aimed to develop and validate a machine learning (ML) algorithm to predict aPTT within 12 hours after a specified bolus and maintenance dose of UFH.

Methods

This was a retrospective cohort study of 3019 patient episodes of care from January 2017 to August 2020 using data collected from electronic health records of 5 hospitals in Queensland, Australia. Data from 4 hospitals were used to build and test ensemble models using cross-validation, whereas data from the fifth hospital were used for external validation. We built 2 ML models: a regression model to predict the aPTT value after a UFH bolus dose and a multiclass model to predict the aPTT, classified as subtherapeutic (aPTT <70 seconds), therapeutic (aPTT 70-100 seconds), or supratherapeutic (aPTT >100 seconds). Modeling was performed using Driverless AI (H2O), an automated ML tool, and 17 different experiments were iteratively conducted to optimize model accuracy.

Results

In predicting aPTT, the best performing model was an ensemble with 4x LightGBM models with a root mean square error of 31.35 (SD 1.37). In predicting the aPTT class using a repurposed data set, the best performing ensemble model achieved an accuracy of 0.599 (SD 0.0289) and an area under the receiver operating characteristic curve of 0.735. External validation yielded similar results: root mean square error of 30.52 (SD 1.29) for the aPTT prediction model, and accuracy of 0.568 (SD 0.0315) and area under the receiver operating characteristic curve of 0.724 for the aPTT multiclassification model.

Conclusions

To the best of our knowledge, this is the first ML model applied to intravenous UFH dosing that has been developed and externally validated in a multisite adult general medical and surgical inpatient setting. We present the processes of data collection, preparation, and feature engineering for replication.