Analyzing interactions on combining multiple clinical guidelines

ROAD2H: Development and evaluation of an open-source explainable artificial intelligence approach for managing co-morbidity and clinical guidelines

Introduction

Clinical decision support (CDS) systems (CDSSs) that integrate clinical guidelines need to reflect real-world co-morbidity. In patient-specific clinical contexts, transparent recommendations that allow for contraindications and other conflicts arising from co-morbidity are a requirement. In this work, we develop and evaluate a non-proprietary, standards-based approach to the deployment of computable guidelines with explainable argumentation, integrated with a commercial electronic health record (EHR) system in Serbia, a middle-income country in West Balkans.

Methods

We used an ontological framework, the Transition-based Medical Recommendation (TMR) model, to represent, and reason about, guideline concepts, and chose the 2017 International global initiative for chronic obstructive lung disease (GOLD) guideline and a Serbian hospital as the deployment and evaluation site, respectively. To mitigate potential guideline conflicts, we used a TMR-based implementation of the Assumptions-Based Argumentation framework extended with preferences and Goals (ABA+G). Remote EHR integration of computable guidelines was via a microservice architecture based on HL7 FHIR and CDS Hooks. A prototype integration was developed to manage chronic obstructive pulmonary disease (COPD) with comorbid cardiovascular or chronic kidney diseases, and a mixed-methods evaluation was conducted with 20 simulated cases and five pulmonologists.

Results

Pulmonologists agreed 97% of the time with the GOLD-based COPD symptom severity assessment assigned to each patient by the CDSS, and 98% of the time with one of the proposed COPD care plans. Comments were favourable on the principles of explainable argumentation; inclusion of additional co-morbidities was suggested in the future along with customisation of the level of explanation with expertise.

Conclusion

An ontological model provided a flexible means of providing argumentation and explainable artificial intelligence for a long-term condition. Extension to other guidelines and multiple co-morbidities is needed to test the approach further.

Supporting physicians in the coordination of distributed execution of CIGs to treat comorbid patients

Clinical Practice Guidelines (CPGs) encode the "best" medical practices to treat patients affected by a specific disease and are widely used in the medical practice. Starting from the '90s', several Computer-Interpretable Guideline (CIG) systems have been devised to provide physicians with CPG-based decision support. CPGs (and CIGs) are devoted to provide evidence-based recommendations for one specific disease. In order to support the treatment of patients affected by multiple diseases (i.e., comorbid patients), challenging additional tasks have to be addressed, such as (i) the detection of the interactions between CIG actions, (ii) their management, and, finally, (iii) the "merge" or conciliation of the CIGs. Several CIG approaches have been recently extended in order to face (at least one of) such challenging problems, and one of them is GLARE. However, besides the solutions to tasks (i)-(iii) above, the "run-time" support to physicians treating a comorbid patient requires additional capabilities, to support the distribution of the management of interactions and of the execution of CIGs among different physicians. In this paper, we propose a general framework, based on GLARE and GLARE-SSCPM, to provide such additional capabilities.

Decision-support systems for managing polypharmacy in the elderly: A scoping review

Polypharmacy, the consuming of more than five drugs, is a public health problem. It can lead to many interactions and adverse drug reactions and is very expensive. Therapeutic guidelines for managing polypharmacy in the elderly have been issued, but are highly complex, limiting their use. Decision-support systems have therefore been developed to automate the execution of these guidelines, or to provide information about drugs adapted to the context of polypharmacy. These systems differ widely in terms of their technical design, knowledge sources and evaluation methods. We present here a scoping review of electronic systems for supporting the management, by healthcare providers, of polypharmacy in elderly patients. Most existing reviews have focused mainly on evaluation results, whereas the present review also describes the technical design of these systems and the methodologies for developing and evaluating them. A systematic bibliographic search identified 19 systems differing considerably in terms of their technical design (rule-based systems, documentary approach, mixed); outputs (textual report, alerts and/or visual approaches); and evaluations (impact on clinical practices, impact on patient outcomes, efficiency and/or user satisfaction). The evaluations performed are minimal (among all the systems identified, only one system has been evaluated according to all the criteria mentioned above) and no machine learning systems and/or conflict management systems were retrieved. This review highlights the need to develop new methodologies, combining various approaches for decision support system in polypharmacy.

Argumentation schemes for clinical decision support

This paper demonstrates how argumentation schemes can be used in decision support systems that help clinicians in making treatment decisions. The work builds on the use of computational argumentation, a rigorous approach to reasoning with complex data that places strong emphasis on being able to justify and explain the decisions that are recommended. The main contribution of the paper is to present a novel set of specialised argumentation schemes that can be used in the context of a clinical decision support system to assist in reasoning about what treatments to offer. These schemes provide a mechanism for capturing clinical reasoning in such a way that it can be handled by the formal reasoning mechanisms of formal argumentation. The paper describes how the integration between argumentation schemes and formal argumentation may be carried out, sketches how this is achieved by an implementation that we have created and illustrates the overall process on a small set of case studies.

Decision support for comorbid conditions via execution-time integration of clinical guidelines using transaction-based semantics and temporal planning

In case of comorbidity, i.e., multiple medical conditions, Clinical Decision Support Systems (CDSS) should issue recommendations based on all relevant disease-related Clinical Practice Guidelines (CPG). However, treatments from multiple comorbid CPG often interact adversely (e.g., drug-drug interactions) or introduce operational inefficiencies (e.g., redundant scans). A common solution is the a-priori integration of computerized CPG, which involves integration decisions such as discarding, replacing or delaying clinical tasks (e.g., treatments) to avoid adverse interactions or inefficiencies. We argue this insufficiently deals with execution-time events: as the patient's health profile evolves, acute conditions occur, and real-time delays take place, new CPG integration decisions will often be needed, and prior ones may need to be reverted or undone. Any realistic CPG integration effort needs to further consider temporal aspects of clinical tasks-these are not only restricted by temporal constraints from CPGs (e.g., sequential relations, task durations) but also by CPG integration efforts (e.g., avoid treatment overlap). This poses a complex execution-time challenge and makes it difficult to determine an up-to-date, optimal comorbid care plan. We present a solution for dynamic integration of CPG in response to evolving health profiles and execution-time events. CPG integration policies are formulated by clinical experts for coping with comorbidity at execution-time, with clearly defined integration semantics that build on Description and Transaction Logics. A dynamic planning approach reconciles temporal constraints of CPG tasks at execution-time based on their importance, and continuously updates an optimal task schedule.

Assumption-based argumentation with preferences and goals for patient-centric reasoning with interacting clinical guidelines

A paramount, yet unresolved issue in personalised medicine is that of automated reasoning with clinical guidelines in multimorbidity settings. This entails enabling machines to use computerised generic clinical guideline recommendations and patient-specific information to yield patient-tailored recommendations where interactions arising due to multimorbidities are resolved. This problem is further complicated by patient management desiderata, in particular the need to account for patient-centric goals as well as preferences of various parties involved. We propose to solve this problem of automated reasoning with interacting guideline recommendations in the context of a given patient by means of computational argumentation. In particular, we advance a structured argumentation formalism ABA+G (short for Assumption-Based Argumentation with Preferences (ABA+) and Goals) for integrating and reasoning with information about recommendations, interactions, patient’s state, preferences and prioritised goals. ABA+G combines assumption-based reasoning with preferences and goal-driven selection among reasoning outcomes. Specifically, we assume defeasible applicability of guideline recommendations with the general goal of patient well-being, resolve interactions (conflicts and otherwise undesirable situations) among recommendations based on the state and preferences of the patient, and employ patient-centered goals to suggest interaction-resolving, goal-importance maximising and preference-adhering recommendations. We use a well-established Transition-based Medical Recommendation model for representing guideline recommendations and identifying interactions thereof, and map the components in question, together with the given patient’s state, prioritised goals, and preferences over actions, to ABA+G for automated reasoning. In this, we follow principles of patient management and establish corresponding theoretical properties as well as illustrate our approach in realistic personalised clinical reasoning scenaria.

Towards a goal-oriented methodology for clinical-guideline-based management recommendations for patients with multimorbidity: GoCom and its preliminary evaluation

Patients with chronic multimorbidity are becoming more common as life expectancy increases, making it necessary for physicians to develop complex management plans. We are looking at the patient management process as a goal-attainment problem. Hence, our aim is to develop a goal-oriented methodology for providing decision support for managing patients with multimorbidity continuously, as the patient's health state is progressing and new goals arise (e.g., treat ulcer, prevent osteoporosis). Our methodology allows us to detect and mitigate inconsistencies among guideline recommendations stemming from multiple clinical guidelines, while consulting medical ontologies and terminologies and relying on patient information standards. This methodology and its implementation as a decision-support system, called GoCom, starts with computer-interpretable clinical guidelines (CIGs) for single problems that are formalized using the PROforma CIG language. We previously published the architecture of the system as well as a CIG elicitation guide for enriching PROforma tasks with properties referring to vocabulary codes of goals and physiological effects of management plans. In this paper, we provide a formalization of the conceptual model of GoCom that generates, for each morbidity of the patient, a patient-specific goal tree that results from the PROforma engine's enactment of the CIG with the patient's data. We also present the "Controller" algorithm that drives the GoCom system. Given a new problem that a patient develops, the Controller detects inconsistencies among goals pertaining to different comorbid problems and consults the CIGs to generate alternative non-conflicted and goal-oriented management plans that address the multiple goals simultaneously. In this stage of our research, the inconsistencies that can be detected are of two types - starting vs. stopping medications that belong to the same medication class hierarchy, and detecting opposing physiological effect goals that are specified in concurrent CIGs (e.g., decreased blood pressure vs. increased blood pressure). However, the design of GoCom is modular and generic and allows the future introduction of additional interaction detection and mitigation strategies. Moreover, GoCom generates explanations of the alternative non-conflicted management plans, based on recommendations stemming from the clinical guidelines and reasoning patterns. GoCom's functionality was evaluated using three cases of multimorbidity interactions that were checked by our three clinicians. Usefulness was evaluated with two studies. The first evaluation was a pilot study with ten 6th year medical students and the second evaluation was done with 27 6th medical students and interns. The participants solved complex realistic cases of multimorbidity patients: with and without decision-support, two cases in the first evaluation and 6 cases in the second evaluation. Use of GoCom increased completeness of the patient management plans produced by the medical students from 0.44 to 0.71 (P-value of 0.0005) in the first evaluation, and from 0.31 to 0.78 (P-value < 0.0001) in the second evaluation. Correctness in the first evaluation was very high with (0.98) or without the system (0.91), with non-significant difference (P-value ≥ 0.17). In the second evaluation, use of GoCom increased correctness from 0.68 to 0.83 (P-value of 0.001). In addition, GoCom's explanation and visualization were perceived as useful by the vast majority of participants. While GoCom's detection of goal interactions is currently limited to detection of starting vs. stopping the same medication or medication subclasses and detecting conflicting physiological effects of concurrent medications, the evaluation demonstrated potential of the system for improving clinical decision-making for multimorbidity patients.

Conformance analysis for comorbid patients in Answer Set Programming

The treatment of comorbid patients is a hot problem in Medical Informatics, since the plain application of multiple Computer-Interpretable Guidelines (CIGs) can lead to interactions that are potentially dangerous for the patients. The specialized literature has mostly focused on the "a priori" or "execution-time" analysis of the interactions between multiple Computer-Interpretable Guidelines (CIGs), and/or CIG "merge". In this paper, we face a complementary problem, namely, the a posteriori analysis of the treatment of comorbid patients. Given the CIGs, the history of the status of the patient, and the log of the clinical actions executed on her, we try to explain the actions executed on the patient (i.e., the log) in terms of the actions recommended by the CIGs, of their potential interactions, and of the possible ways of managing each such interaction, pointing out (i) deviations from CIG recommendations not explained in terms of interaction management (if any) and (ii) unmanaged interactions (if any). Our approach is based on Answer Set Programming, and, to face realistic problems, devotes specific attention to the temporal dimension.

Artificial Intelligence in Clinical Decision Support: a Focused Literature Survey

OBJECTIVES

This survey analyses the latest literature contributions to clinical decision support systems (DSSs) on a two-year period (2017-2018), focusing on the approaches that adopt Artificial Intelligence (AI) techniques in a broad sense. The goal is to analyse the distribution of data-driven AI approaches with respect to "classical" knowledge-based ones, and to consider the issues raised and their possible solutions.

METHODS

We included PubMed and Web of ScienceTM publications, focusing on contributions describing clinical DSSs that adopted one or more AI methodologies.

RESULTS

We selected 75 papers, 49 of which describe approaches in the data-driven AI area, 20 present purely knowledge-based DSSs, and 6 adopt hybrid approaches relying on both formalized knowledge and data.

CONCLUSIONS

Recent studies in the clinical DSS area demonstrate a prevalence of data-driven AI, which can be adopted autonomously in purely data-driven systems, or in cooperation with domain knowledge in hybrid systems. Such hybrid approaches, able to conjugate all available knowledge sources through proper knowledge integration steps, represent an interesting example of synergy between the two AI categories. This synergy can lead to the resolution of some existing issues, such as the need for transparency and explainability, nowadays recognized as central themes to be addressed by both AI and medical informatics research.

A framework for automated conflict detection and resolution in medical guidelines

Common chronic conditions are routinely treated following standardised procedures known as clinical guidelines. For patients suffering from two or more chronic conditions, known as multimorbidity, several guidelines have to be applied simultaneously, which may lead to severe adverse effects when the combined recommendations and prescribed medications are inconsistent or incomplete. This paper presents an automated formal framework to detect, highlight and resolve conflicts in the treatments used for patients with multimorbidities focusing on medications. The presented extended framework has a front-end which takes guidelines captured in a standard modelling language and returns the visualisation of the detected conflicts as well as suggested alternative treatments. Internally, the guidelines are transformed into formal models capturing the possible unfoldings of the guidelines. The back-end takes the formal models associated with multiple guidelines and checks their correctness with a theorem prover, and inherent inconsistencies with a constraint solver. Key to our approach is the use of an optimising constraint solver which enables us to search for the best solution that resolves/minimises conflicts according to medication efficacy and the degree of severity in case of harmful combinations, also taking into account their temporal overlapping. The approach is illustrated throughout with a real medical example.

Execution-time integration of clinical practice guidelines to provide decision support for comorbid conditions

Patients with multiple medical conditions (comorbidity) pose major challenges to clinical decision support systems, since the different Clinical Practice Guidelines (CPG) often involve adverse interactions, such as drug-drug or drug-disease interactions. Moreover, opportunities often exist for optimizing care and resources across multiple CPG. These challenges have been taken up in the state of the art, with many approaches focusing on the static integration of comorbid CIG. Nevertheless, we observe that many aspects often change dynamically over time, in ways that cannot be foreseen - such as delays in care tasks, resource availability, test outcomes, and acute comorbid conditions. To ensure the clinical safety and effectiveness of integrating multiple comorbid CIG, these execution-time difficulties must be considered. Further, when dealing with comorbid conditions, we remark that clinical practitioners typically consider multiple complex solutions, depending on the patient's health profile. Hence, execution-time flexibility, based on dynamic health parameters, is needed to effectively and safely cope with comorbid conditions. In this work, we introduce a flexible, knowledge-driven and execution-time approach to comorbid CIG integration, based on an OWL ontology with clearly defined integration semantics.

The use of computer-interpretable clinical guidelines to manage care complexities of patients with multimorbid conditions: A review

Clinical practice guidelines (CPGs) document evidence-based information and recommendations on treatment and management of conditions. CPGs usually focus on management of a single condition; however, in many cases a patient will be at the centre of multiple health conditions (multimorbidity). Multiple CPGs need to be followed in parallel, each managing a separate condition, which often results in instructions that may interact with each other, such as conflicts in medication. Furthermore, the impetus to deliver customised care based on patient-specific information, results in the need to be able to offer guidelines in an integrated manner, identifying and managing their interactions. In recent years, CPGs have been formatted as computer-interpretable guidelines (CIGs). This enables developing CIG-driven clinical decision support systems (CDSSs), which allow the development of IT applications that contribute to the systematic and reliable management of multiple guidelines. This study focuses on understanding the use of CIG-based CDSSs, in order to manage care complexities of patients with multimorbidity. The literature between 2011 and 2017 is reviewed, which covers: (a) the challenges and barriers in the care of multimorbid patients, (b) the role of CIGs in CDSS augmented delivery of care, and (c) the approaches to alleviating care complexities of multimorbid patients. Generating integrated care plans, detecting and resolving adverse interactions between treatments and medications, dealing with temporal constraints in care steps, supporting patient-caregiver shared decision making and maintaining the continuity of care are some of the approaches that are enabled using a CIG-based CDSS.