1
|
Yang M, Liu S, Hao T, Ma C, Chen H, Li Y, Wu C, Xie J, Qiu H, Li J, Yang Y, Liu C. Development and validation of a deep interpretable network for continuous acute kidney injury prediction in critically ill patients. Artif Intell Med 2024; 149:102785. [PMID: 38462285 DOI: 10.1016/j.artmed.2024.102785] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2022] [Revised: 10/05/2023] [Accepted: 01/21/2024] [Indexed: 03/12/2024]
Abstract
Early detection of acute kidney injury (AKI) may provide a crucial window of opportunity to prevent further injury, which helps improve clinical outcomes. This study aimed to develop a deep interpretable network for continuously predicting the 24-hour AKI risk in real-time and evaluate its performance internally and externally in critically ill patients. A total of 21,163 patients' electronic health records sourced from Beth Israel Deaconess Medical Center (BIDMC) were first included in building the model. Two external validation populations included 3025 patients from the Philips eICU Research Institute and 2625 patients from Zhongda Hospital Southeast University. A total of 152 intelligently engineered predictors were extracted on an hourly basis. The prediction model referred to as DeepAKI was designed with the basic framework of squeeze-and-excitation networks with dilated causal convolution embedded. The integrated gradients method was utilized to explain the prediction model. When performed on the internal validation set (3175 [15 %] patients from BIDMC) and the two external validation sets, DeepAKI obtained the area under the curve of 0.799 (95 % CI 0.791-0.806), 0.763 (95 % CI 0.755-0.771) and 0.676 (95 % CI 0.668-0.684) for continuousAKI prediction, respectively. For model interpretability, clinically relevant important variables contributing to the model prediction were informed, and individual explanations along the timeline were explored to show how AKI risk arose. The potential threats to generalisability in deep learning-based models when deployed across health systems in real-world settings were analyzed.
Collapse
Affiliation(s)
- Meicheng Yang
- The State Key Laboratory of Digital Medical Engineering, School of Instrument Science and Engineering, Southeast University, Nanjing, China
| | - Songqiao Liu
- Jiangsu Provincial Key Laboratory of Critical Care Medicine, Department of Critical Care Medicine, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China; Department of Critical Care Medicine, Nanjing Lishui People's Hospital, Zhongda Hospital Lishui Branch, Nanjing, China
| | - Tong Hao
- Jiangsu Provincial Key Laboratory of Critical Care Medicine, Department of Critical Care Medicine, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China
| | - Caiyun Ma
- The State Key Laboratory of Digital Medical Engineering, School of Instrument Science and Engineering, Southeast University, Nanjing, China
| | - Hui Chen
- Jiangsu Provincial Key Laboratory of Critical Care Medicine, Department of Critical Care Medicine, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China
| | - Yuwen Li
- The State Key Laboratory of Digital Medical Engineering, School of Instrument Science and Engineering, Southeast University, Nanjing, China
| | - Changde Wu
- Jiangsu Provincial Key Laboratory of Critical Care Medicine, Department of Critical Care Medicine, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China
| | - Jianfeng Xie
- Jiangsu Provincial Key Laboratory of Critical Care Medicine, Department of Critical Care Medicine, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China
| | - Haibo Qiu
- Jiangsu Provincial Key Laboratory of Critical Care Medicine, Department of Critical Care Medicine, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China
| | - Jianqing Li
- The State Key Laboratory of Digital Medical Engineering, School of Instrument Science and Engineering, Southeast University, Nanjing, China; School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing, China.
| | - Yi Yang
- Jiangsu Provincial Key Laboratory of Critical Care Medicine, Department of Critical Care Medicine, Zhongda Hospital, School of Medicine, Southeast University, Nanjing, China.
| | - Chengyu Liu
- The State Key Laboratory of Digital Medical Engineering, School of Instrument Science and Engineering, Southeast University, Nanjing, China.
| |
Collapse
|
2
|
Shi J, Bendig D, Vollmar HC, Rasche P. Mapping the Bibliometrics Landscape of AI in Medicine: Methodological Study. J Med Internet Res 2023; 25:e45815. [PMID: 38064255 PMCID: PMC10746970 DOI: 10.2196/45815] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Revised: 08/16/2023] [Accepted: 09/30/2023] [Indexed: 12/18/2023] Open
Abstract
BACKGROUND Artificial intelligence (AI), conceived in the 1950s, has permeated numerous industries, intensifying in tandem with advancements in computing power. Despite the widespread adoption of AI, its integration into medicine trails other sectors. However, medical AI research has experienced substantial growth, attracting considerable attention from researchers and practitioners. OBJECTIVE In the absence of an existing framework, this study aims to outline the current landscape of medical AI research and provide insights into its future developments by examining all AI-related studies within PubMed over the past 2 decades. We also propose potential data acquisition and analysis methods, developed using Python (version 3.11) and to be executed in Spyder IDE (version 5.4.3), for future analogous research. METHODS Our dual-pronged approach involved (1) retrieving publication metadata related to AI from PubMed (spanning 2000-2022) via Python, including titles, abstracts, authors, journals, country, and publishing years, followed by keyword frequency analysis and (2) classifying relevant topics using latent Dirichlet allocation, an unsupervised machine learning approach, and defining the research scope of AI in medicine. In the absence of a universal medical AI taxonomy, we used an AI dictionary based on the European Commission Joint Research Centre AI Watch report, which emphasizes 8 domains: reasoning, planning, learning, perception, communication, integration and interaction, service, and AI ethics and philosophy. RESULTS From 2000 to 2022, a comprehensive analysis of 307,701 AI-related publications from PubMed highlighted a 36-fold increase. The United States emerged as a clear frontrunner, producing 68,502 of these articles. Despite its substantial contribution in terms of volume, China lagged in terms of citation impact. Diving into specific AI domains, as the Joint Research Centre AI Watch report categorized, the learning domain emerged dominant. Our classification analysis meticulously traced the nuanced research trajectories across each domain, revealing the multifaceted and evolving nature of AI's application in the realm of medicine. CONCLUSIONS The research topics have evolved as the volume of AI studies increases annually. Machine learning remains central to medical AI research, with deep learning expected to maintain its fundamental role. Empowered by predictive algorithms, pattern recognition, and imaging analysis capabilities, the future of AI research in medicine is anticipated to concentrate on medical diagnosis, robotic intervention, and disease management. Our topic modeling outcomes provide a clear insight into the focus of AI research in medicine over the past decades and lay the groundwork for predicting future directions. The domains that have attracted considerable research attention, primarily the learning domain, will continue to shape the trajectory of AI in medicine. Given the observed growing interest, the domain of AI ethics and philosophy also stands out as a prospective area of increased focus.
Collapse
Affiliation(s)
- Jin Shi
- Institute for Entrepreneurship, University of Münster, Münster, Germany
| | - David Bendig
- Institute for Entrepreneurship, University of Münster, Münster, Germany
| | | | - Peter Rasche
- Department of Healthcare, University of Applied Science - Hochschule Niederrhein, Krefeld, Germany
| |
Collapse
|
3
|
Tang Z, Feng Y, Nie W, Li C. Xanthohumol attenuates renal ischemia/reperfusion injury by inhibiting ferroptosis. Exp Ther Med 2023; 26:571. [PMID: 37954118 PMCID: PMC10632967 DOI: 10.3892/etm.2023.12269] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Accepted: 08/22/2023] [Indexed: 11/14/2023] Open
Abstract
Ischemia/reperfusion injury (IRI) is a notable contributor to kidney injury, but effective prevention and treatment options are limited. The present study aimed to evaluate the impact of xanthohumol (XN), a kind of flavonoid, on renal IRI and its pathological process in rats. Rats and HK-2 cells were divided into five groups: Sham (control), IR [hypoxia-reoxygenation (HR)], IR (HR) + XN, IR (HR) + erastin or IR (HR) + XN + erastin. The effects of XN and erastin (a ferroptosis inducer) on IRI in rats were evaluated using blood urea nitrogen, plasma creatinine, glutathione, superoxide dismutase and malondialdehyde kits, western blotting, cell viability assay, hematoxylin and eosin staining and reactive oxygen species (ROS) detection. Nrf2 small interfering (si)RNA was used to investigate the role of the Nrf2/heme oxygenase (HO)-1 axis in XN-mediated protection against HR injury. Cell viability, ROS levels and expression of ferroptosis-related proteins were analyzed. Following IR, renal function of rats was severely impaired and oxidative stress and ferroptosis levels significantly increased. However, XN treatment decreased renal injury and inhibited oxidative stress and ferroptosis in renal tubular epithelial cells. Additionally, XN upregulated the Nrf2/HO-1 signaling pathway and Nrf2-siRNA reversed the renoprotective effect of XN. XN effectively decreased renal IRI by inhibiting ferroptosis and oxidative stress and its protective mechanism may be associated with the Nrf2/HO-1 signaling pathway.
Collapse
Affiliation(s)
- Zhe Tang
- Department of Urology, The First People's Hospital of Jing Zhou, The First Affiliated Hospital of Yangtze University, Jingzhou, Hubei 434000, P.R. China
| | - Ye Feng
- Department of Urology, The First People's Hospital of Jing Zhou, The First Affiliated Hospital of Yangtze University, Jingzhou, Hubei 434000, P.R. China
| | - Wen Nie
- Department of Training Injury Prevention and Treatment, Wuhan Armed Police Special Service Rehabilitation Center, Wuhan, Hubei 430074, P.R. China
| | - Chenglong Li
- Department of Urology, Renmin Hospital of Wuhan University, Wuhan, Hubei 430060, P.R. China
| |
Collapse
|
4
|
Kim M, Sohn H, Choi S, Kim S. Requirements for Trustworthy Artificial Intelligence and its Application in Healthcare. Healthc Inform Res 2023; 29:315-322. [PMID: 37964453 PMCID: PMC10651407 DOI: 10.4258/hir.2023.29.4.315] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Revised: 10/06/2023] [Accepted: 10/13/2023] [Indexed: 11/16/2023] Open
Abstract
OBJECTIVES Artificial intelligence (AI) technologies are developing very rapidly in the medical field, but have yet to be actively used in actual clinical settings. Ensuring reliability is essential to disseminating technologies, necessitating a wide range of research and subsequent social consensus on requirements for trustworthy AI. METHODS This review divided the requirements for trustworthy medical AI into explainability, fairness, privacy protection, and robustness, investigated research trends in the literature on AI in healthcare, and explored the criteria for trustworthy AI in the medical field. RESULTS Explainability provides a basis for determining whether healthcare providers would refer to the output of an AI model, which requires the further development of explainable AI technology, evaluation methods, and user interfaces. For AI fairness, the primary task is to identify evaluation metrics optimized for the medical field. As for privacy and robustness, further development of technologies is needed, especially in defending training data or AI algorithms against adversarial attacks. CONCLUSIONS In the future, detailed standards need to be established according to the issues that medical AI would solve or the clinical field where medical AI would be used. Furthermore, these criteria should be reflected in AI-related regulations, such as AI development guidelines and approval processes for medical devices.
Collapse
Affiliation(s)
- Myeongju Kim
- Healthcare Innovation Park, Center for Artificial Intelligence in Healthcare, Seoul National University Bundang Hospital, Seongnam,
Korea
| | - Hyoju Sohn
- Healthcare Innovation Park, Center for Artificial Intelligence in Healthcare, Seoul National University Bundang Hospital, Seongnam,
Korea
| | - Sookyung Choi
- Healthcare Innovation Park, Center for Artificial Intelligence in Healthcare, Seoul National University Bundang Hospital, Seongnam,
Korea
| | - Sejoong Kim
- Healthcare Innovation Park, Center for Artificial Intelligence in Healthcare, Seoul National University Bundang Hospital, Seongnam,
Korea
- Department of Internal Medicine, Seoul National University Bundang Hospital, Seongnam,
Korea
- Department of Internal Medicine, Seoul National University College of Medicine, Seoul,
Korea
| |
Collapse
|
5
|
Pungitore S, Subbian V. Assessment of Prediction Tasks and Time Window Selection in Temporal Modeling of Electronic Health Record Data: a Systematic Review. J Healthc Inform Res 2023; 7:313-331. [PMID: 37637723 PMCID: PMC10449760 DOI: 10.1007/s41666-023-00143-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2022] [Revised: 04/12/2023] [Accepted: 07/28/2023] [Indexed: 08/29/2023]
Abstract
Temporal electronic health record (EHR) data are often preferred for clinical prediction tasks because they offer more complete representations of a patient's pathophysiology than static data. A challenge when working with temporal EHR data is problem formulation, which includes defining the time windows of interest and the prediction task. Our objective was to conduct a systematic review that assessed the definition and reporting of concepts relevant to temporal clinical prediction tasks. We searched PubMed® and IEEE Xplore® databases for studies from January 1, 2010 applying machine learning models to EHR data for patient outcome prediction. Publications applying time-series methods were selected for further review. We identified 92 studies and summarized them by clinical context and definition and reporting of the prediction problem. For the time windows of interest, 12 studies did not discuss window lengths, 57 used a single set of window lengths, and 23 evaluated the relationship between window length and model performance. We also found that 72 studies had appropriate reporting of the prediction task. However, evaluation of prediction problem formulation for temporal EHR data was complicated by heterogeneity in assessing and reporting of these concepts. Even among studies modeling similar clinical outcomes, there were variations in terminology used to describe the prediction problem, rationale for window lengths, and determination of the outcome of interest. As temporal modeling using EHR data expands, minimal reporting standards should include time-series specific concerns to promote rigor and reproducibility in future studies and facilitate model implementation in clinical settings. Supplementary Information The online version contains supplementary material available at 10.1007/s41666-023-00143-4.
Collapse
Affiliation(s)
- Sarah Pungitore
- Program in Applied Mathematics, Department of Mathematics, 617 N Santa Rita Ave, Tucson, AZ 85721 USA
| | - Vignesh Subbian
- Department of Biomedical Engineering, The University of Arizona, Tucson, AZ 85721-0020 USA
- Department of Systems and Industrial Engineering, The University of Arizona, Tucson, AZ 85721-0020 USA
| |
Collapse
|
6
|
Wainstein M, Flanagan E, Johnson DW, Shrapnel S. Systematic review of externally validated machine learning models for predicting acute kidney injury in general hospital patients. Front Nephrol 2023; 3:1220214. [PMID: 37675372 PMCID: PMC10479567 DOI: 10.3389/fneph.2023.1220214] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Accepted: 07/03/2023] [Indexed: 09/08/2023]
Abstract
Acute kidney injury (AKI) is one of the most common and consequential complications among hospitalized patients. Timely AKI risk prediction may allow simple interventions that can minimize or avoid the harm associated with its development. Given the multifactorial and complex etiology of AKI, machine learning (ML) models may be best placed to process the available health data to generate accurate and timely predictions. Accordingly, we searched the literature for externally validated ML models developed from general hospital populations using the current definition of AKI. Of 889 studies screened, only three were retrieved that fit these criteria. While most models performed well and had a sound methodological approach, the main concerns relate to their development and validation in populations with limited diversity, comparable digital ecosystems, use of a vast number of predictor variables and over-reliance on an easily accessible biomarker of kidney injury. These are potentially critical limitations to their applicability in diverse socioeconomic and cultural settings, prompting a need for simpler, more transportable prediction models which can offer a competitive advantage over the current tools used to predict and diagnose AKI.
Collapse
Affiliation(s)
- Marina Wainstein
- Faculty of Medicine, University of Queensland, Brisbane, QLD, Australia
- Department of Medicine, West Moreton Kidney Health Service, Ipswich Hospital, Brisbane, QLD, Australia
| | - Emily Flanagan
- Faculty of Science, University of Queensland, Brisbane, QLD, Australia
| | - David W. Johnson
- Metro South Kidney and Transplant Services (MSKATS), Princess Alexandra Hospital, Brisbane, QLD, Australia
- Centre for Kidney Disease Research, University of Queensland at Princess Alexandra Hospital, Brisbane, QLD, Australia
- Centre for Kidney Disease Research, Translational Research Institute, Brisbane, QLD, Australia
| | - Sally Shrapnel
- Centre for Health Services Research, University of Queensland, Brisbane, QLD, Australia
- Australian Research Council (ARC) Centre of Excellence for Engineered Quantum Systems, School of Mathematics and Physics, University of Queensland, Brisbane, QLD, Australia
| |
Collapse
|
7
|
Yu X, Wu R, Ji Y, Feng Z. Bibliometric and visual analysis of machine learning-based research in acute kidney injury worldwide. Front Public Health 2023; 11:1136939. [PMID: 37006534 PMCID: PMC10063840 DOI: 10.3389/fpubh.2023.1136939] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Accepted: 03/01/2023] [Indexed: 03/19/2023] Open
Abstract
BackgroundAcute kidney injury (AKI) is a serious clinical complication associated with adverse short-term and long-term outcomes. In recent years, with the rapid popularization of electronic health records and artificial intelligence machine learning technology, the detection rate and treatment of AKI have been greatly improved. At present, there are many studies in this field, and a large number of articles have been published, but we do not know much about the quality of research production in this field, as well as the focus and trend of current research.MethodsBased on the Web of Science Core Collection, studies reporting machine learning-based AKI research that were published from 2013 to 2022 were retrieved and collected after manual review. VOSviewer and other software were used for bibliometric visualization analysis, including publication trends, geographical distribution characteristics, journal distribution characteristics, author contributions, citations, funding source characteristics, and keyword clustering.ResultsA total of 336 documents were analyzed. Since 2018, publications and citations have increased dramatically, with the United States (143) and China (101) as the main contributors. Regarding authors, Bihorac, A and Ozrazgat-Baslanti, T from the Kansas City Medical Center have published 10 articles. Regarding institutions, the University of California (18) had the most publications. Approximately 1/3 of the publications were published in Q1 and Q2 journals, of which Scientific Reports (19) was the most prolific journal. Tomašev et al.'s study that was published in 2019 has been widely cited by researchers. The results of cluster analysis of co-occurrence keywords suggest that the construction of AKI prediction model related to critical patients and sepsis patients is the research frontier, and XGBoost algorithm is also popular.ConclusionThis study first provides an updated perspective on machine learning-based AKI research, which may be beneficial for subsequent researchers to choose suitable journals and collaborators and may provide a more convenient and in-depth understanding of the research basis, hotspots and frontiers.
Collapse
Affiliation(s)
- Xiang Yu
- State Key Laboratory of Kidney Diseases, Department of Nephrology, Chinese People's Liberation Army General Hospital, Chinese People's Liberation Army Institute of Nephrology, National Clinical Research Center of Kidney Diseases, Beijing, China
| | - RiLiGe Wu
- Medical Big Data Research Center, Chinese People's Liberation Army General Hospital, Beijing, China
| | - YuWei Ji
- State Key Laboratory of Kidney Diseases, Department of Nephrology, Chinese People's Liberation Army General Hospital, Chinese People's Liberation Army Institute of Nephrology, National Clinical Research Center of Kidney Diseases, Beijing, China
| | - Zhe Feng
- State Key Laboratory of Kidney Diseases, Department of Nephrology, Chinese People's Liberation Army General Hospital, Chinese People's Liberation Army Institute of Nephrology, National Clinical Research Center of Kidney Diseases, Beijing, China
- *Correspondence: Zhe Feng
| |
Collapse
|
8
|
Yu X, Ji Y, Huang M, Feng Z. Machine learning for acute kidney injury: Changing the traditional disease prediction mode. Front Med (Lausanne) 2023; 10:1050255. [PMID: 36817768 PMCID: PMC9935708 DOI: 10.3389/fmed.2023.1050255] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2022] [Accepted: 01/17/2023] [Indexed: 02/05/2023] Open
Abstract
Acute kidney injury (AKI) is a serious clinical comorbidity with clear short-term and long-term prognostic implications for inpatients. The diversity of risk factors for AKI has been recognized in previous studies, and a series of predictive models have been developed using traditional statistical methods in conjunction with its preventability, but they have failed to meet the expectations in limited clinical applications, the rapid spread of electronic health records and artificial intelligence machine learning technology has brought new hope for the construction of AKI prediction models. In this article, we systematically review the definition and classification of machine learning methods, modeling ideas and evaluation methods, and the characteristics and current status of modeling studies. According to the modeling objectives, we subdivided them into critical care medical setting models, all medical environment models, special surgery models, special disease models, and special nephrotoxin exposure models. As the first review article to comprehensively summarize and analyze machine learning prediction models for AKI, we aim to objectively describe the advantages and disadvantages of machine learning approaches to modeling, and help other researchers more quickly and intuitively understand the current status of modeling research, inspire ideas and learn from experience, so as to guide and stimulate more research and more in-depth exploration in the future, which will ultimately provide greater help to improve the overall status of AKI diagnosis and treatment.
Collapse
|
9
|
Selby NM, Pannu N. Opportunities in digital health and electronic health records for acute kidney injury care. Curr Opin Crit Care 2022; 28:605-12. [PMID: 35942677 DOI: 10.1097/MCC.0000000000000971] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
PURPOSE OF REVIEW The field of digital health is evolving rapidly with applications relevant to the prediction, detection and management of acute kidney injury (AKI). This review will summarize recent publications in these areas. RECENT FINDINGS Machine learning (ML) approaches have been applied predominantly for AKI prediction, but also to identify patients with AKI at higher risk of adverse outcomes, and to discriminate different subgroups (subphenotypes) of AKI. There have been multiple publications in this area, but a smaller number of ML models have robust external validation or the ability to run in real-time in clinical systems. Recent studies of AKI alerting systems and clinical decision support systems continue to demonstrate variable results, which is likely to result from differences in local context and implementation strategies. In the design of AKI alerting systems, choice of baseline creatinine has a strong effect on performance of AKI detection algorithms. SUMMARY Further research is required to overcome barriers to the validation and implementation of ML models for AKI care. Simpler electronic systems within the electronic medical record can lead to improved care in some but not all settings, and careful consideration of local context and implementation strategy is recommended.
Collapse
|
10
|
Zhang X, Xue Y, Su X, Chen S, Liu K, Chen W, Liu M, Hu Y. A Transfer Learning Approach to Correct the Temporal Performance Drift of Clinical Prediction Models: Retrospective Cohort Study. JMIR Med Inform 2022; 10:e38053. [DOI: 10.2196/38053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Revised: 07/31/2022] [Accepted: 10/12/2022] [Indexed: 11/11/2022] Open
Abstract
Background
Clinical prediction models suffer from performance drift as the patient population shifts over time. There is a great need for model updating approaches or modeling frameworks that can effectively use the old and new data.
Objective
Based on the paradigm of transfer learning, we aimed to develop a novel modeling framework that transfers old knowledge to the new environment for prediction tasks, and contributes to performance drift correction.
Methods
The proposed predictive modeling framework maintains a logistic regression–based stacking ensemble of 2 gradient boosting machine (GBM) models representing old and new knowledge learned from old and new data, respectively (referred to as transfer learning gradient boosting machine [TransferGBM]). The ensemble learning procedure can dynamically balance the old and new knowledge. Using 2010-2017 electronic health record data on a retrospective cohort of 141,696 patients, we validated TransferGBM for hospital-acquired acute kidney injury prediction.
Results
The baseline models (ie, transported models) that were trained on 2010 and 2011 data showed significant performance drift in the temporal validation with 2012-2017 data. Refitting these models using updated samples resulted in performance gains in nearly all cases. The proposed TransferGBM model succeeded in achieving uniformly better performance than the refitted models.
Conclusions
Under the scenario of population shift, incorporating new knowledge while preserving old knowledge is essential for maintaining stable performance. Transfer learning combined with stacking ensemble learning can help achieve a balance of old and new knowledge in a flexible and adaptive way, even in the case of insufficient new data.
Collapse
|
11
|
Sheu RK, Pardeshi MS. A Survey on Medical Explainable AI (XAI): Recent Progress, Explainability Approach, Human Interaction and Scoring System. Sensors (Basel) 2022; 22:8068. [PMID: 36298417 PMCID: PMC9609212 DOI: 10.3390/s22208068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Revised: 10/18/2022] [Accepted: 10/18/2022] [Indexed: 06/16/2023]
Abstract
The emerging field of eXplainable AI (XAI) in the medical domain is considered to be of utmost importance. Meanwhile, incorporating explanations in the medical domain with respect to legal and ethical AI is necessary to understand detailed decisions, results, and current status of the patient's conditions. Successively, we will be presenting a detailed survey for the medical XAI with the model enhancements, evaluation methods, significant overview of case studies with open box architecture, medical open datasets, and future improvements. Potential differences in AI and XAI methods are provided with the recent XAI methods stated as (i) local and global methods for preprocessing, (ii) knowledge base and distillation algorithms, and (iii) interpretable machine learning. XAI characteristics details with future healthcare explainability is included prominently, whereas the pre-requisite provides insights for the brainstorming sessions before beginning a medical XAI project. Practical case study determines the recent XAI progress leading to the advance developments within the medical field. Ultimately, this survey proposes critical ideas surrounding a user-in-the-loop approach, with an emphasis on human-machine collaboration, to better produce explainable solutions. The surrounding details of the XAI feedback system for human rating-based evaluation provides intelligible insights into a constructive method to produce human enforced explanation feedback. For a long time, XAI limitations of the ratings, scores and grading are present. Therefore, a novel XAI recommendation system and XAI scoring system are designed and approached from this work. Additionally, this paper encourages the importance of implementing explainable solutions into the high impact medical field.
Collapse
Affiliation(s)
- Ruey-Kai Sheu
- Department of Computer Science, Tunghai University, No. 1727, Section 4, Taiwan Blvd, Xitun District, Taichung 407224, Taiwan
| | - Mayuresh Sunil Pardeshi
- AI Center, Tunghai University, No. 1727, Section 4, Taiwan Blvd, Xitun District, Taichung 407224, Taiwan
| |
Collapse
|
12
|
Abstract
Diagnosis assistant is an effective way to reduce the workloads of professional doctors. The rich professional knowledge plays a crucial role in diagnosis. Therefore, it is important to introduce the relevant medical knowledge into diagnosis assistant. In this paper, diagnosis assistant is treated as a classification task, and a Graph-based Structural Knowledge-aware Network (GSKN) model is proposed to fuse Electronic Medical Records (EMRs) and medical knowledge graph. Considering that different information in EMRs affects the diagnosis results differently, the information in EMRs is categorized into general information, key information and numerical information, and is introduced to GSKN by adding an enhancement layer to the Bidirectional Encoder Representation from Transformers (BERT) model. The entities in EMRs are recognized, and Graph Convolutional Neural Networks (GCN) is employed to learn deep-level graph structure information and dynamic representation of these entities in the subgraphs. An interactive attention mechanism is utilized to fuse the enhanced textual representation and the deep representation of these subgraphs. Experimental results on Chinese Obstetric Electronic Medical Records (COEMRs) and open dataset C-EMRs demonstrate the effectiveness of our model.
Collapse
Affiliation(s)
- Kunli Zhang
- School of Computer and Artificial Intelligence, Zhengzhou University, Zhengzhou, China
- Pengcheng Laboratory, Shenzhen, China
| | - Bin Hu
- School of Computer and Artificial Intelligence, Zhengzhou University, Zhengzhou, China
| | - Feijie Zhou
- The Third Affiliated Hospital of Zhengzhou University, Zhengzhou 450052, China
| | - Yu Song
- School of Computer and Artificial Intelligence, Zhengzhou University, Zhengzhou, China
| | - Xu Zhao
- School of Computer and Artificial Intelligence, Zhengzhou University, Zhengzhou, China
| | - Xiyang Huang
- School of Computer and Artificial Intelligence, Zhengzhou University, Zhengzhou, China
| |
Collapse
|
13
|
Bacchi S, Gilbert T, Gluck S, Cheng J, Tan Y, Chim I, Jannes J, Kleinig T, Koblar S. Daily estimates of individual discharge likelihood with deep learning natural language processing in general medicine: a prospective and external validation study. Intern Emerg Med 2022; 17:411-415. [PMID: 34333736 DOI: 10.1007/s11739-021-02816-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/15/2021] [Accepted: 07/21/2021] [Indexed: 12/11/2022]
Abstract
Machine learning, in particular deep learning, may be able to assist in the prediction of the length of stay and timing of discharge for individual patients. Artificial neural networks applied to medical text have previously shown promise in this area. In this study, a previously derived artificial neural network was applied to prospective and external validation datasets. In the prediction of discharge within the next 2 days, when the algorithm was applied to prospective and external datasets, the area under the receiver operator curve for this task were 0.78 and 0.74, respectively. The performance in the prediction of discharge within the next 7 days was more limited (area under the receiver operator curve 0.68 and 0.67). This study has shown that in prospective and external validation datasets the previously derived deep learning algorithms have demonstrated moderate performance in the prediction of which patients will be discharged within the next 2 days. Future studies may seek to further refine or evaluate the effect of the implementation of such algorithms.
Collapse
Affiliation(s)
- Stephen Bacchi
- Royal Adelaide Hospital, Port Road, Adelaide, SA, 5000, Australia.
- School of Medicine, Faculty Health and Medical Science, University of Adelaide, Adelaide, SA, 5005, Australia.
| | - Toby Gilbert
- Royal Adelaide Hospital, Port Road, Adelaide, SA, 5000, Australia
| | - Samuel Gluck
- School of Medicine, Faculty Health and Medical Science, University of Adelaide, Adelaide, SA, 5005, Australia
| | - Joy Cheng
- Royal Adelaide Hospital, Port Road, Adelaide, SA, 5000, Australia
| | - Yiran Tan
- Royal Adelaide Hospital, Port Road, Adelaide, SA, 5000, Australia
- School of Medicine, Faculty Health and Medical Science, University of Adelaide, Adelaide, SA, 5005, Australia
| | - Ivana Chim
- Royal Adelaide Hospital, Port Road, Adelaide, SA, 5000, Australia
| | - Jim Jannes
- Royal Adelaide Hospital, Port Road, Adelaide, SA, 5000, Australia
- School of Medicine, Faculty Health and Medical Science, University of Adelaide, Adelaide, SA, 5005, Australia
| | - Timothy Kleinig
- Royal Adelaide Hospital, Port Road, Adelaide, SA, 5000, Australia
- School of Medicine, Faculty Health and Medical Science, University of Adelaide, Adelaide, SA, 5005, Australia
| | - Simon Koblar
- Royal Adelaide Hospital, Port Road, Adelaide, SA, 5000, Australia
- School of Medicine, Faculty Health and Medical Science, University of Adelaide, Adelaide, SA, 5005, Australia
| |
Collapse
|
14
|
Luo XQ, Yan P, Zhang NY, Luo B, Wang M, Deng YH, Wu T, Wu X, Liu Q, Wang HS, Wang L, Kang YX, Duan SB. Machine learning for early discrimination between transient and persistent acute kidney injury in critically ill patients with sepsis. Sci Rep 2021; 11:20269. [PMID: 34642418 PMCID: PMC8511088 DOI: 10.1038/s41598-021-99840-6] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2021] [Accepted: 09/30/2021] [Indexed: 12/29/2022] Open
Abstract
Acute kidney injury (AKI) is commonly present in critically ill patients with sepsis. Early prediction of short-term reversibility of AKI is beneficial to risk stratification and clinical treatment decision. The study sought to use machine learning methods to discriminate between transient and persistent sepsis-associated AKI. Septic patients who developed AKI within the first 48 h after ICU admission were identified from the Medical Information Mart for Intensive Care III database. AKI was classified as transient or persistent according to the Acute Disease Quality Initiative workgroup consensus. Five prediction models using logistic regression, random forest, support vector machine, artificial neural network and extreme gradient boosting were constructed, and their performance was evaluated by out-of-sample testing. A simplified risk prediction model was also derived based on logistic regression and features selected by machine learning algorithms. A total of 5984 septic patients with AKI were included, 3805 (63.6%) of whom developed persistent AKI. The artificial neural network and logistic regression models achieved the highest area under the receiver operating characteristic curve (AUC) among the five machine learning models (0.76, 95% confidence interval [CI] 0.74-0.78). The simplified 14-variable model showed adequate discrimination, with the AUC being 0.76 (95% CI 0.73-0.78). At the optimal cutoff of 0.63, the sensitivity and specificity of the simplified model were 63% and 76% respectively. In conclusion, a machine learning-based simplified prediction model including routine clinical variables could be used to differentiate between transient and persistent AKI in critically ill septic patients. An easy-to-use risk calculator can promote its widespread application in daily clinical practice.
Collapse
Affiliation(s)
- Xiao-Qin Luo
- Department of Nephrology, Hunan Key Laboratory of Kidney Disease and Blood Purification, The Second Xiangya Hospital of Central South University, 139 Renmin Road, Changsha, 410011, Hunan, China
| | - Ping Yan
- Department of Nephrology, Hunan Key Laboratory of Kidney Disease and Blood Purification, The Second Xiangya Hospital of Central South University, 139 Renmin Road, Changsha, 410011, Hunan, China
| | - Ning-Ya Zhang
- Information Center, The Second Xiangya Hospital of Central South University, Changsha, 410011, Hunan, China
| | - Bei Luo
- Department of Information Systems, City University of Hong Kong, Tat Chee Avenue, Kowloon, 999077, Hong Kong SAR, China
| | - Mei Wang
- Department of Nephrology, Hunan Key Laboratory of Kidney Disease and Blood Purification, The Second Xiangya Hospital of Central South University, 139 Renmin Road, Changsha, 410011, Hunan, China
| | - Ying-Hao Deng
- Department of Nephrology, Hunan Key Laboratory of Kidney Disease and Blood Purification, The Second Xiangya Hospital of Central South University, 139 Renmin Road, Changsha, 410011, Hunan, China
| | - Ting Wu
- Department of Nephrology, Hunan Key Laboratory of Kidney Disease and Blood Purification, The Second Xiangya Hospital of Central South University, 139 Renmin Road, Changsha, 410011, Hunan, China
| | - Xi Wu
- Department of Nephrology, Hunan Key Laboratory of Kidney Disease and Blood Purification, The Second Xiangya Hospital of Central South University, 139 Renmin Road, Changsha, 410011, Hunan, China
| | - Qian Liu
- Department of Nephrology, Hunan Key Laboratory of Kidney Disease and Blood Purification, The Second Xiangya Hospital of Central South University, 139 Renmin Road, Changsha, 410011, Hunan, China
| | - Hong-Shen Wang
- Department of Nephrology, Hunan Key Laboratory of Kidney Disease and Blood Purification, The Second Xiangya Hospital of Central South University, 139 Renmin Road, Changsha, 410011, Hunan, China
| | - Lin Wang
- Department of Nephrology, Hunan Key Laboratory of Kidney Disease and Blood Purification, The Second Xiangya Hospital of Central South University, 139 Renmin Road, Changsha, 410011, Hunan, China
| | - Yi-Xin Kang
- Department of Nephrology, Hunan Key Laboratory of Kidney Disease and Blood Purification, The Second Xiangya Hospital of Central South University, 139 Renmin Road, Changsha, 410011, Hunan, China
| | - Shao-Bin Duan
- Department of Nephrology, Hunan Key Laboratory of Kidney Disease and Blood Purification, The Second Xiangya Hospital of Central South University, 139 Renmin Road, Changsha, 410011, Hunan, China.
| |
Collapse
|