1
|
Cui J, Heavey J, Klein E, Madden GR, Sifri CD, Vullikanti A, Prakash BA. Identifying and forecasting importation and asymptomatic spreaders of multi-drug resistant organisms in hospital settings. NPJ Digit Med 2025; 8:147. [PMID: 40055525 PMCID: PMC11889233 DOI: 10.1038/s41746-025-01529-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2024] [Accepted: 02/19/2025] [Indexed: 03/14/2025] Open
Abstract
Healthcare-associated infections (HAIs) from multi-drug resistant organisms (MDROs) pose a significant challenge for healthcare systems. Patients can arrive at hospitals already infected ("importation") or acquire infections during their stay ("nosocomial infection"). Many cases, often asymptomatic, complicate rapid identification due to testing limitations and delays. Although recent advancements in mathematical modeling and machine learning have aimed to identify at-risk patients, these methods face challenges: transmission models often overlook valuable electronic health record (EHR) data, while machine learning approaches typically lack mechanistic insights into underlying processes. To address these issues, we propose NeurABM, a novel framework that integrates neural networks and agent-based models (ABM) to leverage the strengths of both methods. NeurABM simultaneously learns a neural network for patient-level importation predictions and an ABM for infection identification. Our findings show that NeurABM significantly outperforms existing methods, marking a breakthrough in accurately identifying importation cases and forecasting future nosocomial infections in clinical practice.
Collapse
Affiliation(s)
- Jiaming Cui
- College of Computing, Georgia Institute of Technology, Atlanta, GA, 30332, USA
- Department of Computer Science, Virginia Tech, Blacksburg, VA, 24060, USA
| | - Jack Heavey
- Department of Computer Science, University of Virginia, Charlottesville, VA, 22904, USA
| | - Eili Klein
- Center for Disease Dynamics, Economics & Policy, Washington, DC, 20015, USA
- Department of Emergency Medicine, Johns Hopkins School of Medicine, Baltimore, MD, 21205, USA
- Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, 21205, USA
| | - Gregory R Madden
- Division of Infectious Diseases & International Health, Department of Medicine, University of Virginia School of Medicine, Charlottesville, VA, 22903, USA
- Office of Hospital Epidemiology/Infection Prevention & Control, UVA Health, Charlottesville, VA, 22904, USA
| | - Costi D Sifri
- Division of Infectious Diseases & International Health, Department of Medicine, University of Virginia School of Medicine, Charlottesville, VA, 22903, USA
- Office of Hospital Epidemiology/Infection Prevention & Control, UVA Health, Charlottesville, VA, 22904, USA
| | - Anil Vullikanti
- Department of Computer Science, University of Virginia, Charlottesville, VA, 22904, USA
- Biocomplexity Institute, University of Virginia, Charlottesville, VA, 22904, USA
| | - B Aditya Prakash
- College of Computing, Georgia Institute of Technology, Atlanta, GA, 30332, USA.
| |
Collapse
|
2
|
Cui J, Heavey J, Klein E, Madden GR, Sifri CD, Vullikanti A, Prakash BA. Identifying and Forecasting Importation and Asymptomatic Spreaders of Multi-drug Resistant Organisms in Hospital Settings. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2025:2024.07.14.24310393. [PMID: 39072020 PMCID: PMC11275683 DOI: 10.1101/2024.07.14.24310393] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/30/2024]
Abstract
Healthcare-associated infections (HAIs) from multi-drug resistant organisms (MDROs) pose a significant challenge for healthcare systems. Patients can arrive at hospitals already infected ("importation") or acquire infections during their stay ("nosocomial infection"). Many cases, often asymptomatic, complicate rapid identification due to testing limitations and delays. Although recent advancements in mathematical modeling and machine learning have aimed to identify at-risk patients, these methods face challenges: transmission models often overlook valuable electronic health record (EHR) data, while machine learning approaches typically lack mechanistic insights into underlying processes. To address these issues, we propose NeurABM, a novel framework that integrates neural networks and agent-based models (ABM) to leverage the strengths of both methods. NeurABM simultaneously learns a neural network for patient-level importation predictions and an ABM for infection identification. Our findings show that NeurABM significantly outperforms existing methods, marking a breakthrough in accurately identifying importation cases and forecasting future nosocomial infections in clinical practice.
Collapse
Affiliation(s)
- Jiaming Cui
- College of Computing, Georgia Institute of Technology, Atlanta, GA 30332, US
- Department of Computer Science, Virginia Tech, Blacksburg, VA 24060, US
| | - Jack Heavey
- Department of Computer Science, University of Virginia, Charlottesville, VA 22904, US
| | - Eili Klein
- Center for Disease Dynamics, Economics & Policy, Washington, DC 20015, US
- Department of Emergency Medicine, Johns Hopkins School of Medicine, Baltimore, MD 21205, US
- Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD 21205, US
| | - Gregory R Madden
- Division of Infectious Diseases & International Health, Department of Medicine, University of Virginia School of Medicine, Charlottesville, VA 22903, US
- Office of Hospital Epidemiology/Infection Prevention & Control, UVA Health, Charlottesville, VA 22904, US
| | - Costi D Sifri
- Division of Infectious Diseases & International Health, Department of Medicine, University of Virginia School of Medicine, Charlottesville, VA 22903, US
- Office of Hospital Epidemiology/Infection Prevention & Control, UVA Health, Charlottesville, VA 22904, US
| | - Anil Vullikanti
- Department of Computer Science, University of Virginia, Charlottesville, VA 22904, US
- Biocomplexity Institute, University of Virginia, Charlottesville, VA 22904, US
| | - B Aditya Prakash
- College of Computing, Georgia Institute of Technology, Atlanta, GA 30332, US
| |
Collapse
|
3
|
Cui J, Cho S, Kamruzzaman M, Bielskas M, Vullikanti A, Prakash BA. Using spectral characterization to identify healthcare-associated infection (HAI) patients for clinical contact precaution. Sci Rep 2023; 13:16197. [PMID: 37758756 PMCID: PMC10533902 DOI: 10.1038/s41598-023-41852-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Accepted: 08/31/2023] [Indexed: 09/29/2023] Open
Abstract
Healthcare-associated infections (HAIs) are a major problem in hospital infection control. Although HAIs can be suppressed using contact precautions, such precautions are expensive, and we can only apply them to a small fraction of patients (i.e., a limited budget). In this work, we focus on two clinical problems arising from the limited budget: (a) choosing the best patients to be placed under precaution given a limited budget to minimize the spread (the isolation problem), and (b) choosing the best patients to release when limited budget requires some of the patients to be cleared from precaution (the clearance problem). A critical challenge in addressing them is that HAIs have multiple transmission pathways such that locations can also accumulate 'load' and spread the disease. One of the most common practices when placing patients under contact precautions is the regular clearance of pathogen loads. However, standard propagation models like independent cascade (IC)/susceptible-infectious-susceptible (SIS) cannot capture such mechanisms directly. Hence to account for this challenge, using non-linear system theory, we develop a novel spectral characterization of a recently proposed pathogen load based model, 2-MODE-SIS model, on people/location networks to capture spread dynamics of HAIs. We formulate the two clinical problems using this spectral characterization and develop effective and efficient algorithms for them. Our experiments show that our methods outperform several natural structural and clinical approaches on real-world hospital testbeds and pick meaningful solutions.
Collapse
Affiliation(s)
- Jiaming Cui
- College of Computing, Georgia Institute of Technology, Atlanta, GA, 30332, USA.
| | - Sungjun Cho
- College of Computing, Georgia Institute of Technology, Atlanta, GA, 30332, USA
| | - Methun Kamruzzaman
- Biocomplexity Institute, University of Virginia, Charlottesville, VA, 22904, USA
| | - Matthew Bielskas
- Biocomplexity Institute, University of Virginia, Charlottesville, VA, 22904, USA
- Department of Computer Science, University of Virginia, Charlottesville, VA, 22904, USA
| | - Anil Vullikanti
- Biocomplexity Institute, University of Virginia, Charlottesville, VA, 22904, USA
- Department of Computer Science, University of Virginia, Charlottesville, VA, 22904, USA
| | - B Aditya Prakash
- College of Computing, Georgia Institute of Technology, Atlanta, GA, 30332, USA.
| |
Collapse
|
4
|
Jang H, Pai S, Adhikari B, Pemmaraju SV. Risk-aware temporal cascade reconstruction to detect asymptomatic cases. Knowl Inf Syst 2022; 64:3373-3399. [PMID: 36124337 PMCID: PMC9476452 DOI: 10.1007/s10115-022-01748-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2022] [Revised: 08/07/2022] [Accepted: 08/13/2022] [Indexed: 11/23/2022]
Abstract
This paper studies the problem of detecting asymptomatic cases in a temporal contact network in which multiple outbreaks have occurred. We show that the key to detecting asymptomatic cases well is taking into account both individual risk and the likelihood of disease-flow along edges. We consider both aspects by formulating the asymptomatic case detection problem as a directed prize-collecting Steiner tree (Directed PCST) problem. We present an approximation-preserving reduction from this problem to the directed Steiner tree problem and obtain scalable algorithms for the Directed PCST problem on instances with more than 1.5M edges obtained from both synthetic and fine-grained hospital data. On synthetic data, we demonstrate that our detection methods significantly outperform various baselines (with a gain of 3.6 × ). We apply our method to the infectious disease prediction task by using an additional feature set that captures exposure to detected asymptomatic cases and show that our method outperforms all baselines. We further use our method to detect infection sources ("patient zero") of outbreaks that outperform baselines. We also demonstrate that the solutions returned by our approach are clinically meaningful by presenting case studies.
Collapse
Affiliation(s)
- Hankyu Jang
- Department of Computer Science, University of Iowa, Iowa City, 52242 IA USA
| | - Shreyas Pai
- Department of Computer Science, Aalto University, Espoo, Finland
| | - Bijaya Adhikari
- Department of Computer Science, University of Iowa, Iowa City, 52242 IA USA
| | | |
Collapse
|
5
|
Cheng Q, Collender PA, Heaney AK, Li X, Dasan R, Li C, Lewnard JA, Zelner JL, Liang S, Chang HH, Waller LA, Lopman BA, Yang C, Remais JV. The DIOS framework for optimizing infectious disease surveillance: Numerical methods for simulation and multi-objective optimization of surveillance network architectures. PLoS Comput Biol 2020; 16:e1008477. [PMID: 33275606 PMCID: PMC7744064 DOI: 10.1371/journal.pcbi.1008477] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2020] [Revised: 12/16/2020] [Accepted: 10/28/2020] [Indexed: 11/28/2022] Open
Abstract
Infectious disease surveillance systems provide vital data for guiding disease prevention and control policies, yet the formalization of methods to optimize surveillance networks has largely been overlooked. Decisions surrounding surveillance design parameters-such as the number and placement of surveillance sites, target populations, and case definitions-are often determined by expert opinion or deference to operational considerations, without formal analysis of the influence of design parameters on surveillance objectives. Here we propose a simulation framework to guide evidence-based surveillance network design to better achieve specific surveillance goals with limited resources. We define evidence-based surveillance design as an optimization problem, acknowledging the many operational constraints under which surveillance systems operate, the many dimensions of surveillance system design, the multiple and competing goals of surveillance, and the complex and dynamic nature of disease systems. We describe an analytical framework-the Disease Surveillance Informatics Optimization and Simulation (DIOS) framework-for the identification of optimal surveillance designs through mathematical representations of disease and surveillance processes, definition of objective functions, and numerical optimization. We then apply the framework to the problem of selecting candidate sites to expand an existing surveillance network under alternative objectives of: (1) improving spatial prediction of disease prevalence at unmonitored sites; or (2) estimating the observed effect of a risk factor on disease. Results of this demonstration illustrate how optimal designs are sensitive to both surveillance goals and the underlying spatial pattern of the target disease. The findings affirm the value of designing surveillance systems through quantitative and adaptive analysis of network characteristics and performance. The framework can be applied to the design of surveillance systems tailored to setting-specific disease transmission dynamics and surveillance needs, and can yield improved understanding of tradeoffs between network architectures.
Collapse
Affiliation(s)
- Qu Cheng
- Division of Environmental Health Sciences, School of Public Health, University of California, Berkeley, Berkeley, California, United States of America
| | - Philip A. Collender
- Division of Environmental Health Sciences, School of Public Health, University of California, Berkeley, Berkeley, California, United States of America
| | - Alexandra K. Heaney
- Division of Environmental Health Sciences, School of Public Health, University of California, Berkeley, Berkeley, California, United States of America
| | - Xintong Li
- Department of Biostatistics and Bioinformatics, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America
| | - Rohini Dasan
- Division of Environmental Health Sciences, School of Public Health, University of California, Berkeley, Berkeley, California, United States of America
| | - Charles Li
- Division of Environmental Health Sciences, School of Public Health, University of California, Berkeley, Berkeley, California, United States of America
| | - Joseph A. Lewnard
- Division of Epidemiology, School of Public Health, University of California, Berkeley, Berkeley, California, United States of America
| | - Jonathan L. Zelner
- Department of Epidemiology, School of Public Health, University of Michigan, Ann Arbor, Michigan, United States of America
- Center for Social Epidemiology and Population Health, School of Public Health, University of Michigan School of Public Health, Ann Arbor, Michigan, United States of America
| | - Song Liang
- Department of Environmental and Global Health, College of Public Health and Health Professions, and Emerging Pathogens Institute, University of Florida, Gainesville, Florida, United States of America
| | - Howard H. Chang
- Department of Biostatistics and Bioinformatics, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America
| | - Lance A. Waller
- Department of Biostatistics and Bioinformatics, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America
| | - Benjamin A. Lopman
- Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America
| | - Changhong Yang
- Institute of Health Informatics, Sichuan Center for Disease Control and Prevention, Chengdu, Sichuan, People’s Republic of China
| | - Justin V. Remais
- Division of Environmental Health Sciences, School of Public Health, University of California, Berkeley, Berkeley, California, United States of America
| |
Collapse
|
6
|
Fan Y, Wu Y, Cao X, Zou J, Zhu M, Dai D, Lu L, Yin X, Xiong L. Automated Cluster Detection of Health Care-Associated Infection Based on the Multisource Surveillance of Process Data in the Area Network: Retrospective Study of Algorithm Development and Validation. JMIR Med Inform 2020; 8:e16901. [PMID: 32965228 PMCID: PMC7647819 DOI: 10.2196/16901] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2019] [Revised: 07/13/2020] [Accepted: 08/02/2020] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND The cluster detection of health care-associated infections (HAIs) is crucial for identifying HAI outbreaks in the early stages. OBJECTIVE We aimed to verify whether multisource surveillance based on the process data in an area network can be effective in detecting HAI clusters. METHODS We retrospectively analyzed the incidence of HAIs and 3 indicators of process data relative to infection, namely, antibiotic utilization rate in combination, inspection rate of bacterial specimens, and positive rate of bacterial specimens, from 4 independent high-risk units in a tertiary hospital in China. We utilized the Shewhart warning model to detect the peaks of the time-series data. Subsequently, we designed 5 surveillance strategies based on the process data for the HAI cluster detection: (1) antibiotic utilization rate in combination only, (2) inspection rate of bacterial specimens only, (3) positive rate of bacterial specimens only, (4) antibiotic utilization rate in combination + inspection rate of bacterial specimens + positive rate of bacterial specimens in parallel, and (5) antibiotic utilization rate in combination + inspection rate of bacterial specimens + positive rate of bacterial specimens in series. We used the receiver operating characteristic (ROC) curve and Youden index to evaluate the warning performance of these surveillance strategies for the detection of HAI clusters. RESULTS The ROC curves of the 5 surveillance strategies were located above the standard line, and the area under the curve of the ROC was larger in the parallel strategy than in the series strategy and the single-indicator strategies. The optimal Youden indexes were 0.48 (95% CI 0.29-0.67) at a threshold of 1.5 in the antibiotic utilization rate in combination-only strategy, 0.49 (95% CI 0.45-0.53) at a threshold of 0.5 in the inspection rate of bacterial specimens-only strategy, 0.50 (95% CI 0.28-0.71) at a threshold of 1.1 in the positive rate of bacterial specimens-only strategy, 0.63 (95% CI 0.49-0.77) at a threshold of 2.6 in the parallel strategy, and 0.32 (95% CI 0.00-0.65) at a threshold of 0.0 in the series strategy. The warning performance of the parallel strategy was greater than that of the single-indicator strategies when the threshold exceeded 1.5. CONCLUSIONS The multisource surveillance of process data in the area network is an effective method for the early detection of HAI clusters. The combination of multisource data and the threshold of the warning model are 2 important factors that influence the performance of the model.
Collapse
Affiliation(s)
- Yunzhou Fan
- Department of Nosocomial Infection Management, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Yanyan Wu
- Department of Nosocomial Infection Management, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Xiongjing Cao
- Department of Nosocomial Infection Management, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Junning Zou
- Department of Nosocomial Infection Management, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Ming Zhu
- Department of Nosocomial Infection Management, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Di Dai
- Department of Nosocomial Infection Management, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Lin Lu
- Department of Nosocomial Infection Management, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Xiaoxv Yin
- School of Public Health, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Lijuan Xiong
- Department of Nosocomial Infection Management, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| |
Collapse
|