1
|
El Arab RA, Almoosa Z, Alkhunaizi M, Abuadas FH, Somerville J. Artificial intelligence in hospital infection prevention: an integrative review. Front Public Health 2025; 13:1547450. [PMID: 40241963 PMCID: PMC12001280 DOI: 10.3389/fpubh.2025.1547450] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2025] [Accepted: 03/17/2025] [Indexed: 04/18/2025] Open
Abstract
Background Hospital-acquired infections (HAIs) represent a persistent challenge in healthcare, contributing to substantial morbidity, mortality, and economic burden. Artificial intelligence (AI) offers promising potential for improving HAIs prevention through advanced predictive capabilities. Objective To evaluate the effectiveness, usability, and challenges of AI models in preventing, detecting, and managing HAIs. Methods This integrative review synthesized findings from 42 studies, guided by the SPIDER framework for inclusion criteria. We assessed the quality of included studies by applying the TRIPOD checklist to individual predictive studies and the AMSTAR 2 tool for reviews. Results AI models demonstrated high predictive accuracy for the detection, surveillance, and prevention of multiple HAIs, with models for surgical site infections and urinary tract infections frequently achieving area-under-the-curve (AUC) scores exceeding 0.80, indicating strong reliability. Comparative data suggest that while both machine learning and deep learning approaches perform well, some deep learning models may offer slight advantages in complex data environments. Advanced algorithms, including neural networks, decision trees, and random forests, significantly improved detection rates when integrated with EHRs, enabling real-time surveillance and timely interventions. In resource-constrained settings, non-real-time AI models utilizing historical EHR data showed considerable scalability, facilitating broader implementation in infection surveillance and control. AI-supported surveillance systems outperformed traditional methods in accurately identifying infection rates and enhancing compliance with hand hygiene protocols. Furthermore, Explainable AI (XAI) frameworks and interpretability tools such as Shapley additive explanations (SHAP) values increased clinician trust and facilitated actionable insights. AI also played a pivotal role in antimicrobial stewardship by predicting the emergence of multidrug-resistant organisms and guiding optimal antibiotic usage, thereby reducing reliance on second-line treatments. However, challenges including the need for comprehensive clinician training, high integration costs, and ensuring compatibility with existing workflows were identified as barriers to widespread adoption. Discussion The integration of AI in HAI prevention and management represents a potentially transformative shift in enhancing predictive capabilities and supporting effective infection control measures. Successful implementation necessitates standardized validation protocols, transparent data reporting, and the development of user-friendly interfaces to ensure seamless adoption by healthcare professionals. Variability in data sources and model validations across studies underscores the necessity for multicenter collaborations and external validations to ensure consistent performance across diverse healthcare environments. Innovations in non-real-time AI frameworks offer viable solutions for scaling AI applications in low- and middle-income countries (LMICs), addressing the higher prevalence of HAIs in these regions. Conclusions Artificial Intelligence stands as a transformative tool in the fight against hospital-acquired infections, offering advanced solutions for prevention, surveillance, and management. To fully realize its potential, the healthcare sector must prioritize rigorous validation standards, comprehensive data quality reporting, and the incorporation of interpretability tools to build clinician confidence. By adopting scalable AI models and fostering interdisciplinary collaborations, healthcare systems can overcome existing barriers, integrating AI seamlessly into infection control policies and ultimately enhancing patient safety and care quality. Further research is needed to evaluate cost-effectiveness, real-world applications, and strategies (e.g., clinician training and the integration of explainable AI) to improve trust and broaden clinical adoption.
Collapse
Affiliation(s)
| | - Zainab Almoosa
- Department of Infectious Disease, Almoosa Specialist Hospital, Al Mubarraz, Saudi Arabia
| | - May Alkhunaizi
- Almoosa College of Health Sciences, Al Mubarraz, Saudi Arabia
- Department of Pediatric, Almoosa Specialist Hospital, Al Mubarraz, Saudi Arabia
| | - Fuad H. Abuadas
- Department of Community Health Nursing, College of Nursing, Jouf University, Sakaka, Saudi Arabia
| | - Joel Somerville
- Inverness College, University of the Highlands and Island, Inverness, United Kingdom
- Glasgow Caledonian University, Glasgow, United Kingdom
| |
Collapse
|
2
|
Kumar R, Kumar Maurya P, Kumar Singh A, Qavi A, Kulshreshtha D, Sen M. Prevalence of hospital-acquired infection among patients with acute neurological conditions in the ICU. J Clin Neurosci 2025; 134:111072. [PMID: 40023117 DOI: 10.1016/j.jocn.2025.111072] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2024] [Revised: 01/05/2025] [Accepted: 01/21/2025] [Indexed: 03/04/2025]
Abstract
INTRODUCTION Healthcare-associated infections (HAIs) are a significant cause of morbidity and mortality. HAIs become crucial in patients with neurological illnesses, as they need invasive procedures and extended care, prolonging the hospital stay in most cases. In this study, we report the type, microbial etiology, and outcome of patients with HAIs in a Neurology Intensive Care Unit setting. METHODS In this prospective study, 213 neurologically ill patients were recruited. Patient demographics, primary diagnosis, comorbidities, invasive interventions, device specific data, and length of hospital stay were recorded. Data collected for each episode of HAI included- site of infection, causative organisms, and susceptibility. Site specific infections were categorised as per CDC/NHSN definitions for HAIs. RESULTS The median age of patients was 60 years (range 15-88) and 66.70 % were male. HAIs were observed in 135 (63.38 %) patients. Majority of the patients had stroke (ischemic/haemorrhagic) [n = 142;66.66 %] followed by neuromuscular [n = 18; 8.45 %] and seizure disorder [n = 14; 6.57 %]. Most prevalent site of HAIs was urinary tract infections (UTI) (n = 80;37.55 %) followed by pneumonia (n = 74;34.74 %) and blood stream infections (n = 53;24.88 %). 209 patients (98.12 %) underwent urinary catheterization, 90 (42.3 %) required intubation and mechanical ventilation, and 70 (32.86 %) central venous catheterisations. Amongst various HAIs, commonly isolated bacterial pathogens in UTI were Escherichia coli [18/48;37.59 %], Enterococcus [10/48;20.83 %] while Candida species [35/40;87.50 %] was the most common amongst fungal pathogens. Causative organisms in Pneumonia were Klebsiella pneumoniae (27/104;25.96 %), Acinetobacter baumannii (n = 25/104;24.03 %), and Pseudomonas aeruginosa [14/104;13.46 %]. Among the blood stream infections, Staphylococcus species were the most common [39/161;24.22 %] followed by candida species [5/161;3.10 %]. Out of 55 patients who died, HAI was observed in 39 patients (70.90 %). Mean length of hospital stay was 17.56 ± 13.17 days. Presence of coronary artery disease, pulmonary site infection, low Glasgow Coma Scale, central venous catheterization, mechanical ventilation, abnormal chest x-ray, and multiple site infections were significantly associated with high mortality (p < 0.05). CONCLUSION In our study 63.38% of neurological patients had HAIs. The most common sites were urinary, pulmonary, and blood stream infections. Device associated infections were common and significantly associated with poor outcome. Considering the high incidence of HAIs early recognition and treatment of site-specific pathogens may improve the outcome in these patients.
Collapse
Affiliation(s)
- Raghav Kumar
- Department of Neurology, Dr. Ram Manohar Lohia Institute of Medical Sciences, Lucknow, Uttar Pradesh, India
| | - Pradeep Kumar Maurya
- Department of Neurology, Dr. Ram Manohar Lohia Institute of Medical Sciences, Lucknow, Uttar Pradesh, India.
| | - Ajai Kumar Singh
- Department of Neurology, Dr. Ram Manohar Lohia Institute of Medical Sciences, Lucknow, Uttar Pradesh, India
| | - Abdul Qavi
- Department of Neurology, Dr. Ram Manohar Lohia Institute of Medical Sciences, Lucknow, Uttar Pradesh, India
| | - Dinkar Kulshreshtha
- Department of Neurology, Dr. Ram Manohar Lohia Institute of Medical Sciences, Lucknow, Uttar Pradesh, India
| | - Manodeep Sen
- Department of Microbiology, Dr. Ram Manohar Lohia Institute of Medical Sciences, Lucknow, Uttar Pradesh, India
| |
Collapse
|
3
|
Abu-El-Ruz R, AbuHaweeleh MN, Hamdan A, Rajha HE, Sarah JM, Barakat K, Zughaier SM. Artificial Intelligence in Bacterial Infections Control: A Scoping Review. Antibiotics (Basel) 2025; 14:256. [PMID: 40149067 PMCID: PMC11939793 DOI: 10.3390/antibiotics14030256] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2025] [Revised: 02/15/2025] [Accepted: 02/19/2025] [Indexed: 03/29/2025] Open
Abstract
Background/Objectives: Artificial intelligence has made significant strides in healthcare, contributing to diagnosing, treating, monitoring, preventing, and testing various diseases. Despite its broad adoption, clinical consensus on AI's role in infection control remains uncertain. This scoping review aims to understand the characteristics of AI applications in bacterial infection control. Results: This review examines the characteristics of AI applications in bacterial infection control, analyzing 54 eligible studies across 5 thematic scopes. The search from 3 databases yielded a total of 1165 articles, only 54 articles met the eligibility criteria and were extracted and analyzed. Five thematic scopes were synthesized from the extracted data; countries, aim, type of AI, advantages, and limitations of AI applications in bacterial infection prevention and control. The majority of articles were reported from high-income countries, mainly by the USA. The most common aims are pathogen identification and infection risk assessment. The most common AI used in infection control is machine learning. The commonest reported advantage is predictive modeling and risk assessment, and the commonest disadvantage is generalizability of the models. Methods: This scoping review was developed according to Arksey and O'Malley frameworks. A comprehensive search across PubMed, Embase, and Web of Science was conducted using broad search terms, with no restrictions. Publications focusing on AI in infection control and prevention were included. Citations were managed via EndNote, with initial title and abstract screening by two authors. Data underwent comprehensive narrative mapping and categorization, followed by the construction of thematic scopes. Conclusions: Artificial intelligence applications in infection control need to be strengthened for low-income countries. More efforts should be dedicated to investing in models that have proven their effectiveness in infection control, to maximize their utilization and tackle challenges.
Collapse
Affiliation(s)
- Rasha Abu-El-Ruz
- College of Health Sciences, QU Health, Qatar University, Doha P.O. Box 2713, Qatar;
| | | | - Ahmad Hamdan
- College of Medicine, QU Health, Qatar University, Doha P.O. Box 2713, Qatar; (M.N.A.); (A.H.); (H.E.R.)
| | - Humam Emad Rajha
- College of Medicine, QU Health, Qatar University, Doha P.O. Box 2713, Qatar; (M.N.A.); (A.H.); (H.E.R.)
| | - Jood Mudar Sarah
- College of Medicine, University of Jordan, Amman P.O. Box 11942, Jordan;
| | - Kaoutar Barakat
- College of Pharmacy, QU Health, Qatar University, Doha P.O. Box 2713, Qatar;
| | - Susu M. Zughaier
- College of Medicine, QU Health, Qatar University, Doha P.O. Box 2713, Qatar; (M.N.A.); (A.H.); (H.E.R.)
| |
Collapse
|
4
|
Kiouri DP, Batsis GC, Mavromoustakos T, Giuliani A, Chasapis CT. Structure-Based Modeling of the Gut Bacteria-Host Interactome Through Statistical Analysis of Domain-Domain Associations Using Machine Learning. BIOTECH 2025; 14:13. [PMID: 40227324 PMCID: PMC11940256 DOI: 10.3390/biotech14010013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2025] [Revised: 02/16/2025] [Accepted: 02/21/2025] [Indexed: 04/15/2025] Open
Abstract
The gut microbiome, a complex ecosystem of microorganisms, plays a pivotal role in human health and disease. The gut microbiome's influence extends beyond the digestive system to various organs, and its imbalance is linked to a wide range of diseases, including cancer and neurodevelopmental, inflammatory, metabolic, cardiovascular, autoimmune, and psychiatric diseases. Despite its significance, the interactions between gut bacteria and human proteins remain understudied, with less than 20,000 experimentally validated protein interactions between the host and any bacteria species. This study addresses this knowledge gap by predicting a protein-protein interaction network between gut bacterial and human proteins. Using statistical associations between Pfam domains, a comprehensive dataset of over one million experimentally validated pan-bacterial-human protein interactions, as well as inter- and intra-species protein interactions from various organisms, were used for the development of a machine learning-based prediction method to uncover key regulatory molecules in this dynamic system. This study's findings contribute to the understanding of the intricate gut microbiome-host relationship and pave the way for future experimental validation and therapeutic strategies targeting the gut microbiome interplay.
Collapse
Affiliation(s)
- Despoina P. Kiouri
- Institute of Chemical Biology, National Hellenic Research Foundation, 11635 Athens, Greece; (D.P.K.); (G.C.B.)
- Laboratory of Organic Chemistry, Department of Chemistry, National and Kapodistrian University of Athens, 15772 Athens, Greece;
| | - Georgios C. Batsis
- Institute of Chemical Biology, National Hellenic Research Foundation, 11635 Athens, Greece; (D.P.K.); (G.C.B.)
| | - Thomas Mavromoustakos
- Laboratory of Organic Chemistry, Department of Chemistry, National and Kapodistrian University of Athens, 15772 Athens, Greece;
| | - Alessandro Giuliani
- Environment and Health Department, Istituto Superiore di Sanità, 00161 Rome, Italy;
| | - Christos T. Chasapis
- Institute of Chemical Biology, National Hellenic Research Foundation, 11635 Athens, Greece; (D.P.K.); (G.C.B.)
| |
Collapse
|
5
|
van der Meijden SL, van Boekel AM, Schinkelshoek LJ, van Goor H, Steyerberg EW, Nelissen RG, Mesotten D, Geerts BF, de Boer MG, Arbous MS. Development and validation of artificial intelligence models for early detection of postoperative infections (PERISCOPE): a multicentre study using electronic health record data. THE LANCET REGIONAL HEALTH. EUROPE 2025; 49:101163. [PMID: 39720095 PMCID: PMC11667051 DOI: 10.1016/j.lanepe.2024.101163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/13/2024] [Revised: 11/20/2024] [Accepted: 11/21/2024] [Indexed: 12/26/2024]
Abstract
Background Postoperative infections significantly impact patient outcomes and costs, exacerbated by late diagnoses, yet early reliable predictors are scarce. Existing artificial intelligence (AI) models for postoperative infection prediction often lack external validation or perform poorly in local settings when validated. We aimed to develop locally valid models as part of the PERISCOPE AI system to enable early detection, safer discharge, and more timely treatment of patients. Methods We developed and validated XGBoost models to predict postoperative infections within 7 and 30 days of surgery. Using retrospective pre-operative and intra-operative electronic health record data from 2014 to 2023 across various surgical specialities, the models were developed at Hospital A and validated and updated at Hospitals B and C in the Netherlands and Belgium. Model performance was evaluated before and after updating using the two most recent years of data as temporal validation datasets. Main outcome measures were model discrimination (area under the receiver operating characteristic curve (AUROC)), calibration (slope, intercept, and plots), and clinical utility (decision curve analysis with net benefit). Findings The study included 253,010 surgical procedures with 23,903 infections within 30-days. Discriminative performance, calibration properties, and clinical utility significantly improved after updating. Final AUROCs after updating for Hospitals A, B, and C were 0.82 (95% confidence interval (CI) 0.81-0.83), 0.82 (95% CI 0.81-0.83), and 0.91 (95% CI 0.90-0.91) respectively for 30-day predictions on the temporal validation datasets (2022-2023). Calibration plots demonstrated adequate correspondence between observed outcomes and predicted risk. All local models were deemed clinically useful as the net benefit was higher than default strategies (treat all and treat none) over a wide range of clinically relevant decision thresholds. Interpretation PERISCOPE can accurately predict overall postoperative infections within 7- and 30-days post-surgery. The robust performance implies potential for improving clinical care in diverse clinical target populations. This study supports the need for approaches to local updating of AI models to account for domain shifts in patient populations and data distributions across different clinical settings. Funding This study was funded by a REACT EU grant from European Regional Development Fund (ERDF) and Kansen voor West.
Collapse
Affiliation(s)
- Siri L. van der Meijden
- Intensive Care Unit, Leiden University Medical Centre, Leiden, the Netherlands
- Healthplus.ai B.V., Amsterdam, the Netherlands
| | - Anna M. van Boekel
- Intensive Care Unit, Leiden University Medical Centre, Leiden, the Netherlands
| | | | - Harry van Goor
- General Surgery Department, Radboud University Medical Centre, Nijmegen, the Netherlands
| | - Ewout W. Steyerberg
- Department of Biomedical Data Sciences, Leiden University Medical Centre, Leiden, the Netherlands
| | - Rob G.H.H. Nelissen
- Department of Orthopaedics, Leiden University Medical Centre, Leiden, the Netherlands
| | - Dieter Mesotten
- Department of Anaesthesiology, Intensive Care Medicine, Ziekenhuis Oost-Limburg, Genk, Belgium
- Faculty of Medicine and Life Sciences, Limburg Clinical Research Centre, UHasselt, Diepenbeek, Belgium
| | | | - Mark G.J. de Boer
- Department of Infectious Diseases, Leiden University Medical Centre, Leiden, the Netherlands
| | - M. Sesmu Arbous
- Intensive Care Unit, Leiden University Medical Centre, Leiden, the Netherlands
| |
Collapse
|
6
|
Olawade DB, Marinze S, Qureshi N, Weerasinghe K, Teke J. The impact of artificial intelligence and machine learning in organ retrieval and transplantation: A comprehensive review. Curr Res Transl Med 2025; 73:103493. [PMID: 39792149 DOI: 10.1016/j.retram.2025.103493] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2024] [Revised: 12/11/2024] [Accepted: 01/05/2025] [Indexed: 01/12/2025]
Abstract
This narrative review examines the transformative role of Artificial Intelligence (AI) and Machine Learning (ML) in organ retrieval and transplantation. AI and ML technologies enhance donor-recipient matching by integrating and analyzing complex datasets encompassing clinical, genetic, and demographic information, leading to more precise organ allocation and improved transplant success rates. In surgical planning, AI-driven image analysis automates organ segmentation, identifies critical anatomical features, and predicts surgical outcomes, aiding pre-operative planning and reducing intraoperative risks. Predictive analytics further enable personalized treatment plans by forecasting organ rejection, infection risks, and patient recovery trajectories, thereby supporting early intervention strategies and long-term patient management. AI also optimizes operational efficiency within transplant centers by predicting organ demand, scheduling surgeries efficiently, and managing inventory to minimize wastage, thus streamlining workflows and enhancing resource allocation. Despite these advancements, several challenges hinder the widespread adoption of AI and ML in organ transplantation. These include data privacy concerns, regulatory compliance issues, interoperability across healthcare systems, and the need for rigorous clinical validation of AI models. Addressing these challenges is essential to ensuring the reliable, safe, and ethical use of AI in clinical settings. Future directions for AI and ML in transplantation medicine include integrating genomic data for precision immunosuppression, advancing robotic surgery for minimally invasive procedures, and developing AI-driven remote monitoring systems for continuous post-transplantation care. Collaborative efforts among clinicians, researchers, and policymakers are crucial to harnessing the full potential of AI and ML, ultimately transforming transplantation medicine and improving patient outcomes while enhancing healthcare delivery efficiency.
Collapse
Affiliation(s)
- David B Olawade
- Department of Allied and Public Health, School of Health, Sport and Bioscience, University of East London, London, United Kingdom; Department of Research and Innovation, Medway NHS Foundation Trust, Gillingham ME7 5NY, United Kingdom; Department of Public Health, York St John University, London, United Kingdom; School of Health and Care Management, Arden University, Arden House, Middlemarch Park, Coventry CV3 4FJ, United Kingdom.
| | - Sheila Marinze
- Department of Surgery, Medway NHS Foundation Trust, Gillingham ME7 5NY, United Kingdom
| | - Nabeel Qureshi
- Department of Surgery, Medway NHS Foundation Trust, Gillingham ME7 5NY, United Kingdom
| | - Kusal Weerasinghe
- Department of Research and Innovation, Medway NHS Foundation Trust, Gillingham ME7 5NY, United Kingdom
| | - Jennifer Teke
- Department of Research and Innovation, Medway NHS Foundation Trust, Gillingham ME7 5NY, United Kingdom; Faculty of Medicine, Health and Social Care, Canterbury Christ Church University, United Kingdom
| |
Collapse
|
7
|
Cotia ALF, Scorsato AP, da Silva Victor E, Prado M, Gagliardi G, de Barros JEV, Generoso JR, de Menezes FG, Hsieh MK, Lopes GOV, Edmond MB, Perencevich EN, Goto M, Wey SB, Marra AR. Integration of an electronic hand hygiene auditing system with electronic health records using machine learning to predict hospital-acquired infection in a health care setting. Am J Infect Control 2025; 53:58-64. [PMID: 39312966 DOI: 10.1016/j.ajic.2024.09.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2024] [Revised: 09/11/2024] [Accepted: 09/12/2024] [Indexed: 09/25/2024]
Abstract
BACKGROUND Hospital-acquired infections (HAIs) increase morbidity, mortality, and health care costs. Effective hand hygiene (HH) is crucial for prevention, but achieving high compliance remains challenge. This study explores using machine learning to integrate an electronic HH auditing system with electronic health records to predict HAIs. METHODS A retrospective cohort study was conducted at a Brazilian hospital during 2017-2020. HH compliance was recorded electronically, and patient data were collected from electronic health records. The primary outcomes were HAIs per CDC/National Healthcare Safety Network surveillance definitions. Machine learning algorithms, balanced with Random Over Sampling Examples (ROSE), were utilized for predictive modeling, including generalized linear models (GLM); generalized additive models for location, scale, and shape (GAMLSS); random forest; support vector machine; and extreme gradient boosting (XGboost). RESULTS 125 of 6,253 patients (2%) developed HAIs and 920,489 HH opportunities (49.3% compliance) were analyzed. A direct correlation between HH compliance and HAIs was observed. The GLM algorithm with ROSE demonstrated superior performance, with 84.2% sensitivity, 82.9% specificity, and a 93% AUC. CONCLUSIONS Integrating electronic HH auditing systems with electronic health records and using machine learning models can enhance infection control surveillance and predict patient outcomes. Further research is needed to validate these findings and integrate them into clinical practice.
Collapse
Affiliation(s)
| | | | | | | | | | | | - José R Generoso
- Department of Biomedical Informatics, Cincinnati Children's Hospital Medical Center, Cincinnati, OH, USA
| | | | - Mariana Kim Hsieh
- Program of Hospital Epidemiology, University of Iowa Health Care, Iowa City, IA, USA
| | | | - Michael B Edmond
- Department of Medicine, West Virginia University School of Medicine, Morgantown, WV, USA
| | - Eli N Perencevich
- Department of Internal Medicine, University of Iowa Carver College of Medicine, Iowa City, IA, USA; Center for Access & Delivery Research & Evaluation (CADRE), Iowa City Veterans Affairs Health Care System, Iowa City, IA, USA
| | - Michihiko Goto
- Department of Internal Medicine, University of Iowa Carver College of Medicine, Iowa City, IA, USA; Center for Access & Delivery Research & Evaluation (CADRE), Iowa City Veterans Affairs Health Care System, Iowa City, IA, USA
| | - Sérgio B Wey
- Hospital Israelita Albert Einstein, São Paulo, Brazil
| | - Alexandre R Marra
- Hospital Israelita Albert Einstein, São Paulo, Brazil; Department of Internal Medicine, University of Iowa Carver College of Medicine, Iowa City, IA, USA; Center for Access & Delivery Research & Evaluation (CADRE), Iowa City Veterans Affairs Health Care System, Iowa City, IA, USA
| |
Collapse
|
8
|
Sartelli M, Marini CP, McNelis J, Coccolini F, Rizzo C, Labricciosa FM, Petrone P. Preventing and Controlling Healthcare-Associated Infections: The First Principle of Every Antimicrobial Stewardship Program in Hospital Settings. Antibiotics (Basel) 2024; 13:896. [PMID: 39335069 PMCID: PMC11428707 DOI: 10.3390/antibiotics13090896] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2024] [Revised: 09/12/2024] [Accepted: 09/19/2024] [Indexed: 09/30/2024] Open
Abstract
Antimicrobial resistance (AMR) is one of the main public health global burdens of the 21st century, responsible for over a million deaths every year. Hospital programs aimed at improving antibiotic use, referred to as antimicrobial stewardship programs (ASPs), can both optimize the treatment of infections and minimize adverse antibiotics events including the development and spread of AMR. The challenge of AMR is closely linked to the development and spread of healthcare-associated infection (HAIs). In fact, the management of patients with HAIs frequently requires the administration of broader-spectrum antibiotic regimens due to the higher risk of acquiring multidrug-resistant organisms, which, in turn, promotes resistance. For this reason, even before using antibiotics correctly, it is necessary to prevent and control the spread of HAIs in our hospitals. In this narrative review, we present seven measures that healthcare workers, even if not directly involved in the tasks of infection prevention and control, must know, support, and embrace. We hope that this review may raise awareness among all healthcare professionals about the issues with the increasing rate of AMR and the ongoing efforts towards minimizing its rise.
Collapse
Affiliation(s)
| | - Corrado P Marini
- Jacobi Medical Center, New York Medical College, Bronx, NY 10461, USA
| | - John McNelis
- Jacobi Medical Center, Albert Einstein College of Medicine, Bronx, NY 10461, USA
| | - Federico Coccolini
- General, Emergency and Trauma Surgery Unit, Pisa University Hospital, 56125 Pisa, Italy
| | - Caterina Rizzo
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, 56125 Pisa, Italy
| | | | - Patrizio Petrone
- NYU Langone Hospital-Long Island, NYU Grossman Long Island School of Medicine, Mineola, NY 11501, USA
| |
Collapse
|
9
|
Eisenmann M, Spreckelsen C, Rauschenberger V, Krone M, Kampmeier S. A qualitative, multi-centre approach to the current state of digitalisation and automation of surveillance in infection prevention and control in German hospitals. Antimicrob Resist Infect Control 2024; 13:78. [PMID: 39020438 PMCID: PMC11256362 DOI: 10.1186/s13756-024-01436-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2024] [Accepted: 07/07/2024] [Indexed: 07/19/2024] Open
Abstract
BACKGROUND Healthcare associated infections (HAI) pose a major threat to healthcare systems resulting in an increased burden of disease. Surveillance plays a key role in rapidly identifying these infections and preventing further transmissions. Alas, in German hospitals, the majority of surveillance efforts have been heavily relying on labour intensive processes like manual chart review. In order to be able to identify further starting points for future digital tools and interventions to aid the surveillance of HAI we aimed to gain an understanding of the current state of digitalisation in the context of the general surveillance organisation in German clinics across all care-levels. The end user perspective of infection prevention and control (IPC) professionals was chosen to identify digital interventions that have the biggest impact on the daily surveillance work routines of IPC professionals. Perceived impediments in the advancement of surveillance digitalisation should be explored. METHODS Following the development of an interview guideline, eight IPC professionals from seven German hospitals of different care levels were questioned in semi- structured interviews between December 2022 and January 2023. These included questions about general surveillance organisation, access to digital data sources, software to aid the surveillance process as well as current issues in the surveillance process and implementation of software systems. Subsequently, after full transcription, the interview sections were categorized in code categories (first deductive then inductive coding) and analysed qualitatively. RESULTS Results were characterised by high heterogeneity in terms of general surveillance organisation and access to digital data sources. Software configuration of hospital and laboratory information systems (HIS/LIS) as well as patient data management systems (PDMS) varied not only between hospitals of different care levels but also between hospitals of the same care level. Outside research projects, neither fully automatic software nor solutions utilising artificial intelligence have currently been implemented in clinical routine in any of the hospitals. CONCLUSIONS Access to digital data sources and software is increasingly available to aid surveillance of HAI. Nevertheless, surveillance processes in hospitals analysed in this study still heavily rely on manual processes. In the analysed hospitals, there is an implementation and funding gap of (semi-) automatic surveillance solutions in clinical practice, especially in healthcare facilities of lower care levels.
Collapse
Affiliation(s)
- Michael Eisenmann
- Infection Control and Antimicrobial Stewardship Unit, University Hospital Würzburg, Würzburg, Germany.
| | - Cord Spreckelsen
- Institute of Medical Statistics, Computer and Data Sciences, Jena University Hospital, Jena, Germany
| | - Vera Rauschenberger
- Infection Control and Antimicrobial Stewardship Unit, University Hospital Würzburg, Würzburg, Germany
- Institute for Hygiene and Microbiology, University of Würzburg, Würzburg, Germany
| | - Manuel Krone
- Infection Control and Antimicrobial Stewardship Unit, University Hospital Würzburg, Würzburg, Germany
- Institute for Hygiene and Microbiology, University of Würzburg, Würzburg, Germany
| | - Stefanie Kampmeier
- Infection Control and Antimicrobial Stewardship Unit, University Hospital Würzburg, Würzburg, Germany
- Institute for Hygiene and Microbiology, University of Würzburg, Würzburg, Germany
| |
Collapse
|
10
|
Wiemken TL, Carrico RM. Assisting the infection preventionist: Use of artificial intelligence for health care-associated infection surveillance. Am J Infect Control 2024; 52:625-629. [PMID: 38483430 DOI: 10.1016/j.ajic.2024.02.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Revised: 02/12/2024] [Accepted: 02/12/2024] [Indexed: 05/13/2024]
Abstract
BACKGROUND Health care-associated infection (HAI) surveillance is vital for safety in health care settings. It helps identify infection risk factors, enhancing patient safety and quality improvement. However, HAI surveillance is complex, demanding specialized knowledge and resources. This study investigates the use of artificial intelligence (AI), particularly generative large language models, to improve HAI surveillance. METHODS We assessed 2 AI agents, OpenAI's chatGPT plus (GPT-4) and a Mixtral 8×7b-based local model, for their ability to identify Central Line-Associated Bloodstream Infection (CLABSI) and Catheter-Associated Urinary Tract Infection (CAUTI) from 6 National Health Care Safety Network training scenarios. The complexity of these scenarios was analyzed, and responses were matched against expert opinions. RESULTS Both AI models accurately identified CLABSI and CAUTI in all scenarios when given clear prompts. Challenges appeared with ambiguous prompts including Arabic numeral dates, abbreviations, and special characters, causing occasional inaccuracies in repeated tests. DISCUSSION The study demonstrates AI's potential in accurately identifying HAIs like CLABSI and CAUTI. Clear, specific prompts are crucial for reliable AI responses, highlighting the need for human oversight in AI-assisted HAI surveillance. CONCLUSIONS AI shows promise in enhancing HAI surveillance, potentially streamlining tasks, and freeing health care staff for patient-focused activities. Effective AI use requires user education and ongoing AI model refinement.
Collapse
Affiliation(s)
- Timothy L Wiemken
- Saint Louis University School of Medicine, Department of Medicine, Division of Infectious Diseases Allergy & Immunology, Saint Louis, MO.
| | - Ruth M Carrico
- Department of Medicine, Division of Infectious Diseases, University of Louisville School of Medicine, Louisville, KY
| |
Collapse
|
11
|
Lukasewicz Ferreira SA, Franco Meneses AC, Vaz TA, da Fontoura Carvalho OL, Hubner Dalmora C, Pressotto Vanni D, Ribeiro Berti I, Pires Dos Santos R. Hospital-acquired infections surveillance: The machine-learning algorithm mirrors National Healthcare Safety Network definitions. Infect Control Hosp Epidemiol 2024; 45:604-608. [PMID: 38204340 DOI: 10.1017/ice.2023.224] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2024]
Abstract
BACKGROUND Surveillance of hospital-acquired infections (HAIs) is the foundation of infection control. Machine learning (ML) has been demonstrated to be a valuable tool for HAI surveillance. We compared manual surveillance with a supervised, semiautomated, ML method, and we explored the types of infection and features of importance depicted by the model. METHODS From July 2021 to December 2021, a semiautomated surveillance method based on the ML random forest algorithm, was implemented in a Brazilian hospital. Inpatient records were independently manually searched by the local team, and a panel of independent experts reviewed the ML semiautomated results for confirmation of HAI. RESULTS Among 6,296 patients, manual surveillance classified 183 HAI cases (2.9%), and a semiautomated method found 299 HAI cases (4.7%). The semiautomated method added 77 respiratory infections, which comprised 93.9% of the additional HAIs. The ML model considered 447 features for HAI classification. Among them, 148 features (33.1%) were related to infection signs and symptoms; 101 (22.6%) were related to patient severity status, 51 features (11.4%) were related to bacterial laboratory results; 40 features (8.9%) were related to invasive procedures; 34 (7.6%) were related to antibiotic use; and 31 features (6.9%) were related to patient comorbidities. Among these 447 features, 229 (51.2%) were similar to those proposed by NHSN as criteria for HAI classification. CONCLUSION The ML algorithm, which included most NHSN criteria and >200 features, augmented the human capacity for HAI classification. Well-documented algorithm performances may facilitate the incorporation of AI tools in clinical or epidemiological practice and overcome the drawbacks of traditional HAI surveillance.
Collapse
|
12
|
Baddal B, Taner F, Uzun Ozsahin D. Harnessing of Artificial Intelligence for the Diagnosis and Prevention of Hospital-Acquired Infections: A Systematic Review. Diagnostics (Basel) 2024; 14:484. [PMID: 38472956 DOI: 10.3390/diagnostics14050484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2023] [Revised: 01/23/2024] [Accepted: 02/19/2024] [Indexed: 03/14/2024] Open
Abstract
Healthcare-associated infections (HAIs) are the most common adverse events in healthcare and constitute a major global public health concern. Surveillance represents the foundation for the effective prevention and control of HAIs, yet conventional surveillance is costly and labor intensive. Artificial intelligence (AI) and machine learning (ML) have the potential to support the development of HAI surveillance algorithms for the understanding of HAI risk factors, the improvement of patient risk stratification as well as the prediction and timely detection and prevention of infections. AI-supported systems have so far been explored for clinical laboratory testing and imaging diagnosis, antimicrobial resistance profiling, antibiotic discovery and prediction-based clinical decision support tools in terms of HAIs. This review aims to provide a comprehensive summary of the current literature on AI applications in the field of HAIs and discuss the future potentials of this emerging technology in infection practice. Following the PRISMA guidelines, this study examined the articles in databases including PubMed and Scopus until November 2023, which were screened based on the inclusion and exclusion criteria, resulting in 162 included articles. By elucidating the advancements in the field, we aim to highlight the potential applications of AI in the field, report related issues and shortcomings and discuss the future directions.
Collapse
Affiliation(s)
- Buket Baddal
- Department of Medical Microbiology and Clinical Microbiology, Faculty of Medicine, Near East University, North Cyprus, Mersin 10, 99138 Nicosia, Turkey
- DESAM Research Institute, Near East University, North Cyprus, Mersin 10, 99138 Nicosia, Turkey
| | - Ferdiye Taner
- Department of Medical Microbiology and Clinical Microbiology, Faculty of Medicine, Near East University, North Cyprus, Mersin 10, 99138 Nicosia, Turkey
- DESAM Research Institute, Near East University, North Cyprus, Mersin 10, 99138 Nicosia, Turkey
| | - Dilber Uzun Ozsahin
- Department of Medical Diagnostic Imaging, College of Health Science, University of Sharjah, Sharjah 27272, United Arab Emirates
- Research Institute for Medical and Health Sciences, University of Sharjah, Sharjah 27272, United Arab Emirates
- Operational Research Centre in Healthcare, Near East University, North Cyprus, Mersin 10, 99138 Nicosia, Turkey
| |
Collapse
|
13
|
Arzilli G, De Vita E, Pasquale M, Carloni LM, Pellegrini M, Di Giacomo M, Esposito E, Porretta AD, Rizzo C. Innovative Techniques for Infection Control and Surveillance in Hospital Settings and Long-Term Care Facilities: A Scoping Review. Antibiotics (Basel) 2024; 13:77. [PMID: 38247635 PMCID: PMC10812752 DOI: 10.3390/antibiotics13010077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2023] [Revised: 01/05/2024] [Accepted: 01/11/2024] [Indexed: 01/23/2024] Open
Abstract
Healthcare-associated infections (HAIs) pose significant challenges in healthcare systems, with preventable surveillance playing a crucial role. Traditional surveillance, although effective, is resource-intensive. The development of new technologies, such as artificial intelligence (AI), can support traditional surveillance in analysing an increasing amount of health data or meeting patient needs. We conducted a scoping review, following the PRISMA-ScR guideline, searching for studies of new digital technologies applied to the surveillance, control, and prevention of HAIs in hospitals and LTCFs published from 2018 to 4 November 2023. The literature search yielded 1292 articles. After title/abstract screening and full-text screening, 43 articles were included. The mean study duration was 43.7 months. Surgical site infections (SSIs) were the most-investigated HAI and machine learning was the most-applied technology. Three main themes emerged from the thematic analysis: patient empowerment, workload reduction and cost reduction, and improved sensitivity and personalization. Comparative analysis between new technologies and traditional methods showed different population types, with machine learning methods examining larger populations for AI algorithm training. While digital tools show promise in HAI surveillance, especially for SSIs, challenges persist in resource distribution and interdisciplinary integration in healthcare settings, highlighting the need for ongoing development and implementation strategies.
Collapse
Affiliation(s)
- Guglielmo Arzilli
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy; (G.A.); (M.P.); (L.M.C.); (M.P.); (M.D.G.); (E.E.); (A.D.P.); (C.R.)
| | - Erica De Vita
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy; (G.A.); (M.P.); (L.M.C.); (M.P.); (M.D.G.); (E.E.); (A.D.P.); (C.R.)
| | - Milena Pasquale
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy; (G.A.); (M.P.); (L.M.C.); (M.P.); (M.D.G.); (E.E.); (A.D.P.); (C.R.)
| | - Luca Marcello Carloni
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy; (G.A.); (M.P.); (L.M.C.); (M.P.); (M.D.G.); (E.E.); (A.D.P.); (C.R.)
| | - Marzia Pellegrini
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy; (G.A.); (M.P.); (L.M.C.); (M.P.); (M.D.G.); (E.E.); (A.D.P.); (C.R.)
| | - Martina Di Giacomo
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy; (G.A.); (M.P.); (L.M.C.); (M.P.); (M.D.G.); (E.E.); (A.D.P.); (C.R.)
| | - Enrica Esposito
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy; (G.A.); (M.P.); (L.M.C.); (M.P.); (M.D.G.); (E.E.); (A.D.P.); (C.R.)
| | - Andrea Davide Porretta
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy; (G.A.); (M.P.); (L.M.C.); (M.P.); (M.D.G.); (E.E.); (A.D.P.); (C.R.)
- University Hospital of Pisa, 56124, Pisa, Italy
| | - Caterina Rizzo
- Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, 56126 Pisa, Italy; (G.A.); (M.P.); (L.M.C.); (M.P.); (M.D.G.); (E.E.); (A.D.P.); (C.R.)
- University Hospital of Pisa, 56124, Pisa, Italy
| |
Collapse
|
14
|
Tian Y, Li R, Wang G, Xu K, Li H, He L. Prediction of postoperative infectious complications in elderly patients with colorectal cancer: a study based on improved machine learning. BMC Med Inform Decis Mak 2024; 24:11. [PMID: 38184556 PMCID: PMC10770876 DOI: 10.1186/s12911-023-02411-0] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2023] [Accepted: 12/18/2023] [Indexed: 01/08/2024] Open
Abstract
BACKGROUND Infectious complications after colorectal cancer (CRC) surgery increase perioperative mortality and are significantly associated with poor prognosis. We aimed to develop a model for predicting infectious complications after colorectal cancer surgery in elderly patients based on improved machine learning (ML) using inflammatory and nutritional indicators. METHODS The data of 512 elderly patients with colorectal cancer in the Third Affiliated Hospital of Anhui Medical University from March 2018 to April 2022 were retrospectively collected and randomly divided into a training set and validation set. The optimal cutoff values of NLR (3.80), PLR (238.50), PNI (48.48), LCR (0.52), and LMR (2.46) were determined by receiver operating characteristic (ROC) curve; Six conventional machine learning models were constructed using patient data in the training set: Linear Regression, Random Forest, Support Vector Machine (SVM), BP Neural Network (BP), Light Gradient Boosting Machine (LGBM), Extreme Gradient Boosting (XGBoost) and an improved moderately greedy XGBoost (MGA-XGBoost) model. The performance of the seven models was evaluated by area under the receiver operator characteristic curve, accuracy (ACC), precision, recall, and F1-score of the validation set. RESULTS Five hundred twelve cases were included in this study; 125 cases (24%) had postoperative infectious complications. Postoperative infectious complications were notably associated with 10 items features: American Society of Anesthesiologists scores (ASA), operation time, diabetes, presence of stomy, tumor location, NLR, PLR, PNI, LCR, and LMR. MGA-XGBoost reached the highest AUC (0.862) on the validation set, which was the best model for predicting postoperative infectious complications in elderly patients with colorectal cancer. Among the importance of the internal characteristics of the model, LCR accounted for the highest proportion. CONCLUSIONS This study demonstrates for the first time that the MGA-XGBoost model with 10 risk factors might predict postoperative infectious complications in elderly CRC patients.
Collapse
Affiliation(s)
- Yuan Tian
- Department of Gastrointestinal Surgery, The Third Affiliated Hospital of Anhui Medical University (The first people's Hospital of Hefei), Hefei, Anhui, China
| | - Rui Li
- Department of Gastrointestinal Surgery, The Third Affiliated Hospital of Anhui Medical University (The first people's Hospital of Hefei), Hefei, Anhui, China
| | - Guanlong Wang
- Department of Gastrointestinal Surgery, The Third Affiliated Hospital of Anhui Medical University (The first people's Hospital of Hefei), Hefei, Anhui, China
| | - Kai Xu
- Department of Gastrointestinal Surgery, The Third Affiliated Hospital of Anhui Medical University (The first people's Hospital of Hefei), Hefei, Anhui, China
| | - Hongxia Li
- Department of Oncology, The Third Affiliated Hospital of Anhui Medical University (The first people's Hospital of Hefei), Hefei, Anhui, China
| | - Lei He
- Department of Gastrointestinal Surgery, The Third Affiliated Hospital of Anhui Medical University (The first people's Hospital of Hefei), Hefei, Anhui, China.
| |
Collapse
|
15
|
Jakobsen RS, Nielsen TD, Leutscher P, Koch K. A study on the risk stratification for patients within 24 hours of admission for risk of hospital-acquired urinary tract infection using Bayesian network models. Health Informatics J 2024; 30:14604582241234232. [PMID: 38419559 DOI: 10.1177/14604582241234232] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/02/2024]
Abstract
Early identification of patients at risk of hospital-acquired urinary tract infections (HA-UTI) enables the initiation of timely targeted preventive and therapeutic strategies. Machine learning (ML) models have shown great potential for this purpose. However, existing ML models in infection control have demonstrated poor ability to support explainability, which challenges the interpretation of the result in clinical practice, limiting the adaption of the ML models into a daily clinical routine. In this study, we developed Bayesian Network (BN) models to enable explainable assessment within 24 h of admission for risk of HA-UTI. Our dataset contained 138,250 unique hospital admissions. We included data on admission details, demographics, lifestyle factors, comorbidities, vital parameters, laboratory results, and urinary catheter. Models developed from a reduced set of five features were characterized by transparency compared to models developed from a full set of 50 features. The expert-based clinical BN model over the reduced feature space showed the highest performance (area under the curve = 0.746) compared to the naïve- and tree-augmented-naïve BN models. Moreover, models developed from expert-based knowledge were characterized by enhanced explainability.
Collapse
Affiliation(s)
- Rune Sejer Jakobsen
- Centre for Clinical Research, North Denmark Regional Hospital, Aalborg, Denmark
- Business Intelligence and Analysis, The North Denmark Region, Aalborg, Denmark
| | | | - Peter Leutscher
- Centre for Clinical Research, North Denmark Regional Hospital, Aalborg, Denmark
- Department of Clinical Medicine, Aalborg Universitet, Aalborg, Denmark
| | - Kristoffer Koch
- Centre for Clinical Research, North Denmark Regional Hospital, Aalborg, Denmark
- Department of Clinical Microbiology, Aalborg University Hospital, Aalborg, Denmark
| |
Collapse
|
16
|
Perret J, Schmid A. Application of OpenAI GPT-4 for the retrospective detection of catheter-associated urinary tract infections in a fictitious and curated patient data set. Infect Control Hosp Epidemiol 2024; 45:96-99. [PMID: 37675518 PMCID: PMC10782204 DOI: 10.1017/ice.2023.189] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Revised: 06/22/2023] [Accepted: 07/12/2023] [Indexed: 09/08/2023]
Abstract
The use of the OpenAI GPT-4 model in detecting catheter-associated urinary tract infection (CAUTI) cases in small fictitious and curated patient data sets was investigated. Final analysis of 50 patients including 11 CAUTI cases yielded sensitivity, specificity and positive and negative predictive values of 91%, 92%, 83%, and 96%, respectively.
Collapse
Affiliation(s)
- Jasmin Perret
- Infectious Diseases and Hospital Epidemiology, Department of General Internal Medicine, Cantonal Hospital Winterthur, Winterthur, Switzerland
| | - Adrian Schmid
- Infectious Diseases and Hospital Epidemiology, Department of General Internal Medicine, Cantonal Hospital Winterthur, Winterthur, Switzerland
| |
Collapse
|
17
|
Kolasa K, Admassu B, Hołownia-Voloskova M, Kędzior KJ, Poirrier JE, Perni S. Systematic reviews of machine learning in healthcare: a literature review. Expert Rev Pharmacoecon Outcomes Res 2024; 24:63-115. [PMID: 37955147 DOI: 10.1080/14737167.2023.2279107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Accepted: 10/31/2023] [Indexed: 11/14/2023]
Abstract
INTRODUCTION The increasing availability of data and computing power has made machine learning (ML) a viable approach to faster, more efficient healthcare delivery. METHODS A systematic literature review (SLR) of published SLRs evaluating ML applications in healthcare settings published between1 January 2010 and 27 March 2023 was conducted. RESULTS In total 220 SLRs covering 10,462 ML algorithms were reviewed. The main application of AI in medicine related to the clinical prediction and disease prognosis in oncology and neurology with the use of imaging data. Accuracy, specificity, and sensitivity were provided in 56%, 28%, and 25% SLRs respectively. Internal and external validation was reported in 53% and less than 1% of the cases respectively. The most common modeling approach was neural networks (2,454 ML algorithms), followed by support vector machine and random forest/decision trees (1,578 and 1,522 ML algorithms, respectively). EXPERT OPINION The review indicated considerable reporting gaps in terms of the ML's performance, both internal and external validation. Greater accessibility to healthcare data for developers can ensure the faster adoption of ML algorithms into clinical practice.
Collapse
Affiliation(s)
- Katarzyna Kolasa
- Division of Health Economics and Healthcare Management, Kozminski University, Warsaw, Poland
| | - Bisrat Admassu
- Division of Health Economics and Healthcare Management, Kozminski University, Warsaw, Poland
| | | | | | | | | |
Collapse
|
18
|
Scharp D, Hobensack M, Davoudi A, Topaz M. Natural Language Processing Applied to Clinical Documentation in Post-acute Care Settings: A Scoping Review. J Am Med Dir Assoc 2024; 25:69-83. [PMID: 37838000 PMCID: PMC10792659 DOI: 10.1016/j.jamda.2023.09.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Revised: 09/05/2023] [Accepted: 09/07/2023] [Indexed: 10/16/2023]
Abstract
OBJECTIVES To determine the scope of the application of natural language processing to free-text clinical notes in post-acute care and provide a foundation for future natural language processing-based research in these settings. DESIGN Scoping review; reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews guidelines. SETTING AND PARTICIPANTS Post-acute care (ie, home health care, long-term care, skilled nursing facilities, and inpatient rehabilitation facilities). METHODS PubMed, Cumulative Index of Nursing and Allied Health Literature, and Embase were searched in February 2023. Eligible studies had quantitative designs that used natural language processing applied to clinical documentation in post-acute care settings. The quality of each study was appraised. RESULTS Twenty-one studies were included. Almost all studies were conducted in home health care settings. Most studies extracted data from electronic health records to examine the risk for negative outcomes, including acute care utilization, medication errors, and suicide mortality. About half of the studies did not report age, sex, race, or ethnicity data or use standardized terminologies. Only 8 studies included variables from socio-behavioral domains. Most studies fulfilled all quality appraisal indicators. CONCLUSIONS AND IMPLICATIONS The application of natural language processing is nascent in post-acute care settings. Future research should apply natural language processing using standardized terminologies to leverage free-text clinical notes in post-acute care to promote timely, comprehensive, and equitable care. Natural language processing could be integrated with predictive models to help identify patients who are at risk of negative outcomes. Future research should incorporate socio-behavioral determinants and diverse samples to improve health equity in informatics tools.
Collapse
Affiliation(s)
| | | | - Anahita Davoudi
- VNS Health, Center for Home Care Policy & Research, New York, NY, USA
| | - Maxim Topaz
- Columbia University School of Nursing, New York, NY, USA
| |
Collapse
|
19
|
Marra AR, Nori P, Langford BJ, Kobayashi T, Bearman G. Brave new world: Leveraging artificial intelligence for advancing healthcare epidemiology, infection prevention, and antimicrobial stewardship. Infect Control Hosp Epidemiol 2023; 44:1909-1912. [PMID: 37395009 DOI: 10.1017/ice.2023.122] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/04/2023]
Affiliation(s)
- Alexandre R Marra
- Hospital Israelita Albert Einstein, São Paulo, Brazil
- Department of Internal Medicine, University of Iowa Carver College of Medicine, Iowa City, Iowa, United States
| | - Priya Nori
- Division of Infectious Diseases, Department of Medicine, Montefiore Health System, Albert Einstein College of Medicine, Bronx, New York, United States
| | - Bradley J Langford
- Dalla Lana School of Public Health, University of Toronto, Toronto, Canada
- Hotel Dieu Shaver Health and Rehabilitation Centre, St. Catharines, Canada
| | - Takaaki Kobayashi
- Department of Internal Medicine, University of Iowa Carver College of Medicine, Iowa City, Iowa, United States
| | - Gonzalo Bearman
- Division of Infectious Diseases, Virginia Commonwealth University Health, Virginia Commonwealth University, Richmond, Virginia, United States
| |
Collapse
|
20
|
Zaidan AM. The leading global health challenges in the artificial intelligence era. Front Public Health 2023; 11:1328918. [PMID: 38089037 PMCID: PMC10711066 DOI: 10.3389/fpubh.2023.1328918] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Accepted: 11/13/2023] [Indexed: 12/18/2023] Open
Abstract
Millions of people's health is at risk because of several factors and multiple overlapping crises, all of which hit the vulnerable the most. These challenges are dynamic and evolve in response to emerging health challenges and concerns, which need effective collaboration among countries working toward achieving Sustainable Development Goals (SDGs) and securing global health. Mental Health, the Impact of climate change, cardiovascular diseases (CVDs), diabetes, Infectious diseases, health system, and population aging are examples of challenges known to pose a vast burden worldwide. We are at a point known as the "digital revolution," characterized by the expansion of artificial intelligence (AI) and a fusion of technology types. AI has emerged as a powerful tool for addressing various health challenges, and the last ten years have been influential due to the rapid expansion in the production and accessibility of health-related data. The computational models and algorithms can understand complicated health and medical data to perform various functions and deep-learning strategies. This narrative mini-review summarizes the most current AI applications to address the leading global health challenges. Harnessing its capabilities can ultimately mitigate the Impact of these challenges and revolutionize the field. It has the ability to strengthen global health through personalized health care and improved preparedness and response to future challenges. However, ethical and legal concerns about individual or community privacy and autonomy must be addressed for effective implementation.
Collapse
Affiliation(s)
- Amal Mousa Zaidan
- King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia
- King Abdullah International Medical Research Center (KAIMRC), Riyadh, Saudi Arabia
- Ministry of National Guard Health Affairs, Riyadh, Saudi Arabia
| |
Collapse
|
21
|
Haby MM, Chapman E, Barreto JOM, Mujica OJ, Rivière Cinnamond A, Caixeta R, Garcia-Saiso S, Reveiz L. Greater agreement is required to harness the potential of health intelligence: a critical interpretive synthesis. J Clin Epidemiol 2023; 163:37-50. [PMID: 37742988 PMCID: PMC10735235 DOI: 10.1016/j.jclinepi.2023.09.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2023] [Revised: 09/17/2023] [Accepted: 09/18/2023] [Indexed: 09/26/2023]
Abstract
OBJECTIVES To synthesize existing knowledge on the features of, and approaches to, health intelligence, including definitions, key concepts, frameworks, methods and tools, types of evidence used, and research gaps. STUDY DESIGN AND SETTING We applied a critical interpretive synthesis methodology, combining systematic searching, purposive sampling, and inductive analysis to explore the topic. We conducted electronic and supplementary searches to identify records (papers, books, websites) based on their potential relevance to health intelligence. The key themes identified in the literature were combined under each of the compass subquestions and circulated among the research team for discussion and interpretation. RESULTS Of the 290 records screened, 40 were included in the synthesis. There is no clear definition of health intelligence in the literature. Some records describe it in similar terms as public health surveillance. Some focus on the use of artificial intelligence, while others refer to health intelligence in a military or security sense. And some authors have suggested a broader definition of health intelligence that explicitly includes the concepts of synthesis of research evidence for informed decision making. CONCLUSION Rather than developing a new or all-encompassing definition, we suggest incorporating the concept and scope of health intelligence within the evidence ecosystem.
Collapse
Affiliation(s)
- Michelle M Haby
- Evidence and Intelligence for Action in Health, Pan American Health Organization, Washington, DC, USA; Department of Chemical and Biological Sciences, University of Sonora, Hermosillo, Sonora, Mexico; Melbourne School of Population and Global Health, The University of Melbourne, Parkville, Victoria 3010, Australia.
| | - Evelina Chapman
- Fiocruz Brasília, Oswaldo Cruz Foundation, Avenida L3 Norte, s/n, Campus Universitário Darcy Ribeiro, Gleba A, Brasília, DF 70904-130, Brazil
| | - Jorge Otávio Maia Barreto
- Fiocruz Brasília, Oswaldo Cruz Foundation, Avenida L3 Norte, s/n, Campus Universitário Darcy Ribeiro, Gleba A, Brasília, DF 70904-130, Brazil
| | - Oscar J Mujica
- Evidence and Intelligence for Action in Health, Pan American Health Organization, Washington, DC, USA
| | - Ana Rivière Cinnamond
- PAHO/WHO Representation in Panama, Ministerio de Salud, Ancon, Av Gorgas, Edificio 261, Panama City, Panama
| | - Roberta Caixeta
- Noncommunicable Disease and Mental Health, Pan American Health Organization/World Health Organization, Washington, DC, USA
| | - Sebastian Garcia-Saiso
- Evidence and Intelligence for Action in Health, Pan American Health Organization, Washington, DC, USA
| | - Ludovic Reveiz
- Evidence and Intelligence for Action in Health, Pan American Health Organization, Washington, DC, USA
| |
Collapse
|
22
|
Cao Y, Niu Y, Tian X, Peng D, Lu L, Zhang H. Development of a knowledge-based healthcare-associated infections surveillance system in China. BMC Med Inform Decis Mak 2023; 23:209. [PMID: 37817157 PMCID: PMC10563206 DOI: 10.1186/s12911-023-02297-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2022] [Accepted: 09/16/2023] [Indexed: 10/12/2023] Open
Abstract
BACKGROUND In the modern era of antibiotics, healthcare-associated infections (HAIs) have emerged as a prominent and concerning health threat worldwide. Implementing an electronic surveillance system for healthcare-associated infections offers the potential to not only alleviate the manual workload of clinical physicians in surveillance and reporting but also enhance patient safety and the overall quality of medical care. Despite the widespread adoption of healthcare-associated infections surveillance systems in numerous hospitals across China, several challenges persist. These encompass incomplete coverage of all infection types in the surveillance, lack of clarity in the alerting results provided by the system, and discrepancies in sensitivity and specificity that fall short of practical expectations. METHODS We design and develop a knowledge-based healthcare-associated infections surveillance system (KBHAIS) with the primary goal of supporting clinicians in their surveillance of HAIs. The system operates by automatically extracting infection factors from both structured and unstructured electronic health data. Each patient visit is represented as a tuple list, which is then processed by the rule engine within KBHAIS. As a result, the system generates comprehensive warning results, encompassing infection site, infection diagnoses, infection time, and infection probability. These knowledge rules utilized by the rule engine are derived from infection-related clinical guidelines and the collective expertise of domain experts. RESULTS We develop and evaluate our KBHAIS on a dataset of 106,769 samples collected from 84,839 patients at Gansu Provincial Hospital in China. The experimental results reveal that the system achieves a sensitivity rate surpassing 0.83, offering compelling evidence of its effectiveness and reliability. CONCLUSIONS Our healthcare-associated infections surveillance system demonstrates its effectiveness in promptly alerting patients to healthcare-associated infections. Consequently, our system holds the potential to considerably diminish the occurrence of delayed and missed reporting of such infections, thereby bolstering patient safety and elevating the overall quality of healthcare delivery.
Collapse
Affiliation(s)
- Yu Cao
- College of Computer Science, Sichuan University, No. 24 South Section 1, Yihuan Road, 610065, Chengdu, China
| | - Yaojun Niu
- LiLian Information Technology Company, Room 1536, Building 1, No.668 Shangda Road, Baoshan District, 201999, Shanghai, China
| | - Xuetao Tian
- LiLian Information Technology Company, Room 1536, Building 1, No.668 Shangda Road, Baoshan District, 201999, Shanghai, China
| | - DeZhong Peng
- College of Computer Science, Sichuan University, No. 24 South Section 1, Yihuan Road, 610065, Chengdu, China
| | - Li Lu
- College of Computer Science, Sichuan University, No. 24 South Section 1, Yihuan Road, 610065, Chengdu, China.
| | - Haojun Zhang
- The dean's office, Second Provincial People's Hospital of Gansu, No.1 Hezheng West Road, Chengguan District, 730099, Lanzhou, China.
- Nosocomial Infection Management and Quality Control Center of Gansu Province, Lanzhou, China.
| |
Collapse
|
23
|
Irgang L, Barth H, Holmén M. Data-Driven Technologies as Enablers for Value Creation in the Prevention of Surgical Site Infections: a Systematic Review. JOURNAL OF HEALTHCARE INFORMATICS RESEARCH 2023; 7:1-41. [PMID: 36910913 PMCID: PMC9995622 DOI: 10.1007/s41666-023-00129-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2022] [Revised: 01/16/2023] [Accepted: 02/03/2023] [Indexed: 03/02/2023]
Abstract
Despite the advances in modern medicine, the use of data-driven technologies (DDTs) to prevent surgical site infections (SSIs) remains a major challenge. Scholars recognise that data management is the next frontier in infection prevention, but many aspects related to the benefits and advantages of using DDTs to mitigate SSI risk factors remain unclear and underexplored in the literature. This study explores how DDTs enable value creation in the prevention of SSIs. This study follows a systematic literature review approach and the PRISMA statement to analyse peer-reviewed articles from seven databases. Fifty-nine articles were included in the review and were analysed through a descriptive and a thematic analysis. The findings suggest a growing interest in DDTs in SSI prevention in the last 5 years, and that machine learning and smartphone applications are widely used in SSI prevention. DDTs are mainly applied to prevent SSIs in clean and clean-contaminated surgeries and often used to manage patient-related data in the postoperative stage. DDTs enable the creation of nine categories of value that are classified in four dimensions: cost/sacrifice, functional/instrumental, experiential/hedonic, and symbolic/expressive. This study offers a unique and systematic overview of the value creation aspects enabled by DDT applications in SSI prevention and suggests that additional research is needed in four areas: value co-creation and product-service systems, DDTs in contaminated and dirty surgeries, data legitimation and explainability, and data-driven interventions. Supplementary Information The online version contains supplementary material available at 10.1007/s41666-023-00129-2.
Collapse
Affiliation(s)
- Luís Irgang
- School of Business, Innovation and Sustainability - Department of Engineering and Innovation, Halmstad University, Halmstad, Sweden
| | - Henrik Barth
- School of Business, Innovation and Sustainability - Department of Engineering and Innovation, Halmstad University, Halmstad, Sweden
| | - Magnus Holmén
- School of Business, Innovation and Sustainability - Department of Engineering and Innovation, Halmstad University, Halmstad, Sweden
| |
Collapse
|
24
|
Wu G, Khair S, Yang F, Cheligeer C, Southern D, Zhang Z, Feng Y, Xu Y, Quan H, Williamson T, Eastwood CA. Performance of machine learning algorithms for surgical site infection case detection and prediction: A systematic review and meta-analysis. Ann Med Surg (Lond) 2022; 84:104956. [PMID: 36582918 PMCID: PMC9793260 DOI: 10.1016/j.amsu.2022.104956] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 11/08/2022] [Accepted: 11/13/2022] [Indexed: 11/24/2022] Open
Abstract
Background Medical researchers and clinicians have shown much interest in developing machine learning (ML) algorithms to detect/predict surgical site infections (SSIs). However, little is known about the overall performance of ML algorithms in predicting SSIs and how to improve the algorithm's robustness. We conducted a systematic review and meta-analysis to summarize the performance of ML algorithms in SSIs case detection and prediction and to describe the impact of using unstructured and textual data in the development of ML algorithms. Methods MEDLINE, EMBASE, CINAHL, CENTRAL and Web of Science were searched from inception to March 25, 2021. Study characteristics and algorithm development information were extracted. Performance statistics (e.g., sensitivity, area under the receiver operating characteristic curve [AUC]) were pooled using a random effect model. Stratified analysis was applied to different study characteristic levels. Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Diagnostic Test Accuracy Studies (PRISMA-DTA) was followed. Results Of 945 articles identified, 108 algorithms from 32 articles were included in this review. The overall pooled estimate of the SSI incidence rate was 3.67%, 95% CI: 3.58-3.76. Mixed-use of structured and textual data-based algorithms (pooled estimates of sensitivity 0.83, 95% CI: 0.78-0.87, specificity 0.92, 95% CI: 0.86-0.95, AUC 0.92, 95% CI: 0.89-0.94) outperformed algorithms solely based on structured data (sensitivity 0.56, 95% CI:0.43-0.69, specificity 0.95, 95% CI:0.91-0.97, AUC = 0.90, 95% CI: 0.87-0.92). Conclusions ML algorithms developed with structured and textual data provided optimal performance. External validation of ML algorithms is needed to translate current knowledge into clinical practice.
Collapse
Affiliation(s)
- Guosong Wu
- Centre for Health Informatics, Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
- O'Brien Institute for Public Health, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
- Institute of Health Economics, University of Alberta, Edmonton, Alberta, Canada
| | - Shahreen Khair
- Centre for Health Informatics, Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
| | - Fengjuan Yang
- Centre for Health Informatics, Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
| | | | - Danielle Southern
- Centre for Health Informatics, Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
- O'Brien Institute for Public Health, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
| | - Zilong Zhang
- Centre for Health Informatics, Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
| | - Yuanchao Feng
- Centre for Health Informatics, Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
| | - Yuan Xu
- Centre for Health Informatics, Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
- Department of Oncology and Surgery, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
| | - Hude Quan
- Centre for Health Informatics, Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
- O'Brien Institute for Public Health, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
| | - Tyler Williamson
- Centre for Health Informatics, Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
- O'Brien Institute for Public Health, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
| | - Cathy A. Eastwood
- Centre for Health Informatics, Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada
| |
Collapse
|
25
|
Martinez-Millana A, Saez-Saez A, Tornero-Costa R, Azzopardi-Muscat N, Traver V, Novillo-Ortiz D. Artificial intelligence and its impact on the domains of universal health coverage, health emergencies and health promotion: An overview of systematic reviews. Int J Med Inform 2022; 166:104855. [PMID: 35998421 PMCID: PMC9551134 DOI: 10.1016/j.ijmedinf.2022.104855] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Revised: 08/01/2022] [Accepted: 08/11/2022] [Indexed: 12/04/2022]
Abstract
BACKGROUND Artificial intelligence is fueling a new revolution in medicine and in the healthcare sector. Despite the growing evidence on the benefits of artificial intelligence there are several aspects that limit the measure of its impact in people's health. It is necessary to assess the current status on the application of AI towards the improvement of people's health in the domains defined by WHO's Thirteenth General Programme of Work (GPW13) and the European Programme of Work (EPW), to inform about trends, gaps, opportunities, and challenges. OBJECTIVE To perform a systematic overview of systematic reviews on the application of artificial intelligence in the people's health domains as defined in the GPW13 and provide a comprehensive and updated map on the application specialties of artificial intelligence in terms of methodologies, algorithms, data sources, outcomes, predictors, performance, and methodological quality. METHODS A systematic search in MEDLINE, EMBASE, Cochrane and IEEEXplore was conducted between January 2015 and June 2021 to collect systematic reviews using a combination of keywords related to the domains of universal health coverage, health emergencies protection, and better health and wellbeing as defined by the WHO's PGW13 and EPW. Eligibility criteria was based on methodological quality and the inclusion of practical implementation of artificial intelligence. Records were classified and labeled using ICD-11 categories into the domains of the GPW13. Descriptors related to the area of implementation, type of modeling, data entities, outcomes and implementation on care delivery were extracted using a structured form and methodological aspects of the included reviews studies was assessed using the AMSTAR checklist. RESULTS The search strategy resulted in the screening of 815 systematic reviews from which 203 were assessed for eligibility and 129 were included in the review. The most predominant domain for artificial intelligence applications was Universal Health Coverage (N = 98) followed by Health Emergencies (N = 16) and Better Health and Wellbeing (N = 15). Neoplasms area on Universal Health Coverage was the disease area featuring most of the applications (21.7 %, N = 28). The reviews featured analytics primarily over both public and private data sources (67.44 %, N = 87). The most used type of data was medical imaging (31.8 %, N = 41) and predictors based on regions of interest and clinical data. The most prominent subdomain of Artificial Intelligence was Machine Learning (43.4 %, N = 56), in which Support Vector Machine method was predominant (20.9 %, N = 27). Regarding the purpose, the application of Artificial Intelligence I is focused on the prediction of the diseases (36.4 %, N = 47). With respect to the validation, more than a half of the reviews (54.3 %, N = 70) did not report a validation procedure and, whenever available, the main performance indicator was the accuracy (28.7 %, N = 37). According to the methodological quality assessment, a third of the reviews (34.9 %, N = 45) implemented methods for analysis the risk of bias and the overall AMSTAR score below was 5 (4.01 ± 1.93) on all the included systematic reviews. CONCLUSION Artificial intelligence is being used for disease modelling, diagnose, classification and prediction in the three domains of GPW13. However, the evidence is often limited to laboratory and the level of adoption is largely unbalanced between ICD-11 categoriesand diseases. Data availability is a determinant factor on the developmental stage of artificial intelligence applications. Most of the reviewed studies show a poor methodological quality and are at high risk of bias, which limits the reproducibility of the results and the reliability of translating these applications to real clinical scenarios. The analyzed papers show results only in laboratory and testing scenarios and not in clinical trials nor case studies, limiting the supporting evidence to transfer artificial intelligence to actual care delivery.
Collapse
Affiliation(s)
- Antonio Martinez-Millana
- Instituto Universitario de Investigación de Aplicaciones de las Tecnologías de la Información y de las Comunicaciones Avanzadas (ITACA), Universitat Politècnica de València, Camino de Vera S/N, Valencia 46022, Spain
| | - Aida Saez-Saez
- Instituto Universitario de Investigación de Aplicaciones de las Tecnologías de la Información y de las Comunicaciones Avanzadas (ITACA), Universitat Politècnica de València, Camino de Vera S/N, Valencia 46022, Spain
| | - Roberto Tornero-Costa
- Instituto Universitario de Investigación de Aplicaciones de las Tecnologías de la Información y de las Comunicaciones Avanzadas (ITACA), Universitat Politècnica de València, Camino de Vera S/N, Valencia 46022, Spain
| | - Natasha Azzopardi-Muscat
- Division of Country Health Policies and Systems, World Health Organization, Regional Office for Europe, Copenhagen, Denmark
| | - Vicente Traver
- Instituto Universitario de Investigación de Aplicaciones de las Tecnologías de la Información y de las Comunicaciones Avanzadas (ITACA), Universitat Politècnica de València, Camino de Vera S/N, Valencia 46022, Spain
| | - David Novillo-Ortiz
- Division of Country Health Policies and Systems, World Health Organization, Regional Office for Europe, Copenhagen, Denmark.
| |
Collapse
|
26
|
Terry AL, Kueper JK, Beleno R, Brown JB, Cejic S, Dang J, Leger D, McKay S, Meredith L, Pinto AD, Ryan BL, Stewart M, Zwarenstein M, Lizotte DJ. Is primary health care ready for artificial intelligence? What do primary health care stakeholders say? BMC Med Inform Decis Mak 2022; 22:237. [PMID: 36085203 PMCID: PMC9461192 DOI: 10.1186/s12911-022-01984-6] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2022] [Accepted: 09/02/2022] [Indexed: 11/10/2022] Open
Abstract
Abstract
Background
Effective deployment of AI tools in primary health care requires the engagement of practitioners in the development and testing of these tools, and a match between the resulting AI tools and clinical/system needs in primary health care. To set the stage for these developments, we must gain a more in-depth understanding of the views of practitioners and decision-makers about the use of AI in primary health care. The objective of this study was to identify key issues regarding the use of AI tools in primary health care by exploring the views of primary health care and digital health stakeholders.
Methods
This study utilized a descriptive qualitative approach, including thematic data analysis. Fourteen in-depth interviews were conducted with primary health care and digital health stakeholders in Ontario. NVivo software was utilized in the coding of the interviews.
Results
Five main interconnected themes emerged: (1) Mismatch Between Envisioned Uses and Current Reality—denoting the importance of potential applications of AI in primary health care practice, with a recognition of the current reality characterized by a lack of available tools; (2) Mechanics of AI Don’t Matter: Just Another Tool in the Toolbox– reflecting an interest in what value AI tools could bring to practice, rather than concern with the mechanics of the AI tools themselves; (3) AI in Practice: A Double-Edged Sword—the possible benefits of AI use in primary health care contrasted with fundamental concern about the possible threats posed by AI in terms of clinical skills and capacity, mistakes, and loss of control; (4) The Non-Starters: A Guarded Stance Regarding AI Adoption in Primary Health Care—broader concerns centred on the ethical, legal, and social implications of AI use in primary health care; and (5) Necessary Elements: Facilitators of AI in Primary Health Care—elements required to support the uptake of AI tools, including co-creation, availability and use of high quality data, and the need for evaluation.
Conclusion
The use of AI in primary health care may have a positive impact, but many factors need to be considered regarding its implementation. This study may help to inform the development and deployment of AI tools in primary health care.
Collapse
|
27
|
Verberk JDM, Aghdassi SJS, Abbas M, Nauclér P, Gubbels S, Maldonado N, Palacios-Baena ZR, Johansson AF, Gastmeier P, Behnke M, van Rooden SM, van Mourik MSM. Automated surveillance systems for healthcare-associated infections: results from a European survey and experiences from real-life utilization. J Hosp Infect 2022; 122:35-43. [PMID: 35031393 DOI: 10.1016/j.jhin.2021.12.021] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2021] [Accepted: 12/04/2021] [Indexed: 10/19/2022]
Abstract
BACKGROUND As most automated surveillance (AS) methods to detect healthcare-associated infections (HAIs) have been developed and implemented in research settings, information about the feasibility of large-scale implementation is scarce. AIM We aimed to describe key aspects of the design of AS systems and implementation in European institutions and hospitals. METHODS An online survey was distributed via email in February/March 2019 among 1) PRAISE (Providing a Roadmap for Automated Infection Surveillance in Europe) network members; 2) corresponding authors of peer-reviewed European publications on existing AS systems; and 3) the mailing list of national infection prevention and control focal points of the European Centre for Disease Prevention and Control. Three AS systems from the survey were selected, based on quintessential features, for in-depth review focusing on implementation in practice. FINDINGS Through the survey and the review of three selected AS systems, notable differences regarding the methods, algorithms, data sources and targeted HAIs were identified. The majority of AS systems used a classification algorithm for semi-automated surveillance and targeted HAIs were mostly surgical site infections, urinary tract infections, sepsis or other bloodstream infections. AS systems yielded a reduction of workload for hospital staff. Principal barriers of implementation were strict data security regulations as well as creating and maintaining an information technology infrastructure. CONCLUSION AS in Europe is characterized by heterogeneity in methods and surveillance targets. To allow for comparisons and encourage homogenization, future publications on AS systems should provide detailed information on source data, methods and the state of implementation.
Collapse
Affiliation(s)
- Janneke D M Verberk
- Department of Medical Microbiology and Infection Prevention, University Medical Centre Utrecht, Utrecht, the Netherlands; Julius Centre for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht, the Netherlands; Department of Epidemiology and Surveillance, Centre for Infectious Diseases Control, National Institute for Public Health and the Environment, Bilthoven, the Netherlands.
| | - Seven J S Aghdassi
- Institute of Hygiene and Environmental Medicine, Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany; Berlin Institute of Health at Charité - Universitätsmedizin Berlin, BIH Biomedical Innovation Academy, BIH Charité Digital Clinician Scientist Program, Anna-Louisa-Karsch-Straße 2, 10178 Berlin, Germany
| | - Mohamed Abbas
- Infection Control Programme, Geneva University Hospitals and Faculty of Medicine, Geneva, Switzerland
| | - Pontus Nauclér
- Department of Medicine Solna, Division of Infectious Disease, Karolinska Institutet, Stockholm, Sweden; Department of Infectious Diseases, Karolinska University Hospital, Stockholm, Sweden
| | - Sophie Gubbels
- Department of Infectious Disease Preparedness, Statens Serum Institut, Copenhagen, Denmark
| | - Natalia Maldonado
- Unit of Infectious Diseases, Clinical Microbiology and Preventive Medicine, Hospital Universitario Virgen Macarena, Institute of Biomedicine of Seville (IBIS), Sevilla, Spain
| | - Zaira R Palacios-Baena
- Unit of Infectious Diseases, Clinical Microbiology and Preventive Medicine, Hospital Universitario Virgen Macarena, Institute of Biomedicine of Seville (IBIS), Sevilla, Spain
| | - Anders F Johansson
- Department of Clinical microbiology and the Laboratory for Molecular Infection Medicine (MIMS), Umeå University, Umeå, Sweden
| | - Petra Gastmeier
- Institute of Hygiene and Environmental Medicine, Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany
| | - Michael Behnke
- Institute of Hygiene and Environmental Medicine, Charité-Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany
| | - Stephanie M van Rooden
- Julius Centre for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht, the Netherlands; Department of Epidemiology and Surveillance, Centre for Infectious Diseases Control, National Institute for Public Health and the Environment, Bilthoven, the Netherlands
| | - Maaike S M van Mourik
- Department of Medical Microbiology and Infection Prevention, University Medical Centre Utrecht, Utrecht, the Netherlands
| |
Collapse
|
28
|
Dos Santos RP, Silva D, Menezes A, Lukasewicz S, Dalmora CH, Carvalho O, Giacomazzi J, Golin N, Pozza R, Vaz TA. Automated healthcare-associated infection surveillance using an artificial intelligence algorithm. Infect Prev Pract 2021; 3:100167. [PMID: 34471868 PMCID: PMC8387762 DOI: 10.1016/j.infpip.2021.100167] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2021] [Accepted: 07/26/2021] [Indexed: 11/23/2022] Open
Abstract
Healthcare-associated infections (HAIs) are among the most common adverse events in hospitals. We used artificial intelligence (AI) algorithms for infection surveillance in a cohort study. The model correctly detected 67 out of 73 patients with HAIs. The final model used a multilayer perceptron neural network achieving an area under receiver operating curve (AUROC) of 90.27%; specificity of 78.86%; sensitivity of 88.57%. Respiratory infections had the best results (AUROC ≥93.47%). The AI algorithm could identify most HAIs. AI is a feasible method for HAI surveillance, has the potential to save time, promote accurate hospital-wide surveillance, and improve infection prevention performance.
Collapse
Affiliation(s)
| | - D Silva
- Qualis Soluções em Infectologia, Brazil
| | - A Menezes
- Qualis Soluções em Infectologia, Brazil
| | | | | | | | | | | | | | - T A Vaz
- Qualis Soluções em Infectologia, Brazil
| |
Collapse
|
29
|
Song J, Woo K, Shang J, Ojo M, Topaz M. Predictive Risk Models for Wound Infection-Related Hospitalization or ED Visits in Home Health Care Using Machine-Learning Algorithms. Adv Skin Wound Care 2021; 34:1-12. [PMID: 34260423 DOI: 10.1097/01.asw.0000755928.30524.22] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
OBJECTIVE Wound infection is prevalent in home healthcare (HHC) and often leads to hospitalizations. However, none of the previous studies of wounds in HHC have used data from clinical notes. Therefore, the authors created a more accurate description of a patient's condition by extracting risk factors from clinical notes to build predictive models to identify a patient's risk of wound infection in HHC. METHODS The structured data (eg, standardized assessments) and unstructured information (eg, narrative-free text charting) were retrospectively reviewed for HHC patients with wounds who were served by a large HHC agency in 2014. Wound infection risk factors were identified through bivariate analysis and stepwise variable selection. Risk predictive performance of three machine learning models (logistic regression, random forest, and artificial neural network) was compared. RESULTS A total of 754 of 54,316 patients (1.39%) had a hospitalization or ED visit related to wound infection. In the bivariate logistic regression, language describing wound type in the patient's clinical notes was strongly associated with risk (odds ratio, 9.94; P < .05). The areas under the curve were 0.82 in logistic regression, 0.75 in random forest, and 0.78 in artificial neural network. Risk prediction performance of the models improved (by up to 13.2%) after adding risk factors extracted from clinical notes. CONCLUSIONS Logistic regression showed the best risk prediction performance in prediction of wound infection-related hospitalization or ED visits in HHC. The use of data extracted from clinical notes can improve the performance of risk prediction models.
Collapse
Affiliation(s)
- Jiyoun Song
- Jiyoun Song, PhD, RN, AGACNP-BC, is Postdoctoral Fellow, Columbia University School of Nursing, New York, NY. Kyungmi Woo, PhD, RN, is Assistant Professor, The Research Institute of Nursing Science, Seoul National University College of Nursing, Republic of Korea. Jingjing Shang, PhD, RN, is Associate Professor, Columbia University School of Nursing, New York, NY. Marietta Ojo, MPH, is Research Assistant, Columbia University Mailman School of Public Health, New York, NY. Maxim Topaz, PhD, RN, is Associate Professor, Columbia University School of Nursing, New York, NY. Acknowledgments: This study is funded by the Eugenie and Joseph Doyle Research Partnership Fund from Visiting Nurses Service of New York and the Intramural Pilot Grant from Columbia University School of Nursing. At the time of data analysis and manuscript development, Jiyoun Song was supported in part by the Agency for Healthcare Research and Quality (R01HS024915), Nursing Intensity of Patient Care Needs and Rates of Healthcare-Associated Infections, and The Jonas Center for Nursing and Veterans Healthcare. Kyungmi Woo was supported by the Comparative and Cost-Effectiveness Research (T32 NR014205) grant through the National Institute of Nursing Research. The authors have disclosed no other financial relationships related to this article. Submitted August 28, 2020; accepted in revised form December 8, 2020
| | | | | | | | | |
Collapse
|
30
|
Dhalluin T, Fakhiri S, Bouzillé G, Herbert J, Rosset P, Cuggia M, Grammatico-Guillon L. Role of real-world digital data for orthopedic implant automated surveillance: a systematic review. Expert Rev Med Devices 2021; 18:799-810. [PMID: 34148465 DOI: 10.1080/17434440.2021.1943361] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
INTRODUCTION Data collection automation through the reuse of real-world digital data from clinical data warehouses (CDW) could represent a great opportunity to improve medical device monitoring. For instance, this approach is starting to be used for the design of automated decision support systems for joint replacement monitoring. However, a number of obstacles remains, such as data quality and interoperability through the use of common and regularly updated terminologies, and the use of a Unique Device Identifier (UDI). AREAS COVERED To present the existing models of automated surveillance of orthopedic devices, a systematic review of initiatives using real-world digital health data to monitor joint replacement surgery was performed following the PRISMA 2020 guidelines. The main objective was to identify the data sources, the target populations, the population size, the device location, and the main results of studies on such initiatives. EXPERT OPINION Analysis of the identified studies showed that real-world digital data offer many opportunities for improving the automation of monitoring in orthopedics. The contribution of real-world data, especially through natural language processing, UDI use in CDW and the integration of device databases, is needed for automated and more robust health surveillance.
Collapse
Affiliation(s)
- Thibault Dhalluin
- Department of Medical Information, University Hospital of Tours, Tours, France. Medical School, University of Tours, EA, Tours, France
| | - Sara Fakhiri
- Department of Medical Information, University Hospital of Tours, Tours, France. Medical School, University of Tours, EA, Tours, France
| | | | - Julien Herbert
- Department of Medical Information, University Hospital of Tours, Tours, France. Medical School, University of Tours, EA, Tours, France
| | - Philippe Rosset
- Department of Orthopedic Surgery, University Hospital of Tours, Tours, France. Medical School, University of Tours, EA, Tours, France
| | - Marc Cuggia
- Univ Rennes, CHU Rennes, Inserm, LTSI - UMR 1099, Rennes, France
| | - Leslie Grammatico-Guillon
- Department of Medical Information, University Hospital of Tours, Tours, France. Medical School, University of Tours, EA, Tours, France
| |
Collapse
|
31
|
Predicting healthcare-associated infections, length of stay, and mortality with the nursing intensity of care index. Infect Control Hosp Epidemiol 2021; 43:298-305. [PMID: 33858546 DOI: 10.1017/ice.2021.114] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECTIVES The objectives of this study were (1) to develop and validate a simulation model to estimate daily probabilities of healthcare-associated infections (HAIs), length of stay (LOS), and mortality using time varying patient- and unit-level factors including staffing adequacy and (2) to examine whether HAI incidence varies with staffing adequacy. SETTING The study was conducted at 2 tertiary- and quaternary-care hospitals, a pediatric acute care hospital, and a community hospital within a single New York City healthcare network. PATIENTS All patients discharged from 2012 through 2016 (N = 562,435). METHODS We developed a non-Markovian simulation to estimate daily conditional probabilities of bloodstream, urinary tract, surgical site, and Clostridioides difficile infection, pneumonia, length of stay, and mortality. Staffing adequacy was modeled based on total nurse staffing (care supply) and the Nursing Intensity of Care Index (care demand). We compared model performance with logistic regression, and we generated case studies to illustrate daily changes in infection risk. We also described infection incidence by unit-level staffing and patient care demand on the day of infection. RESULTS Most model estimates fell within 95% confidence intervals of actual outcomes. The predictive power of the simulation model exceeded that of logistic regression (area under the curve [AUC], 0.852 and 0.816, respectively). HAI incidence was greatest when staffing was lowest and nursing care intensity was highest. CONCLUSIONS This model has potential clinical utility for identifying modifiable conditions in real time, such as low staffing coupled with high care demand.
Collapse
|
32
|
Borges do Nascimento IJ, Marcolino MS, Abdulazeem HM, Weerasekara I, Azzopardi-Muscat N, Gonçalves MA, Novillo-Ortiz D. Impact of Big Data Analytics on People's Health: Overview of Systematic Reviews and Recommendations for Future Studies. J Med Internet Res 2021; 23:e27275. [PMID: 33847586 PMCID: PMC8080139 DOI: 10.2196/27275] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2021] [Revised: 02/19/2021] [Accepted: 03/24/2021] [Indexed: 12/17/2022] Open
Abstract
Background Although the potential of big data analytics for health care is well recognized, evidence is lacking on its effects on public health. Objective The aim of this study was to assess the impact of the use of big data analytics on people’s health based on the health indicators and core priorities in the World Health Organization (WHO) General Programme of Work 2019/2023 and the European Programme of Work (EPW), approved and adopted by its Member States, in addition to SARS-CoV-2–related studies. Furthermore, we sought to identify the most relevant challenges and opportunities of these tools with respect to people’s health. Methods Six databases (MEDLINE, Embase, Cochrane Database of Systematic Reviews via Cochrane Library, Web of Science, Scopus, and Epistemonikos) were searched from the inception date to September 21, 2020. Systematic reviews assessing the effects of big data analytics on health indicators were included. Two authors independently performed screening, selection, data extraction, and quality assessment using the AMSTAR-2 (A Measurement Tool to Assess Systematic Reviews 2) checklist. Results The literature search initially yielded 185 records, 35 of which met the inclusion criteria, involving more than 5,000,000 patients. Most of the included studies used patient data collected from electronic health records, hospital information systems, private patient databases, and imaging datasets, and involved the use of big data analytics for noncommunicable diseases. “Probability of dying from any of cardiovascular, cancer, diabetes or chronic renal disease” and “suicide mortality rate” were the most commonly assessed health indicators and core priorities within the WHO General Programme of Work 2019/2023 and the EPW 2020/2025. Big data analytics have shown moderate to high accuracy for the diagnosis and prediction of complications of diabetes mellitus as well as for the diagnosis and classification of mental disorders; prediction of suicide attempts and behaviors; and the diagnosis, treatment, and prediction of important clinical outcomes of several chronic diseases. Confidence in the results was rated as “critically low” for 25 reviews, as “low” for 7 reviews, and as “moderate” for 3 reviews. The most frequently identified challenges were establishment of a well-designed and structured data source, and a secure, transparent, and standardized database for patient data. Conclusions Although the overall quality of included studies was limited, big data analytics has shown moderate to high accuracy for the diagnosis of certain diseases, improvement in managing chronic diseases, and support for prompt and real-time analyses of large sets of varied input data to diagnose and predict disease outcomes. Trial Registration International Prospective Register of Systematic Reviews (PROSPERO) CRD42020214048; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=214048
Collapse
Affiliation(s)
- Israel Júnior Borges do Nascimento
- School of Medicine, Universidade Federal de Minas Gerais, Belo Horizonte, Minas Gerais, Brazil.,Department of Medicine, School of Medicine, Medical College of Wisconsin, Wauwatosa, WI, United States
| | - Milena Soriano Marcolino
- Department of Internal Medicine, University Hospital, Universidade Federal de Minas Gerais, Belo Horizonte, Minas Gerais, Brazil.,School of Medicine and Telehealth Center, Universidade Federal de Minas Gerais, Belo Horizonte, Minas Gerais, Brazil
| | | | - Ishanka Weerasekara
- School of Health Sciences, Faculty of Health and Medicine, The University of Newcastle, Callaghan, Australia.,Department of Physiotherapy, Faculty of Allied Health Sciences, University of Peradeniya, Peradeniya, Sri Lanka
| | - Natasha Azzopardi-Muscat
- Division of Country Health Policies and Systems, World Health Organization, Regional Office for Europe, Copenhagen, Denmark
| | - Marcos André Gonçalves
- Department of Computer Science, Institute of Exact Sciences, Federal University of Minas Gerais, Belo Horizonte, Minas Gerais, Brazil
| | - David Novillo-Ortiz
- Division of Country Health Policies and Systems, World Health Organization, Regional Office for Europe, Copenhagen, Denmark
| |
Collapse
|
33
|
Barchitta M, Maugeri A, Favara G, Riela PM, Gallo G, Mura I, Agodi A. A machine learning approach to predict healthcare-associated infections at intensive care unit admission: findings from the SPIN-UTI project. J Hosp Infect 2021; 112:77-86. [PMID: 33676936 DOI: 10.1016/j.jhin.2021.02.025] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2020] [Revised: 01/27/2021] [Accepted: 02/26/2021] [Indexed: 12/13/2022]
Abstract
BACKGROUND Identifying patients at higher risk of healthcare-associated infections (HAIs) in intensive care units (ICUs) represents a major challenge for public health. Machine learning could improve patient risk stratification and lead to targeted infection prevention and control interventions. AIM To evaluate the performance of the Simplified Acute Physiology Score (SAPS) II for HAI risk prediction in ICUs, using both traditional statistical and machine learning approaches. METHODS Data for 7827 patients from the 'Italian Nosocomial Infections Surveillance in Intensive Care Units' project were used in this study. The Support Vector Machines (SVM) algorithm was applied to classify patients according to sex, patient origin, non-surgical treatment for acute coronary disease, surgical intervention, SAPS II at admission, presence of invasive devices, trauma, impaired immunity, and antibiotic therapy in 48 h preceding ICU admission. FINDINGS The performance of SAPS II for predicting HAI risk provides a receiver operating characteristic curve with an area under the curve of 0.612 (P<0.001) and accuracy of 56%. Considering SAPS II along with other characteristics at ICU admission, the SVM classifier was found to have accuracy of 88% and an AUC of 0.90 (P<0.001) for the test set. The predictive ability was lower when considering the same SVM model but with the SAPS II variable removed (accuracy 78%, AUC 0.66). CONCLUSIONS This study suggested that the SVM model is a useful tool for early prediction of patients at higher risk of HAIs at ICU admission.
Collapse
Affiliation(s)
- M Barchitta
- Department of Medical and Surgical Sciences and Advanced Technologies 'GF Ingrassia', University of Catania, Catania, Italy; GISIO-SItI (Italian Study Group of Hospital Hygiene), Italian Society of Hygiene, Preventive Medicine and Public Health, Italy
| | - A Maugeri
- Department of Medical and Surgical Sciences and Advanced Technologies 'GF Ingrassia', University of Catania, Catania, Italy; GISIO-SItI (Italian Study Group of Hospital Hygiene), Italian Society of Hygiene, Preventive Medicine and Public Health, Italy
| | - G Favara
- Department of Medical and Surgical Sciences and Advanced Technologies 'GF Ingrassia', University of Catania, Catania, Italy
| | - P M Riela
- Department of Mathematics and Informatics, University of Catania, Catania, Italy
| | - G Gallo
- Department of Mathematics and Informatics, University of Catania, Catania, Italy
| | - I Mura
- GISIO-SItI (Italian Study Group of Hospital Hygiene), Italian Society of Hygiene, Preventive Medicine and Public Health, Italy; Department of Biomedical Sciences, University of Sassari, Sassari, Italy
| | - A Agodi
- Department of Medical and Surgical Sciences and Advanced Technologies 'GF Ingrassia', University of Catania, Catania, Italy; GISIO-SItI (Italian Study Group of Hospital Hygiene), Italian Society of Hygiene, Preventive Medicine and Public Health, Italy.
| | | |
Collapse
|
34
|
Barchitta M, Maugeri A, Favara G, Riela PM, Gallo G, Mura I, Agodi A. Early Prediction of Seven-Day Mortality in Intensive Care Unit Using a Machine Learning Model: Results from the SPIN-UTI Project. J Clin Med 2021; 10:992. [PMID: 33801207 PMCID: PMC7957866 DOI: 10.3390/jcm10050992] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2020] [Revised: 02/09/2021] [Accepted: 02/12/2021] [Indexed: 12/18/2022] Open
Abstract
Patients in intensive care units (ICUs) were at higher risk of worsen prognosis and mortality. Here, we aimed to evaluate the ability of the Simplified Acute Physiology Score (SAPS II) to predict the risk of 7-day mortality, and to test a machine learning algorithm which combines the SAPS II with additional patients' characteristics at ICU admission. We used data from the "Italian Nosocomial Infections Surveillance in Intensive Care Units" network. Support Vector Machines (SVM) algorithm was used to classify 3782 patients according to sex, patient's origin, type of ICU admission, non-surgical treatment for acute coronary disease, surgical intervention, SAPS II, presence of invasive devices, trauma, impaired immunity, antibiotic therapy and onset of HAI. The accuracy of SAPS II for predicting patients who died from those who did not was 69.3%, with an Area Under the Curve (AUC) of 0.678. Using the SVM algorithm, instead, we achieved an accuracy of 83.5% and AUC of 0.896. Notably, SAPS II was the variable that weighted more on the model and its removal resulted in an AUC of 0.653 and an accuracy of 68.4%. Overall, these findings suggest the present SVM model as a useful tool to early predict patients at higher risk of death at ICU admission.
Collapse
Affiliation(s)
- Martina Barchitta
- Department of Medical and Surgical Sciences and Advanced Technologies “GF Ingrassia”, University of Catania, 95123 Catania, Italy; (M.B.); (A.M.); (G.F.)
- GISIO-SItI—Italian Study Group of Hospital Hygiene—Italian Society of Hygiene, Preventive Medicine and Public Health, 00144 Roma, Italy;
| | - Andrea Maugeri
- Department of Medical and Surgical Sciences and Advanced Technologies “GF Ingrassia”, University of Catania, 95123 Catania, Italy; (M.B.); (A.M.); (G.F.)
- GISIO-SItI—Italian Study Group of Hospital Hygiene—Italian Society of Hygiene, Preventive Medicine and Public Health, 00144 Roma, Italy;
| | - Giuliana Favara
- Department of Medical and Surgical Sciences and Advanced Technologies “GF Ingrassia”, University of Catania, 95123 Catania, Italy; (M.B.); (A.M.); (G.F.)
| | - Paolo Marco Riela
- Department of Mathematics and Informatics, University of Catania, 95123 Catania, Italy; (P.M.R.); (G.G.)
| | - Giovanni Gallo
- Department of Mathematics and Informatics, University of Catania, 95123 Catania, Italy; (P.M.R.); (G.G.)
| | - Ida Mura
- GISIO-SItI—Italian Study Group of Hospital Hygiene—Italian Society of Hygiene, Preventive Medicine and Public Health, 00144 Roma, Italy;
- Department of Biomedical Sciences, University of Sassari, 07100 Sassari, Italy
| | - Antonella Agodi
- Department of Medical and Surgical Sciences and Advanced Technologies “GF Ingrassia”, University of Catania, 95123 Catania, Italy; (M.B.); (A.M.); (G.F.)
- GISIO-SItI—Italian Study Group of Hospital Hygiene—Italian Society of Hygiene, Preventive Medicine and Public Health, 00144 Roma, Italy;
| | | |
Collapse
|
35
|
Ronzio L, Cabitza F, Barbaro A, Banfi G. Has the Flood Entered the Basement? A Systematic Literature Review about Machine Learning in Laboratory Medicine. Diagnostics (Basel) 2021; 11:372. [PMID: 33671623 PMCID: PMC7926482 DOI: 10.3390/diagnostics11020372] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Revised: 02/08/2021] [Accepted: 02/18/2021] [Indexed: 02/08/2023] Open
Abstract
This article presents a systematic literature review that expands and updates a previous review on the application of machine learning to laboratory medicine. We used Scopus and PubMed to collect, select and analyse the papers published from 2017 to the present in order to highlight the main studies that have applied machine learning techniques to haematochemical parameters and to review their diagnostic and prognostic performance. In doing so, we aim to address the question we asked three years ago about the potential of these techniques in laboratory medicine and the need to leverage a tool that was still under-utilised at that time.
Collapse
Affiliation(s)
- Luca Ronzio
- Department of Informatics, University of Milano-Bicocca, 20126 Milan, Italy;
| | - Federico Cabitza
- Department of Informatics, University of Milano-Bicocca, 20126 Milan, Italy;
| | - Alessandro Barbaro
- IRCCS Istituto Ortopedico Galeazzi, Via Riccardo Galeazzi, 4, 20161 Milan, Italy; (A.B.); (G.B.)
| | - Giuseppe Banfi
- IRCCS Istituto Ortopedico Galeazzi, Via Riccardo Galeazzi, 4, 20161 Milan, Italy; (A.B.); (G.B.)
- School of Medicine, University Vita-Salute San Raffaele, Via Olgettina, 58, 20132 Milan, Italy
| |
Collapse
|
36
|
Abstract
The coronavirus disease 2019 (COVID-19) pandemic has resulted in the acceleration of telehealth and remote environments as stakeholders and healthcare systems respond to the threat of this disease. How can infectious diseases and healthcare epidemiology expertise be adapted to support safe care for all?
Collapse
|
37
|
Yahya BM, Yahya FS, Thannoun RG. COVID-19 prediction analysis using artificial intelligence procedures and GIS spatial analyst: a case study for Iraq. APPLIED GEOMATICS 2021; 13:481-491. [PMCID: PMC7929909 DOI: 10.1007/s12518-021-00365-4] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/18/2020] [Accepted: 02/18/2021] [Indexed: 05/07/2023]
Abstract
The prediction of diseases caused by viral infections is a complex medical task where many real data that consists of different variables must be employed. As known, COVID-19 is the most dangerous disease worldwide; nowhere, an effective drug has been found yet. To limit its spread, it is essential to find a rational method that shows the spread of this virus by relying on many infected people’s data. A model consisting of three artificial neural networks’ (ANN) functions was developed to predict COVID-19 separation in Iraq based on real infection data supplied by the public health department at the Iraqi Ministry of Health. The performance efficiency of this model was evaluated, where its performance efficiency reached 81.6% when employed four statistical error criteria as mean absolute percentage error (MAPE), root mean square error (RMSE), coefficient of determination (R 2), and Nash-Sutcliffe coefficient (NC). The severity of the virus’s spread across Iraq was assessed in a short term (in the next 6 months), where the results show that the spread severity will intensify in this short term by 17.1%, and the average death cases will increase by 8.3%. These results clarified by creating spatial distribution maps for virus spread are simulated by employing a Geographic Information System (GIS) environment to be used as a useful database for developing plans for combating viruses in Iraq.
Collapse
|